Information Processing Apparatus, Information Processing Method, and Program

Abstract

SOLUTION: A control device for controlling a display device which is provided with a display apparatus to display images comprises: a secret image generation unit that generates a secret image for displaying secret information which is the object to be processed for concealment; an obstacle image generation unit that generates an obstacle image for obstructing at least a portion of the secret image from being visually recognized; and a display control unit that controls the display apparatus so that the display apparatus displays the secret image and the obstacle image separately in time for each frame. The control device may be provided with a secret region determination unit for determining a secret region of the secret image that should be obstructed from being visually recognized by a third person, on the basis of a change of a color tone of the secret image. The obstacle image generation unit may generate an obstacle image for obstructing the secret region from being visually recognized.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Patent Documents 1 to 7 disclose, for example, generating an anti-color image for canceling a display image of one frame for each frame, time-dividing the display image of one frame into display images of a plurality of sub-fields, and time-dividing the anti-color image of one frame into anti-color images of a plurality of sub-fields, and disposing the anti-color images of one sub-field before and after the display time of the display image of one sub-field, respectively, to generate a time-divided image. [Prior Art Documents] [Patent Documents] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-204948 [Patent Document 2] Japanese Patent Application Laid-Open No. 06-118927 [Patent Document 3] Japanese Patent No. 5207175 [Patent Document 4] Japanese Patent No. 5447391 [Patent Document 5] Japanese Patent No. 5867117 [Patent Document 6] International Publication No. 2012 / 120853 [Patent Document 7] Japanese Patent No. 6145622

Summary of the Invention

Means for Solving the Problems

[0003] In a first aspect of the present invention, a control device is provided. The control device controls, for example, a display device including a display device that displays an image. The control device includes, for example, a secret image generation unit that generates a secret image for displaying secret information that is information to be subjected to a concealment process. The control device includes, for example, an interference image generation unit that generates an interference image for disturbing the visual recognition of at least a part of the secret image. The control device includes, for example, a display control unit that controls the display device so that the display device displays the secret image and the interference image in a time-division manner for each frame.

[0004] The above control device may include a concealment area determination unit that determines a concealment area, which is an area in the concealed image where visual recognition by a third party should be obstructed, based on a change in the color tone of the concealed image. In the above control device, the interference image generation unit may generate an interference image for obstructing the visual recognition of the concealment area. In the above control device, the concealment area determination unit may have a position identification unit that identifies the position of the concealed information in the concealed image based on the degree of change in the color tone of a plurality of pixels constituting the concealed image. In the above control device, the concealment area determination unit may have a range determination unit that determines the range of each of one or more concealment areas so that at least a part of the concealed information is covered by the one or more concealment areas. In the above control device, the interference image generation unit may generate an interference image corresponding to the concealed image by (i) converting the color tone of at least a part of one or more pixels arranged inside the concealment area and (ii) adjusting the brightness or luminance of at least a part of one or more pixels arranged outside the concealment area.

[0005] In the above control device, the image displayed on the display device may include one or more display windows for displaying information presented to the user. In the above control device, the concealed image may include at least an image of the image display area of the display window for displaying the concealed information. The above control device may include a target identification unit that identifies a target window, which is a window to be subjected to the concealment process, among the one or more display windows. The above control device may include a window information acquisition unit that acquires window information indicating the position, shape, and size of the target window identified by the target identification unit. In the above control device, the interference image generation unit may determine the position, shape, and size at which the interference image is to be displayed on the display device based on the position, shape, and size of the target window indicated by the window information acquired by the window information acquisition unit. The above control device may include a concealment area determination unit that determines a concealment area, which is an area in the image of the image display area of the display window where visual recognition by a third party should be obstructed, based on a change in the color tone of the image. In the above control device, the interference image generation unit may generate an interference image for obstructing the visual recognition of the concealment area.

[0006] In the above control device, the display control unit may control the display device such that a full-screen window covering substantially the entire screen display area of the display device is arranged in front of one or more display windows, and the concealed image and the interference image for each frame are displayed on the full-screen window in a time-division manner. In the above control device, the display control unit may: (a) generate a full-screen window; and (b) (i) when a concealed image is to be displayed on the display device, arrange a full-screen window having a transparent area or a transmissive area at least in the area where the concealed image is to be displayed in front of one or more display windows; and (ii) when an interference image is to be displayed on the display device, arrange a full-screen window on which the interference image is drawn in front of one or more display windows, so as to control the display device.

[0007] The above control device may include a pointer detection unit that detects the position of a pointer in the screen display area of the display device. The above control device may include a color information acquisition unit that acquires information regarding a color to be treated as a transparent color or a transmissive color. In the above control device, the interference image generation unit may generate an interference image whose color in a pointer area, which is an area including the instruction position of the pointer, is a color to be treated as a transparent color or a transmissive color.

[0008] In a second aspect of the present invention, a display device is provided. The above display device includes, for example, a display device that displays an image. The above display device includes, for example, a control device that controls the display device. The above control device includes, for example, the control device according to the first aspect above.

[0009] In a third aspect of the present invention, a control method is provided. The above control method is, for example, a control method for controlling a display device including a display device that displays an image. The above control method has, for example, a secret image generation step of generating a secret image for displaying secret information which is information to be subjected to a concealment process. The above control method has, for example, an interference image generation step of generating an interference image for disturbing the visual recognition of the secret image. The above control method has, for example, a display control step of controlling the display device so that the display device displays the secret image and the interference image in a time-division manner for each frame.

[0010] In a fourth aspect of the present invention, a program is provided. The above program may be a program for causing a computer to function as the control device according to the first aspect above. The above program may also be a program for causing a computer to execute the control method according to the third aspect above. A computer-readable medium storing the above program may also be provided. The computer-readable medium may be a non-transitory computer-readable medium. The computer-readable medium may be a computer-readable recording medium.

[0011] Note that the above summary of the invention does not list all of the necessary features of the present invention. Also, sub-combinations of these feature groups can also be inventions.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Embodiments for Carrying Out the Invention

[0013] Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention claimed in the claims. Also, not all combinations of features described in the embodiments are essential for the solution of the invention. In the drawings, the same or similar parts may be denoted by the same reference numerals, and redundant descriptions may be omitted.

[0014] [Overview of Information Concealment System 100] FIG. 1 schematically shows an example of the system configuration of the information concealment system 100. In the present embodiment, the information concealment system 100 is composed of a display terminal 120 and an eyewear-type device 140. In the present embodiment, the display terminal 120 includes a display 122. In the present embodiment, the eyewear-type device 140 includes an optical shutter 142.

[0015] In the present embodiment, one or more third parties 32 and one or more third parties 34 exist around the display terminal 120 used by the user 20, and information that the user 20 does not wish to be viewed by the third parties 32 and 34 is displayed on the display 122 of the display terminal 120. As an example, the details of the information concealment system 100 will be described. Also, in the present embodiment, the user 20 views the display 122 while wearing the eyewear-type device 140. Thereby, the optical shutter 142 is disposed between the display 122 and the user 20. On the other hand, the third party 32 peeks at the display 122 without using the eyewear-type device 140 or the eyewear-type device 150. Also, the third party 34 peeks at the display 122 while wearing the eyewear-type device 150.

[0016] In this embodiment, when, for example, the user 20 of the display terminal 120 operates the display terminal 120 to display information on the display 122 of the display terminal 120, the information concealment system 100 executes a process (which may be referred to as a concealment process) for concealing at least a part of the information. The information concealment system 100 may execute the concealment process according to an instruction from the user 20, or may execute the concealment process according to the situation of the display terminal 120. For example, the information concealment system 100 executes the concealment process in response to the detection of a third party 32 or a third party 34 around the display terminal 120. Thereby, even when there is a third party 32 or a third party 34 around the display terminal 120, information leakage to the third party 32 or the third party 34 is prevented.

[0017] In one embodiment, the information concealment system 100 executes a first concealment process for suppressing information leakage to a third party 32 who is not wearing the eyewear-type device 140 or the eyewear-type device 150 as the concealment process. In another embodiment, the information concealment system 100 executes a second concealment process for suppressing not only information leakage to the third party 32 but also information leakage to a third party 34 who is wearing the eyewear-type device 150. The second concealment process may be a process of concealing at least a part of the concealed information in a manner different from the first concealment process.

[0018] As a method for preventing information leakage to a third party 32 and / or a third party 34 existing around the display terminal 120, it is conceivable that the user 20 wears a wearable terminal equipped with a display device for displaying information. Examples of the display device include a display, a projector, and the like. Then, it is conceivable that the information concealment system 100 causes the display device of the wearable terminal to display information and stops the display of information on the display 122 of the display terminal 120. However, a wearable terminal equipped with a display device is relatively heavy, and the physical burden on the user 20 is large.

[0019] [First Concealment Process] Therefore, according to the present embodiment, the display terminal 120 executes the anonymization process according to the following procedure. For example, the display terminal 120 first generates, for each frame, an image (which may be referred to as the original image) for displaying information to be anonymized (which may be referred to as anonymization information) and an image (which may be referred to as the masking image) for obstructing the visual recognition of at least a part of the original image.

[0020] The above anonymization process may be executed in dot units, line units, BOX units, window units, or screen units. The above anonymization process may also be executed in color units.

[0021] Next, during the period when each frame is processed (which may be referred to as the frame period), the display terminal 120 causes the display 122 to display the original image and the masking image corresponding to each frame in a time-division manner. During the frame period of a single frame, the number of times the original image corresponding to the frame is displayed on the display 122 may be once or multiple times. Similarly, during the frame period of a single frame, the number of times the masking image corresponding to the frame is displayed on the display 122 may be once or multiple times. During the frame period of a single frame, the number of times the original image corresponding to the frame is displayed on the display 122 and the number of times the masking image corresponding to the frame is displayed on the display 122 may be the same or different.

[0022] When the number of frames processed per unit time (which may be referred to as the frame rate), or the number of original images and masking images displayed per unit time exceeds a threshold value, the switching interval between the original image and the masking image becomes shorter, and a third party 32 not wearing the eyewear type device 140 or the eyewear type device 150 cannot recognize the switching between the original image and the masking image. That is, as a stimulus felt by the nerves of the third party 32, the difference in the brightness and / or color tone of light due to the switching of the images can be distinguished, but as the consciousness of the third party 32, the difference cannot be distinguished. In this state, the third party 32 will recognize an image different from the original image (which may be referred to as a fused image) in which the original image and the masking image are fused by afterimages.

[0023] For example, when the switching interval between the original image and the masking image becomes shorter than 1 / 10 second to 1 / 15 second, it will seem to the third party 32 that the display 122 is displaying a fused image. As a result, it becomes difficult for the third party 32 to recognize the content of the confidential information. Also, the shorter the switching interval between the original image and the masking image becomes, the more difficult it becomes for the third party 32 to recognize the content of the confidential information from the fused image. For example, when the switching interval between the original image and the masking image becomes shorter than about 1 / 50 second, in many cases, the third party 32 cannot recognize the content of the confidential information.

[0024] [Masking Image] The masking image is an image for obstructing the visual recognition of at least a part of the original image, and is generated, for example, by converting the color of each of one or more pixels included in at least a part of the original image based on a predetermined rule. The masking image is generated, for example, by converting the color of each pixel of the original image based on the correspondence relationship between the color of the original image and the color of the masking image. The above correspondence relationship may be represented by a function or may be represented by a table. When a color treated as a transparent color or a transmissive color (which may be referred to as a key color) is set, the correspondence relationship between the color of the original image and the color of the masking image may be determined so that the color treated as the key color is not included in the color used for generating the masking image.

[0025] The masking image only needs to be an image that can prevent the visual recognition of the confidential information contained in the original image when the original image and the masking image are fused due to afterimages, and its details are not particularly limited. The masking image is, for example, (i) an image for preventing the visual recognition of an image displayed substantially over the entire image display area of the display 122 in the original image, (ii) an image for preventing the visual recognition of an image displayed substantially at the center of the image display area of the display 122 in the original image, (iii) an image for preventing the visual recognition of an image displayed on a specific scanning line of the display device in the original image, and / or (iv) an image including at least one of images for preventing the visual recognition of an image having a specific color tone or luminance in the original image. The masking image may be (i) an image for preventing the visual recognition of an image displayed substantially over the entire image display area of the display 122 in the original image, (ii) an image for preventing the visual recognition of an image displayed substantially at the center of the image display area of the display 122 in the original image, (iii) an image for preventing the visual recognition of an image displayed on a specific scanning line of the display device in the original image, or (iv) an image for preventing the visual recognition of an image having a specific color tone or luminance in the original image.

[0026] The masking image may be a complementary color image (sometimes referred to as an inverted image) that is in a complementary color relationship with the original image. The above complementary color relationship may be an example of the correspondence relationship between the color of the original image and the color of the masking image. The above complementary color relationship may be (i) a complementary color relationship on the color wheel (sometimes referred to as the first complementary color relationship), or (ii) a complementary color relationship (sometimes referred to as the second complementary color relationship) considering allowing the viewer of the display 122 to recognize the fused image of the original image and the masking image.

[0027] As a complementary color relationship considering allowing the viewer of the display 122 to recognize the composite image of the original image and the masking image, a complementary color relationship considering the visual characteristics of the viewer of the display 122 and the display characteristics of the display 122 is exemplified. As the display characteristics of the display 122, characteristics of the adjustment process of the light intensity of each pixel are exemplified. As the adjustment process of the light intensity of each pixel, (i) gamma correction processing or contrast suppression processing in a cathode ray tube display, (ii) adjustment processing of input / output in accordance with a color space standard such as sRGB in a liquid crystal display, an organic EL display, etc. are exemplified.

[0028] [First complementary color relationship] For example, when the color of each pixel is represented by RGB color and 1 byte is assigned to each of RGB, according to the complementary color relationship on the color wheel, the complementary color of red represented by RGB=(255, 0, 0) is RGB=(0, 255, 255), which is cyan. Similarly, according to the complementary color relationship on the color wheel, the complementary color of white represented by RGB=(255, 255, 255) is black represented by RGB=(0, 0, 0). When the color of the masking image corresponding to the color of the original image is determined based on the complementary color relationship on the color wheel, the generation procedure of the masking image becomes relatively simple, so the generation time of the masking image can be shortened.

[0029] [Second complementary color relationship] On the other hand, according to the present embodiment, the anonymization process is performed by allowing the viewer of the display 122 to recognize the composite image of the original image and the masking image. Therefore, in the process of determining the color of the masking image corresponding to the color of the original image, by considering the characteristics of the display 122 and the characteristics of human vision, the accuracy of the anonymization process can be improved. For example, (i) the difference between the color indicated by the image data of the original image (for example, data in sRGB format) and the color displayed on the display 122, and / or (ii) the difference between the color displayed on the display 122 and the color recognized by the viewer are considered, and by using the defined complementary color relationship to determine the correspondence between the color of the original image and the color of the masking image, the accuracy of the anonymization process can be improved.

[0030] For example, in the display 122, a process for adjusting the correspondence relationship between the input magnitude and the emission intensity of each of the RGB colors is executed. Also, the human vision has a property (sometimes referred to as visual characteristics) that it is sensitive to changes in low luminance and insensitive to changes in high luminance.

[0031] Generally, in the display 122, when the value of the parameter of the image data represented in the RGB format (sometimes referred to as the RGB value) is 0 or 255, the input and output are adjusted to correspond one-to-one. Therefore, when the value of the parameter of the image data is 0 or 255, the emission intensity of the pixel of the display 122 corresponding to the parameter (sometimes referred to as the corresponding pixel) is not affected by the color adjustment function in the display 122.

[0032] As described above, the human vision has a property that it is sensitive to changes in low luminance and insensitive to changes in high luminance. Therefore, in this case, the color obtained by averaging the RGB values of the colors of the original image and the masking image displayed on the display 122 does not match the color of the fused image (sometimes referred to as the fused color) recognized by the viewer of the display 122.

[0033] For example, when the color of the original image is white represented by RGB = (255, 255, 255) and the color of the masking image is black represented by RGB = (0, 0, 0), the color obtained by averaging the RGB values of the colors of the original image and the masking image displayed on the display 122 becomes gray represented by RGB = (128, 128, 128). On the other hand, for example, when the gamma value of gamma correction by human vision is 0.45 and the gamma value in the gamma correction in the display 122 is 2.2 (that is, 1 / 0.45), the color of the fused image recognized by the viewer of the display 122 becomes gray represented by RGB = (186, 186, 186).

[0034] On the one hand, when one of the RGB values of a specific color is in the vicinity of 128, it is difficult for a viewer of the display 122 to visually distinguish the specific color from its complementary color due to the influence of adjustment processing in the display 122. For example, when the specific color is gray represented by RGB = (128, 128, 128), in the display 122, for example, considering human visual characteristics, the emission intensity of pixels is adjusted. As a result, although the color displayed on the display 122 is different from the gray represented by RGB = (128, 128, 128), the color recognized by the viewer of the display 122 is the gray represented by RGB = (128, 128, 128).

[0035] Also, in this case, the color that has a complementary color relationship with the specific color on the color wheel becomes gray represented by RGB = (127, 127, 127). Even in the case of gray represented by RGB = (127, 127, 127), the color recognized by the viewer of the display 122 is the gray represented by RGB = (127, 127, 127). However, usually, the viewer of the display 122 cannot distinguish between the gray represented by RGB = (128, 128, 128) and the gray represented by RGB = (127, 127, 127).

[0036] Considering the above, as a method for determining the second complementary color relationship, (i) a method of determining the complementary color of each of one or more colors used for image drawing so that at least one of the RGB values of the blended color becomes the median value of the gradation number of the parameter or a value in the vicinity of the median value, and (ii) a method of determining the complementary color of each of one or more colors used for image drawing so that at least one parameter of the RGB values of the blended color becomes A times (A is a positive number of 1.4 or more) the median value of the gradation number of the parameter can be considered.

[0037] Values in the vicinity of the median value may be values that are 98% or more and 102% or less of the median value. When the number of gradations is 256, the value of the above parameter may be 126 to 129, or may be 127 or 128. The above coefficient A may be 1.45 or more, or may be 1.5 or more. The coefficient A may be 1.4 or more and 1.6 or less, or may be 1.45 or more and 1.55 or less. When the number of gradations is 256, the value of the above parameter may be 183 to 189, may be 185 to 187, or may be 186.

[0038] When determining the complementary color of each color so that at least one parameter among the RGB values of the fused color becomes the median value of the number of gradations of the parameter, in the concealment process, in addition to the procedure for generating the masking image based on the second complementary color relationship, a procedure for adjusting the color of the original image is executed. In this case, the number of gradations available for generating the masking image may be the same as the number of gradations available for generating the original image. Thereby, the concealed information can be more reliably concealed.

[0039] On the other hand, when determining the complementary color of each color so that at least one parameter among the RGB values of the fused color is 1.4 times or more the median value of the number of gradations of the parameter, the number of gradations available for generating the masking image is less than the number of gradations available for generating the original image. However, in this case, the procedure for adjusting the color of the original image in the concealment process can be omitted. Thereby, the load on the computer for executing the concealment process is reduced.

[0040] Other examples of the masking image include a monochromatic image, a sandstorm image, a color bar image, a display mode change image for changing the display mode of an image element included in the original image, and the like. Examples of the monochromatic image include a white image, a black image, a gray image, and the like. Examples of the display mode change image include a position change image for changing the position (referred to as the display position) of an image element included in the original image on the display 122, a size change image for changing the size of an image element included in the original image, a shape change image for changing the shape of an image element included in the original image, a color change image for changing the color tone and / or luminance of an image element included in the original image, and the like. Examples of the image element include a symbol, a figure, a table, a picture, a photograph, and the like. Examples of the symbol include a character, a sign, a number, a logo, and the like.

[0041] Animation may be generated using image elements included in the original image with a plurality of original images and masking images. Examples of the above animation include an animation in which at least one of one or more image elements included in the original image rotates, an animation in which at least one of one or more image elements included in the original image repeatedly enlarges and shrinks, an animation in which at least one of one or more image elements included in the original image blinks, and the like. In the animation in which the image element included in the original image rotates, the rotation center of the image element may be a point inside the image element or a point outside the image element.

[0042] The masking image may be an image for generating a second image element different from the first image element included in the original image when the original image and the masking image are fused by an afterimage. The first image element included in the original image and the second image element included in the fused image are different in at least one of, for example, color, pattern, and shape. The first image element included in the original image and the second image element included in the fused image are different in at least one of, for example, position and size in each image.

[0043] For example, when the original image and the complementary color image are displayed on the display 122 in time division for a short period, to a third party 32, due to afterimages, it may seem that a gray image in which both images are fused is being displayed on the display 122. Thereby, the visual recognition of the original image is obstructed. Note that the relationship between the color tone of each image of the complementary color image and the color tone of each image of the original image may be a complete complementary color relationship or may not be a complete complementary color relationship. For example, by adjusting the color tone of the complementary color image, the color tone of the gray image can be adjusted.

[0044] For example, when the original image and the position-changed image are displayed on the display 122 in time division for a short period, to a third party 32, due to afterimages, the original image may seem blurred. Thereby, the visual recognition of the original image is obstructed.

[0045] On the other hand, according to the present embodiment, the user 20 wears the eyewear-type device 140 including the light shutter 142. The light shutter 142 can transmit light or block light by varying the light transmittance. Examples of the light shutter 142 include a liquid crystal shutter, a rotating disk type slit, and a reflection mirror using MEMS.

[0046] The eyewear-type device 140 executes a process (which may be referred to as a recognizable processing) for making the encrypted confidential information recognizable by controlling the operation of the light shutter 142. Specifically, the eyewear-type device 140 synchronizes the timing at which the original image and the masking image are displayed on the display 122 (which may be referred to as the display timing) with the timing at which the light shutter 142 is opened and closed (which may be referred to as the opening / closing timing).

[0047] As a result, the optical shutter 142 opens at the timing when the original image is displayed on the display 122. Also, the optical shutter 142 closes at the timing when the masking image is displayed on the display 122. In one embodiment, the opening and closing timing of the optical shutter 142 is adjusted so that the length of the period during which the original image is displayed on the display 122 is the same as the length of the period during which the optical shutter 142 is open. In other embodiments, the opening and closing timing of the optical shutter 142 is adjusted so that the optical shutter 142 is open during a part of the period during which the original image is displayed on the display 122.

[0048] According to the present embodiment, the masking image is blocked by the optical shutter 142, and the light constituting the masking image does not enter the eyes of the user 20. As a result, the user 20 can selectively view the original image. As a result, the user 20 can recognize the content of the confidential information. Also, the optical shutter 142 has a simple structure and low power consumption compared to a display device that displays an image. Therefore, the wearable device 140 equipped with the optical shutter 142 is very light compared to a wearable terminal equipped with a display device. Thus, according to the present embodiment, information leakage to a third party can be suppressed while reducing the burden on the user 20.

[0049] [Second Confidentialization Process] Also, according to the present embodiment, the display terminal 120 executes the confidentialization process according to the second embodiment by the following procedure. For example, the display terminal 120 first determines the presence or absence of the wearable device 150 existing around the display terminal 120. Details of the method for determining the presence or absence of the wearable device 150 will be described later.

[0050] (a) When it is determined that there is no eyewear-type device 150 around the display terminal 120, the display terminal 120 decides to execute the first anonymization process described above. The display terminal 120 is configured to be able to execute the first anonymization process described above. When the display terminal 120 executes the first anonymization process, information leakage to a third party 32 who is not wearing the eyewear-type device 140 or the eyewear-type device 150 is prevented.

[0051] Note that when it is determined that there is no eyewear-type device 150 around the display terminal 120 and it is also determined that there is a third party 32 around the display terminal 120, the display terminal 120 may execute the first anonymization process described above. When it is determined that neither the eyewear-type device 150 nor the third party 32 exists around the display terminal 120, the display terminal 120 does not necessarily have to execute the first anonymization process described above.

[0052] On the other hand, (b) when it is determined that there is an eyewear-type device 150 around the display terminal 120, the display terminal 120 decides to execute the second anonymization process described above. The display terminal 120 is configured to be able to execute the second anonymization process described above. When the display terminal 120 executes the second anonymization process, not only is information leakage to the third party 32 prevented, but information leakage to the third party 34 can also be suppressed.

[0053] As the second anonymization process, at least one of the following processes is exemplified: (i) a process for stopping the display of the original image on the display 122, (ii) a process for changing the timing at which the original image is displayed on the display 122, (iii) a process for reducing the window in which the anonymized information is displayed, (iv) a process for moving the window in which the anonymized information is displayed to the back of another window, (v) a process for changing the display position of the window in which the anonymized information is displayed, and (vi) a process for changing the color tone, contrast, or brightness of the original image. As the process for changing the timing at which the original image is displayed on the display 122, at least one of the following processes is exemplified: (i) a process for changing a pattern (which may be referred to as a display pattern) for defining the display and non-display of the original image, (ii) a process for changing the start period of the above pattern, and (iii) a process for changing the cycle of the above pattern.

[0054] For example, when it is determined that the eyewear-type device 150 exists around the display terminal 120 in the case where it is established by the display pattern that one original image is displayed for 3 ms and one masking image is displayed for 3 ms for each frame, the display terminal 120 changes the display pattern and determines to display one original image for 3 ms and one masking image for 1 ms for each frame. Next, the display terminal 120 transmits information indicating the changed display pattern to the eyewear-type device 140 in a manner that the eyewear-type device 150 cannot receive it.

[0055] The display terminal 120 may encrypt the information indicating the changed display pattern and transmit it to the eyewear-type device 140. For example, the display terminal 120 encrypts the information indicating the changed display pattern with a common key and transmits it to the eyewear-type device 140.

[0056] As a result, the eyewear-type device 140 can block the transmission of the masked image by the light shutter 142. Therefore, the user 20 wearing the eyewear-type device 140 can view the confidential information displayed in the original image. On the other hand, the light shutter 152 of the eyewear-type device 150 cannot block the transmission of all masked images. As a result, a third party 34 wearing the eyewear-type device 150 will have difficulty viewing the confidential information compared to the user 20 wearing the eyewear-type device 140. The same applies when the start period of the display pattern is changed and when the cycle of the display pattern is changed.

[0057] [Determination process for the range to be encrypted] As described above, the masked image is used to prevent at least a part of the original image from being viewed. The area in the original image that should be prevented from being viewed by a third party (that is, the area to be encrypted, which may be referred to as the encrypted area) may be the whole or substantially the whole of the original image, may be an area that meets a predetermined condition for a change in color tone, or may be at least one of one or more windows displayed in the original image. The encrypted area may be a specific area inside the window.

[0058] In the present embodiment, the display terminal 120 first determines conditions for determining a confidential area based on settings or instructions from the user. As described above, examples of the conditions for determining the confidential area include: (i) the condition that the confidential area is the whole or substantially the whole of the original image; (ii) the condition that the confidential area is an area that matches a predetermined condition regarding the change in color tone; (iii) the condition that the confidential area is a display object (for example, an object drawn on the screen such as a text box), and the display object is such that at least a part of the type and / or name of the display object matches a predetermined condition; (iv) the condition that the confidential area is a window that matches a predetermined condition, and so on. An area that matches a predetermined condition regarding the change in color tone may be an area surrounded by the detected edges. Next, the display terminal 120 determines the confidential area of the original image based on the conditions for determining the confidential area.

[0059] [Confidentialization Processing of Confidential Area] In one embodiment of the present technology, the display terminal 120 determines the range in which the above-described confidentialization processing is to be performed (for example, the range of the confidential area) based on the change in color tone of the original image. For example, the display terminal 120 first identifies the position of the confidential information in the original image based on the degree of change in color tone of a plurality of pixels constituting the original image. The display terminal 120 may identify the position of the confidential information in the original image by combining and evaluating known filter processes (for example, convolution, feature extraction techniques, etc.) for detecting symbols, figures, tables, pictures, photographs, and the like. The display terminal 120 may also identify an area in the original image where no confidential information is arranged by executing a known filter process for detecting symbols, figures, tables, pictures, photographs, and the like.

[0060] For example, the display terminal 120 traces the entire area of the original image using a first-order differential filter and determines a filter block with a high degree of edge as the confidential area. As the first-order differential filter, a known filter such as a prwitt filter may be employed. By using the first-order differential filter, the entire area of the original image can be traced at high speed.

[0061] For example, the display terminal 120 uses, as teacher data, images such as characters, WORDs, short texts, symbols, graphics, tables, pictures, photos, or a part thereof, and further small image parts cut out from parts within the images, to generate, by machine learning, an estimation model for estimating a confidential area from feature amounts of information that can be confidential information such as texts, charts, and photos. The display terminal 120 inputs the data of the original image into the estimation model, and even if the image match is not probabilistically large, estimates it as an interesting area, and based on the density thereof, identifies a part of the original image as the position of the confidential information and determines the confidential area. The display terminal 120 utilizes a learned convolutional neural network (CNN), creates a feature map using the CNN in the world where the original image is convolved, and may use the candidate of the area of interest that is interesting as confidential information as the confidential area.

[0062] The display terminal 120 may determine, as the confidential area, an input item field arranged on the WEB page or an area including the input item field. Examples of the input item field include a field for inputting personal information such as name and date of birth, and a field for inputting login information such as login ID and password.

[0063] In this case, the display terminal 120 may identify the position or area where the above input item field is displayed by analyzing the source of the WEB page. For example, the display terminal 120 analyzes the source of the WEB page and searches for an object whose name setting matches a predetermined condition. Examples of the condition regarding the name setting include the condition that the object has a name setting in which confidential information can be input, such as "pass" and "DOB". When an object whose name setting matches a predetermined condition is extracted, the display terminal 120 determines, for example, the display position of the object as the confidential area.

[0064] The display terminal 120 may identify the display position of the name of the object in the original image by analyzing the original image and identifying the positions of one or more strings displayed in the original image. The display terminal 120 may determine the hidden area by identifying the position or area where the input item field is to be displayed based on the display position of the name of the object in the original image. For example, the display terminal 120 may determine, as the hidden area, an area having a predetermined shape and size that includes the display position of the name of the object in the original image. The display terminal 120 may determine the position, size, and range of the hidden area so that the hidden area covers the input item field.

[0065] The display terminal 120 may also determine the hidden area based on the temporal variation of a plurality of original images. For example, the display terminal 120 analyzes a plurality of original images with different display timings. When a transition is detected in at least a part of the plurality of original images, the display terminal 120 may determine, as the hidden area, an area where the degree of temporal variation is greater than a predetermined reference.

[0066] The display terminal 120 determines a plurality of candidate areas that are candidates for the hidden area by executing the above-described determination process for a plurality of hidden areas. In one embodiment, the display terminal 120 may determine the hidden area based on the overlapping degree of the plurality of candidate areas. For example, the display terminal 120 determines, as the hidden area, an area where n or more (n is a positive integer of 2 or more) candidate areas overlap. In another embodiment, the display terminal 120 may determine, as the hidden area, an area formed by the logical sum of the plurality of candidate areas.

[0067] Next, the display terminal 120 determines the range of each of the one or more hidden areas so that at least a part of the hidden information is covered by the one or more hidden areas. Examples of the range of the hidden area include the position of the hidden area and the shape and size of the hidden area. For example, when the hidden information is a string of multiple lines, the display terminal 120 determines a plurality of rectangular areas corresponding to each line of the plurality of strings as the hidden areas. When the hidden information is a string of multiple lines, a single rectangular area corresponding to the plurality of strings may be determined as the hidden area.

[0068] Also, when the range of the hidden area in the original image is determined, the display terminal 120 generates a masking image for obstructing the visibility of the hidden area. As described above, the display terminal 120 generates a masking image by converting the color tone of at least a part of one or more pixels arranged inside the hidden area of the original image.

[0069] In one embodiment, the display terminal 120 may generate a masking image without converting the color tone of one or more pixels arranged outside the hidden area of the original image. Thereby, the speed of the generation process of the masking image is improved.

[0070] In another embodiment, the display terminal 120 may generate a masking image by adjusting the lightness or luminance of at least a part of one or more pixels arranged outside the hidden area of the original image. For example, when the original image and the masking image are displayed in a time-division manner, depending on the visual characteristics of humans, the display characteristics of the display 122, etc., some users 20 may feel that the inside of the hidden area is darker than the outside of the hidden area. Therefore, the display terminal 120 may generate a masking image by making the lightness or luminance of at least a part of one or more pixels arranged outside the hidden area of the original image smaller than that of the original image. Note that the display terminal 120 may also generate a masking image by making the lightness or luminance of at least a part of one or more pixels arranged inside the hidden area of the original image larger than that of the original image. Thereby, the sense of discomfort felt by the user 20 is reduced.

[0071] Thereafter, the display terminal 120 controls the display 122 so that the original image and the masking image are displayed on the display 122 in a time-division manner. According to the present embodiment, a part of the original screen is subject to the concealment process. As a result, the area of the region subject to the concealment process is smaller than the case where the entire original screen is subject to the concealment process. As a result, the flicker perceived by the user 20 when the original image and the masking image are displayed on the display 122 in a time-division manner is reduced.

[0072] [Concealment process in window units] In another embodiment of the present technology, the display terminal 120 determines the necessity of the above-described concealment process in window units. For example, the display terminal 120 determines, as a target for the concealment process, a window (which may be referred to as a target window) that displays confidential information among one or more windows arranged on the desktop screen. The display terminal 120 determines, for example, the target window or the image display area of the target window as the concealed area. The display terminal 120 may determine, as the concealed area, an area that covers the target window or the image display area of the target window.

[0073] As described above, the display terminal 120 may determine a specific area inside the target window as the object of the anonymization process. For example, the display terminal 120 determines a confidential area inside the target window based on the change in the color tone of the image in the image display area of the target window. For example, the display terminal 120 first identifies the position of the confidential information inside the target window based on the degree of change in the color tone of a plurality of pixels constituting the original image. The display terminal 120 may identify the position of the confidential information inside the target window by performing known filter processing for detecting symbols, figures, tables, pictures, photographs, and the like. The display terminal 120 may also identify an area inside the target window where no confidential information is arranged by performing known filter processing for detecting symbols, figures, tables, pictures, photographs, and the like. Next, the display terminal 120 determines the range of each of the one or more confidential areas so that at least a part of the confidential information is covered by the one or more confidential areas. Examples of the range of the confidential area include the position of the confidential area, as well as the shape and size of the confidential area.

[0074] Also, when the range of the confidential area in the original image is determined, the display terminal 120 generates a masking image for obstructing the visual recognition of the confidential area. As described above, the display terminal 120 generates a masking image by converting the color tone of at least a part of one or more pixels arranged inside the confidential area of the original image. In one embodiment, the display terminal 120 may generate a masking image without converting the color tone of one or more pixels arranged outside the confidential area of the original image. In other embodiments, the display terminal 120 may generate a masking image by adjusting the brightness or luminance of at least a part of one or more pixels arranged outside the confidential area of the original image.

[0075] The display terminal 120 may control the display 122 such that the original image and the masking image are displayed in a time-division manner in an area corresponding to the target window on the display 122. Thereby, the anonymization process can be executed on a window-by-window basis. According to the present embodiment, when the anonymization process is executed on a window-by-window basis, the area of the region to be anonymized is smaller compared to the case where the entire screen is the target of the anonymization process. As a result, the flickering perceived by the user 20 when the original image and the masking image are displayed in a time-division manner on the display 122 is reduced.

[0076] According to the present embodiment, the user 20 can easily specify the area on the desktop screen where the original image and the masking image are displayed by performing an input operation for specifying a window for which anonymization is desired, or by performing a setting operation for designating as the target of the anonymization process a window for displaying the execution result of a specific application program. Further, even when the user 20 changes the position of the target window (which may be referred to as moving the target window), or changes the shape and / or size of the target window, the display terminal 120 can adjust the area on the desktop screen where the original image and the masking image are displayed according to the change. Thereby, even when the user 20 changes the position, shape, and / or size of the target window, leakage of confidential information is prevented without the user 20 having to re-specify the area on the desktop screen where the original image and the masking image are displayed.

[0077] Also, for example, when (a) the user 20 views the display 122 together with the third party 32 and / or the third party 34, or (b) the user 20 shares the screen with the third party 32 and / or the third party 34, on the desktop screen of the display terminal 120 used by the user 20, there may be a mixture of windows that can be disclosed to the third party 32 and / or the third party 34 and windows that cannot be disclosed to the third party 32 and / or the third party 34. Even in such a case, according to the present embodiment, the user 20 can execute the anonymization process for the non-disclosable window without executing the anonymization process for the disclosable window described above.

[0078] [Detection Process of the Wearable Device 150] In another embodiment of the present technology, the display terminal 120 determines whether a device having at least one of a light shutter and an imaging device exists around the display terminal 120. For example, the display terminal 120 executes a detection process of the wearable device 140 and the wearable device 150 existing around the display terminal 120.

[0079] When a device having at least one of a light shutter and an imaging device is detected around the display terminal 120, the display terminal 120 determines whether the device is a device for which the recognition enabling process is permitted. When the above device is not a device for which the recognition enabling process is permitted, the display terminal 120 executes the second anonymization process described above. Thereby, even when a third party 34 wearing the wearable device 150 exists around the display terminal 120, leakage of confidential information can be prevented.

[0080] As described above, when the second anonymization process is executed, the display of the confidential information on the display 122 is stopped, or the timing at which the confidential information is displayed on the display 122 (which may be referred to as the display timing) is changed. The display terminal 120 may determine the content of the process to be executed according to the level of the risk of information leakage. Examples of the risk level include (i) the type of application that generates the confidential information, (ii) the number of detected eyewear-type devices 150, and (iii) the distance between the display terminal 120 and the detected eyewear-type devices 150.

[0081] When the above device is not a device for which the recognition process is permitted, the display terminal 120 may output a warning to the user 20. For example, the display terminal 120 outputs a warning sound or a warning message from the audio output device of the display terminal 120. For example, the display terminal 120 displays a warning icon or a warning message on the display 122. The display terminal 120 may turn on a warning lamp provided on the display terminal 120. Thereby, even when there is a third party 34 wearing an eyewear-type device 150 around the display terminal 120, leakage of the confidential information can be prevented.

[0082] In addition, the display terminal 120 may temporarily hide a window, a folder, or an icon related to the confidential information based on an instruction from the user 20 who has received the warning. Examples of the process of temporarily hiding a window, a folder, or an icon include a process of making the window or the like invisible, a process of minimizing the window or the like, and a process of moving the window or the like to the back of another window or the like. Thereby, even when there is a third party 34 wearing an eyewear-type device 150 around the display terminal 120, leakage of the confidential information can be prevented.

[0083] For example, the display terminal 120 notifies information indicating the changed display timing by transmitting a control signal to the eyewear-type device 140. The eyewear-type device 140 adjusts the opening and closing timing of the optical shutter 142 based on the information indicating the changed display timing. As a result, the user 20 wearing the eyewear-type device 140 can continue to view the confidential information displayed on the display 122. On the other hand, the eyewear-type device 150 cannot adjust the opening and closing timing of the optical shutter 152 according to the changed display timing, or it takes time to make such an adjustment. Thereby, leakage of confidential information is prevented.

[0084] According to the present embodiment, after the second confidentiality process is executed, when a predetermined event is detected, the execution of the second confidentiality process is stopped. As a result, for example, the display terminal 120 returns to the state in which the first confidentiality process is being executed. Examples of the predetermined event include that a predetermined period has elapsed and that a device having at least one of an optical shutter and an imaging device has not been detected around the display terminal 120.

[0085] [Overview of each part related to the information confidentiality system 100] In the present embodiment, the display terminal 120 causes the display 122 to display various types of information. Further, the display terminal 120 transmits and receives various control signals to and from the eyewear-type device 140. Examples of the display terminal 120 include a personal computer and a mobile terminal. Examples of the mobile terminal include a mobile phone, a smartphone, a PDA, a tablet, a notebook computer or a laptop computer, and a wearable computer. Examples of the wearable computer include a bracelet-type or ring-type wearable computer.

[0086] In the present embodiment, the eyewear-type device 140 is a device permitted by the user 20 or the information concealment system 100 to perform a process for enabling recognition of information displayed on the display 122 of the display terminal 120. The eyewear-type device 140 controls the opening and closing timing of the optical shutter 142. The eyewear-type device 140 may be configured to be able to adjust the opening and closing timing of the optical shutter 142. Further, the eyewear-type device 140 transmits and receives various control signals to and from the display terminal 120. The eyewear-type device 140 may be a glasses-type device, a head-mounted device, or a contact lens-type device.

[0087] In the present embodiment, the eyewear-type device 150 is a device for which the user 20 or the information concealment system 100 has not permitted a process for enabling recognition of information displayed on the display 122 of the display terminal 120. The eyewear-type device 150 controls the opening and closing timing of the optical shutter 152. The eyewear-type device 150 may be configured to be able to adjust the opening and closing timing of the optical shutter 142. The eyewear-type device 150 may be a glasses-type device, a head-mounted device, or a contact lens-type device.

[0088] [Specific Configuration of Each Part of Information Concealment System 100] Each part of the information concealment system 100 may be implemented by hardware, may be implemented by software, or may be implemented by hardware and software. Each part of the information concealment system 100 may have at least a part of it implemented by a single server or may be implemented by a plurality of servers. Each part of the information concealment system 100 may have at least a part of it implemented on a virtual machine or on a cloud system. Each part of the information concealment system 100 may have at least a part of it implemented by a personal computer or a mobile terminal. Examples of the mobile terminal include a mobile phone, a smartphone, a PDA, a tablet, a notebook computer or a laptop computer, a wearable computer, etc. Each part of the information concealment system 100 may store information using a distributed ledger technology such as blockchain or a distributed network.

[0089] When at least a part of the components constituting the information concealment system 100 is implemented by software, the components implemented by the software may be realized by starting software or a program that defines the operations related to the components in an information processing apparatus with a general configuration. The above information processing apparatus with a general configuration may include: (i) a data processing apparatus having a processor such as a CPU or a GPU, a ROM, a RAM, a communication interface, etc.; (ii) an input apparatus such as a keyboard, a pointing device, a touch panel, a camera, a voice input device, a gesture input device, various sensors, a GPS receiver, etc.; (iii) an output apparatus such as a display device, a voice output device, a vibration device, etc.; and (iv) a storage device such as a memory, an HDD, an SSD (including an external storage device).

[0090] In the information processing apparatus having the above general configuration, the above data processing apparatus or storage device may store the above software or program. When the above software or program is executed by a processor, the information processing apparatus is caused to execute operations defined by the software or program. The above software or program may be stored in a non-transitory computer-readable recording medium. The above software or program may be a program for causing a computer to function as the information concealment system 100 or a part thereof. The above software or program may be a program for causing a computer to execute an information processing method in the information concealment system 100 or a part thereof.

[0091] In one embodiment, the above information processing method may be a control method for controlling a display device including a display device that displays an image. The above information processing method may be a control method for a computer to control the above display device.

[0092] The above control method has, for example, a secret image generation step of generating a secret image for displaying secret information that is information to be subjected to a concealment process. The above control method has, for example, an interference image generation step of generating an interference image for obstructing the visual recognition of at least a part of the secret image. The above control method has, for example, a display control step of controlling the display device so that the display device displays the secret image and the interference image in a time-division manner for each frame.

[0093] In another embodiment, the above information processing method may be a control method for controlling a display device including a display device that displays an image. The above information processing method may be a control method for a computer to control the above display device.

[0094] The above control method has, for example, a display control stage for controlling a display device. The above control method has, for example, at least one of an optical shutter and an imaging device, and has a peripheral device detection stage for detecting one or more peripheral devices existing around the display device. The above control method has, for example, a determination stage for determining whether or not a suspicious device, which is a device that does not meet the genuine product determination conditions, which are conditions related to a device in which the recognition enabling process of confidential information is permitted, is included among the one or more peripheral devices detected in the peripheral device detection stage.

[0095] In the above control method, the display control stage includes, for example, (a) a stage of determining to execute a first concealment process of causing the display device to display a concealment image for displaying confidential information and an interference image for obstructing visual recognition of at least a part of the concealment image in a time-division manner when it is not determined in the determination stage that a suspicious device is included among the one or more peripheral devices. The display control stage includes, for example, (b) a stage of determining to execute a second concealment process of concealing at least a part of the confidential information in a manner different from the first concealment process when it is determined in the determination stage that a suspicious device is included among the one or more peripheral devices. The second concealment process includes, for example, at least one of a process for stopping the display of the concealment image on the display device, a process for changing the timing at which the concealment image is displayed on the display device, a process for reducing the window in which the confidential information is displayed, a process for moving the window behind another window, a process for changing the display position of the window, and a process for changing the color tone or brightness of the concealment image.

[0096] In still another embodiment, the above information processing method may be a control method for controlling a display device including a display device that displays an image including one or more display windows for presenting information to a user. The above information processing method may be a control method for a computer to control the above display device.

[0097] The above control method has, for example, a confidential image generation stage for generating a confidential image for displaying confidential information, which is information to be subject to the anonymization process. The above control method has, for example, an interference image generation stage for generating an interference image for disturbing the visual recognition of the confidential image. The above control method has, for example, a display control stage for controlling a display device so that the display device displays the confidential image and the interference image in a time-division manner for each frame. In the above control method, the confidential image includes at least an image of an image display area of a display window for displaying the confidential information. The above control method may include a stage for determining the necessity of the anonymization process in units of windows.

[0098] The display terminal 120 may be an example of a display device. The display 122 may be an example of a display device. The eyewear-type device 140 may be an example of a peripheral device, a legitimate device, or a device for which the process of enabling the recognition of confidential information is permitted. The eyewear-type device 150 may be an example of a peripheral device or a suspicious device.

[0099] Information that the user 20 does not wish to be viewed by the third parties 32 and 34 may be an example of confidential information. The original image may be an example of a display image. The masking image may be an example of an interference image. The first anonymization process may be an example of the first anonymization process. The second anonymization process may be an example of the second anonymization process. The anonymization process according to the first embodiment may be an example of the first anonymization process. The anonymization process according to the second embodiment may be an example of the second anonymization process. The visual characteristics of the viewer of the display 122 may be an example of human visual characteristics. The area where the confidential information is displayed in the original image may be an example of at least a part of the confidential image.

[0100] [An example of another embodiment] In this embodiment, an example of the information concealment system 100 has been described by taking the case where the display terminal 120 includes a display 122 as an example. However, the information concealment system 100 is not limited to this embodiment. In other embodiments, the display terminal 120 may include various devices capable of displaying images. For example, the display terminal 120 includes a projector that displays the image by projecting the image.

[0101] In this embodiment, an example of the information concealment system 100 has been described by taking the case where the user 20 and the third party 32 and / or the third party 34 view the same display 122, and the display terminal 120 used by the user 20 generates the original image and the masking image displayed on the display 122 as an example. However, the information concealment system 100 is not limited to this embodiment.

[0102] In other embodiments, the user 20 and the third party 32 and / or the third party 34 use different display terminals 120, and an information processing apparatus that provides image data to the display terminal 120 used by the user 20 and the display terminals 120 used by the third party 32 and / or the third party 34 generates the original image and the masking image. Examples of the information processing apparatus include a server configured to be communicable with these display terminals 120. In this case, the information processing apparatus may transmit a control signal for controlling the operation of the above-described eyewear type device 140 to the display terminal 120 used by the user 20, and may not transmit the control signal to the display terminals 120 used by the third party 32 and / or the third party 34.

[0103] In this embodiment, an example of the information concealment system 100 has been described by taking the case where the third party 34 uses the eyewear type device 150 including the optical shutter 152 to peek at the concealed information displayed on the display 122 as an example. However, the mode of peeking at the concealed information is not limited to this embodiment.

[0104] In another embodiment, a third party 34 peeks at the confidential information displayed on the display 122 by using a device equipped with an imaging element that images the display 122 on which the confidential information is displayed. Even in this case, if it is determined that the device equipped with the imaging element described above is not a device permitted to perform the above-described recognition enabling process, the display terminal 120 stops displaying the confidential information on the display 122. Thereby, leakage of information is suppressed.

[0105] In the present embodiment, an example of the information concealment system 100 has been described by taking as an example the case where the eyewear-type device 140 includes the optical shutter 142 and the masking image is blocked by the optical shutter 142. However, the information concealment system 100 is not limited to the present embodiment. In other embodiments, the information concealment system 100 or the eyewear-type device 140 may (i) image a display 122 that displays a confidential image and a masking image using an imaging element such as an image sensor, (ii) selectively extract the confidential image from the imaged image of the display 122, and (iii) present the extracted confidential image to the user.

[0106] FIG. 2 schematically shows an example of a desktop image 200 for displaying information. The desktop image 200 may be an example of an image displayed on the display 122 when no concealment process is executed. The desktop image 200 is displayed, for example, in the screen display area of the display 122.

[0107] In the present embodiment, the desktop image 200 has a desktop display area 212 and a task bar display area 214. In the present embodiment, an image of an active window 220, an image of a non-active window 240, and an image of a pointer 260 are displayed in the desktop display area 212. In the present embodiment, the active window 220 has a title area 222 and a work area 224. Also, a cursor 226 is arranged at the current input position in the work area 224. Similarly, the non-active window 240 has a title area 242 and a work area 244.

[0108] In this embodiment, one or more windows are displayed in the desktop display area 212. Each of the one or more windows displayed in the desktop display area 212 may be a display area assigned to an application executed on the display terminal 120, or may be a display area assigned to an application executed on another computer configured to be communicable with the display terminal 120.

[0109] On the other hand, in this embodiment, the task bar display area 214 may be an area where the image of the window is not displayed. In the task bar display area 214, for example, icons of applications currently executed on the display terminal 120, time, etc. are displayed.

[0110] In this embodiment, the active window 220 displays information presented to the user 20 by the corresponding application program. The active window 220 may be a window that is currently the target of the user 20's operation among the one or more windows displayed in the desktop display area 212. In this embodiment, the title of the active window 220 is displayed in the title area 222. Also, the content of the current work is displayed in the work area 224. The cursor 226 indicates, for example, the current input position in the work area 224.

[0111] In this embodiment, the non-active window 240 displays information presented to the user 20 by the corresponding application program. The non-active window 240 may be a window that is not currently the target of the user 20's operation among the one or more windows displayed in the desktop display area 212. In this embodiment, the title of the non-active window 240 is displayed in the title area 242. The content of the work that the user 20 last performed on the non-active window 240 is displayed in the work area 244.

[0112] In the present embodiment, the pointer 260 indicates the position indicated by the pointing device. Examples of the pointing device include a mouse and a touch panel.

[0113] The desktop image 200 may be an example of a concealed image. The active window 220 may be an example of a display window. The work area 224 of the active window 220 may be an example of the image display area of the display window. The image of the active window 220 may be an example of a concealed image. The image of the work area 224 of the active window 220 may be an example of a concealed image. The inactive window 240 may be an example of a display window. The work area 244 of the inactive window 240 may be an example of the image display area of the display window. The image of the inactive window 240 may be an example of a concealed image. The image of the work area 244 of the inactive window 240 may be an example of the image display area of the display window.

[0114] An example of the concealment process in the information concealment system 100 will be described with reference to FIGS. 3, 4, and 5. According to the present embodiment, an example of the concealment process will be described by taking as an example the case where the information displayed in the active window 220 in the desktop image 200 described in relation to FIG. 2 is concealed.

[0115] FIG. 3 schematically shows an example of an output frame 302 that stores the data of the image displayed on the display 122. FIG. 4 schematically shows an example of the operations of the display 122 and the optical shutter 142 during the execution of the concealment process. FIG. 5 schematically shows an example of a desktop image 500 recognized by a third party 32.

[0116] As shown in FIG. 3, in the present embodiment, the output frame 302 includes a sub-frame 312 and a sub-frame 314. By the display terminal 120 processing the sub-frame 312, the desktop image 320 is displayed in the desktop display area 212 of the display 122. Similarly, by the display terminal 120 processing the sub-frame 314, the desktop image 340 is displayed in the desktop display area 212 of the display 122.

[0117] In the present embodiment, the desktop image 320 includes a window image 322, a window image 324, and a pointer image 326. The window image 322 may be an image of the active window 220 at the time when the output frame 302 is processed. The window image 324 may be an image of the non-active window 240 at the above time. The pointer image 326 may be an image of the pointer 260 at the above time.

[0118] In the present embodiment, the desktop image 340 includes a window image 342, a window image 344, and a pointer image 346. The window image 342 may be an image of the active window 220 at the time when the output frame 302 is processed. The window image 344 may be an image of the non-active window 240 at the above time. The pointer image 346 may be an image of the pointer 260 at the above time.

[0119] In the present embodiment, taking the case where the desktop image 320 is the original image of the output frame 302 and the desktop image 340 is the masking image of the output frame 302 as an example, an example of the anonymization process in the information anonymization system 100 will be described. The desktop image 340 may be the same image as the desktop image 320, except that the window image 342 is displayed instead of the window image 322. The window image 322 is the original image of the active window 220, and the window image 342 is the masking image of the window image 322.

[0120] For example, when the output frame 302 is one frame of the video played in the active window 220, the original image of the one-frame image is displayed in the window image 322. On the other hand, the masked image of the one-frame image is displayed in the window image 342. Thus, according to the present embodiment, for each frame of the video, the original image and the masked image related to the same frame are displayed in a time-division manner so as to be paired. Therefore, a third party 32 not wearing the eyewear type device 140 recognizes, for example, a monochromatic gray image as the fused image. Thereby, the content of the video played in the active window 220 is concealed.

[0121] In the present embodiment, the window image 322 is an image for displaying the information displayed in the active window 220, and includes the information presented by the application program corresponding to the active window 220 to the user 20. The window image 322 is, for example, an input image generated based on the input image signal output by the above application program.

[0122] In the present embodiment, the window image 342 is an image for obstructing the visual recognition of the window image 322, and is, for example, a complementary color image in a complementary color relationship with the window image 322. When the input image and the complementary color image are switched at high speed alternately, to a third party 32 not wearing the eyewear type device 140 or the eyewear type device 150, it seems that a gray image in which both images are fused is displayed on the display 122 due to the afterimages of the input image and the complementary color image.

[0123] As shown in FIG. 4, according to this embodiment, the display terminal 120 processes a plurality of output frames having the same configuration as the output frame 302, so that the display 122 displays the desktop image 320 and the desktop image 340 in a time-division manner. For example, during the period Pso in which the sub-frame 312 is processed out of the period Pf (which may be referred to as the frame period) during which the output frame 302 is processed, the display 122 displays the desktop image 320. Also, during the period Psj in which the sub-frame 314 is processed, the display 122 displays the desktop image 340.

[0124] According to this embodiment, the eyewear-type device 140 sets the opening / closing timing of the optical shutter 142 such that the length of the opening / closing period Pg of the optical shutter 142 is equal to the length of Pf, the length of the period Pgo during which the optical shutter 142 is open is equal to the length of Pso, and the length of the period Pgc during which the optical shutter 142 is closed is equal to the length of Psj. Also, the eyewear-type device 140 controls the opening / closing of the optical shutter 142 in response to a synchronization signal from the display terminal 120. Thereby, the eyewear-type device 140 opens the optical shutter 142 during the period Pso in which the sub-frame 312 is processed and closes the optical shutter 142 during the period Pso in which the sub-frame 312 is processed.

[0125] As shown in FIG. 5, for the third party 32, the region corresponding to the active window 220 of the desktop image 200 in the desktop image 500 is seen masked by the fusion image 524. When the window image 342 is the complementary color image of the window image 322, the fusion image 524 becomes a gray image. On the other hand, the user 20 wearing the eyewear-type device 140 can view the desktop image 200.

[0126] The desktop image 320 may be an example of a concealed image. The window image 322 may be an example of a concealed image. The information displayed in the window image 322 may be an example of concealed information. The desktop image 340 may be an example of an obstructive image. The window image 342 may be an example of an obstructive image. The complementary color image may be an example of an obstructive image.

[0127] [Example of Another Embodiment] In this embodiment, an example of the information concealment system 100 has been described by taking as an example the case where (i) the information displayed in the active window 220 includes concealed information, (ii) the window image 322 including the title area 222 and the working area 224 of the active window 220 is a concealed image, and (iii) the window image 342 having the same shape and size as the window image 322 and being the complementary color image of the window image 322 is an obstructive image. However, the information concealment system 100 is not limited to this embodiment.

[0128] In other embodiments, the concealed image includes at least the image of the working area 224 of the active window 220. For example, the information concealment system 100 executes a concealment process using the image of the working area 224 of the active window 220 as the concealed image. In this case, the information concealment system 100 generates, as an obstructive image, for example, the complementary color image of the image of the working area 224 of the active window 220. The information concealment system 100 may generate, as an obstructive image, the complementary color image of an image of an area that includes the working area 224 of the active window 220 and is larger than the working area 224. Note that the information concealment system 100 may execute a concealment process using, as the concealed image, an image of an area that includes the working area 224 of the active window 220 and is larger than the working area 224.

[0129] In this embodiment, an example of the information concealment system 100 has been described by taking as an example the case where the information displayed in the active window 220 is concealed. However, the information concealment system 100 is not limited to this embodiment. In other embodiments, the information displayed in the non-active window 240 may be concealed. In this case, the information displayed in the non-active window 240 may be an example of the concealed information.

[0130] In this embodiment, an example of the information concealment system 100 has been described by taking as an example the case where a single output frame 302 includes a single sub-frame 312 corresponding to the original image and a single sub-frame 314 corresponding to the masking image. However, the information concealment system 100 is not limited to this embodiment. In other embodiments, a single output frame may include three or more sub-frames, or four or more sub-frames. In a single output frame, the number of sub-frames corresponding to the original image and the number of sub-frames corresponding to the masking image are preferably the same.

[0131] In this embodiment, an example of the information concealment system 100 has been described by taking as an example the case where in a single output frame 302, a single sub-frame 312 corresponding to the original image and a single sub-frame 314 corresponding to the masking image are arranged in this order. However, the information concealment system 100 is not limited to this embodiment. In other embodiments, the positions of the sub-frames in a single output frame may be arbitrarily determined. For example, a single sub-frame 312 corresponding to the original image is arranged after a single sub-frame 314 corresponding to the masking image.

[0132] Other examples of the concealment process in the information concealment system 100 will be described with reference to FIGS. 6 and 7. FIG. 6 schematically shows an example of an output frame 602 that stores the data of the image displayed on the display 122. FIG. 5 schematically shows an example of a desktop image 700 recognized by a third party 32.

[0133] As shown in FIG. 6, the output frame 602 includes a sub-frame 612, a sub-frame 614, a sub-frame 616, and a sub-frame 618. By the display terminal 120 processing the sub-frame 612, the desktop image 320 is displayed in the desktop display area 212 of the display 122. Similarly, by the display terminal 120 processing the sub-frame 614, the desktop image 660 is displayed in the desktop display area 212 of the display 122. By the display terminal 120 processing the sub-frame 616, the desktop image 340 is displayed in the desktop display area 212 of the display 122. By the display terminal 120 processing the sub-frame 618, the desktop image 680 is displayed in the desktop display area 212 of the display 122.

[0134] In the present embodiment, the desktop image 660 may be the same image as the desktop image 320, except that a dummy image 662 is displayed instead of the window image 322. Similarly, the desktop image 680 may be the same image as the desktop image 320, except that a dummy image 682 is displayed instead of the window image 322. The dummy image 662 and the dummy image 682 may be the same image, may be different images constituting a single video, or may be different images constituting a series of images output from a single application program.

[0135] According to the present embodiment, by the display terminal 120 processing a plurality of output frames having the same configuration as the output frame 602, the display 122 displays the desktop image 320, the desktop image 660, the desktop image 340, and the desktop image 680 in a time-division manner. On the other hand, in the present embodiment, the eyewear-type device 140 controls the opening and closing of the light shutter 142 such that (i) the light shutter 142 opens during the period when the desktop image 320 is displayed on the display 122, and (ii) the light shutter 142 opens during the periods when the desktop image 660, the desktop image 340, and the desktop image 680 are displayed on the display 122.

[0136] As shown in FIG. 7, for the third party 32, the area corresponding to the active window 220 of the desktop image 200 in the desktop image 700 is masked by the fusion image 724 and appears to be hidden. When the window image 342 is the complementary color image of the window image 322, the fusion image 724 is an image in which a gray image and a dummy image are mixed. Thus, the anonymization process can be executed without being noticed by the third party 32. On the other hand, the user 20 wearing the eyewear type device 140 can view the desktop image 200.

[0137] [Example of Another Embodiment] In this embodiment, an example of the information anonymization system 100 has been described by taking as an example the case where the output frame 602 includes the sub-frame 612 corresponding to the original image, the sub-frame 616 corresponding to the masking image, and the sub-frames 614 and 618 corresponding to the dummy image. However, the information anonymization system 100 is not limited to this embodiment. In other embodiments, the output frame includes one or more sub-frames corresponding to the original image, one or more sub-frames corresponding to the masking image, and one or more sub-frames corresponding to the dummy image. The order of the sub-frame corresponding to the original image, the sub-frame corresponding to the masking image, and the sub-frame corresponding to the dummy image in the above output frame can be arbitrarily determined.

[0138] FIG. 8 schematically shows an example of the internal configuration of the display terminal 120. In this embodiment, the display terminal 120 includes an input unit 820, a display 122, a communication unit 840, and a control unit 860. In this embodiment, the control unit 860 includes a peripheral device management unit 862, an application execution unit 863, an image display control unit 864, an optical shutter control unit 865, and a communication control unit 866.

[0139] In the present embodiment, the input unit 820 receives an input from the user 20. Examples of the input unit 820 include input devices such as a keyboard, a pointing device, and a camera. Examples of the pointing device include a mouse and a touch panel. When the input unit 820 includes a camera, devices existing around the display terminal 120 can be detected based on an image captured by the camera.

[0140] The input unit 820 may receive an instruction from the user 20 to the display terminal 120. For example, the input unit 820 receives an instruction (which may be referred to as a change instruction) for changing at least one of the position, shape, and size of a window.

[0141] In the present embodiment, the communication unit 840 transmits and receives information to and from devices external to the display terminal 120. The communication unit 840 may transmit and receive information to and from external devices by a wired communication method or may transmit and receive information to and from external devices by a wireless communication method. For example, the communication unit 840 is configured to be communicable with at least one of one or more eyewear-type devices 140. The communication unit 840 may be configured to be wirelessly communicable with at least one of one or more eyewear-type devices 140. The wireless communication method may be a communication method using radio waves, a communication method using infrared rays, or a communication method using visible light. The wireless communication method may be WiFi (registered trademark) or Bluetooth (registered trademark).

[0142] For example, the communication unit 840 transmits and receives various control signals to and from each of one or more eyewear-type devices 140. The communication unit 840 may receive a signal including a unique ID of the device from one or more devices existing around the display terminal 120. Examples of the unique ID include a MAC address and a DeviceID (which may be referred to as a UUID) of Bluetooth (registered trademark). The unique ID may be information that is stored in or stored in a specific item and can be distinguished to some extent. Note that peripheral devices can be detected based on the communication unit 840 receiving the unique ID.

[0143] When the communication unit 840 is configured to be able to transmit and receive information with an external device by a wireless communication method, the communication unit 840 may be configured to be able to adjust the intensity of the transmitted radio wave. For example, when the distance between the user 20 and the display terminal 120 is smaller than the distance between the third party 34 and the display terminal 120, the communication unit 840 can selectively transmit a control signal to the wearable device 140 worn by the user 20. When the radio wave intensity of the radio wave transmitting the above control signal is small, the wearable device 150 worn by the third party 34 cannot receive the above control signal. Thereby, peeping by the third party 34 can be suppressed.

[0144] In the present embodiment, the control unit 860 controls the operation of the display terminal 120. The control unit 860 may control the operation of the wearable device 140 by transmitting a control signal to the wearable device 140.

[0145] In the present embodiment, the peripheral device management unit 862 manages various devices existing around the display terminal 120. The peripheral device management unit 862 manages a device having at least one of a light shutter and an imaging element among the devices existing around (which may be referred to as a peripheral device).

[0146] The peripheral device management unit 862 may manage a unique ID for each of one or more peripheral devices. The peripheral device management unit 862 may manage the state of each of one or more peripheral devices. Examples of the state of the peripheral device include the remaining battery level. The peripheral device management unit 862 may manage the presence or absence of information regarding a specific item among a plurality of items regarding the state of the peripheral device.

[0147] The peripheral device management unit 862 may manage, for each of one or more peripheral devices, whether or not the device (which may be referred to as a genuine device) meets the genuine product determination conditions. The genuine product determination conditions may be conditions regarding a device for which the process of making confidential information recognizable is permitted.

[0148] Examples of the genuine product determination conditions include the condition that the ID unique to the peripheral device is registered in the whitelist, the condition that the ID unique to the peripheral device is not registered in the blacklist, the condition that the specifications of the peripheral device meet specific conditions, the condition that information regarding specific items related to the state of the peripheral device is acquired, and the condition that information indicating a predetermined character string is included in the control signal transmitted from the peripheral device to the display terminal 120. When information regarding specific items related to the state of the peripheral device is acquired, it may be determined that the specifications of the peripheral device meet specific conditions. For example, when information regarding the remaining battery level of the peripheral device is acquired, it may be determined that the peripheral device has a specification that it can transmit information regarding the remaining battery level.

[0149] In the present embodiment, the application execution unit 863 executes an application program. The application execution unit 863 outputs a signal (which may be referred to as an input image signal) for displaying the execution result of the application program in the working area of the window corresponding to the application program.

[0150] In the present embodiment, the image display control unit 864 controls the display 122. The image display control unit 864 may control the content of the image or information displayed on the display 122 by controlling the display 122.

[0151] In one embodiment, the image display control unit 864 identifies confidential information and executes a confidentiality process on the confidential information. The image display control unit 864 may determine the necessity of the confidentiality process on a window-by-window basis. The image display control unit 864 may control the display 122 such that the display 122 displays the original image and the masking image in a time-division manner for each frame.

[0152] In other embodiments, if a device that does not meet the above-described genuine product determination conditions (which may be referred to as a suspicious device) is detected during the execution of the anonymization process, the image display control unit 864 executes the second anonymization process described above. As described above, the image display control unit 864 may determine the content of the process to be executed based on the level of the risk of information leakage. For example, the image display control unit 864 may stop the display of the confidential information or an image including the confidential information (which may be referred to as a confidential image). When a suspicious device is detected during the execution of the anonymization process, the image display control unit 864 may change the display timing of the confidential information or the confidential image.

[0153] When the image display control unit 864 changes the display timing of the confidential information or the confidential image, the image display control unit 864 may transmit a signal including information indicating the above change or information indicating the changed display timing to the eyewear-type device 140. As described above, the image display control unit 864 may encrypt the information indicating the above change or the information indicating the changed display timing and transmit the encrypted information to the eyewear-type device 140.

[0154] Specifically, for example, the image display control unit 864 first determines whether a suspicious device is included in one or more peripheral devices detected by the peripheral device management unit 862. If it is determined that no suspicious device is included in the one or more peripheral devices (which may be referred to as a case where no suspicious device is detected), the image display control unit 864 determines to display the original image and the masking image on the display 122 in a time-division manner. Thereby, the anonymization process is executed. On the other hand, if it is determined that a suspicious device is included in the one or more peripheral devices (which may be referred to as a case where a suspicious device is detected), the image display control unit 864 determines to execute the second anonymization process described above. For example, the image display control unit 864 determines to stop the display of the confidential information or the confidential image, or to change the display timing of the confidential information or the confidential image. Thereby, for example, peeping by a third party 34 wearing the eyewear-type device 150 is suppressed.

[0155] In this embodiment, the optical shutter control unit 865 controls the operation of the optical shutter 142 of the eyewear-type device 140. The optical shutter control unit 865 may control the operation of the optical shutter 142 by transmitting a control signal for controlling the operation of the optical shutter 142 of the eyewear-type device 140 to the eyewear-type device 140.

[0156] For example, the optical shutter control unit 865 controls the opening and closing timing of the optical shutter 142. The optical shutter control unit 865 may control the opening and closing timing of the optical shutter 142 by transmitting a control signal indicating the length of the opening and closing cycle Pg of the optical shutter 142 and the position of the period Pgo during which the optical shutter 142 is open in the opening and closing cycle Pg of the optical shutter 142 to the eyewear-type device 140. The above control signal may include information indicating the length of the period Pgo during which the optical shutter 142 is open, or may include information indicating the length of the period Pgc during which the optical shutter 142 is closed.

[0157] The above control signal may include a synchronization signal for synchronizing the switching of the image on the display 122 and the opening and closing of the optical shutter 142 in the eyewear-type device 140. The above control signal may include information indicating that a suspicious device has been detected, may include information indicating that the display of the concealed image on the display 122 has stopped, or may include information indicating that the display timing of the concealed image on the display 122 has been changed.

[0158] The optical shutter control unit 865 may control the operation of the optical shutter 142 based on the information from the image display control unit 864. For example, the optical shutter control unit 865 generates the above control signal based on the information from the image display control unit 864.

[0159] The light shutter control unit 865 may acquire information indicating the length of the frame period Pf from the image display control unit 864, and determine the length of the opening / closing period Pg of the light shutter 142 based on the length of the Pf. The light shutter control unit 865 may acquire information indicating the position of the period Pso during which the sub-frame 312 in the frame period Pf is processed from the image display control unit 864, and determine the position of the period Pgo in the opening / closing period Pg of the light shutter 142 based on the position of the period Pso in the frame period Pf. The light shutter control unit 865 may acquire information indicating the length of the period Pso from the image display control unit 864, and determine the length of the opening / closing period Pg of the light shutter 142 based on the length of the Pso. The light shutter control unit 865 may acquire information indicating the length of the period Psj from the image display control unit 864, and determine the length of the opening / closing period Pg of the light shutter 142 based on the length of the Psj.

[0160] In the present embodiment, the communication control unit 866 controls the communication unit 840. The communication control unit 866 may support a wired communication method or may support one or more wireless communication methods. The communication control unit 866 may control the transmission and reception of information between the eyewear type device 140 and each part of the control unit 860. For example, the communication control unit 866 controls the communication unit 840 so that a control signal from the light shutter control unit 865 is transmitted to a specific eyewear type device 140 or an unspecified eyewear type device 140.

[0161] According to one embodiment, when no suspicious device is detected, a control signal including a synchronization signal is transmitted to the eyewear type device 140. According to another embodiment, when a suspicious device is detected and the image display control unit 864 determines to change the display timing, a control signal is transmitted to the eyewear type device 140. The above control signal includes, for example, information indicating that the display timing is changed, information indicating the changed display timing, and the like. The information indicating the changed opening / closing timing may be an example of the information indicating the changed display timing.

[0162] The communication control unit 866 may control the radio wave intensity of the transmission radio wave output by the communication unit 840. For example, when a suspicious device is detected and the image display control unit 864 determines to change the display timing, the communication control unit 866 controls the communication unit 840 so that the radio wave intensity of the radio wave transmitting the control signal becomes weaker than a predetermined intensity.

[0163] The input unit 820 may be an example of an instruction reception unit. The camera or a part thereof of the input unit 820 may be an example of an image pickup device. The communication unit 840 may be an example of a transmitter. The control unit 860 may be an example of a control device. The peripheral device management unit 862 may be an example of a peripheral device detection unit. The image display control unit 864 may be an example of a display control unit or a determination unit. The communication control unit 866 may be an example of a transmission control unit.

[0164] FIG. 9 schematically shows an example of the internal configuration of the image display control unit 864. In the present embodiment, an example of the image display control unit 864 will be described by taking as an example the case where a complementary color image is generated as a masking image.

[0165] In the present embodiment, the image display control unit 864 includes, for example, a user input reception unit 922, a pointer positioning unit 924, and a window management unit 926. In the present embodiment, the image display control unit 864 includes, for example, an input image generation unit 932, an input image buffer 934, a complementary color image generation unit 936, a complementary color image buffer 938, an output image generation unit 940, and an image output management unit 950.

[0166] In the present embodiment, the user input reception unit 922 receives an input from the user 20. Specifically, the user input reception unit 922 acquires information indicating the content of the user input input to the input unit 820. For example, the user input reception unit 922 receives an instruction for changing at least one of the position, shape, and size of the window.

[0167] In this embodiment, the pointer positioning unit 924 determines the position of the pointer 260 on the display 122. The pointer positioning unit 924 may determine the position of the pointer 260 on the display 122 based on the user input from the pointing device received by the user input receiving unit 922.

[0168] In this embodiment, the window management unit 926 manages each of one or more windows displayed in the desktop display area 212 of the display 122. The window management unit 926 may manage information regarding the state of each of the one or more windows described above. Details of the information regarding the state of the window will be described later.

[0169] In this embodiment, the input image generation unit 932 generates an input image serving as an original image. Specifically, the input image generation unit 932 generates a desktop image displayed in the desktop display area 212 as an input image based on the input image signal from the application execution unit 863. As described above, the desktop image may include images of one or more windows. The input image generation unit 932 stores the generated desktop image in the input image buffer 934.

[0170] In this embodiment, the complementary color image generation unit 936 generates a complementary color image which is an example of a masking image. In this embodiment, an example of the complementary color image generation unit 936 will be described by taking as an example the case where the complementary color image generation unit 936 generates a complementary color image having a complementary color relationship with an image constituting at least a part of the input image generated by the input image generation unit 932.

[0171] For example, the complementary color image generation unit 936 generates a desktop image including a complementary color image of the image of the window including the confidential information among one or more windows arranged on the desktop as a masking image corresponding to the desktop image generated by the input image generation unit 932. The complementary color image generation unit 936 stores the generated desktop image in the complementary color image generation unit 936.

[0172] Specifically, the complementary color image generation unit 936 first acquires the desktop image generated by the input image generation unit 932. Also, the complementary color image generation unit 936 identifies a target window among one or more windows that is the target of the anonymization process. For example, the complementary color image generation unit 936 identifies the target window based on the user input received by the user input reception unit 922. The complementary color image generation unit 936 may identify one or more windows corresponding to a specific type of application program as the target window.

[0173] Next, the complementary color image generation unit 936 refers to the information managed by the window management unit 926 and acquires information indicating the position and size of the target window (which may be referred to as window information). The complementary color image generation unit 936 may refer to the information managed by the window management unit 926 and acquire information indicating the shape of the target window.

[0174] Next, the complementary color image generation unit 936 identifies, in the desktop image generated by the input image generation unit 932, the area that is the target of the complementary color image generation process based on the position, shape, and size of the target window. Thereby, the position, shape, and size of the area where the complementary color image is generated are determined.

[0175] The area that is the target of the complementary color image generation process may be the same as the area where the target window is arranged, or may be an area larger than the area where the target window is arranged. The area that is the target of the complementary color image generation process may be an area that includes at least a part of the area where the target window is arranged.

[0176] In one embodiment, the complementary color image generation unit 936 determines the position, shape, and size of the area where the complementary color image of the target window is to be generated in the desktop display area 212 of the display 122 such that (i) the area where the complementary color image of the target window is displayed (which may be referred to as the interference area) when the complementary color image of the target window is displayed on the display 122 covers (ii) the area where the original image of the target window is displayed (which may be referred to as the display area) when the original image of the target window is displayed on the display 122. Thereby, leakage of confidential information can be further suppressed.

[0177] In other embodiments, the complementary color image generation unit 936 may determine the position, shape, and size of the complementary color image of the target window according to the speed at which at least one of the position, shape, and size of the target window is changed. For example, the complementary color image generation unit 936 adjusts the degree of overlap between the interference area and the display area according to the above speed. The complementary color image generation unit 936 may determine the position, shape, and size of the complementary color image of the target window such that the degree of overlap between the interference area and the display area increases as the above speed increases.

[0178] Next, the complementary color image generation unit 936 converts at least one of the color tone and luminance of each pixel arranged in the area where the complementary color image is to be generated among the desktop images generated by the input image generation unit 932 based on a known algorithm for generating an image in a complementary color relationship. Thereby, for example, a desktop image including the complementary color image of the target window is generated.

[0179] For example, the complementary color image generation unit 936 first acquires or generates information indicating the correspondence between the color of the original image and the color of the complementary color image. The above correspondence may be the first complementary color relationship described above or the second complementary color relationship. The above correspondence may be represented by a function or by a table.

[0180] Next, the complementary color image generation unit 936 generates a complementary color image of the target window by converting the color of each pixel in the target window of the original image based on the correspondence between the color of the original image and the color of the complementary color image. Further, the complementary color image generation unit 936 synthesizes the complementary color image of the target window at an appropriate position of the original image of the desktop image. Thereby, a desktop image including the complementary color image of the target window is generated.

[0181] Note that the complementary color image generation unit 936 may perform the synthesis process of the complementary color image of the target window after adjusting the brightness or luminance of at least a part of one or more pixels constituting the original image of the desktop image. For example, the complementary color image generation unit 936 may synthesize an image in which the brightness or luminance of at least a part of the pixels in the whole of the original image or in the region other than the target window is made smaller than that of the original image and the complementary color image of the target window.

[0182] In the present embodiment, the output image generation unit 940 generates an image (which may be referred to as an output image) to be displayed on the display 122. The output image generation unit 940 may generate an output image based on a control signal from the image output management unit 950. For example, the output image generation unit 940 generates an output image based on a control signal indicating the display timing.

[0183] Specifically, the output image generation unit 940 outputs the desktop image stored in the input image buffer 934 at the timing when the original image is displayed. Further, the output image generation unit 940 outputs the desktop image stored in the complementary color image buffer 938 at the timing when the masking image is output.

[0184] [Adjustment of Output Image Considering Display Characteristics of Display] The output image generation unit 940 may correct the desktop image stored in the input image buffer 934 in consideration of the display characteristics of the display 122, and output the corrected image to the display 122. The output image generation unit 940 may correct the desktop image stored in the complementary color image buffer 938 in consideration of the display characteristics of the display 122, and output the corrected image to the display 122.

[0185] [Adjustment of Output Image Considering Pointer Position] When the pointer 260 is located near or inside the complementary color image of the target window, the output image generation unit 940 may correct the desktop image stored in the complementary color image buffer 938. Further, the output image generation unit 940 may output the corrected image to the display 122.

[0186] Specifically, the output image generation unit 940 first obtains information indicating the position of the pointer 260 on the display 122 from the pointer positioning unit 924. Further, the output image generation unit 940 accesses, for example, the OS to obtain information regarding the color treated as the key color. Next, the output image generation unit 940 determines whether the pointer 260 is located near or inside the complementary color image of the target window. The definition of "near" is determined, for example, by system settings or user designation.

[0187] When it is determined that the pointer 260 is not located near or inside the complementary color image of the target window, the output image generation unit 940 outputs, for example, the desktop image stored in the complementary color image buffer 938 to the display 122 without correcting it. On the other hand, when it is determined that the pointer 260 is located near or inside the complementary color image of the target window, the output image generation unit 940 determines to correct the desktop image stored in the complementary color image buffer 938. The output image generation unit 940 changes the color of the area (which may be referred to as the pointer area) including the indicated position of the pointer 260 in the above desktop image to the key color. Thereby, even when the corrected desktop image is displayed on the frontmost active window, the user 20 can select or operate the icon or window arranged behind the active window.

[0188] The shape and size of the pointer area are determined, for example, by system settings or user specifications. The shape and size of the pointer area may be determined based on at least one of the moving direction of the pointer 260, the moving speed of the pointer 260, the type of pointing device, and the settings of the pointing device.

[0189] For example, the shape and size of the pointer area are determined such that the length of the pointer area in the moving direction of the pointer 260 is larger than the length in the opposite direction of the moving direction of the pointer 260. For example, the shape and size of the pointer area are determined such that the larger the moving speed of the pointer 260, the larger the size of the pointer area. For example, when the type of pointing device is a touch panel, the shape and size of the pointer area are determined such that the size of the pointer area is larger compared to the case where the type of pointing device is a mouse. For example, the shape and size of the pointer area may be determined such that the larger the sensitivity of the pointing device, the larger the size of the pointer area.

[0190] In this embodiment, the image output management unit 950 manages the output of images. Details of the image output management unit 950 will be described later.

[0191] The user input reception unit 922 may be an example of an instruction reception unit. The input image generation unit 932 may be an example of a concealed image generation unit. The complementary color image generation unit 936 may be an example of an interference image generation unit, a target identification unit, or a window information acquisition unit. The output image generation unit 940 may be an example of a concealed image generation unit or an interference image generation unit. The image output management unit 950 may be an example of a determination unit. An image of a window including concealed information may be an example of a concealed image. An area where a complementary color image is generated may be an example of a concealed area.

[0192] The pointer positioning unit 924 may be an example of a pointer detection unit. The complementary color image generation unit 936 may be an example of a concealed area determination unit, a position identification unit, or a range determination unit. The output image generation unit 940 may be an example of a color information acquisition unit or an interference image generation unit.

[0193] [An example of another embodiment] In this embodiment, an example of the information concealment system 100 has been described by taking as an example the case where, when it is determined that the pointer 260 is located near or inside the complementary color image of the target window, the output image generation unit 940 corrects the desktop image stored in the complementary color image buffer 938. However, the information concealment system 100 is not limited to this embodiment.

[0194] In other embodiments, regardless of the position of the pointer 260, a complementary color image in which the color of the pointer area is set to a key color is generated. For example, the complementary color image generation unit 936 generates a complementary color image in which the color of the pointer area is set to a key color. Thereby, even when the complementary color image is displayed in the active window, the pointer can penetrate the active window.

[0195] FIG. 10 schematically shows an example of a data table 1000. In the present embodiment, for each of one or more windows, the data table 1000 stores, in association, a window ID 1022, information 1024 indicating a title name, a process ID 1032, information 1034 indicating the state of the process, information 1042 regarding layout, information 1044 indicating settings regarding transparency, and information 1052 indicating the necessity of anonymization.

[0196] Examples of the information 1042 regarding layout include position, shape, size, and the overlapping relationship with other windows. If the shape of a window is predetermined by initial settings, user settings, etc., the information regarding the shape of the window may not be stored in the data table 1000. Examples of the overlapping relationship with other windows include the order of overlapping.

[0197] Examples of the settings regarding transparency include non-transparent, semi-transparent, and transparent. The settings regarding transparency may be the settings regarding the above-described transparent color or transmissive color. Also, in a single window, if there are two or more regions with different settings regarding transparency, the identification information of each region, the information regarding the position, shape, and size of each region, and the information indicating the settings regarding transparency of each region may be stored in association.

[0198] According to the present embodiment, for example, upon an instruction from a user, a window with the title name "Word_Contract.doc" corresponding to process P002 is anonymized. When the display terminal 120 receives the above instruction, a process P011 for anonymization processing is executed, and a new window is generated. The generated new window is, for example, arranged in the frontmost position. The title name of the above new window may include a part of the title name of the target window to be anonymized. Note that the title name of the above new window may be the same as the title name of the target window to be anonymized. Also, the target may be determined by performing a fuzzy search process using a filter in which anonymization targets are defined in advance by a regular expression.

[0199] FIG. 11 schematically shows an example of the internal configuration of the output image generation unit 940. In the present embodiment, the output image generation unit 940 includes a display window generation unit 1122, a masking window generation unit 1124, an overlapping state determination unit 1132, an image correction unit 1134, and an image composition unit 1140.

[0200] In the present embodiment, the display window generation unit 1122 generates a window (sometimes referred to as a display window) for displaying information presented to the user 20. The display window generation unit 1122 may generate one or more display windows corresponding to each of the one or more application programs executed by the application execution unit 863.

[0201] In the present embodiment, the masking window generation unit 1124 generates at least a window (sometimes referred to as a masking window) for displaying a masking image. In one embodiment, the original image and the masking image are displayed in the masking window in a time-division manner. In another embodiment, the transparent image and the masking image are displayed in the masking window in a time-division manner. In still another embodiment, the masking image is selectively displayed in the masking window. Details of the images displayed in the masking window will be described later.

[0202] In the present embodiment, the overlapping state determination unit 1132 determines the overlapping state of one or more display windows and the masking window. Details of the above overlapping state will be described later.

[0203] In this embodiment, the image correction unit 1134 corrects at least one of the desktop image stored in the input image buffer 934 and the complementary color image buffer 938. In one embodiment, the image correction unit 1134 corrects the desktop image stored in the complementary color image buffer 938 in consideration of the display characteristics of the display 122. For example, the image correction unit 1134 corrects the desktop image stored in the complementary color image buffer 938 by reducing the color gradation range. Thereby, the occurrence of shading in the fused image generated by fusing the original image and the masking image is suppressed.

[0204] In other embodiments, based on the desktop image stored in the input image buffer 934, when it is switched at a display speed of 15 frames per second or more and displayed on the display 122, a first image and a second image for displaying the desktop image due to afterimages are generated. The first image and the second image may be, for example, images with different color tones or luminances in corresponding regions.

[0205] Also, the image correction unit 1134 generates a masking image corresponding to the first image and a masking image corresponding to the second image. The image correction unit 1134 may generate a masking image corresponding to the first image and a masking image corresponding to the second image based on the desktop image stored in the complementary color image buffer 938. The masking image corresponding to the first image and the masking image corresponding to the second image may be, for example, images with different color tones or luminances in corresponding regions.

[0206] In this embodiment, the image composition unit 1140 composes the images displayed in each of the one or more display windows and the image displayed in the masking window to generate an output image. The image composition unit 1140 outputs the generated image to the display 122 at the timing indicated by the control signal from the image output management unit 950. Thereby, the display image by the display 122 is controlled.

[0207] In one embodiment, the masking window may be a full-screen window that substantially entirely covers the desktop display area 212 of the display 122. The masking window may be arranged in front of one or more display windows. In this case, for example, at the timing when the original image is displayed on the display 122, the image composition unit 1140 generates an output image such that the masking window in which the original image is displayed is arranged in front of one or more display windows. Also, at the timing when the masking image is displayed on the display 122, the image composition unit 1140 generates an output image such that the masking window in which the masking image is displayed is arranged in front of one or more display windows.

[0208] In other embodiments, the masking window may be a full-screen window that substantially entirely covers the desktop display area 212 of the display 122 and has a transparent area or a transmissive area. The masking window may be arranged in front of one or more display windows. In this case, for example, at the timing when the original image is displayed on the display 122, the image composition unit 1140 generates an output image such that the masking window having a transparent area or a transmissive area in at least the area where the target window is displayed is arranged in front of one or more display windows. Also, at the timing when the masking image is displayed on the display 122, the image composition unit 1140 generates an output image such that the masking window in which the masking image is displayed is arranged in front of one or more display windows.

[0209] In still other embodiments, the image composition unit 1140 performs a concealment process by changing the overlapping order of the masking window and the target window according to the display timing. For example, at the timing when the original image is displayed on the display 122, the image composition unit 1140 generates an output image such that the target window is arranged in front of the masking window. Also, at the timing when the masking image is displayed on the display 122, the image composition unit 1140 generates an output image such that the masking window is arranged in front of the target window.

[0210] The masking window may be an example of an interfering window. The image composition unit 1140 may be an example of a concealed image generation unit or an interfering image generation unit.

[0211] FIG. 12 schematically shows an example of the superimposed state of the image 1200. In the present embodiment, the image 1200 includes a background layer 1210, a window layer 1220, and a pointer layer 1230. In the present embodiment, one or more display windows 1222 and a masking window 1224 are arranged in the window layer 1220. The display window 1222 includes, for example, the active window 220. The display window 1222 may include the active window 220 and one or more non-active windows 240.

[0212] As described in relation to FIG. 11, in one embodiment, the original image and the masking image are displayed in the masking window 1224 in a time-division manner. In other embodiments, a transparent image and a masking image are displayed in the masking window 1224 in a time-division manner. During the period when the transparent image is displayed in the masking window 1224, the background layer 1210 and one or more display windows 1222 are displayed on the display 122. As a result, the original image is displayed on the display 122.

[0213] The method of displaying the transparent image is not particularly limited. For example, the transparent image can be displayed on the display 122 according to the following procedure. First, for example, the transparent color (sometimes referred to as the transmission color) of a form such as the masking window 1224 is set by the OS of the display terminal 120. The transparent color is set, for example, by the TransparencyKey property. At the timing when the original image is displayed, the display terminal 120 generates a monochromatic image of the color set as the transparent color and displays the monochromatic image in the masking window 1224. Thereby, the above monochromatic image is treated as a transparent image.

[0214] FIG. 13 schematically shows an example of the correction process by the image correction unit 1134. In the present embodiment, the output frame 1302 has a sub-frame 1322, a sub-frame 1324, a sub-frame 1326, and a sub-frame 1328.

[0215] When the display terminal 120 processes the sub-frame 1322, the desktop image 1342 is displayed in the desktop display area 212 of the display 122. Similarly, when the display terminal 120 processes the sub-frame 1324, the desktop image 1344 is displayed in the desktop display area 212 of the display 122. When the display terminal 120 processes the sub-frame 1326, the desktop image 1346 is displayed in the desktop display area 212 of the display 122. When the display terminal 120 processes the sub-frame 1328, the desktop image 1348 is displayed in the desktop display area 212 of the display 122.

[0216] For example, when the desktop image 1342 and the desktop image 1346 are switched and displayed on the display 122 at a display speed of 15 frames per second or more, at least one of the color tone and luminance of the pixels constituting each image is adjusted so that the original image to be displayed in the output frame 1302 is generated due to afterimages. For example, the color tone and luminance of each pixel constituting the desktop image 1346 are determined based on the color tone and luminance of the corresponding pixels of the desktop image 1342.

[0217] According to FIG. 13, taking the areas enclosed by the dotted lines of desktop image 1342 and desktop image 1346 as examples, the correspondence of each pixel between desktop image 1342 and desktop image 1346 is described. In this embodiment, among the color tone and brightness of each pixel, the brightness of each pixel is adjusted. For example, the brightness of one or more pixels included in each of area 1362 and area 1368 is set to be greater than the brightness of the original image in desktop image 1342, and is set to be less than the brightness of the original image in desktop image 1346. Similarly, the brightness of one or more pixels included in each of area 1364 and area 1366 is set to be less than the brightness of the original image in desktop image 1342, and is set to be greater than the brightness of the original image in desktop image 1346.

[0218] Note that in this embodiment, desktop image 1344 shows the complementary color image of desktop image 1342. Desktop image 1348 shows the complementary color image of desktop image 1346.

[0219] [An example of another embodiment] In this embodiment, taking the case where the shapes of each of area 1362, area 1364, area 1366, and area 1368 are quadrilaterals, the shape of each area is constant over time, and the mode of correction regarding at least one of color tone and brightness is constant over time as an example, an example of information concealment system 100 is described. However, information concealment system 100 is not limited to this embodiment.

[0220] In other embodiments, the shape of each of the above-mentioned areas may be an arbitrary shape. In other embodiments, the shape of each of the above-mentioned areas may vary with time. That is, the shape of each area in one output frame and the shape of each area in another output frame may be different. Further, in other embodiments, the mode of correction regarding at least one of color tone and brightness in each of the above-mentioned areas may vary with time. That is, the mode of correction of each area in one output frame and the mode of correction of each area in another output frame may be different.

[0221] Thus, when the display pattern of the image on the display 122 and the opening / closing pattern of the optical shutter 142 are not synchronized, the regions that are units of correction processing (in the example of FIG. 13, the image correction unit 1134 executes image correction processing with four regions, i.e., region 1362, region 1364, region 1366, and region 1368, as one unit) appear to flow vertically, horizontally, or rotate over time. Further, when the amount of luminance correction varies for each frame, the regions that are units of correction processing appear to blink or the light amount of the regions appears to increase or decrease. As a result, information leakage is suppressed.

[0222] An example of the synthesis processing by the image synthesis unit 1140 will be described with reference to FIGS. 14, 15, and 16. According to the present embodiment, an example of the synthesis processing by the image synthesis unit 1140 will be described by taking as an example the case where the desktop image 320 is displayed in the desktop display region 212 of the display 122 at the display timing of the original image, and the desktop image 340 is displayed in the desktop display region 212 of the display 122 at the display timing of the masking image.

[0223] FIG. 14 schematically shows an example of the synthesis processing by the image synthesis unit 1140. FIG. 15 schematically shows another example of the synthesis processing by the image synthesis unit 1140. FIG. 16 schematically shows still another example of the synthesis processing by the image synthesis unit 1140.

[0224] In the embodiment described in relation to FIGS. 14 and 15, in the window layer 1220, the masking window is arranged at the frontmost position. Further, during the period when the anonymization processing is being executed, the masking window is arranged at the frontmost position of the window layer 1220. On the other hand, in the embodiment described in relation to FIG. 16, during the period when the anonymization processing is being executed, the stacking order of the masking window in the window layer 1220 varies.

[0225] In the embodiment described in relation to FIG. 14, the image synthesis unit 1140 controls the display 122 so that the desktop image 1420 serving as the original image and the desktop image 1440 serving as the masking image are displayed in a time-division manner in the masking window. Specifically, the image synthesis unit 1140 controls the display 122 by outputting an output image signal for controlling the image displayed on the display 122.

[0226] As shown in FIG. 14, the desktop image 1420 may be an image in which an opaque background image 1410, a window image 322, and a window image 324 are synthesized. The background image 1410 may be generated, for example, by capturing the background image before the execution of the anonymization process is started or immediately after the execution of the anonymization process is started. In one embodiment, the desktop image 1420 may be an image synthesized by the input image generation unit 932 and stored in the input image buffer 934. In other embodiments, the desktop image 1420 may be synthesized by the output image generation unit 940.

[0227] As shown in FIG. 14, the desktop image 1440 may be an image in which an opaque background image 1410, a window image 342, and a window image 344 are synthesized. In one embodiment, the desktop image 1440 may be an image synthesized by the complementary color image generation unit 936 and stored in the complementary color image buffer 938. In other embodiments, the desktop image 1440 may be synthesized by the output image generation unit 940.

[0228] According to this embodiment, the desktop image 1420 and the desktop image 1440 having the opaque background image 1410 are displayed in a masking window arranged in front of one or more display windows, whereby the one or more display windows are masked. Also, for example, by processing a plurality of output frames described in relation to FIG. 4, the desktop image 1420 and the desktop image 1440 are displayed in the masking window in a time-division manner. Thereby, the image of the target window is anonymized.

[0229] In the embodiment described in relation to FIG. 15, the image synthesizing unit 1140 controls the display 122 so that the desktop image 1520 and the desktop image 1540 serving as a masking image are displayed in the masking window in a time-division manner. Specifically, the image synthesizing unit 1140 controls the display 122 by outputting an output image signal for controlling the image displayed on the display 122.

[0230] As shown in FIG. 15, in the present embodiment, the desktop image 1520 has a transparent background image 1510. The desktop image 1520 is generated, for example, by the output image generating unit 940. By displaying the desktop image 1520 in a masking window arranged in front of one or more display windows, the original image of the one or more display windows and the original image of the background image are displayed in the desktop display area 212 of the display 122.

[0231] As shown in FIG. 15, in the present embodiment, the desktop image 1540 may be an image in which the transparent background image 1510 and the window image 342 are synthesized. The arrangement of the window image 342 in the desktop image 1540 is determined, for example, so that the area where the window image 322 is arranged in the desktop image 320 as the original image substantially coincides with the area where the window image 342 is arranged in the desktop image 1540 as the masking image. The desktop image 1540 is generated, for example, by the output image generating unit 940 synthesizing the transparent background image 1510 and the window image 342 generated by the output image generating unit 940 and stored in the complementary color image buffer 938.

[0232] According to the present embodiment, the desktop image 1540 is displayed in a masking window arranged in front of one or more display windows, so that the window image 322 to be subjected to the anonymization process is masked. On the other hand, since the background image 1510 of the desktop image 1540 is transparent, the images of the display windows other than the window image 322 are displayed in the desktop display area 212 of the display 122.

[0233] In the embodiment described in relation to FIG. 16, the image composition unit 1140 controls the display 122 such that the active window 220 to be subjected to the anonymization process and the desktop image 1620 arranged in front of at least the masking window 1224 in which the window image 342 is displayed and the masking window 1224 in which at least the window image 342 is displayed and arranged in front of the active window 220 to be subjected to the anonymization process. The desktop image 1640 is displayed in a time-sharing manner. Specifically, the image composition unit 1140 controls the display 122 by outputting an output image signal for controlling the image displayed on the display 122.

[0234] As shown in FIG. 16, the position, shape, and size of the masking window 1224 in which at least the window image 342 is displayed may substantially coincide with the position, shape, and size of the active window 220. The arrangement of the window image 342 in the desktop image 1640 is determined such that, for example, the area where the window image 322 is arranged in the desktop image 320, which is the original image, and the area where the window image 342 is arranged in the desktop image 1640, which is the masking image, substantially coincide.

[0235] In other embodiments, the position, shape, and size of the masking window 1224 may be determined such that when the masking window 1224 is placed in front of the active window 220, the masking window 1224 covers the entire active window 220. In still other embodiments, the masking window 1224 may be a full-screen window that substantially entirely covers the desktop display area 212 of the display 122. In this case, a desktop image 1440 or a desktop image 1540 may be displayed on the masking window 1224.

[0236] The desktop image 1420 may be an example of a concealed image. The desktop image 1440 may be an example of an obstructive image. The desktop image 1520 may be an example of a concealed image. The desktop image 1540 may be an example of an obstructive image. The desktop image 1620 may be an example of a concealed image. The desktop image 1640 may be an example of an obstructive image.

[0237] FIG. 17 schematically shows an example of the internal configuration of the image output management unit 950. In the present embodiment, the image output management unit 950 includes a management information storage unit 1720, a display timing determination unit 1732, an opening / closing timing determination unit 1734, an authentic product determination unit 1740, and a control signal output unit 1750. In the present embodiment, the management information storage unit 1720 has a display pattern storage unit 1722, an image composition condition storage unit 1724, and an authentic product determination condition storage unit 1726.

[0238] In the present embodiment, the management information storage unit 1720 stores various types of information used to control the output of images. The management information storage unit 1720 may store information generated in the anonymization process.

[0239] In this embodiment, the display pattern storage unit 1722 stores information (which may be referred to as a display pattern) for controlling the timing at which at least one of the original image and the masking image is displayed. The display pattern storage unit 1722 may store information for controlling the period of the display pattern. Examples of the display pattern include the configuration of the output frame, the variation pattern of the output frame, and the like. For example, for the purpose of preventing peeping by a third party 34, the components of each output frame may be periodically varied among a plurality of consecutive output frames. For example, the frame period Pf increases and decreases according to a predetermined pattern, and the pattern is repeated at predetermined intervals. In this case, the display pattern storage unit 1722 may store information indicating the variation pattern of the output frames in a frame group composed of a predetermined number of output frames.

[0240] In one embodiment, the display pattern storage unit 1722 stores the identification information of the display pattern in association with the information indicating the configuration of the output frame. Examples of the configuration of the output frame include the correspondence between the input frame and the output frame, the number of sub-frames included in the output frame, the position of the sub-frame in which the original image is displayed in the output frame, the position of the sub-frame in which the masking image is displayed in the output frame, the frame period Pf of the output frame, the length Pso of the sub-frame in which the original image is displayed, the length Psj of the sub-frame in which the masking image is displayed, and the like.

[0241] In another embodiment, the display pattern storage unit 1722 may store the identification information of the display pattern in association with the information indicating the variation pattern of the output frame. Examples of the information indicating the variation pattern of the output frame include the information indicating the number of output frames constituting the frame group, the information indicating the configuration of the output frames that vary in the frame group, the information indicating the increase / decrease pattern of the varying configuration, and the like.

[0242] In the present embodiment, the display pattern storage unit 1722 may store information (which may be referred to as an opening / closing pattern) for controlling the timing of opening and closing the optical shutter 142 of the eyewear type device 140. For each of one or more display patterns, the display pattern storage unit 1722 may store a corresponding opening / closing pattern. Examples of the opening / closing pattern include the opening / closing cycle Pg of the optical shutter 142, the length of the period Pgo during which the optical shutter 142 is open, the length of the period Pgc during which the optical shutter 142 is closed, the position of the period Pgo in the opening / closing cycle Pg of the optical shutter 142, the position of the period Pgc in the opening / closing cycle Pg of the optical shutter 142, and combinations thereof.

[0243] The display pattern storage unit 1722 may store, for each of one or more display patterns, by associating the identification information of the display pattern with the identification information of the corresponding opening / closing pattern. Thus, when a database that stores, by associating the identification information of the opening / closing pattern with the information indicating the opening / closing pattern, is shared between the display terminal 120 and the eyewear type device 140, the optical shutter control unit 865 can control the operation of the optical shutter 142 by transmitting the information indicating the identification information of the opening / closing pattern to the eyewear type device 140.

[0244] For example, in an environment where the eyewear type device 150 does not exist around the eyewear type device 140, the image output management unit 950 distributes the above-described database or update information of the database to one or more eyewear type devices 140. Thereby, the risk of leakage of confidential information is further reduced.

[0245] In the present embodiment, the image composition condition storage unit 1724 stores information indicating the conditions for the image composition unit 1140 to compose images. Examples of the above conditions include conditions for determining the necessity of correction in the image correction unit 1134, conditions for determining the type of correction in the image correction unit 1134, conditions for determining the setting values related to the correction in the image correction unit 1134, and conditions for determining the image composition method in the image composition unit 1140. The above conditions may be information indicating compliance with an instruction from the user 20, or may be information defining a determination criterion.

[0246] As described above, examples of the type of correction in the image correction unit 1134 include correction for reducing the color gradation range in consideration of the display characteristics of the display 122, and the correction described in relation to FIG. 13. The image composition condition storage unit 1724 may store information indicating a criterion, for example, whether or not the display characteristics of the display 122 match predetermined conditions, as a criterion for determining the necessity of correction for reducing the color gradation range.

[0247] In the present embodiment, the genuine product determination condition storage unit 1726 stores genuine product determination conditions. As described above, examples of the genuine product determination conditions include the condition that the device to be determined is registered in the whitelist, the condition that the device is not registered in the blacklist, the condition that the specifications of the device match specific conditions, the condition that information regarding specific items related to the state of the device has been acquired, the condition that information indicating a predetermined character string is included in the control signal transmitted from the device to the display terminal 120, and the condition of whether or not a general regular expression (for example, calculating True / False using the regular expression function of the character string standardly installed in the OS) is satisfied.

[0248] In this embodiment, the display timing determination unit 1732 determines the timing for displaying the original image on the display 122 of the display terminal 120. The display timing determination unit 1732 determines the timing for displaying the masking image on the display 122 of the display terminal 120. The display timing determination unit 1732 may determine to display the original image and the masking image on the display 122 in a time-division manner. The display timing determination unit 1732 may determine to display the original image and the masking image on the display 122 in a time-division manner when no suspicious device has been detected by the genuine product determination unit 1740.

[0249] The display timing determination unit 1732 may also determine the timing to stop displaying the original image. For example, when the genuine product determination unit 1740 detects a suspicious device during the execution of the anonymization process, the display timing determination unit 1732 determines to stop displaying the original image.

[0250] The display timing determination unit 1732 may also determine to change the display timing of the original image. For example, when the genuine product determination unit 1740 detects a suspicious device during the execution of the anonymization process, the display timing determination unit 1732 determines to change the display timing of the original image.

[0251] In this embodiment, the opening / closing timing determination unit 1734 determines the timing for opening and closing the optical shutter 142 of the eyewear-type device 140. The opening / closing timing determination unit 1734 may determine the timing for opening and closing the optical shutter 142 based on the timing for displaying the original image determined by the display timing determination unit 1732.

[0252] In this embodiment, the genuine product determination unit 1740 determines whether any of the one or more peripheral devices detected by the peripheral device management unit 862 includes a suspicious device that does not meet the genuine product determination criteria. As a result, a suspicious device may be detected.

[0253] In the present embodiment, the control signal output unit 1750 outputs various control signals. The control signal output unit 1750 may output a control signal for controlling the operations of each part of the control unit 860, or may output a control signal for controlling the operation of the eyewear type device 140.

[0254] For example, when the display timing determination unit 1732 determines the timing to display the original image, the control signal output unit 1750 may output a control signal indicating the timing to the output image generation unit 940. The control signal output unit 1750 may output a control signal indicating the timing to the output image generation unit 940 at the timing to display the original image. The control signal output unit 1750 may output a control signal indicating the timing to display the original image to the optical shutter control unit 865. The control signal output unit 1750 may output a control signal indicating the timing to the optical shutter control unit 865 at the timing to display the original image or at a timing in the vicinity thereof.

[0255] When the display timing determination unit 1732 determines the timing to display the masking image, the control signal output unit 1750 may output a control signal indicating the timing to the output image generation unit 940. The control signal output unit 1750 may output a control signal indicating the timing to the output image generation unit 940 at the timing to display the masking image. The control signal output unit 1750 may output a control signal indicating the timing to display the masking image to the optical shutter control unit 865. The control signal output unit 1750 may output a control signal indicating the timing to the optical shutter control unit 865 at the timing to display the masking image or at a timing in the vicinity thereof.

[0256] When the display timing determination unit 1732 determines to stop the display of the original image, the control signal output unit 1750 may output a control signal indicating to stop the display of the original image to the output image generation unit 940. The control signal output unit 1750 may output a control signal indicating to stop the display of the original image to the optical shutter control unit 865.

[0257] When the display timing determination unit 1732 determines to change the display timing of the original image, the control signal output unit 1750 may output a control signal indicating the change of the display timing of the original image to the output image generation unit 940. The control signal output unit 1750 may output a control signal indicating the display timing of the original image after the change to the output image generation unit 940. The control signal output unit 1750 may output these control signals to the optical shutter control unit 865.

[0258] When the opening / closing timing determination unit 1734 determines the timing to open / close the optical shutter 142, the control signal output unit 1750 may output a control signal indicating the timing to open / close the optical shutter 142 to the optical shutter control unit 865. The control signal output unit 1750 may output a synchronization signal for synchronizing the switching of the image on the display 122 and the opening / closing of the optical shutter 142 in the eyewear type device 140 to the optical shutter control unit 865.

[0259] When the genuine product determination unit 1740 detects a suspicious device, or when the genuine product determination unit 174 detects a suspicious device during the execution of the anonymization process, the control signal output unit 1750 may output a control signal for requesting a wired connection to the eyewear type device 140, or a control signal for requesting re - pairing to the eyewear type device 140, to the optical shutter control unit 865. When the optical shutter control unit 865 acquires the control signal from the image display control unit 864, it may transmit these control signals to the eyewear type device 140.

[0260] When the eyewear type device 140 has a voice output function, the control signal for requesting a wired connection and the control signal for requesting re - pairing may be signals for causing the eyewear type device 140 to output a voice corresponding to each request. The control signal for requesting a wired connection and the control signal for requesting re - pairing may be signals for opening and closing the optical shutter in a special pattern corresponding to each request in the eyewear type device 140.

[0261] After the above control signal is transmitted to the eyewear type device 140, the communication control unit 866 may release all pairings related to the eyewear type device. In this case, the communication control unit 866 may reject re - pairing of the eyewear type device 150 registered in the blacklist or the eyewear type device 150 not registered in the whitelist. After it is confirmed that the eyewear type device 140 is wired - connected or that re - pairing of the eyewear type device 140 registered in the whitelist has occurred, the optical shutter control unit 865 may transmit to the eyewear type device 140 a control signal indicating stopping the display of the original image, a control signal indicating changing the display timing of the original image, or a control signal including information indicating the changed display timing of the original image. Thereby, leakage of confidential information is suppressed.

[0262] When the genuine product determination unit 174 detects a suspicious device, or when the genuine product determination unit 174 detects a suspicious device during the execution of the anonymization process, the control signal output unit 1750 may output to the communication control unit 866 a control signal for making the radio wave intensity of the transmission radio wave of the communication unit 840 weaker than a predetermined intensity. Thereby, leakage of confidential information is suppressed.

[0263] The display timing determination unit 1732 may be an example of a display control unit. The genuine product determination unit 1740 may be an example of a determination unit.

[0264] An example of the correspondence between an input frame and an output frame is described with reference to FIGS. 18 and 19. The input frame may be an example of an input image signal. The output frame may be an example of an output image signal. FIGS. 18 and 19 schematically show an example of information processing by, for example, the display timing determination unit 1732.

[0265] According to the embodiment described in relation to FIG. 18, the input frame and the output frame correspond one - to - one. In this embodiment, a plurality of input frames including consecutive input frames 1822, input frame 1824, input frame 1826, and input frame 1828 are input to the image display control unit 864.

[0266] For example, the display timing determination unit 1732 determines to generate an output frame 1842 corresponding to the input frame 1822. In the present embodiment, the output frame 1842 includes a sub-frame 1852 and a sub-frame 1862. By the display terminal 120 processing the sub-frame 1852, an original image corresponding to the input frame 1822 is displayed in the desktop display area 212 of the display 122. By the display terminal 120 processing the sub-frame 1862, a masked image corresponding to the input frame 1822 is displayed in the desktop display area 212 of the display 122.

[0267] Similarly, the display timing determination unit 1732 determines to generate an output frame 1844 corresponding to the input frame 1824. In the present embodiment, the output frame 1844 includes a sub-frame 1854 and a sub-frame 1864. The display timing determination unit 1732 determines to generate an output frame 1846 corresponding to the input frame 1826. In the present embodiment, the output frame 1846 includes a sub-frame 1856 and a sub-frame 1866. The display timing determination unit 1732 determines to generate an output frame 1848 corresponding to the input frame 1828. In the present embodiment, the output frame 1848 includes a sub-frame 1858 and a sub-frame 1868.

[0268] The sub-frame 1854 may be a frame for outputting an original image corresponding to the input frame 1824. The sub-frame 1864 may be a frame for outputting a masked image corresponding to the input frame 1824. The sub-frame 1856 may be a frame for outputting an original image corresponding to the input frame 1826. The sub-frame 1866 may be a frame for outputting a masked image corresponding to the input frame 1826. The sub-frame 1858 may be a frame for outputting an original image corresponding to the input frame 1828. The sub-frame 1868 may be a frame for outputting a masked image corresponding to the input frame 1828.

[0269] According to the embodiment described in relation to FIG. 19, the input frame and the output frame do not correspond one-to-one. For example, a part of the input frame is discarded. In this embodiment, a plurality of input frames including consecutive input frames 1822, input frame 1824, input frame 1826, and input frame 1828 are input to the image display control unit 864.

[0270] For example, the display timing determination unit 1732 determines to generate an output frame 1942 corresponding to the input frame 1822. In this embodiment, the output frame 1942 includes a sub-frame 1952 and a sub-frame 1962. By the display terminal 120 processing the sub-frame 1952, the original image corresponding to the input frame 1822 is displayed in the desktop display area 212 of the display 122. By the display terminal 120 processing the sub-frame 1962, the masked image corresponding to the input frame 1822 is displayed in the desktop display area 212 of the display 122.

[0271] According to this embodiment, the respective frame periods of the sub-frame 1952 and the sub-frame 1962 are determined so that the total value of the frame periods of the input frame 1822 and the input frame 1824 matches the total value of the frame periods of the sub-frame 1952 and the sub-frame 1962. Also, it is determined to discard the input frame 1824.

[0272] Similarly, the display timing determination unit 1732 determines to generate an output frame 1946 corresponding to the input frame 1826. In this embodiment, the output frame 1946 includes a sub-frame 1956 and a sub-frame 1966. By the display terminal 120 processing the sub-frame 1956, the original image corresponding to the input frame 1826 is displayed in the desktop display area 212 of the display 122. By the display terminal 120 processing the sub-frame 1966, the masked image corresponding to the input frame 1826 is displayed in the desktop display area 212 of the display 122.

[0273] According to the present embodiment, the respective frame periods of sub-frame 1956 and sub-frame 1966 are determined such that the total value of the frame periods of input frame 1826 and input frame 1828 matches the total value of the frame periods of sub-frame 1956 and sub-frame 1966. Also, it is determined to discard input frame 1828.

[0274] For example, during the execution of the anonymization process, if the change speed of the position, shape, and size of the target window is greater than a predetermined value, according to the embodiment described in relation to FIG. 18, the operation of the target window may become unnatural or the anonymization of the target window may become insufficient. On the other hand, according to the embodiment described in relation to FIG. 19, although the update frequency of the image decreases, compared with the embodiment described in relation to FIG. 18, user 20 can easily operate the target window. Also, compared with the embodiment described in relation to FIG. 18, the target window is sufficiently anonymized.

[0275] When the change speed of the position, shape, and size of the target window is greater than a predetermined value, the embodiment described in relation to FIG. 19 may be adopted. On the other hand, when the change speed of the position, shape, and size of the target window is smaller than a predetermined value, the embodiment described in relation to FIG. 18 may be adopted. The embodiment described in relation to FIG. 18 and the embodiment described in relation to FIG. 19 may be switched according to the change speed of the position, shape, and size of the target window.

[0276] FIG. 20 schematically shows an example of the internal configuration of the eyewear-type device 140. Note that the eyewear-type device 150 may also have the same configuration as the eyewear-type device 140.

[0277] In this embodiment, the eyewear-type device 140 includes an optical shutter 142, a communication unit 2020, a control unit 2030, and a storage unit 2040. In this embodiment, the control unit 2030 includes a state management unit 2032, an opening / closing control unit 2034, and a communication control unit 2036. In this embodiment, the storage unit 2040 includes a device information storage unit 2042 and an opening / closing pattern storage unit 2044.

[0278] In this embodiment, the communication unit 2020 transmits and receives information to and from devices external to the eyewear-type device 140. The communication unit 2020 may transmit and receive information to and from external devices by a wired communication method or may transmit and receive information to and from external devices by a wireless communication method. For example, the communication unit 2020 is configured to be communicable with the display terminal 120. The communication unit 2020 may be configured to be wirelessly communicable with the display terminal 120.

[0279] In this embodiment, the control unit 2030 controls the operation of the eyewear-type device 140. The control unit 2030 may execute the above-described recognition enabling process by controlling the operation of the optical shutter 142.

[0280] In this embodiment, the state management unit 2032 manages the states of the respective parts of the eyewear-type device 140. In one embodiment, the state management unit 2032 manages identification information (which may be referred to as a device ID) for the eyewear-type device 140. The device ID may be identification information unique to the eyewear-type device 140 or may be identification information assigned to the user 20 or the eyewear-type device 140 by the information concealment system 100 or the display terminal 120. In other embodiments, the state management unit 2032 manages the remaining battery level of the eyewear-type device 140. The state management unit 2032 acquires information indicating the remaining amount of a battery (not shown) provided in the eyewear-type device 140 and stores the information in the device information storage unit 2042.

[0281] In this embodiment, the opening / closing control unit 2034 controls various operations related to the optical shutter 142. The opening / closing control unit 2034 may control the opening / closing operation of the optical shutter 142. For example, the opening / closing control unit 2034 acquires the above-described control signal from the image display control unit 864. The opening / closing control unit 2034 controls the opening / closing operation of the optical shutter 142 based on the above control signal.

[0282] In one embodiment, the opening / closing control unit 2034 may control the opening / closing operation of the optical shutter 142 based on the synchronization signal included in the control signal output by the (i) image display control unit 864. For example, when the synchronization signal indicates a first value (for example, 0), the opening / closing control unit 2034 opens the optical shutter 142, and when the synchronization signal indicates a second value (for example, 1), the opening / closing control unit 2034 closes the optical shutter 142.

[0283] In other embodiments, the opening / closing control unit 2034 may control the opening / closing operation of the optical shutter 142 based on (i) the display pattern included in the control signal output by the image display control unit 864 and (ii) the synchronization signal output by the image display control unit 864 or the output signal of the clock arranged in the eyewear type device 140. For example, when the opening / closing control unit 2034 receives a control signal including information indicating the display pattern of the image on the display 122, the opening / closing control unit 2034 stores the information indicating the display pattern in the opening / closing pattern storage unit 2044. The opening / closing control unit 2034 determines the opening / closing pattern of the optical shutter 142 based on the display pattern of the image on the display 122. The opening / closing control unit 2034 stores the information indicating the opening / closing pattern of the optical shutter 142 in the opening / closing pattern storage unit 2044.

[0284] When the opening / closing control unit 2034 receives a synchronization signal from the display terminal 120, the opening / closing control unit 2034 controls the opening / closing operation of the optical shutter 142 so that the display pattern of the image on the display 122 and the opening / closing pattern of the optical shutter 142 are synchronized based on the synchronization signal. The opening / closing control unit 2034 may control the opening / closing operation of the optical shutter 142 so that the display pattern of the image on the display 122 and the opening / closing pattern of the optical shutter 142 are synchronized based on the output signal of the above clock.

[0285] In other embodiments, the opening / closing control unit 2034 may control the opening / closing operation of the optical shutter 142 based on (i) the opening / closing pattern included in the control signal output by the image display control unit 864 and (ii) the synchronization signal output by the image display control unit 864 or the output signal of the clock arranged in the eyewear-type device 140. For example, when the opening / closing control unit 2034 receives a control signal including information indicating the opening / closing pattern of the optical shutter 142, it stores the information indicating the opening / closing pattern in the opening / closing pattern storage unit 2044. The opening / closing control unit 2034 may acquire a database that stores, in association with each other, the identification information of the opening / closing pattern described in relation to FIG. 17 and the information indicating the opening / closing pattern from the display terminal 120 or other information processing device, or update information of the database. The opening / closing control unit 2034 may store the above database or the update information of the database in the opening / closing pattern storage unit 2044.

[0286] When the opening / closing control unit 2034 receives a synchronization signal from the display terminal 120, it controls the opening / closing operation of the optical shutter 142 based on the synchronization signal so that the display pattern of the image on the display 122 and the opening / closing pattern of the optical shutter 142 are synchronized. The opening / closing control unit 2034 may also control the opening / closing operation of the optical shutter 142 based on the output signal of the above clock so that the display pattern of the image on the display 122 and the opening / closing pattern of the optical shutter 142 are synchronized.

[0287] In the present embodiment, the communication control unit 2036 controls the communication unit 2020. It may control the communication between each part of the control unit 2030 and a device external to the eyewear-type device 140. The communication control unit 2036 may output a wireless signal including the identification information of the eyewear-type device 140 from the communication unit 2020 according to the wireless communication method. Examples of the above wireless signal include a probe signal including a device-specific ID such as a MAC address or a Bluetooth (registered trademark) DeviceID (which may be referred to as a UUID).

[0288] In this embodiment, the storage unit 2040 stores various types of information. As described above, the device information storage unit 2042 stores, for example, the identification information of the eyewear type device 140, information indicating the state of each part of the eyewear type device 140, and the like. The opening / closing pattern storage unit 2044 stores, for example, information indicating the display pattern of the image on the display 122, information indicating the opening / closing pattern of the optical shutter 142, and the like.

[0289] FIG. 21 shows an example of a computer 3000 in which a plurality of aspects of the present invention may be embodied in whole or in part. At least a part of the information concealment system 100 may be realized by the computer 3000. For example, the display terminal 120 or a part thereof may be realized by the computer 3000. For example, the eyewear type device 140 or a part thereof may be realized by the computer 3000. For example, the eyewear type device 150 or a part thereof may be realized by the computer 3000.

[0290] The program installed in the computer 3000 can cause the computer 3000 to function as an operation associated with the device according to the embodiment of the present invention or as one or more "parts" of the device, or execute the operation or the one or more "parts", and / or cause the computer 3000 to execute the process according to the embodiment of the present invention or a stage of the process. Such a program may be executed by the CPU 3012 to cause the computer 3000 to execute specific operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

[0291] The computer 3000 according to this embodiment includes a CPU 3012, a RAM 3014, a GPU 3016, and a display device 3018, which are interconnected by a host controller 3010. The computer 3000 also includes input / output units such as a communication interface 3022, a hard disk drive 3024, a DVD-ROM drive 3026, and an IC card drive, which are connected to the host controller 3010 via an input / output controller 3020. The computer also includes legacy input / output units such as a ROM 3030 and a keyboard 3042, which are connected to the input / output controller 3020 via an input / output chip 3040.

[0292] The CPU 3012 operates according to programs stored in the ROM 3030 and the RAM 3014, thereby controlling each unit. The GPU 3016 acquires image data generated by the CPU 3012 in a frame buffer or the like provided in the RAM 3014 or within itself, and causes the image data to be displayed on the display device 3018.

[0293] The communication interface 3022 communicates with other electronic devices via a network. The hard disk drive 3024 stores programs and data used by the CPU 3012 in the computer 3000. The DVD-ROM drive 3026 reads a program or data from the DVD-ROM 3001 and provides the program or data to the hard disk drive 3024 via the RAM 3014. The IC card drive reads programs and data from an IC card and / or writes programs and data to the IC card.

[0294] The ROM 3030 stores therein a boot program or the like to be executed by the computer 3000 upon activation, and / or a program that depends on the hardware of the computer 3000. The input / output chip 3040 may also connect various input / output units to the input / output controller 3020 via a parallel port, a serial port, a keyboard port, a mouse port, or the like.

[0295] The program is provided by a computer-readable storage medium such as a DVD-ROM 3001 or an IC card. The program is read from the computer-readable storage medium, installed in a hard disk drive 3024, a RAM 3014, or a ROM 3030, which are also examples of computer-readable storage media, and executed by the CPU 3012. The information processing described in these programs is read by the computer 3000, resulting in cooperation between the programs and the various types of hardware resources described above. The apparatus or method may be configured by realizing the operation or processing of information according to the use of the computer 3000.

[0296] For example, when communication is executed between the computer 3000 and an external device, the CPU 3012 may execute a communication program loaded in the RAM 3014 and instruct the communication interface 3022 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 3012, the communication interface 3022 reads transmission data stored in a transmission buffer area provided in a recording medium such as the RAM 3014, the hard disk drive 3024, the DVD-ROM 3001, or the IC card, transmits the read transmission data to the network, or writes the received data received from the network to a reception buffer area or the like provided on the recording medium.

[0297] Further, the CPU 3012 may cause all or a necessary part of a file or database stored in an external recording medium such as a hard disk drive 3024, a DVD-ROM drive 3026 (DVD-ROM 3001), an IC card, etc. to be read into the RAM 3014, and may execute various types of processing on the data on the RAM 3014. Next, the CPU 3012 may write back the processed data to the external recording medium.

[0298] Various types of information such as various types of programs, data, tables, and databases may be stored in the recording medium and may undergo information processing. The CPU 3012 may perform various types of processing on the data read from the RAM 3014, including various types of operations, information processing, condition judgment, conditional branch, unconditional branch, information search / replacement, etc. described throughout this disclosure and specified by the instruction sequence of the program, and write back the result to the RAM 3014. Also, the CPU 3012 may search for information in files, databases, etc. within the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 3012 searches for an entry that matches the condition where the attribute value of the first attribute is specified among the plurality of entries, reads the attribute value of the second attribute stored in the entry, and thereby may obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0299] The programs or software modules described above may be stored in a computer-readable storage medium on or near the computer 3000. Also, a recording medium such as a hard disk or RAM provided within a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, whereby the above programs can be provided to the computer 3000 via the network.

[0300] As described above, the present invention has been explained using embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. It is obvious to those skilled in the art that various changes or improvements can be made to the above embodiments. Also, within a technically consistent range, the matters described for a specific embodiment can be applied to other embodiments. It is clear from the description of the claims that such forms with changes or improvements added can also be included in the technical scope of the present invention.

[0301] It should be noted that in the claims, the specification, and the drawings, the execution order of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown is not explicitly stated as "earlier" or "preceding" etc., and can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the specification, and the drawings, even if it is described for convenience using "first," "next," etc., it does not mean that it is essential to be implemented in this order.

[0302] This specification discloses, for example, the following matters. Each step of the control method shown below may be executed by a computer. [Item A-1] A control device for controlling a display device including a display device for displaying an image, a display control unit for controlling the display device, a peripheral device detection unit having at least one of an optical shutter and an imaging element and detecting one or more peripheral devices existing around the display device, a determination unit for determining whether or not a suspicious device, which is a device that does not meet the genuine product determination condition, which is a condition regarding a device for which a process for enabling recognition of confidential information is permitted, is included among the one or more peripheral devices detected by the peripheral device detection unit, comprising the display control unit (a) when the determination unit has not determined that the suspicious device is included among the one or more peripheral devices, configured to be capable of executing a first anonymization process for causing the display device to display an anonymized image for displaying the anonymized information and an obstructive image for obstructing the visibility of at least a part of the anonymized image in a time-division manner, (b) when the determination unit determines that the suspicious device is included in the one or more peripheral devices, configured to be capable of executing a second anonymization process for anonymizing at least a part of the anonymized information in a manner different from the first anonymization process, The second anonymization process includes a process for stopping the display of the anonymized image on the display device, a process for changing the timing at which the anonymized image is displayed on the display device, a process for reducing the window in which the anonymized information is displayed, a process for moving the window behind another window, a process for changing the display position of the window, and a process for changing the color tone, contrast, or brightness of the anonymized image, and includes at least one of a control device. [Item A-2] The process for changing the timing at which the anonymized image is displayed on the display device is a process for changing a pattern for defining the display and non-display of the anonymized image, a process for changing the start period of the pattern, and a process for changing the period of the pattern, and is at least one of the control device according to Item A-1. [Item A-3] The obstructive image is an image for obstructing the visibility of an image that is displayed over substantially the entire screen display area of the display device among the anonymized images, an image for obstructing the visibility of an image that is displayed at substantially the center of the screen display area of the display device among the anonymized images, Of the above-described concealed images, an image for obstructing the visual recognition of an image displayed on a specific scanning line of the display device, and, Of the above-described concealed images, an image for obstructing the visual recognition of an image having a specific color tone or luminance, including at least one of the control device according to item A-1 or item A-2. [Item A-4] further comprising a transmission control unit that controls a transmitter configured to be communicable with at least one of the one or more peripheral devices, wherein the transmission control unit when the display control unit determines to change the timing at which the concealed image is displayed, controls the transmitter so that information indicating the change in the timing at which the concealed image is displayed is transmitted to a legitimate device that has a light shutter and meets the legitimate product determination conditions among the one or more peripheral devices detected by the peripheral device detection unit. the control device according to any one of items A-1 to A-3. [Item A-5] the transmitter is configured to be wirelessly communicable with the legitimate device, wherein the transmission control unit when the display control unit determines to change the timing at which the concealed image is displayed, controls the transmitter so that the radio wave intensity of the radio wave transmitting information indicating the change in the timing at which the concealed image is displayed becomes weaker than a predetermined intensity. the control device according to item A-4. [Item A-6] the image displayed on the display device includes one or more display windows for displaying information presented to the user, the concealed image includes at least an image of an image display area of a display window for displaying the concealed information, the control device according to any one of items A-1 to A-5. [Item A-7] the display control unit A full-screen window that covers substantially the entire screen display area of the display device is arranged in front of the one or more display windows. The concealed image and the obstructive image for each frame are displayed in a time-division manner on the full-screen window. Controlling the display device. The control device according to item A-6. [Item A-8] A concealed image generation unit that generates the concealed image. An obstructive image generation unit that generates the obstructive image. Among the one or more display windows, a target identification unit that identifies a target window to be subjected to the concealment process. A window information acquisition unit that acquires window information indicating the position, shape, and size of the target window identified by the target identification unit. Further comprising: The obstructive image generation unit determines the position, shape, and size at which the obstructive image is to be displayed on the display device based on the position, shape, and size of the target window indicated by the window information acquired by the window information acquisition unit. The control device according to item A-6 or item A-7. [Item A-9] The obstructive image generation unit generates an obstructive window for displaying the obstructive image. The display control unit controls the display device such that (i) when the concealed image is displayed on the display device, the target window is arranged in front of the obstructive window, and (ii) when the obstructive image is displayed on the display device, the obstructive window is arranged in front of the target window. The control device according to item A-8. [Item A-10] A program for causing a computer to function as the control device according to any one of items A-1 to A-9. [Item A-11] A display device that displays an image. The control device according to any one of items A-1 to A-9 that controls the display device. A display device having the same. [Item A-12] A control method for controlling a display device including a display device for displaying an image, a display control step of controlling the display device, a peripheral device detection step of detecting one or more peripheral devices existing around the display device, having at least one of an optical shutter and an imaging device, a determination step of determining whether or not a suspicious device, which is a device that does not meet the genuine product determination condition, which is a condition regarding a device for which a process of enabling recognition of confidential information is permitted, is included among the one or more peripheral devices detected in the peripheral device detection step, having the display control step (a) When it is not determined in the determination step that the suspicious device is included among the one or more peripheral devices, determining to execute a first concealment process of causing the display device to display a confidential image for displaying confidential information and an interference image for interfering with visual recognition of at least a part of the confidential image in a time-division manner, (b) When it is determined in the determination step that the suspicious device is included among the one or more peripheral devices, determining to execute a second concealment process of concealing at least a part of the confidential information in a manner different from the first concealment process, including the second concealment process a process for stopping display of the confidential image on the display device, a process for changing the timing at which the confidential image is displayed on the display device, a process for reducing the window in which the confidential information is displayed, a process for moving the window behind another window, a process for changing the display position of the window, and a process for changing the color tone or luminance of the confidential image, including at least one of a control method.

[0303] This specification discloses, for example, the following matters. Each step of the control method shown below may be executed by a computer. [Item B-1] A control device for controlling a display device including a display device that displays an image, a secret image generation unit that generates a secret image for displaying secret information that is information to be subjected to a concealment process, an interference image generation unit that generates an interference image for obstructing the visual recognition of at least a part of the secret image, a display control unit that controls the display device so that the display device displays the secret image and the interference image in a time-division manner for each frame, A control device comprising: [Item B-2] further comprising a secret area determination unit that determines a secret area, which is an area in the secret image where visual recognition by a third party should be obstructed, based on a change in the color tone of the secret image, wherein the interference image generation unit generates the interference image for obstructing the visual recognition of the secret area, The control device according to Item B-1. [Item B-3] The secret area determination unit includes a position identification unit that identifies the position of the secret information in the secret image based on the degree of change in the color tone of a plurality of pixels constituting the secret image, and a range determination unit that determines the range of each of the one or more secret areas so that at least a part of the secret information is covered by the one or more secret areas, and has The control device according to Item B-2. [Item B-4] The interference image generation unit (i) converts the color tone of at least a part of one or more pixels arranged inside the secret area, and (ii) adjusts the lightness or luminance of at least a part of one or more pixels arranged outside the secret area, to generate the interference image corresponding to the secret image, The control device according to Item B-2 or Item B-3. [Item B-5] The image displayed on the display device includes one or more display windows for displaying information presented to the user, The secret image includes at least an image of an image display area of a display window for displaying the secret information, The control device according to Item B-1. [Item B-6] Among the one or more display windows, a target specifying unit that specifies a target window to be subjected to the anonymization process, A window information acquisition unit that acquires window information indicating the position, shape, and size of the target window specified by the target specifying unit, further comprising, The interference image generation unit determines the position, shape, and size of the interference image to be displayed on the display device based on the position, shape, and size of the target window indicated by the window information acquired by the window information acquisition unit. The control device according to Item B-5. [Item B-7] further comprising a secret area determination unit that determines a secret area, which is an area where visual recognition by a third party should be obstructed, in the image of the image display area based on a change in the color tone of the image of the image display area of the display window, The interference image generation unit generates the interference image for obstructing visual recognition of the secret area. The control device according to Item B-6, [Item B-8] The display control unit, a full-screen window that covers substantially the entire screen display area of the display device is arranged in front of the one or more display windows, controls the display device such that the secret image and the interference image for each frame are displayed on the full-screen window in a time-division manner, The control device according to any one of Items B-5 to B-7. [Item B-9] The display control unit, ​(a) Generate a full-screen window that covers substantially the entire screen display area of the display device, (b) (i) When the secret image is displayed on the display device, the full-screen window having a transparent area or a transmissive area at least in the area where the secret image is displayed is arranged in front of the one or more display windows, and (ii) when the interfering image is displayed on the display device, control the display device such that the full-screen window on which the interfering image is drawn is arranged in front of the one or more display windows. The control device according to any one of items B-5 to B-7. [Item B-10] A pointer detection unit that detects the position of a pointer in the screen display area of the display device, A color information acquisition unit that acquires information regarding a color treated as a transparent color or a transmissive color, further comprising: The interfering image generation unit (i) generates the interfering image in which the color of the pointer area, which is the area including the indicated position of the pointer, is a color treated as the transparent color or the transmissive color. The control device according to item B-1. [Item B-11] A display device that displays an image, The control device according to any one of items B-1 to B-10 that controls the display device, A display device comprising: [Item B-12] A program for causing a computer to function as the control device according to any one of items B-1 to B-10. [Item B-13] A control method for controlling a display device including a display device that displays an image, A secret image generation stage of generating a secret image for displaying secret information that is information to be subjected to a secret processing, An interfering image generation stage of generating an interfering image for obstructing the visual recognition of the secret image, A display control step of controlling the display device so that the display device displays the encrypted image and the interference image in a time-division manner for each frame, A control method having

[0304] This specification discloses, for example, the following matters. Each step of the control method shown below may be executed by a computer. [Item C-1] A control device for controlling a display device including a display device that displays an image including one or more display windows for displaying information presented to a user, An encrypted image generation unit that generates an encrypted image for displaying encrypted information that is information to be encrypted, An interference image generation unit that generates an interference image for obstructing visual recognition of the encrypted image, A display control unit that controls the display device so that the display device displays the encrypted image and the interference image in a time-division manner for each frame, Comprising The encrypted image includes at least an image of an image display area of a display window for displaying the encrypted information, Control device. [Item C-2] Among the one or more display windows, a target identification unit that identifies a target window that is the target of the encryption process, A window information acquisition unit that acquires window information indicating the position, shape, and size of the target window identified by the target identification unit, Further comprising The interference image generation unit determines the position, shape, and size at which the interference image is displayed on the display device based on the position, shape, and size of the target window indicated by the window information acquired by the window information acquisition unit. The control device according to Item C-1. [Item C-3] The interference image generation unit determines the position, shape, and size of the interference image in the screen display area of the display device such that when the interference image is displayed on the display device, the interference area where the interference image is displayed covers the display area where the concealed image is displayed when the concealed image is displayed on the display device. The control device according to item C-2. [Item C-4] The control device further includes an instruction reception unit that receives a change instruction for changing at least one of the position, shape, and size of the target window. The interference image generation unit determines the position, shape, and size of the interference image according to the speed at which at least one of the position, shape, and size of the target window is changed. The control device according to item C-3. [Item C-5] The display control unit A full-screen window that covers substantially the entire screen display area of the display device is arranged in front of the one or more display windows. The concealed image and the interference image for each frame are displayed on the full-screen window in a time-division manner. Controls the display device. The control device according to any one of items C-1 to C-4. [Item C-6] The display control unit (a) Generates the full-screen window. (b) (i) When the concealed image is displayed on the display device, the full-screen window on which the concealed image is drawn is arranged in front of the one or more display windows. (ii) When the interference image is displayed on the display device, the full-screen window on which the interference image is drawn is arranged in front of the one or more display windows, and controls the display device. The control device according to item C-5. [Item C-7] The display control unit (a) Generates the full-screen window. (b)(i) When the above-mentioned concealed image is displayed on the above-mentioned display device, the full-screen window having a transparent area or a transmissive area at least in the area where the above-mentioned concealed image is displayed is arranged in front of the above-mentioned one or more display windows. (ii) When the above-mentioned obstructive image is displayed on the above-mentioned display device, the display device is controlled so that the full-screen window on which the above-mentioned obstructive image is drawn is arranged in front of the above-mentioned one or more display windows. The control device according to item C-5. [Item C-8] The above-mentioned obstructive image generation unit generates an obstructive window for displaying the above-mentioned obstructive image. The above-mentioned display control unit controls the above-mentioned display device such that (i) when the above-mentioned concealed image is displayed on the above-mentioned display device, the target window is arranged in front of the above-mentioned obstructive window, and (ii) when the above-mentioned obstructive image is displayed on the above-mentioned display device, the obstructive window is arranged in front of the above-mentioned target window. The control device according to any one of items C-2 to C-4. [Item C-9] The above-mentioned obstructive image generation unit generates a complementary color image that has a complementary color relationship with the above-mentioned concealed image as the above-mentioned obstructive image. The control device according to any one of items C-1 to C-8. [Item C-10] The above-mentioned obstructive image generation unit generates the complementary color image in consideration of the display characteristics of the above-mentioned display device. The control device according to item C-8. [Item C-11] The above-mentioned concealed image generation unit generates a first concealed image and a second concealed image for displaying the above-mentioned concealed image when switched at a display speed of 15 frames per second or more and displayed on the above-mentioned display device. The above-mentioned obstructive image generation unit generates a first obstructive image and a second obstructive image for displaying the above-mentioned obstructive image when switched at a display speed of 15 frames per second or more and displayed on the above-mentioned display device. The color tone or luminance of the corresponding areas of the above-mentioned first concealed image and the above-mentioned second concealed image is different. The above-described first interference image and the above-described second interference image have different color tones or brightness levels in the corresponding regions. The control device according to item C-8 or item C-9. [Item C-12] A display device that displays an image, The control device according to any one of items C-1 to C-11 that controls the above display device, A display device including the same. [Item C-13] A program for causing a computer to function as the control device according to any one of items C-1 to C-11. [Item C-14] A control method for controlling a display device including a display device that displays an image including one or more display windows for displaying information presented to a user, A confidential image generation step of generating a confidential image for displaying confidential information that is information to be subject to the anonymization process, An interference image generation step of generating an interference image for obstructing the visual recognition of the above confidential image, A display control step of controlling the above display device so that the above display device displays the above confidential image and the above interference image in a time-division manner for each frame, Having, The above confidential image includes at least an image of an image display area of a display window for displaying the above confidential information. Control method.

Explanation of Signs

[0305] 20 User 32 Third Party 34 Third Party 100 Information Anonymization System 120 Display Terminal 122 Display 140 Eyewear-Type Device 142 Optical Shutter 150 Eyewear-Type Device 152 Optical Shutter 174 Genuine Product Determination Unit 200 Desktop Image 212 Desktop display area 214 Task bar display area 220 Active window 222 Title area 224 Working area 226 Cursor 240 Inactive window 242 Title area 244 Working area 260 Pointer 302 Output frame 312 Sub-frame 314 Sub-frame 320 Desktop image 322 Window image 324 Window image 326 Pointer image 340 Desktop image 342 Window image 344 Window image 346 Pointer image 500 Desktop image 524 Composite image 602 Output frame 612 Sub-frame 614 Sub-frame 616 Sub-frame 618 Sub-frame 660 Desktop image 662 Dummy image 680 Desktop image 682 Dummy image 700 Desktop image 724 Composite image 820 Input section 840 Communication section 860 Control section 862 Peripheral device management section 863 Application execution section 864 Image display control section 865 Optical shutter control section 866 Communication control section 922 User input reception unit 924 Pointer positioning unit 926 Window management unit 932 Input image generation unit 934 Input image buffer 936 Complementary color image generation unit 938 Complementary color image buffer 940 Output image generation unit 950 Image output management unit 1000 Data table 1022 Window ID 1024 Information 1032 Process ID 1034 Information 1042 Information 1044 Information 1052 Information 1122 Display window generation unit 1124 Masking window generation unit 1132 Overlay state determination unit 1134 Image correction unit 1140 Image composition unit 1200 Image 1210 Background layer 1220 Window layer 1222 Display window 1224 Masking window 1230 Pointer layer 1302 Output frame 1322 Sub-frame 1324 Sub-frame 1326 Sub-frame 1328 Sub-frame 1342 Desktop image 1344 Desktop image 1346 Desktop image 1348 Desktop image 1362 Region 1364 Region 1366 Region 1368 Region 1410 Background image 1420 Desktop Image 1440 Desktop Image 1510 Background Image 1520 Desktop Image 1540 Desktop Image 1620 Desktop Image 1640 Desktop Image 1720 Management Information Storage Unit 1722 Display Pattern Storage Unit 1724 Image Composition Condition Storage Unit 1726 Genuine Product Judgment Condition Storage Unit 1732 Display Timing Determination Unit 1734 Opening / Closing Timing Determination Unit 1740 Genuine Product Judgment Unit 1750 Control Signal Output Unit 1822 Input Frame 1824 Input Frame 1826 Input Frame 1828 Input Frame 1842 Output Frame 1844 Output Frame 1846 Output Frame 1848 Output Frame 1852 Sub-Frame 1854 Sub-Frame 1856 Sub-Frame 1858 Sub-Frame 1862 Sub-Frame 1864 Sub-Frame 1866 Sub-Frame 1868 Sub-Frame 1942 Output Frame 1946 Output Frame 1952 Sub-Frame 1956 Sub-Frame 1962 Sub-Frame 1966 Sub-Frame 2020 Communication Unit 2030 Control Unit 2032 Status Management Unit 2034 Opening / Closing Control Unit 2036 Communication control unit 2040 Storage unit 2042 Device information storage unit 2044 Open / close pattern storage unit 3000 Computer 3001 DVD-ROM 3010 Host controller 3012 CPU 3014 RAM 3016 GPU 3018 Display device 3020 Input / output controller 3022 Communication interface 3024 Hard disk drive 3026 DVD-ROM drive 3030 ROM 3040 Input / output chip 3042 Keyboard

Claims

1. A control device for controlling a display device including a display device that displays an image, a secret image generation unit that generates a secret image for displaying secret information that is information to be subject to anonymization processing, a secret area determination unit that determines a secret area, which is an area in the secret image where visual recognition by a third party should be obstructed, based on a change in color tone of the secret image, an interference image generation unit that generates an interference image for obstructing visual recognition of the secret area, a display control unit that controls the display device so that the display device displays the secret image and the interference image in a time-division manner for each frame, comprising: The interference image generation unit generates the interference image corresponding to the secret image by (i) converting the color tone of at least a part of one or more pixels arranged inside the secret area and (ii) reducing the brightness or luminance of at least a part of one or more pixels arranged outside the secret area. Control device.

2. The secret area determination unit includes a position identification unit that identifies the position of the secret information in the secret image based on the degree of change in the color tone of a plurality of pixels constituting the secret image, and a range determination unit that determines the range of each of the one or more secret areas so that at least a part of the secret information is covered by the one or more secret areas. The control device according to claim 1.

3. The image displayed on the display device includes one or more display windows for displaying information presented to a user, and the secret image includes at least an image of an image display area of a display window for displaying the secret information. The control device according to claim 1 or claim 2.

4. a target identification unit that identifies a target window, which is a window to be subject to the anonymization processing, among the one or more display windows, and a window information acquisition unit that acquires window information indicating the position, shape, and size of the target window identified by the target identification unit. The control device further comprising: The interference image generation unit determines the position, shape, and size of the interference image to be displayed on the display device based on the position, shape, and size of the target window indicated by the window information acquired by the window information acquisition unit. The control device according to claim 3.

5. ​ ​ Further comprising a concealment area determination unit that determines a concealment area, which is an area in the image of the image display area of the display window where visual recognition by a third party should be obstructed, based on a change in the color tone of the image in the image display area of the display window. The interference image generation unit generates the interference image for obstructing the visual recognition of the concealment area. The control device according to claim 4. **Claim 6** The display control unit A full-screen window covering substantially the entire screen display area of the display device is arranged in front of the one or more display windows. The concealment image and the interference image for each frame are displayed on the full-screen window in a time-division manner. Controls the display device. The control device according to any one of claims 3 to 5. **Claim 7** The display control unit (a) Generates a full-screen window covering substantially the entire screen display area of the display device. (b) (i) When the concealment image is displayed on the display device, the full-screen window having a transparent area or a transmissive area at least in the area where the concealment image is displayed is arranged in front of the one or more display windows. (ii) When the interference image is displayed on the display device, controls the display device so that the full-screen window on which the interference image is drawn is arranged in front of the one or more display windows. The control device according to any one of claims 3 to 5. **Claim 8** A pointer detection unit that detects the position of a pointer in the screen display area of the display device, and A color information acquisition unit that acquires information regarding a color treated as a transparent color or a transmissive color. Further comprising The interference image generation unit (i) Generates the interference image in which the color of a pointer area, which is an area including the indicated position of the pointer, is a color treated as the transparent color or the transmissive color. The control device according to any one of claims 1 to 7. **Claim 9** A program for causing a computer to function as the control device according to any one of claims 1 to 8. **Claim 10** A control method for controlling a display device including a display device that displays an image, the method comprising: A concealment image generation step of generating a concealment image for displaying concealment information, which is information to be subjected to concealment processing; A concealment area determination step of determining a concealment area, which is an area in the concealment image where visual recognition by a third party should be obstructed, based on a change in the color tone of the concealment image. A disturbing image generation step of generating a disturbing image for obstructing the visual recognition of the concealed area; A display control step of controlling the display device so that the display device displays the concealed image and the disturbing image in a time-division manner for each frame; comprising; The disturbing image generation step includes: (i) converting the color tone of at least a part of one or more pixels arranged inside the concealed area, and (ii) reducing the brightness or luminance of at least a part of one or more pixels arranged outside the concealed area, thereby generating the disturbing image corresponding to the concealed image. A control method having the above.

Images