Image processing system and image processing method

Abstract

To provide an image processing system which can suppress leakage of an image of a document to the outside.SOLUTION: An image processing system 10 comprises an internal storage unit 2 and a generation unit 51. An access from an unapproved user to the internal storage unit 2 is prohibited, and the internal storage unit 2 stores an image. The generation unit 51 generates a hash value before correction on the basis of an image before the correction and generates a hash value after the correction on the basis of a corrected image obtained after correcting the image before the correction.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an image processing system and an image processing method. [Background technology]

[0002] Patent Document 1 discloses a tampering detection system that compares a distributed image with a received image to determine whether or not there has been overall tampering. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 11-196392 Summary of the Invention [Problem to be solved by the invention]

[0004] However, Patent Document 1 does not disclose the leakage of document information or measures to prevent such leakage.

[0005] An object of the present invention is to provide an image processing system capable of preventing a document image from being leaked to the outside. [Means for solving the problem]

[0006] The image processing system according to the present invention includes an internal storage unit and a generation unit. The internal storage unit is prohibited from access by unauthorized users and stores images. The generation unit generates a pre-modification hash value based on an unmodified image among the images, and generates a modified hash value based on a modified image obtained by modifying the pre-modification image.

[0007] The image processing method of the present invention includes the steps of storing an image in an internal memory unit to which access from unauthorized users is prohibited, generating a pre-modification hash value based on an unmodified image of the image, and generating a modified hash value based on a modified image obtained by modifying the pre-modification image. Effect of the Invention

[0008] According to the present invention, it is possible to provide an image processing system and an image processing method that can prevent an image of a document from being leaked to the outside. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an image processing system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram illustrating a control device provided in the image processing system according to the embodiment of the present invention. [Diagram 3] FIG. 13 is a diagram showing a hash value generated by a generation unit. [Figure 4] FIG. 13 is a diagram showing hash values ​​generated for each region of an image. [Diagram 5] FIG. 13 is a diagram showing a corrected hash value. [Figure 6] FIG. 2 is an external perspective view of the wearable device. [Figure 7] (a) shows a cylinder-like image generated from an image before modification, and (b) shows a cylinder-like image generated from an image after modification. [Figure 8] 1A is a diagram showing a state in which an uncorrected image is viewed on a wearable device, and FIG. 1B is a diagram showing the uncorrected image displayed on a display unit of the wearable device. [Figure 9] 1A is a diagram showing a state in which a corrected image is viewed on a wearable device, and FIG. 1B is a diagram showing the corrected image displayed on a display unit of the wearable device. [Figure 10] 4 is a flowchart showing an image processing method according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] An image processing system 10 according to an embodiment of the present invention will be described below with reference to the drawings, with reference to Fig. 1 and Fig. 2. In the drawings, the same or corresponding parts are designated by the same reference characters and description thereof will not be repeated.

[0011] Fig. 1 is a diagram showing an image processing system 10 according to an embodiment of the present invention. Fig. 2 is a diagram showing a control device 5 included in the image processing system 10 according to the embodiment of the present invention.

[0012] 1, the image processing system 10 includes a multifunction device 1, an internal storage unit 2, an external storage unit 3, and a wearable device 4. As shown in FIG.

[0013] The multifunction device 1, the internal storage unit 2, the external storage unit 3, the wearable device 4, and the control device 5 are connected to one another via a line L.

[0014] The line L is, for example, a local area network (LAN) or a wide area network (WAN). The line L is not limited to being a wireless line or a wired line.

[0015] An example of the multifunction device 1 is an MFP (Multi Function Printer) that combines the functions of a scanner, a copier, a printer, a copy machine, a facsimile, and others. Hereinafter, the multifunction device 1 may be referred to as a document reading device 1, an image forming device 1, or an image processing device 1.

[0016] An example of the internal storage unit 2 (hereinafter, may be referred to as a terminal 2, a display unit 2, or a display device 2) is a personal computer having a display, a workstation having a display, a tablet, or a smartphone.

[0017] The internal storage unit 2 is prohibited from external access and stores images of documents. The images may be images of documents read by the multifunction device 1. The images may also be images obtained from the external storage unit 3 or other devices.

[0018] In order to prohibit external access to the internal storage unit 2, a firewall must be constructed.

[0019] Firewalls are built using packet filtering, application layer gateways, or both technologies. Packet filtering checks the source and destination IP addresses and port numbers of packets flowing on the network, and blocks them if they do not match permitted patterns. Application layer gateways control traffic based on specific applications.

[0020] The multifunction device 1 may have an internal storage unit 2 .

[0021] The external storage unit 3 manages a hash value, which will be described later. The external storage unit 3 may be a server 30. The external storage unit 3 may be a cloud 31.

[0022] The server 30 is a computer that serves the function of providing information and processing results in response to requests from users.

[0023] The cloud 31 is a service that provides computer resources to users via the Internet. Examples of the cloud 31 include SaaS (Software as a Service), PaaS (Platform as a Service), and IaaS (Infrastructure as a Service).

[0024] The document reading device 1 reads an image written on a document and outputs image data.

[0025] The document reading device 1 includes, for example, a document transport device and an optical device.

[0026] The document transport device has a document tray and transports documents stored in the document tray to the optical device. An example of the document transport device is an ADF (Auto Document Feeder).

[0027] The optical device, for example, includes a light emitting unit, a reflecting mirror, and a light receiving unit. The optical device is provided as a CIS (Contact Image Sensor) type or a CCD (Charge Coupled Devices) type scanner by combining the light emitting unit, the reflecting mirror, and the light receiving unit.

[0028] The image forming apparatus 1 includes a feeding / conveying section, an image creating function section, a fixing section, and a discharging section.

[0029] The feeding and conveying section feeds the sheets stored in the tray, and conveys the sheets to the image creating section, the fixing section, and the discharge section.

[0030] The image forming function unit forms an image on a sheet by using a developer such as toner. When the image forming function unit is an electrophotographic type, the image forming function unit includes a photoconductor, a charging device, an exposure device, a developing device, a transfer device, a cleaning device, and a charge removing device.

[0031] The fixing section applies heat and pressure to the toner image developed on the sheet to fix the toner image to the sheet.

[0032] The discharge section discharges and stores the sheet outside the housing of the image forming function section.

[0033] The control device 5 shown in Fig. 2 controls the multifunction device 1, the internal storage unit 2, the external storage unit 3, or the wearable device 4 shown in Fig. 1. The control device 5 may be included in any of the multifunction device 1, the internal storage unit 2, the external storage unit 3, and the wearable device 4 shown in Fig. 1.

[0034] The control device 5 includes a storage unit 50, a generation unit 51, a detection unit 52, a correction unit 53, a transmission unit 54, an output unit 55, and a conversion unit 56.

[0035] The storage unit 50 includes a storage device and stores data and computer programs. Specifically, the storage unit 50 includes a main storage device such as a semiconductor memory, and an auxiliary storage device such as a semiconductor memory or a hard disk drive. The storage unit 50 may also include removable media.

[0036] When the server 3 or the cloud 4 has a storage unit 50, an example of the storage unit 50 is a cloud storage.

[0037] The generating unit 51, the detecting unit 52, the correcting unit 53, the output unit 55, and the converting unit 56 may be realized by an ASIC (Application Specific Integrated Circuit).

[0038] The transmission unit 54 can be realized by a CODEC (Coder-Decoder).

[0039] Any of the memory unit 50, generation unit 51, detection unit 52, correction unit 53, transmission unit 54, output unit 55, and conversion unit 56 of the control device 5 may be located in any of the multifunction device 1, the internal memory unit 2, the external memory unit 3, or the wearable device 4.

[0040] The image processing performed by the image processing system 10 will be explained step by step below.

[0041] The storage unit 50 stores images of documents.

[0042] For example, an image of a document read by the document reading device 1 is stored in the storage unit 50 as an image of the document before correction.

[0043] The internal storage unit 2, as described above, is prohibited from access by unauthorized users and stores images.

[0044] The generation unit 51 generates a pre-correction hash value based on an image before correction among the images. The generation unit 51 generates a post-correction hash value based on an image after correction obtained by correcting the pre-correction image.

[0045] According to this embodiment, the image itself contained in the document is stored in an internal memory unit 2 to which access by unauthorized users is prohibited, and a hash value of the image before and after modification is generated.

[0046] Since it is difficult to restore the original image from the hash value, even if the pre- or post-modification hash value is leaked, the image contained in the document can be prevented from being leaked to unauthorized users.

[0047] Next, a brief description of hash values ​​will be given with reference to Fig. 3. Fig. 3 is a diagram showing hash values ​​generated by generation unit 51.

[0048] A hash value is a string of a fixed length that is created from a given image. A hash function is applied to the given image to create a hash value. The hash value uniquely identifies the image.

[0049] The same hash value is always generated for the same image. However, even a slight change in the image can generate a significantly different hash value. Hash functions have a one-way property. Therefore, a hash value can be easily generated by applying a hash function to an image. However, it is generally considered difficult to restore the original image from the hash value.

[0050] Examples of hash functions include SHA-2, SHA-3, and BLAKE2.

[0051] SHA-2 includes hash functions that generate hash values ​​with different numbers of bits, such as SHA-224, SHA-256, SHA-384, and SHA-512.

[0052] SHA-3 includes hash functions that generate 224-bit, 256-bit, 384-bit, and 512-bit hash values.

[0053] BLAKE2 is a hash function that generates 256-bit and 512-bit hash values, and is a fast and relatively secure hash function.

[0054] For example, to implement SHA-3, the image processing system 10 selects a SHA-3 library. Since SHA-3 is an open standard, many cryptographic libraries support SHA-3. For example, OpenSSL, LibreSSL, Bouncy Castle, Crypto++, Botan, etc. have been published for SHA-3.

[0055] If a hash value is generated from an image, and then the image is modified and a hash value is generated from the modified image, the hash values ​​before and after the modification will be completely different.

[0056] Examples of the "document" in this embodiment include receipts, reports, confidential documents, etc. The document reading device 1 may read character strings such as the name and amount written on a receipt to obtain an image.

[0057] 3 and the following embodiments, for ease of explanation, an example is shown in which a document containing a simple character string is read and an image is acquired by the document reading device 1. The document reading device 1 performs image recognition on the image of "Hello" written in the document and converts it into an image.

[0058] The generation unit 51 applies a hash function to the image to generate a hash value.

[0059] 3, the generation unit 51 calculates a hash value of "Hello" using a hash function SHA-3-256. The hash value of "Hello" is the hash value 1 of the image before it is modified.

[0060] Now consider the case where the text "Hello" is modified to "Hello!".

[0061] The correction unit 53 corrects the image based on the user's instructions.

[0062] The image corrected by the corrector 53 is stored in the memory 50 as the corrected image.

[0063] The generating unit 51 generates a corrected hash value based on the corrected image.

[0064] As shown in FIG. 3, the generation unit 51 generates a hash value 2 of "Hello!" using a hash function SHA-3-256, for example.

[0065] In this way, simply by changing the string "Hello" to "Hello!", hash value 1 and hash value 2 will become completely different values.

[0066] It is also generally considered difficult to recover the string "Hello" from hash value 1. It is also generally considered difficult to recover the string "Hello!" from hash value 2.

[0067] The detection unit 52 detects that the image has been modified based on a comparison between the image before and after modification.

[0068] Each time it is detected that an image written in a document has been modified, the generating unit 51 may generate a new modified hash value based on the modified image.

[0069] As shown in FIG. 3, the storage unit 50 stores the pre-correction hash value and the corrected hash value in a table.

[0070] As shown in FIG. 3, the storage unit 50 updates the pre-correction hash value and the corrected hash value stored in the table.

[0071] According to this embodiment, the fact that an image written in a document has been updated is suitably reflected in the revised hash value.

[0072] The detection unit 52 may detect that the character string "Hello" has been modified to the character string "Hello!" by comparing the hash value 1 with the hash value 2.

[0073] As shown in FIG. 3, the storage unit 50 stores the pre-correction hash value and the corrected hash value in a table.

[0074] According to this embodiment, a hash value is generated based on a document image, and a further hash value is generated every time the document image is modified. Therefore, even if the document data is leaked, the document data is difficult to decipher. In addition, a user can check whether an image has been modified by comparing the hash value after modification with the hash value before modification, so that the user can easily recognize that the image has been modified compared to when comparing images.

[0075] The generating unit 51 may obtain the pre-correction image or the post-correction image from the storage unit 50 at predetermined time intervals.

[0076] The generating unit 51 may generate a pre-modification hash value based on the pre-modification image at every predetermined time interval.

[0077] The generating unit 51 may generate a corrected hash value based on the corrected image at every predetermined time interval.

[0078] According to this embodiment, a hash value is generated from an image of a document at predetermined time intervals.

[0079] The transmission unit 54 transmits the pre-correction hash value and the corrected hash value to the external storage unit 3.

[0080] The external storage unit 3 can be accessed by unauthorized users, and receives and stores the pre-correction hash value and the post-correction hash value from the generation unit 51 or the internal storage unit 2.

[0081] According to this embodiment, the user can externally observe the pre-correction hash value and the corrected hash value stored in the external storage unit 3. According to this embodiment, the user can easily observe from outside that the document has been corrected, while preventing the leaking of the document image itself.

[0082] The external storage unit 3 is a server 30 or a cloud 31 .

[0083] According to this embodiment, as described below, a user can externally observe the pre-correction hash value and the corrected hash value stored in the external storage unit 3 (server 30, cloud 31).

[0084] The external storage unit 3 may include a receiving device and a storage device, not shown. The receiving device receives the pre-correction hash value and the post-correction hash value from the generating unit 51 or the internal storage unit 2. The storage device stores the pre-correction hash value and the post-correction hash value.

[0085] In order to allow the external storage unit 3 to be accessed from the outside, it is necessary to specify the protocols, port numbers, and source IP addresses of accesses that are permitted by the firewall.

[0086] The output unit 55 outputs the pre-correction hash value or the corrected hash value from the external storage unit 3 based on a user instruction.

[0087] According to this embodiment, when a document image is stored in the internal storage unit 2, even if the document image is leaked, the image is difficult to decipher. Furthermore, regardless of the location of the external storage unit 3, the user can observe the hash value before and after correction from the external storage unit 3, and can check whether the document image stored in the internal storage unit 2 has been corrected.

[0088] Next, as shown in Fig. 4 and Fig. 5, the image includes coordinate information. The generation unit 51 divides the image into a plurality of regions based on the coordinate information. The generation unit 51 may generate a pre-correction hash value and a post-correction hash value for each region. The generation unit 51 may combine the pre-correction hash value or the post-correction hash value for each region with the coordinate information and store the combined values ​​in the storage unit 50.

[0089] According to this embodiment, a hash value is generated for each area of ​​a document, so that it is possible to easily check which area has been modified.

[0090] Next, consider the case where the document contains an image of "Hello!", as shown in Figure 4.

[0091] As described above, the document containing the image of "Hello!" is read by the document reading device 1 and stored in the storage unit 50 as an image.

[0092] The generating unit 51 may divide the image of the document into five regions. That is, the generating unit 51 may divide the image of the document into a region where the pre-correction image "H" is written, a region where the pre-correction image "e" is written, a region where the pre-correction image "l" is written, a region where the pre-correction image "l" is written, a region where the pre-correction image "o" is written, and a region where the pre-correction image "!" is written.

[0093] The area in which the pre-correction image "H" is written is defined, as an example, by at least coordinate information of coordinates (x1, y1) and coordinates (x2, y2) (different from coordinates (x1, y1)) not shown.

[0094] The generating unit 51 combines the pre-correction image “H” with the coordinate information of the coordinates (x1, y1) and the coordinates (x2, y2), and stores the combined image in the storage unit 50.

[0095] The area in which the pre-correction image "e" is written is defined, as an example, by at least coordinate information of coordinates (x3, y3) and coordinates (x4, y4) (different from coordinates (x3, y3)) not shown.

[0096] The generating unit 51 combines the pre-correction image “e” with the coordinate information of the coordinates (x3, y3) and the coordinates (x4, y4), and stores the combined image in the storage unit 50.

[0097] The area in which the pre-correction image "l" is written is defined, as an example, by at least coordinate information of coordinates (x5, y5) and coordinates (x6, y6) (different from coordinates (x5, y5)) not shown.

[0098] The generating unit 51 combines the pre-correction image “l” with the coordinate information of the coordinates (x5, y5) and the coordinates (x6, y6), and stores the combined image in the storage unit 50.

[0099] The area in which the pre-correction image "l" is written is defined, as an example, by at least coordinate information of coordinates (x7, y7) and coordinates (x8, y8) (not shown) (different from coordinates (x7, y7)).

[0100] The generating unit 51 combines the pre-correction image “l” with the coordinate information of the coordinates (x7, y7) and the coordinates (x8, y8), and stores the combined image in the storage unit 50.

[0101] The area in which the pre-correction image "o" is written is defined, as an example, by at least coordinate information of coordinates (x9, y9) and coordinates (x10, y10) (different from coordinates (x9, y9)) not shown.

[0102] The generating unit 51 combines the pre-correction image “o” with the coordinate information of the coordinates (x9, y9) and the coordinates (x10, y10), and stores the combined image in the storage unit 50.

[0103] The area in which the pre-correction image "!" is written is defined, as an example, by at least coordinate information of coordinates (x11, y11) and coordinates (x12, y12) (not shown) (different from coordinates (x11, y11)).

[0104] The generating unit 51 combines the pre-correction image “!” with the coordinate information of the coordinates (x11, y11) and the coordinates (x12, y12), and stores the combined image in the storage unit 50.

[0105] As described below, the post-correction images shown in FIG. 5 include images that have not been corrected from the pre-correction images shown in FIG. 4, but for ease of explanation, each image shown in FIG. 4 will be described as a pre-correction image.

[0106] Next, the generation unit 51 generates a hash value 3 for the pre-correction image "H" using, as an example, a hash function SHA-3-256.

[0107] The generation unit 51 generates a hash value 4 by using the hash function SHA-3-256 on the pre-correction image "e".

[0108] The generation unit 51 generates a hash value 5 by using the hash function SHA-3-256 on the pre-correction image "l" of the two areas.

[0109] The generation unit 51 generates a hash value 6 by using the hash function SHA-3-256 on the pre-correction image "o".

[0110] The generation unit 51 generates a hash value 7 by using the hash function SHA-3-256 on the pre-correction image "!".

[0111] The generating unit 51 combines the hash value based on each pre-correction image with the coordinate information and stores the combined data in the storage unit 50.

[0112] Next, the correction unit 53 corrects (alter) the image based on the user's instructions.

[0113] Consider the case where an image written on a document stored in the storage unit 50 is corrected to a post-correction image "Hello?".

[0114] As shown in FIG. 5, the generation unit 51 may divide the document image into five regions, similar to the generation of the hash value for the pre-modification image.

[0115] The area in which the post-correction image "?" is written is defined by, for example, at least coordinate information of coordinates (x13, y13) and coordinates (x14, y14), not shown. The coordinates of the area in which the post-correction image "?" is written may be the same as the coordinates (x11, y11) and coordinates (x12, y12) of the area in which the pre-correction image "!" is written.

[0116] The generating unit 51 combines the corrected image “?” with the coordinate information of the coordinates (x13, y13) and the coordinates (x14, y14), and stores the combined image in the storage unit 50.

[0117] The area where the post-correction image "H" is written, the area where the post-correction image "e" is written, the area where the post-correction image "l" is written, the area where the post-correction image "l" is written, and the area where the post-correction image "o" is written have not been changed from the pre-correction image.

[0118] Therefore, the hash values ​​(hash value 3 to hash value 6) generated based on each post-correction image shown in FIG. 5 are the same as the hash values ​​generated based on each pre-correction image.

[0119] The generation unit 51 generates a hash value 8 by using the hash function SHA-3-256 on the corrected image "?".

[0120] That is, the hash value 8 based on the post-correction image "?" is different from the hash value 7 based on the pre-correction image "!".

[0121] The generating unit 51 combines the hash value 8 based on the corrected image “?” with the coordinate information of the coordinates (x13, y13) and the coordinates (x14, y14), and stores the combined data in the storage unit 50.

[0122] According to this embodiment, the user can more easily recognize that the image has been modified (tampered with) by comparing hash value 7 and hash value 8 generated for each area.

[0123] Next, with reference to FIG. 6, a specific example will be described in which a VR system is used to visually confirm a correction portion of a document through a VR (Virtual Reality) head mounted display (wearable device 4).

[0124] 6 is a perspective view of the exterior of the wearable device 4. The wearable device 4 is a head-mounted type device that is worn on the user's head.

[0125] The wearable device 45 has a front part 40, a side part 41 (side part 41a), and a side part 41 (side part 41b). When worn, the front part 40 is placed in front of the user so as to cover both of the user's eyes.

[0126] The side portion 41a is connected to one end of the front portion 40, and the side portion 41b is connected to the other end of the front portion 40. When worn, the side portion 41a and the side portion 41b are supported by the user's ears and stabilize the wearable device 4. The side portion 41a and the side portion 41b may be configured to be connected at the back of the user's head when worn.

[0127] The front surface unit 40 has a display unit 42 (display unit 42a) and a display unit 42 (display unit 42b) on a surface that faces the user's eyes when worn. The display unit 42a is disposed at a position that faces the user's right eye when worn, and the display unit 42b is disposed at a position that faces the user's left eye when worn. The display unit 42a displays an image for the right eye, and the display unit 42b displays an image for the left eye.

[0128] In this way, by including display unit 42a and display unit 42b that display images corresponding to each eye of the user when worn, wearable device 4 can realize three-dimensional display utilizing the parallax of both eyes.

[0129] The display unit 42a and the display unit 42b are a pair of semi-transmissive displays, but are not limited thereto. For example, the display unit 42a and the display unit 42b may be provided with lenses such as glasses lenses, sunglasses lenses, and ultraviolet ray cut lenses, and the display unit 42a and the display unit 42b may be provided separately from the lenses. The display unit 42a and the display unit 42b may be configured by a single display device as long as they can independently provide different images to the right eye and the left eye of the user.

[0130] The front surface unit 40 includes an imaging unit 43 and an imaging unit 44 on a surface opposite to the surface on which the display units 42a and 42b are provided. The imaging unit 43 is disposed near one end of the front surface unit 40 (the right eye side when worn), and the imaging unit 44 is disposed near the other end of the front surface unit 40 (the left eye side when worn). The imaging unit 43 acquires an image in a range corresponding to the field of view of the user's right eye. The imaging unit 44 acquires an image in a range corresponding to the field of view of the user's left eye. The field of view means, for example, the field of view when the user is looking straight ahead.

[0131] The wearable device 4 has a function of allowing the user to visually recognize various information in the foreground that the user is viewing. The foreground means the scenery in front of the user. When the display units 42a and 42b are not displaying anything, the wearable device 4 allows the user to visually recognize the foreground through the display units 42a and 42b.

[0132] When the display units 42a and 42b are displaying, the wearable device 4 allows the user to visually recognize the foreground through the display units 42a and 42b and the display contents of the display units 42a and 42b. The wearable device 4 may display three-dimensional information on the display units 42a and 42b.

[0133] 6 shows an example in which the wearable device 4 has a shape like glasses, but the shape of the wearable device 4 is not limited to this. For example, the wearable device 4 may have a shape of goggles. The wearable device 4 may be configured to be connected to an external device such as an information processing device or a battery device by wire or wirelessly.

[0134] As shown in FIG. 2, the conversion unit 56 converts the unmodified hash value into first pixel information.

[0135] The conversion unit 56 converts the corrected hash value into second pixel information.

[0136] The conversion unit 56 adds depth information to each of the first pixel information and the second pixel information.

[0137] The conversion unit 56 generates a stereo image based on the first pixel information and the second pixel information.

[0138] According to this embodiment, pixel information obtained by converting an image of a document into a hash value can be made observable on the wearable device 4.

[0139] The wearable device 4 is capable of projecting a stereo image, which will be described later.

[0140] According to this embodiment, the user can observe through the wearable device 4 an image of the document before correction and an image of the document after correction, in comparison.

[0141] Specifically, the conversion unit 56 divides the pre-correction hash value into 8-bit chunks, interprets each 8-bit numeric value as an RGB value, and converts it into the first pixel information.

[0142] The conversion unit 56 similarly converts the corrected hash value into second pixel information.

[0143] The conversion unit 56 arranges the first pixel information and the second pixel information in random positions, and adds depth information representing the distance from the imaging unit 43 and the imaging unit 44 to the 256 x 256 pixels to generate a random image with no reproducibility.

[0144] The depth information refers to the width of the range in which the first pixel information and the second pixel information can be recognized without being out of focus when the imaging unit 43 and the imaging unit 44 focus on the first pixel information and the second pixel information.

[0145] The imaging unit 43 and the imaging unit 44 each capture a random image.

[0146] The conversion unit 56 converts the random images captured by the imaging units 43 and 44 into stereo images based on the depth information.

[0147] That is, the stereo image is generated by superimposing a random image captured by the imaging section 43 and a random image captured by the imaging section 44.

[0148] The conversion unit 56 causes the stereo image to be displayed on the display unit 42a and the display unit 42b.

[0149] The stereo images displayed on the display units 42a and 42b are distorted and transformed based on the depth information, so that the user can recognize the stereo images as 3D images.

[0150] One example of a VR system is the lens method. In the lens method, the VR system uses a wide-angle lens with a wide field of view, such as a fisheye lens, to focus light on the periphery of the lens and expand the image. The center of the lens has a narrower field of view, which compensates for image distortion from the center of the lens.

[0151] In the VR system, a fisheye lens is used as a camera lens to generate images from different perspectives. The camera rotates 360 degrees to capture images from different angles. The images captured by the fisheye lens at each angle are corrected by software and merged into two flat images. The flat images are then superimposed to generate a single three-dimensional image.

[0152] Next, a specific example of a document viewed on the wearable device 4 will be described with reference to Figs. 7(a) and (b) and Figs. 8(a) and (b) in addition to Fig. 6.

[0153] Of the stereo images generated by the converter 56, the image for the left eye is displayed on the display unit 42a of the wearable device 4.

[0154] Of the stereo images generated by the converter 56, the image for the right eye is displayed on the display unit 42b of the wearable device 4.

[0155] Next, with reference to FIGS. 7(a) and (b), a state in which a figure created based on the pre-correction image shown in FIG. 4 and the post-correction image shown in FIG. 5 is viewed on the wearable device 4 will be described.

[0156] FIG. 7(a) shows, as an example, a state in which an image of a cylindrical figure 100 created based on the pre-correction image shown in FIG.

[0157] FIG. 7(b) shows, as an example, a state in which an image in which a part of the cylinder-like figure 100 created based on the corrected image shown in FIG. 4 has been changed is viewed on the wearable device 4.

[0158] 7(a) and (b) mainly show how a user with an unauthenticated ID and password views an image of a cylinder-like figure 100 created on the wearable device 4 based on a pre-correction image.

[0159] 7(a) and (b) show a state in which a user before his / her ID and password are authenticated views an image of a cylinder-like figure 100 created on the basis of an uncorrected image by the wearable device 4. FIG.

[0160] Specifically, the pre-correction image "Hello!" shown in FIG. 4 is divided into an image "H", an image "e", an image "l", an image "l", an image "o", and an image "!".

[0161] The hash value obtained by converting image “H” using a hash function is hash value 3.

[0162] The hash value obtained by converting image “e” using a hash function is hash value 4.

[0163] The hash value obtained by converting image “l” using a hash function is hash value 5.

[0164] The hash value obtained by converting the image “o” using a hash function is hash value 6.

[0165] The hash value of the image "!" converted using a hash function is hash value 7.

[0166] Hash value 3 to hash value 7 are each 64-bit hexadecimal data.

[0167] The generating unit 51 (FIG. 2) converts each bit of the 64-bit data into a decimal number. The generating unit 51 calculates the decimal value of each bit. The generating unit 51 calculates the sum of the 64-bit decimal values.

[0168] The generating unit 51 generates an image of the cylinder-like figure 100 divided into 64 sectors according to the decimal value of each bit relative to the total value of the 64-bit decimal value.

[0169] 7(a), for ease of explanation, 64 bits are divided into 8 groups of 8 bits each. The generating unit 51 generates an image of the cylinder-like figure 100 divided into 8 groups of sectors (sector 101, sector 102, sector 103, sector 104, sector 105, sector 106, sector 107, and sector 108) based on the total value of the decimal values ​​of each group relative to the total value of the decimal values ​​of the 64 bits.

[0170] The conversion unit 56 (FIG. 2) converts the image of the cylinder-like figure 100 into a 3D stereo image of the cylinder-like figure 100, using the method described above.

[0171] 7(a) is an image of the cylinder-like figure 100 based on the pre-correction image. Therefore, the conversion unit 56 generates sectors (sector 101, sector 102, sector 103, sector 104, sector 105, sector 106, sector 107, and sector 108) that divide the cylinder-like figure 100 in the same manner.

[0172] The transmitting unit (FIG. 2) transmits to the wearable device 4 image data of a cylindrical figure 100 based on the pre-correction image shown in FIG.

[0173] A user can wear the wearable device 4 shown in FIG. 6 on his / her head and view an image of a cylindrical figure 100 based on the pre-correction image displayed on the display unit 42.

[0174] The transmitting unit (FIG. 2) may transmit image data of the cylindrical figure 100 based on the pre-correction image shown in FIG. 7(a) to a display device (not shown) other than the wearable device 4.

[0175] A user may wear the wearable device 4 shown in FIG. 6 on his / her head and view an image of a cylindrical figure 100 based on the pre-correction image displayed on a display device (not shown) other than the wearable device 4.

[0176] Next, with reference to FIG. 7(b), a state in which a figure created based on the corrected image shown in FIG. 5 is viewed on the wearable device 4 will be described.

[0177] Specifically, the generating unit 51 (FIG. 2) divides the corrected image "Hello?" shown in FIG. 5 into an image "H", an image "e", an image "l", an image "l", an image "o", and an image "?".

[0178] The hash value obtained by converting image “H” using a hash function is hash value 3.

[0179] The hash value obtained by converting image “e” using a hash function is hash value 4.

[0180] The hash value obtained by converting image “l” using a hash function is hash value 5.

[0181] The hash value obtained by converting the image “o” using a hash function is hash value 6.

[0182] The hash value obtained by converting the image "?" using a hash function is hash value 8.

[0183] The generating unit 51 and the converting unit 56 convert the corrected image into a 3D image in the same manner as the conversion of the pre-corrected image into a 3D image described with reference to FIG. 7(a).

[0184] The image shown in Fig. 7(b) is an image of the cylinder-like figure 100 based on the corrected image. Therefore, the conversion unit 56 generates sectors (sector 101, sector 102, sector 103, sector 104, sector 105, sector 106, and sector 107) that divide the cylinder-like figure 100 in the same manner.

[0185] The conversion unit 56 generates only the sector 109 in a manner that makes it appear as if it is floating three-dimensionally, for example.

[0186] The transmitting unit (FIG. 2) transmits to the wearable device 4 image data of the cylindrical figure 100 based on the corrected image shown in FIG. 7(b).

[0187] A user can wear the wearable device 4 shown in FIG. 6 on his / her head and view an image of a cylindrical figure 100 based on the before-and-after images displayed on the display unit 42.

[0188] The transmitting unit (FIG. 2) may transmit image data of the cylinder-like figure 100 based on the corrected image shown in FIG. 7(b) to a display device (not shown) other than the wearable device 4.

[0189] A user may wear the wearable device 4 shown in FIG. 6 on his / her head and view an image of a cylindrical figure 100 based on the corrected image displayed on a display device (not shown) other than the wearable device 4.

[0190] Next, the generating unit 51 adds a barcode image or a QR code image (QR: Quick Response) (registered trademark) converted from a URL (Uniform Resource Locator) that can access the internal storage unit 2 or the external storage unit 3 to the image before or after correction. The generating unit 51 generates a duplicate image to which the barcode image or the QR code image has been added.

[0191] The output unit 55 outputs the duplicated image to which the barcode image or the QR code image has been added.

[0192] According to this embodiment, a duplicate image to which a barcode image or a QR code image has been added is output to the multifunction device 1. The multifunction device 1 can print the duplicate image to which a barcode image or a QR code image has been added on a sheet.

[0193] According to this embodiment, the wearable device 4 can display a duplicate image to which a barcode image or a QR code image is added. The control device 5 can access the internal storage unit 2 or the external storage unit 3 based on the barcode image or the QR code image.

[0194] According to this embodiment, the wearable device 4 can display the pre-correction hash value or the corrected hash value stored in the internal storage unit 2 or the external storage unit 3.

[0195] According to this embodiment, the wearable device 4 can display a graphic image converted from a pre-modification image or a post-modification image.

[0196] A barcode (registered trademark) is an identifier that represents numbers and characters by the thickness of striped lines. Generator 51 converts numbers, characters, symbols, and other information of a URL into a one-dimensional code according to certain rules to generate a barcode.

[0197] QR Code (registered trademark) is a two-dimensional matrix code. Generation unit 51 converts numbers, letters, symbols, and other information of a URL into a two-dimensional code according to certain rules to generate a QR code.

[0198] A URL is a unique address that identifies the location of a resource (such as a web page, image, video, etc.) on the Internet.

[0199] The generating unit 51 generates the URL as a QR code.

[0200] The generation unit 51 generates a duplicate image to which the QR code image is added.

[0201] The control device 5 can access the internal storage unit 2 or the external storage unit 3 in which the duplicated image is stored, based on the QR code added to the duplicated image.

[0202] The wearable device 4 can display the pre-correction hash value or the corrected hash value stored in the internal storage unit 2 or the external storage unit 3.

[0203] The wearable device 4 can display a graphical image converted from the before-modification image or the after-modification image.

[0204] Next, the generating unit 51 may generate a duplicate image by masking the corrected image with a marker image (not shown).

[0205] The output unit 55 outputs the duplicated image masked with the marker image.

[0206] According to this embodiment, a duplicate image masked with a marker image is output to the multifunction device 1. The multifunction device 1 can print the duplicate image masked with a marker image on a sheet.

[0207] That is, even if a part of the image is tampered with, the tampered part of the image is masked with the marker image. Since the duplicate image masked with the marker image is printed by the multifunction device 1, leakage of confidential information can be suppressed.

[0208] According to this embodiment, the wearable device 4 can display a duplicate image masked with a marker image.

[0209] According to this embodiment, the wearable device 4 can display a graphic image converted from a corrected image masked with a marker image, thereby making it possible to prevent leakage of confidential information.

[0210] Next, referring to Figures 8(a) and (b) and Figures 9(a) and (b), we will explain how a user views images obtained by converting the pre-correction image shown in Figure 4 and the post-correction image shown in Figure 5 into 3D images on the wearable device 4.

[0211] 8(a) and (b) mainly show how a user whose ID and password have been authenticated views an image of a cylinder-like figure 100 created on a wearable device 4 based on a pre-correction image or a post-correction image.

[0212] That is, if the user's ID and password are authenticated, the conversion unit 56 (FIG. 2) may directly convert the pre-correction images shown in FIG. 4 into 3D stereo images without using a hash value. The conversion unit 56 converts the pre-correction images into 3D stereo images in the same manner as that described with reference to FIG. 7.

[0213] 8(a) is a diagram showing an aspect in which a user is viewing, on the wearable device 4, a pre-correction image displayed on a display device other than the wearable device 4. The pre-correction image may be transmitted directly to the wearable device 4, or the user may be able to view the pre-correction image reproduced inside the wearable device 4.

[0214] FIG. 8(b) is a diagram showing a 3D stereo image displayed on the display unit 42 when the uncorrected image is viewed on the wearable device 4.

[0215] When the pre-correction image is viewed on the wearable device 4 as shown in FIG. 8(a), an image of "Hello!" is displayed on the display unit 42 of the wearable device 4 as shown in FIG. 8(b).

[0216] The conversion unit 56 converts the pre-conversion images "H", "e", "l", "l", "o", and "!" into 3D stereo images so that they are all displayed in the same manner.

[0217] In other words, the conversion unit 56 converts the pre-conversion images "H", "e", "l", "l", "o", and "!" into 3D stereo images so that none of them are displayed floating up.

[0218] As shown in Fig. 8(b), the user can see the pre-correction image displayed on the display unit 42 of the wearable device 4. The pre-correction image is displayed on the display unit 42 in a manner that does not float.

[0219] According to this embodiment, the user can use the wearable device 4 to recognize that the image has not been tampered with.

[0220] Next, FIG. 9(a) shows a state in which a user whose ID and password have been authenticated views, on a wearable device 4, an image of a corrected image or a cylinder-like figure 100 created based on the corrected image.

[0221] If the user's ID and password are authenticated, the conversion unit 56 may directly convert the corrected image shown in Fig. 5 into a 3D stereo image without using a hash value. The conversion unit 56 converts the corrected image into a 3D stereo image in the same manner as that described with reference to Fig. 7.

[0222] As shown in Figure 9(a), when a user views the corrected image on wearable device 4, as shown in Figure 9(b), only the image of "?" that has been tampered with from the "!" in the image of "Hello?" is displayed on display unit 42 of wearable device 4.

[0223] The user can intuitively understand the altered parts of the original image by viewing the image in the 3D virtual space through the wearable device 4. Also, the user can intuitively understand that the original image has been changed by seeing the change in the image.

[0224] Next, an image processing method according to this embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing an image processing method according to the embodiment of the present invention.

[0225] As shown in FIG. 10, the flowchart includes steps S10 to S17.

[0226] 10, the storage unit 50 stores the document. The process proceeds to step S11.

[0227] In step S11, the generation unit 51 generates a hash value before modification based on the image before modification recorded in the document. The process proceeds to step S12.

[0228] In step S12, the storage unit 50 stores the pre-correction hash value. The process proceeds to step S13.

[0229] In step S13, the correction unit 53 corrects the image based on the user's instructions, and the process proceeds to step S14.

[0230] In step S14, the generation unit 51 generates a corrected hash value based on the corrected image. The process proceeds to step S15.

[0231] In step S15, the storage unit 50 stores the corrected hash value in the table. The process proceeds to step S16.

[0232] In step S16, the transmission unit 54 transmits the uncorrected hash value and the corrected hash value to the external storage unit 3. The process proceeds to step S17.

[0233] In step S17, the output unit 55 outputs the pre-correction hash value or the corrected hash value from the external storage unit 3 based on an instruction from the user, and then the process ends.

[0234] The embodiments of the invention have been described above with reference to the drawings. However, the present invention is not limited to the above embodiments, and can be implemented in various forms without departing from the spirit of the present invention. The drawings are mainly schematic illustrations of the respective components for ease of understanding, and the number of each component shown may differ from the actual number due to the convenience of drawing. Furthermore, the components shown in the above embodiments are merely examples, and are not particularly limited, and various modifications are possible without substantially departing from the effects of the present invention. [Industrial Applicability]

[0235] The present invention can be used in the field of image processing systems. [Explanation of symbols]

[0236] 10 Image Processing System 1 Multifunction device 2 Internal storage unit (terminal) 3 External memory unit 30 Servers 31 Cloud 4. Wearable Devices 40 Front part 41 Side part 41a Side part 41b Side part 42 Display section 42a Display section 42b Display section 43 Imaging unit 44 Imaging unit 5. Control device 50 Storage section 51 Generation part 52 Detection unit 53 Correction section 54 Transmitter 55 Output section 56 Conversion unit

Claims

1. an internal storage unit for storing the images, the internal storage unit being prohibited from access by unauthorized users; a generation unit that generates a pre-modification hash value based on an image of the image that is not modified, and generates a modified hash value based on an image that is modified by modifying the pre-modification image; An image processing system comprising:

2. a detection unit that detects that the image has been modified based on a comparison between the image before modification and the image after modification; The image processing system according to claim 1 , wherein the generation unit generates a new modified hash value based on the modified image every time it is detected that the image has been modified.

3. The image processing system of claim 1 or claim 2, further comprising an external memory unit accessible to the unauthorized user and receiving and storing the unmodified hash value and the modified hash value from the generation unit or the internal memory unit.

4. The image includes coordinate information; The generation unit is Dividing the image into a plurality of regions based on the coordinate information; generating a hash value before the correction and a hash value after the correction for each of the areas; 4. The image processing system according to claim 3, wherein the hash value before correction or the hash value after correction is combined with the coordinate information for each of the areas and stored in the external storage unit.

5. An output unit is further provided, the generating unit generates a duplicate image by adding a barcode image or a QR code image obtained by converting a URL that can access the internal storage unit or the external storage unit to the image before correction or the image after correction, The image processing system according to claim 4 , wherein the output unit outputs the duplicated image.

6. An output unit is further provided, The generating unit generates a duplicate image by masking the corrected image with a marker image, The image processing system according to claim 4 , wherein the output unit outputs the duplicated image.

7. A conversion unit is further provided, The conversion unit is converting the unmodified image into first pixel information using the unmodified hash value; converting the modified image into second pixel information using the modified hash value; Adding depth information to the first pixel information and the second pixel information, respectively; The image processing system according to claim 1 , further comprising: a stereo image generating unit configured to generate a stereo image based on the first pixel information and the second pixel information.

8. The image processing system according to claim 7 , further comprising a wearable device capable of projecting the stereo image.

9. The image processing system according to claim 3 , wherein the external storage unit is a server or a cloud.

10. storing the image in an internal storage area that is prohibited from access by unauthorized users; generating a hash value before modification based on an image of the image before modification; generating a modified hash value based on a modified image obtained by modifying the unmodified image; An image processing method comprising:

Images