Reading system, information processing apparatus, reading device, reading method and program

Abstract

To prevent an original object image from being easily acquired even when a divided image of the object image is acquired.SOLUTION: An information processing apparatus performs change processing of at least one of a plurality of divided images that are obtained by dividing a code image, generates an image for composition for each of the divided images, the image including a processing mark indicating information associated with change processing for a divided image and the divided image, and causes a projector to display a plurality of images for composition. A reading device reads an image for reading that image is composed of the displayed plurality of images for composition, and restores the code image by performing processing based on the processing mark included in each of the images for composition on the divided image included in each of images for composition to compose.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a reading system, an information processing device, a reading device, a reading method, and a program. [Background technology]

[0002] Code images such as barcodes and QR codes (registered trademarks) function as barcodes or QR codes even if they are obtained by scanning a photographed image. For this reason, for example, when offering prizes to people who read code images displayed at checkpoints and collect information at an event, it is possible for fraud to occur in which information is obtained from a copy of the code image without going around the checkpoints.

[0003] Therefore, for example, Patent Document 1 describes a technology in which a code image is divided into multiple parts and multiple images are cyclically displayed on a display screen at a predetermined time interval, making it impossible to capture the code image by simply capturing the display screen. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-62260 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technique of Patent Document 1 has a problem in that if the divided images are available, the original image can be easily obtained by combining the divided images.

[0006] An object of the present invention is to make it impossible to easily obtain the original target image even if divided images of the target image are available. [Means for solving the problem]

[0007] In order to solve the above problems, the reading system of the present invention comprises: an information processing device that divides a target image to obtain a plurality of divided images, applies modification processing to at least one of the divided images, and generates a plurality of compositing images for each of the divided images, the compositing images including the divided image and a mark indicating information related to the modification processing performed on the divided image; a display device that displays the generated multiple images to be combined; a reading device that reads the displayed plurality of compositing images, and performs processing based on the mark included in each of the compositing images on the divided images included in each of the compositing images to combine them to restore the target image; Equipped with. Effect of the Invention

[0008] According to the present invention, even if a divided image of a target image can be obtained, it is possible to prevent the original target image from being easily obtained. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram showing an example of the overall configuration of a reading system according to the present invention; [Diagram 2] 2 is a block diagram showing a functional configuration of the information processing device shown in FIG. 1. [Diagram 3] FIG. 2 is a block diagram showing a functional configuration of the reading device of FIG. [Figure 4] 3 is a flowchart showing the flow of a synthesis image generating process executed by the CPU of FIG. 2. [Diagram 5] FIG. 13 is a diagram illustrating an example of division of a code image. [Figure 6] FIG. 13 is a diagram showing an area where no modification processing is performed when the code image is composed of an odd number of pixels by an odd number of pixels. [Figure 7] FIG. 13 is a diagram for explaining an image to be synthesized. [Figure 8] FIG. 13 is a diagram for explaining a processing mark. [Figure 9] FIG. 5 is a diagram showing a specific example of the process of steps S1 to S4 in FIG. [Figure 10] FIG. 5 is a diagram showing a specific example of the process of steps S1 to S4 in FIG. [Figure 11] FIG. 2A is a diagram showing an arrangement of frames of moving image data of an image to be synthesized, and FIG. 2B is a diagram showing an arrangement of frames of an image to be read projected by a projector. [Figure 12] 4 is a flowchart showing the flow of a code reading process executed by the CPU of FIG. 3. [Figure 13] FIG. 13 is a diagram showing the timing at which failed images captured across different frames are acquired. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are subject to various technically preferable limitations for implementing the present invention. Therefore, the technical scope of the present invention is not limited to the following embodiments and illustrated examples.

[0011] [Configuration of the reading system 100] FIG. 1 is a diagram showing an example of the overall configuration of a reading system 100 according to the present invention. As shown in FIG. 1, the reading system 100 includes an information processing device 10, a projector 20 (display device), and a reading device 30.

[0012] The information processing device 10 generates an image for projection, transmits it to the projector 20, and causes the projector 20 to project (display) a projection image 40 including a reading image 41. The projector 20 projects (displays) the projection image 40 including the reading image 41 onto a projection surface such as a screen or a wall. The reading device 30 reads the displayed reading image 41 to obtain information.

[0013] [Configuration of information processing device 10] FIG. 2 is a block diagram showing the functional configuration of the information processing device 10. As shown in FIG. As shown in FIG. 2, the information processing device 10 includes a CPU 11, a RAM 12, an operation unit 13, a display unit 14, a storage unit 15, a communication unit 16, and the like, and each unit is connected to each other via a bus 17.

[0014] The CPU 11 is a processor that controls the operation of each part of the information processing device 10 by reading and executing the program 151 stored in the storage unit 15 and performing various processes. In this embodiment, the CPU 11 corresponds to the "control unit" and the "computer". The control unit may have multiple processors (e.g., multiple CPUs), and the multiple processes performed by the CPU 11 may be executed by the multiple processors. In this case, the multiple processors correspond to the "control unit". In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel.

[0015] The RAM 12 provides a working memory space for the CPU 11 and stores temporary data.

[0016] The operation unit 13 is composed of a keyboard, a touch panel attached to the display unit 14, and the like. The operation unit 13 outputs to the CPU 11 an operation signal of the keyboard by the user and an operation signal on the screen of the display unit 14.

[0017] The display unit 14 is configured with a display device such as a liquid crystal display, an organic EL (Electro Luminescence) display, or the like, and performs display based on the control operation of the CPU 11.

[0018] The storage unit 15 is a non-transitory recording medium readable by the CPU 11 as a computer, and stores a program 151 and various data. The storage unit 15 includes a non-volatile memory such as a hard disk drive (HDD) or a flash memory. The program 151 includes a program for executing a synthesis image generation process described later, and is stored in the storage unit 15 in the form of a computer-readable program code.

[0019] The storage unit 15 also stores data on a code image 42 (target image) to be projected by the projector 20 and a background image that serves as the background of the code image 42.

[0020] The communication unit 16 performs communication control for transmitting and receiving data to and from an external device through wireless or wired communication.

[0021] [Projector 20 Configuration] The projector 20 projects (displays) a projection image 40 on a projection surface by irradiating projection light having an intensity distribution according to an image for projection input from the information processing device 10 with high directivity. In detail, the projector 20 includes a light source, a display element such as a digital micromirror device (DMD) that forms an optical image by adjusting the intensity distribution of the light output from the light source, and a group of projection lenses that collect the optical image formed by the display element and project it as the projection image 40. The projector 20 adjusts the intensity distribution of the light output from the light source by the display element according to image data of the image for projection, and projects the projection image 40 by emitting the light to the outside of the projector 20 through the group of projection lenses.

[0022] [Configuration of the reading device 30] FIG. 3 is a block diagram showing the functional configuration of the reading device 30. As shown in FIG. As shown in FIG. 3, the reading device 30 includes a CPU 31 (control unit), a RAM 32, an operation unit 33, a display unit 34, a memory unit 35, an imaging unit 36 ​​(reading unit), a communication unit 37, etc., and each unit is connected by a bus 38.

[0023] The CPU 31 is a processor that reads and executes a program 351 stored in the storage unit 35 and performs various processes to control the operation of each part of the reading device 30. The CPU 31 may be composed of multiple CPUs. In this case, the multiple CPUs may be involved in a common process, or the multiple CPUs may independently execute different processes in parallel.

[0024] The RAM 32 provides a working memory space for the CPU 31 and stores temporary data.

[0025] The operation unit 33 is composed of push button switches, a touch panel attached to the display unit 34, and the like. The operation unit 33 outputs to the CPU 31 an operation signal of the push button switch by the user or an operation signal on the screen of the display unit 34.

[0026] The display unit 34 is configured with a display device such as a liquid crystal display, an organic EL (Electro Luminescence) display, or the like, and performs display based on the control operation of the CPU 31.

[0027] The storage unit 35 is a non-transitory recording medium readable by the CPU 31 as a computer, and stores the program 351 and various data. The storage unit 35 includes a non-volatile memory such as a flash memory. The program 351 includes a reading application program for executing a code reading process described later, and is stored in the storage unit 35 in the form of a computer-readable program code.

[0028] The imaging unit 36 ​​includes an imaging lens, an imaging element such as an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-oxide Semiconductor), an A / D conversion circuit, etc. The imaging unit 36 ​​converts an optical image that has passed through the imaging lens into a two-dimensional image signal by the imaging element, thereby acquiring image data (2D image).

[0029] The communication unit 37 performs communication control for transmitting and receiving data to and from an external device through wireless or wired communication.

[0030] As the reading device 30 of this embodiment, a smartphone or tablet terminal with a camera and a function for decoding the code image 42 can be used.

[0031] [Operation of the reading system 100] Next, the operation of the reading system 100 will be described. First, the synthesis image generating process executed in the information processing device 10 will be described.

[0032] 4 is a flowchart showing the flow of the composite image generation process. The composite image generation process is executed by the CPU 11 in cooperation with the program 151 when, for example, the operation unit 13 is operated to instruct projection of the projection image 40 including the image to be read 41.

[0033] First, the CPU 11 acquires the code image 42 (target image) to be projected (step S1). For example, the CPU 11 reads out and acquires the code image 42 to be projected from the storage unit 15. Alternatively, the code image 42 to be projected may be acquired from an external device via the communication unit 16.

[0034] Next, the CPU 11 divides the acquired code image 42 to acquire a plurality of divided images 43 (step S2). The number of divisions and the method of division of the code image 42 are determined in advance. The number of divisions and the method of division are not particularly limited. For example, as shown in Fig. 5(a), the code image 42 may be equally divided into four regions, the upper left, upper right, lower left, and lower right, to obtain the divided images 43 (divided images 431 to 434), as shown in Fig. 5(b), the code image 42 may be divided into four regions from the outside to obtain the divided images 43 (divided images 431 to 434), or the code image 42 may be divided by other division methods.

[0035] If the code image 42 has an odd number of pixels in both the vertical and horizontal directions, it is necessary to perform division so that the image is not missing. For example, if the code image 42 is an odd-by-odd square, attempting to equally divide it into four regions, the upper left, upper right, lower left, and lower right, may result in missing pixels on the cross line passing through the center of the code image 42, as shown by hatching in Fig. 6. In this case, for example, the region of the cross line and each of the four regions divided by the region of the cross line are set as divided images 43, and in step S3 described later, processing is performed so that the image is not missing, such as by not performing a change process on the region of the cross line. Note that the contents of the code image 42 are not shown in Fig. 6.

[0036] Next, the CPU 11 performs a modification process on the divided image 43 obtained by the division (step S3). In step S3, the CPU 11 performs a modification process on at least one of the divided images 43 obtained by the division.

[0037] Examples of the modification process include up-down flip, left-right flip, 90° rotation to the right (270° rotation to the left), 180° rotation to the right (180° rotation to the left), 270° rotation to the right (90° rotation to the left), black and white inversion, movement, etc. Note that a copy (duplicate) of the divided image may be generated and the modification process may be applied to the copy.

[0038] Next, the CPU 11 adds the confirmation mark M1 and the processing mark M2 to each divided image 43 (including copies of the divided images 43 that have been modified) to generate a plurality of composite images 44 (step S4).

[0039] FIG. 7 is a diagram showing an example of the synthesis image 44. As shown in FIG. As shown in FIG. 7, each synthesis image 44 includes a divided image 43, a confirmation mark M1, and a processing mark M2.

[0040] The confirmation mark M1 has a number of regions R (R1 to R4 in FIG. 7, assuming that there are four divided images 43) corresponding to the number of divided images 43 obtained in step S2, and the regions R corresponding to the sequential order numbers of the divided images 43 included in this image to be combined 44 (the number of divided images) are filled in black. For example, R1 is filled in black if it is the first divided image 43, and R2 is filled in black if it is the second divided image 43. This makes it possible for the reading device 30 that reads the image to be combined 44 to check which divided image 43 included in the image to be combined 44 is.

[0041] The processing mark M2 is a mark indicating information regarding a modification process for the divided image 43 included in the compositing image 44. As described above, some modification process may have been performed on the divided image 43. In this case, the original code image 42 cannot be obtained by compositing the divided image 43 with another divided image 43 as is. Therefore, by adding the processing mark M2, it is possible to allow the reading device 30 to recognize what process should be performed on the divided image 43 to return it to the original divided image 43.

[0042] 7, the processing mark M2 is a square divided equally into four regions, and the combination of the filling states of the four regions indicates information regarding the modification process for the divided image 43 contained in this image to be combined 44, i.e., what process should be performed on the divided image 43 in the reading device 30. The information regarding the modification process is included in the image to be combined 44 even if the divided image 43 has not been modified. In this case, the information regarding the modification process includes, for example, information indicating that there is no need to apply modification process to the divided image 43 in the reading device 30 (see FIG. 8(a)).

[0043] 8(a) to (g) show examples of the processing marks M2. The processing mark M2 in which no area is filled as shown in FIG. 8(a) indicates that no changes are to be made to the divided image 43. The processing mark M2 with the upper or lower side filled in as shown in FIG. 8(b) indicates that the divided image 43 is to be inverted upside down. The processing mark M2 with the right or left side filled in as shown in FIG. 8(c) indicates that the divided image 43 is to be inverted left to right. The processing mark M2 with the upper right corner filled in as shown in FIG. 8(d) indicates that the divided image 43 is to be rotated 90° to the right (270° to the left). The processing mark M2 with the bottom right portion filled in as shown in FIG. 8(e) indicates that the divided image 43 is to be rotated 180° to the right (180° to the left). The processing mark M2 with the bottom left portion filled in as shown in FIG. 8(f) indicates that the divided image 43 is to be rotated 270° to the right (90° to the left). The processing mark M2, the entire area of ​​which is filled in, shown in FIG. 8(g) indicates that the divided image 43 is not used (is invalid) in the synthesis process.

[0044] 9 and 10 are diagrams showing a specific example of the processes in steps S1 to S4 in FIG. In the example shown in Figure 9, the acquired code image 42 is divided into four areas, namely the upper left, upper right, lower left, and lower right, to generate divided images 43 (431 to 434). The first divided image 431 is not modified, the second divided image 432 is rotated 270° to the right (90° to the left), the third divided image 433 is rotated 90° to the right (270° to the left), and the fourth divided image 434 is rotated 180° to the right (180° to the left), to generate the synthesis image 44 (441 to 434).

[0045] Here, since the first divided image 431 is the first image, the confirmation mark M1 of the compositing image 441 including the divided image 431 has the region R1 filled in black. Also, since no modification process has been performed on the first divided image 431, it can be used as is in the reading device 30. Therefore, none of the regions of the processing mark M2 of the compositing image 441 are filled in.

[0046] Because the second divided image 432 is the second image, the confirmation mark M1 of the compositing image 442 including the divided image 432 has the region R2 filled in black. Also, because the second divided image 432 has been rotated 270° to the right (90° to the left), the reading device 30 can return the divided image 432 to the original divided image 432 by rotating the divided image 432 90° to the right (270° to the left). Therefore, the processing mark M2 of the compositing image 442 has the upper right filled in black.

[0047] Because the third divided image 433 is the third image, the confirmation mark M1 of the compositing image 443 including the divided image 433 has the region R3 filled in black. Also, because the third divided image 433 has been rotated 90° to the right (270° to the left), the original divided image 433 can be restored by rotating the divided image 433 270° to the right (90° to the left) in the reading device 30. Therefore, the bottom left of the processing mark M2 of the compositing image 443 is filled in black.

[0048] Because the fourth divided image 434 is the fourth image, the confirmation mark M1 of the compositing image 444 including the divided image 434 has the region R4 filled in black. Also, because the fourth divided image 434 has been rotated 180° to the right (180° to the left), the reading device 30 can return the divided image 434 to the original divided image 434 by rotating the divided image 434 180° to the right (180° to the left). Therefore, the bottom right of the processing mark M2 of the compositing image 444 is filled in black.

[0049] In the example shown in Figure 10, when code image 42 is divided into four equal parts, it is divided into two parts, one consisting of the upper left and lower right area, and the other consisting of the upper right and lower left area, to generate divided image 43 (431, 433). In addition, divided images 432 and 434 which are copies of divided images 431 and 433 are generated. Split image 431 is not modified, divided image 432 is subjected to black and white inversion processing, divided image 433 is not modified, and divided image 434 is subjected to black and white inversion processing to generate a composite image 44 (441 to 434).

[0050] Here, since the first divided image 431 is the first image, the confirmation mark M1 of the compositing image 441 including the divided image 431 has the region R1 filled in black. Also, since no modification process has been performed on the first divided image 431, it can be used as is in the reading device 30. Therefore, none of the regions of the processing mark M2 of the compositing image 441 are filled in.

[0051] Since the second divided image 432 is the second image, the confirmation mark M1 of the compositing image 442 including the divided image 432 has the region R2 filled in black. Moreover, since the second divided image 432 becomes the same as the divided image 431 when restored to the state before the change process, it is not necessary for compositing to restore the code image 42. Therefore, the entire area of ​​the processing mark M2 of the compositing image 442 is filled in black.

[0052] Because the third divided image 433 is the third image, the confirmation mark M1 of the compositing image 443, which includes the divided image 433, has the region R3 filled in black. Moreover, because no modification processing has been performed on the third divided image 433, it can be used as is in the reading device 30. Therefore, none of the regions of the processing mark M2 of the compositing image 443 are filled in.

[0053] Since the fourth divided image 434 is the fourth image, the confirmation mark M1 of the compositing image 444 including the divided image 434 has the region R4 filled in black. Moreover, since the fourth divided image 434 becomes the same as the divided image 433 when restored to the state before the change process, it is not necessary for compositing to restore the code image 42. Therefore, the entire area of ​​the processing mark M2 of the compositing image 444 is filled in black.

[0054] Returning to FIG. 4, the CPU 11 arranges the generated multiple synthesis images 44 to generate a moving image at a predetermined frame rate (step S5). For example, if there are four images 44 to be combined, each designated as frames A to D, the CPU 11 generates a video at a predetermined frame rate (here, 30 fps) in which the same images 44 to be combined continue for n frames (here, three frames), as shown in FIG. 11(a), so as to make it easy for the reading device 30 to recognize.

[0055] Then, the CPU 11 generates a projection image based on the generated video, transmits it to the projector 20, and projects (displays) the projection image 40 including the reading image 41, which is a video that sequentially displays multiple synthesis images 44 (step S6), and terminates the synthesis image generation process. For example, the CPU 11 generates an image for projection by placing each frame of the generated moving image at a predetermined position on a background image, and transmits the image to the projector 20.

[0056] When the projector 20 receives the projection image from the information processing device 10, the projector 20 performs projection based on the projection image, and displays the projection image 40 including the reading image 41 on the projection surface. Here, when the projector 20 operates at, for example, 120 Hz, it projects each frame of the projection image of 30 fps four times in succession at four times the speed in accordance with the operating frequency, thereby performing projection at 120 fps, as shown in FIG. 11(b).

[0057] The projected image for reading 41 is an image in which at least one of the divided images 43 obtained by dividing the code image 42 is changed and arranged in a sequential moving image, so that the user cannot visually recognize the code image 42. In particular, when the projected image for reading 41 is a moving image in which the divided image 43 and an image in which the divided image 43 is inverted in black and white are displayed in succession, as in the images for synthesis 441 to 444 shown in FIG. 10, the image appears to be entirely gray to the human eye, and it is not possible to visually recognize that information for acquiring the code image 42 is displayed. Therefore, for example, the image for reading 41 for acquiring the code image 42 can be displayed without an unspecified user knowing that information for acquiring the code image 42 is displayed. Note that an image in which the divided image 43 is changed and an image in which the divided image 43 after the change is inverted in black and white may be displayed in succession.

[0058] The reading device 30 reads the image to be read 41 projected onto the projection surface in response to a user operation, and restores the code image 42.

[0059] FIG. 12 is a flowchart showing the flow of the code reading process executed by the reader 30. The code reading process is executed by the CPU 31 in cooperation with the reading application program when the reading application program of the program 351 is started by operating the operation unit 33 and an instruction to shoot is given.

[0060] First, the CPU 31 causes the imaging unit 36 ​​to capture a moving image of the image to be read 41 at a predetermined frame rate (for example, 30 fps) in response to an operation of the operation unit 33 (step S21).

[0061] Next, the CPU 31 refers to the confirmation marks M1 of each frame (composite image 44) acquired by shooting the moving image, identifies and deletes the failed image, and acquires an image to be used for restoring the code image 42 (step S22).

[0062] Here, if the projection by the projector 20 and the photographing (acquisition of an image) by the reader 30 are not synchronized, images may be acquired across different frames. FIG. 13 is a diagram showing the projection timing and exposure timing of each frame when the reading device 30 captures a moving image by shifting the capture start timing to T1 to T12 during the projection (display) of each frame (frames A to D) of the image to be read by the projector 20. Here, an example is shown in which the reading device 30 acquires an image by performing exposure during the projection time of two frames by the projector 20, and processes and transfers (writes into the storage unit 35) the image during the projection time of two frames. As shown in FIG. 13, when the capture is started at any of the timings T1 to T3, T5 to T7, and T9 to T11, the acquisition of four frames A to D is successful, but when the capture is started at the timings T4, T8, and T12, a failed image captured across different frames is acquired.

[0063] In an image where a single frame is captured (a successful image), one of the areas R1-R4 of the confirmation mark M1 will be filled in black, but in an unsuccessful image where a different frame is captured, two of the areas R1-R4 of the confirmation mark M1 will be colored. Therefore, in step S22, CPU 31 refers to the confirmation mark M1 of each frame acquired by shooting a moving image, and deletes a frame in which two of the areas R1 to R4 of confirmation mark M1 are colored as a failed image. Then, CPU 31 acquires an image of each frame to be used for restoration (composite image 44) from among the frames that were not deleted.

[0064] Next, the CPU 31 determines whether or not it is necessary to perform a modification process on the divided image 43 of each acquired frame based on the processing mark M2, and performs the modification process if it is determined that it is necessary (step S23). As described above, the processing mark M2 indicates whether to make no change, invert, rotate, move, or not use (disable) by a combination of filled-in areas. Therefore, the CPU 31 determines whether or not a change process is required for the divided image 43 of each frame based on the filled-in areas of the processing mark M2, and if it determines that a change process is required, applies the change process specified by the processing mark M2. The divided image 43 of the frame that is instructed not to use by the processing mark M2 is deleted.

[0065] Next, the CPU 31 combines the processed divided images 43 (including those that have not been modified according to the instructions of the processing marks M2) to restore the code image 42 (step S24).

[0066] Then, the CPU 11 decodes the restored code image 42 to obtain the information indicated by the code image 42 (step S25), and ends the code reading process.

[0067] As described above, in the reading system 100, the information processing device 10 applies a change process to at least one of the divided images 43 obtained by dividing the code image 42, generates a compositing image 44 including the divided image 43 and the processing mark M2 indicating information related to the change process for the divided image 43 for each divided image 43, and displays the multiple compositing images 44 by the projector 20. The reading device 30 reads the reading image 41 consisting of the multiple compositing images 44 displayed, and restores the code image 42 by applying processing based on the processing mark M2 included in each of the compositing images 44 to the divided images 43 included in each of the compositing images 44 and combining them. In this way, in the reading system 100, even if all types of compositing images 44 of the reading image 41 are available, the original code image 42 cannot be restored (obtained) by simply compositing them. Therefore, even if all divided images 43 of the code image 42 are available, the original code image 42 cannot be easily obtained, and the fraudulent act of obtaining the code image 42 from a copy of the divided images 43 can be suppressed.

[0068] The information related to the change processing includes information indicating a process for returning the divided image 43 after the change processing to the divided image 43 before the change processing. Therefore, it becomes possible for the reading device 30 to easily recognize what processing should be performed on the divided image 43.

[0069] Moreover, information regarding the change process is expressed by a combination of filling in a plurality of areas prepared in advance, like the process mark M2. Therefore, information regarding the change process can be transmitted to the reading device 30 in a manner that cannot be recognized by unspecified users.

[0070] The image to be combined 44 also includes a confirmation mark for confirming whether the image to be combined 44 has been read normally by the reading device 30. Therefore, it is possible to identify images that have been successfully read by the reading device 30 and images that have not been successfully read.

[0071] The contents described in the above embodiment are preferred examples of the reading system, information processing device, reading method, and program according to the present invention, and are not limited to these.

[0072] For example, in the above embodiment, the process mark M2 is described as indicating a process for returning the divided image 43 after the change process such as rotation to the divided image 43 before the change process. However, the process mark M2 may indicate the type of change process performed on the divided image 43. For example, when the divided image 43 is rotated 90 degrees to the right, the process mark M2 may indicate that the divided image 43 has been rotated 90 degrees to the right. The CPU 31 of the reading device 30 may specify and perform a process for returning the divided image 43 to the state before the change process from the type of change process performed on the divided image 43 indicated by the process mark M2. This allows the reading device 30 to easily recognize what kind of process should be performed on the divided image 43.

[0073] Also, for example, in the above embodiment, the target image is described as a code image, but the target image in the present invention is not limited to a code image and may be any image, such as a photographic image, a character image, or a text image.

[0074] Also, for example, in the above embodiment, the projector 30 as a display device is described as sequentially switching between multiple synthesis images 44 to display a moving image, but the multiple synthesis images 44 may be displayed on a single screen (projection surface).

[0075] In the above embodiment, the display device of the present invention is described as a projector, but the display device is not limited to this and may be a display device such as a liquid crystal display or an organic electroluminescence (EL) display.

[0076] In the above embodiment, the information processing device 10 and the projector 20 serving as a display device are separate from each other, but the information processing device 10 and the projector 20 may be integrated together. That is, the functions of the information processing device of the present invention may be incorporated into the display device (the information processing device and the display device may be the same device).

[0077] In the above embodiment, an example is disclosed in which a semiconductor memory such as an HDD or a flash memory is used as a computer-readable medium for the program according to the present invention, but the present invention is not limited to this example. As other computer-readable media, a portable recording medium such as a CD-ROM can be applied. Furthermore, a carrier wave can be applied as a medium for providing data of the program according to the present invention via a communication line.

[0078] In addition, the detailed configurations and operations of the reading system, information processing device, display device, and reading device may be modified as appropriate without departing from the spirit of the invention.

[0079] Although the embodiment of the present invention has been described above, the technical scope of the present invention is not limited to the above embodiment, but is defined based on the claims. Furthermore, the technical scope of the present invention also includes equivalent ranges that are made by adding modifications that are not related to the essence of the present invention from the claims. [Explanation of symbols]

[0080] 100 Reading System 10. Information processing device 11 CPU 12 RAM 13 Control section 14 Display section 15 Storage section 151 Programs 16 Communications Department 17 Bus 20 Projector 30 Reading device 31 CPU 32 RAM 33 Operation section 34 Display section 35 Storage section 351 Programs 36 Imaging unit 37 Communications Department 38 Bus

Claims

1. an information processing device that divides a target image to obtain a plurality of divided images, applies modification processing to at least one of the divided images, and generates a plurality of compositing images for each of the divided images, the compositing images including the divided image and a mark indicating information related to the modification processing performed on the divided image; a display device that displays the generated multiple images to be combined; a reading device that reads the displayed plurality of compositing images, and performs processing based on the mark included in each of the compositing images on the divided images included in each of the compositing images to combine them to restore the target image; A reading system comprising:

2. The reading system according to claim 1 , wherein the display device sequentially switches between displaying the generated plurality of images to be combined.

3. the information regarding the change processing includes information indicating a process for returning the divided image after the change processing to the divided image before the change processing; 2. A reading system according to claim 1.

4. The information regarding the change process includes information indicating a type of the change process.

2. A reading system according to claim 1.

5. The mark indicates information about the change process by a combination of filling in a plurality of areas prepared in advance.

2. A reading system according to claim 1.

6. The modification process includes rotation, up-down inversion, left-right inversion, black-and-white inversion, or movement.

2. A reading system according to claim 1.

7. the image to be synthesized includes a confirmation mark for confirming whether the image to be synthesized has been properly read by the reading device; 2. A reading system according to claim 1.

8. Divide the target image to obtain a plurality of divided images; performing a modification process on at least one of the divided images; generating a plurality of compositing images for each of the divided images, the compositing images including the divided images and a mark indicating information regarding a modification process for the divided images; outputting the generated plurality of images to be combined to a display device and causing the display device to display the plurality of images to be combined; An information processing device having a control unit.

9. A reading unit that reads a plurality of images to be combined, each of which includes a plurality of divided images obtained by dividing a target image and a mark indicating information regarding a modification process for each of the divided images; a control unit that restores the target image by performing processing based on the mark included in each of the read compositing images on the divided images included in each of the compositing images and compositing the divided images; A reading device comprising:

10. An information processing device, Dividing a target image to obtain a plurality of divided images, performing a modification process on at least one of the divided images, and generating a plurality of compositing images for each of the divided images, the compositing images including the divided image and a mark indicating information related to the modification process on the divided image; The display device, Displaying the generated multiple images for synthesis; The reading device reading the displayed plurality of compositing images, and performing processing based on the mark included in each of the compositing images on the divided images included in each of the compositing images to combine the divided images, thereby restoring the target image; How to read.

11. On the computer, Divide the target image to obtain a plurality of divided images; performing a modification process on at least one of the divided images; generating a plurality of compositing images for each of the divided images, the compositing images including the divided images and a mark indicating information regarding a modification process for the divided images; outputting the generated plurality of images to be combined to a display device and causing the display device to display the plurality of images to be combined; A program for executing a process.

Images