Imaging device, imaging method, and program

Abstract

To provide a technique with which an image capturing operation for creating a composite image by combining with a first image can be received in a state where a composite image obtained by combining the first image with a captured image is displayed.SOLUTION: An imaging apparatus includes: an imaging part capturing an image; a composite image display part displaying a first composite image obtained by combining a first image with a second image captured by the imaging part; and a capturing operation reception part receiving, in a state where the first composite image is displayed, a third image capturing operation for combining with the first image to create a second composite image.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an imaging apparatus, an imaging method, and a program. [Background technology]

[0002] There is known a technique for compositing a two-dimensional code image with another image. For example, Patent Document 1 discloses an image generating device that, when a user wants to combine a two-dimensional code with an arbitrary image, displays the two-dimensional code image and another image in an overlapping manner, and, in response to an operation to specify the position to combine, combines the images at the specified position. Summary of the Invention [Problem to be solved by the invention]

[0003] However, in the conventional technology, when an image capturing operation is performed for generating a composite image by combining with a first image, a composite image obtained by combining the first image and the captured image is not displayed. If a user performs an image capturing operation for generating a composite image in a state where the composite image is not displayed, the user may need to repeat capturing and generating the composite image until the generated composite image is satisfied, which may increase the user's workload.

[0004] The disclosed technology aims to perform an image capture operation for combining with a first image to generate a composite image while a composite image combining the first image and the captured image is displayed. [Means for solving the problem]

[0005] The disclosed technology includes an imaging unit that captures an image, a composite image display unit that displays a first composite image obtained by combining a first image and a second image captured by the imaging unit, and an imaging operation receiving unit that receives, while the first composite image is being displayed, an imaging operation for a third image to be composited with the first image to generate a second composite image; a composite image generating unit that generates a second composite image by combining the third image with the first image as a feature; The imaging device includes: Effect of the Invention

[0006] An image capturing operation for generating a composite image by combining with the first image can be received in a state in which the composite image obtained by combining the first image with the captured image is displayed. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 illustrates an example of a system configuration of an image forming system. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of an imaging apparatus. [Diagram 3] FIG. 2 illustrates an example of a hardware configuration of an image forming apparatus. [Figure 4] FIG. 2 is a diagram illustrating an example of functions of the imaging device according to the first embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of a flow of imaging processing according to the first embodiment. [Figure 6] FIG. 2 is a diagram for explaining capturing of a first image according to the first embodiment. [Figure 7] 11A to 11C are diagrams for explaining capturing of a second image and a third image according to the first embodiment. [Figure 8] FIG. 11 is a diagram illustrating an example of a flow of an imaging process according to a second embodiment. [Figure 9] FIG. 11 is a diagram for explaining capturing of a first image according to a second embodiment. [Figure 10] 13A to 13C are diagrams for explaining capturing of a second image and a third image according to a second embodiment. [Figure 11] FIG. 13 is a diagram illustrating an example of functions of an imaging device according to a third embodiment. [Figure 12] 13A to 13C are diagrams for explaining capturing of a second image and a third image according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] First Embodiment DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of an image forming system including an image pickup device according to the present invention will be described below with reference to the drawings.

[0009] FIG. 1 is a diagram illustrating an example of a system configuration of an image forming system.

[0010] The image forming system 1 includes an imaging device 10 and an image forming device 20. The imaging device 10 and the image forming device 20 are connected via a communication network 30 so as to be able to communicate with each other.

[0011] The imaging device 10 is a device having an imaging function, such as a digital camera or a smartphone. The imaging device 10 generates a composite image by combining a plurality of captured images, and transmits data indicative of the generated composite image to the image forming device 20. For example, the imaging device 10 captures and combines an image of a landscape and an image of a QR code (registered trademark) to be used as a train ticket, and transmits data indicative of the generated composite image to the image forming device 20.

[0012] The image forming device 20 forms an image based on the data received from the imaging device 10. For example, in order to print a train ticket, the image forming device 20 prints on a printing paper a composite image of a landscape captured by the imaging device 10 and an image of a QR code (registered trademark).

[0013] FIG. 2 is a diagram illustrating an example of a hardware configuration of the imaging apparatus.

[0014] The imaging device 10 is constructed by a computer, and includes a CPU 101 , a ROM 102 , a RAM 103 , an EEPROM 104 , a CMOS sensor 105 , an imaging element I / F 106 , an acceleration / direction sensor 107 , a media I / F 109 and a GPS receiving unit 111 .

[0015] Of these, the CPU 101 controls the overall operation of the imaging device 10. The ROM 102 stores programs such as an IPL used to drive the CPU 101. The RAM 103 is used as a work area for the CPU 101. The EEPROM 104 reads or writes various data such as programs for the imaging device under the control of the CPU 101.

[0016] The CMOS (Complementary Metal Oxide Semiconductor) sensor 105 is a type of built-in imaging means that captures an image of a subject (mainly a self-portrait) to obtain image data under the control of the CPU 101. Note that instead of a CMOS sensor, an imaging means such as a CCD (Charge Coupled Device) sensor may also be used.

[0017] The imaging element I / F 106 is a circuit that controls the driving of the CMOS sensor 105. The acceleration / direction sensor 107 is various sensors such as an electronic magnetic compass that detects geomagnetism, a gyrocompass, or an acceleration sensor. The media I / F 109 controls the reading and writing (storage) of data from and to a recording medium 108 such as a flash memory. The GPS receiver 111 receives GPS signals from GPS satellites.

[0018] The imaging device 10 also includes a long-distance communication circuit 112, a CMOS sensor 113, an imaging element I / F 114, a microphone 115, a speaker 116, an audio input / output I / F 117, a display 118, an external device connection I / F (Interface) 119, a short-distance communication circuit 120, an antenna 120a of the short-distance communication circuit 120, and a touch panel 121.

[0019] Among these, the long-distance communication circuit 112 is a circuit that communicates with the image forming apparatus 20 via the communication network 30 by wireless communication. The CMOS sensor 113 is a type of built-in imaging means that captures an image of a subject and obtains image data under the control of the CPU 101. The imaging element I / F 114 is a circuit that controls the driving of the CMOS sensor 113.

[0020] The microphone 115 is a built-in circuit that converts sound into an electrical signal. The speaker 116 is a built-in circuit that converts the electrical signal into physical vibrations to produce sound such as music or voice. The audio input / output I / F 117 is a circuit that processes input and output of audio signals between the microphone 115 and the speaker 116 under the control of the CPU 101.

[0021] The display 118 is a type of display means such as a liquid crystal or organic EL (Electro Luminescence) that displays an image of a subject, various icons, etc. The external device connection I / F 119 is an interface for connecting various external devices. The short-distance communication circuit 120 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The touch panel 121 is a type of input means that allows a user to operate the imaging device 10 by pressing the display 118.

[0022] The imaging device 10 also includes a bus line 110. The bus line 110 is an address bus or a data bus for electrically connecting the components such as the CPU 101 shown in FIG.

[0023] FIG. 3 is a diagram illustrating an example of a hardware configuration of the image forming apparatus.

[0024] The image forming apparatus 20 includes a controller 210 , a short-range communication circuit 220 , an engine control unit 230 , an operation panel 240 , and a network I / F 250 .

[0025] Of these, the controller 210 has a CPU (Central Processing Unit) 201 which is the main part of the computer, a system memory (MEM-P) 202, a north bridge (NB) 203, a south bridge (SB) 204, an ASIC (Application Specific Integrated Circuit) 206, a local memory (MEM-C) 207 which is a memory unit, an HDD (Hard Disk Drive) controller 208, and a HD 209 which is a memory unit.

[0026] The NB 203 and the ASIC 206 are connected via an AGP (Accelerated Graphics Port) bus 221 .

[0027] Of these, the CPU 201 is a control unit that performs overall control of the image forming apparatus 20. The NB 203 is a bridge for connecting the CPU 201 with the MEM-P 202, the SB 204, and the AGP bus 221. The NB 203 has a memory controller that controls reading and writing to the MEM-P 202, a PCI (Peripheral Component Interconnect) master, and an AGP target.

[0028] The MEM-P202 includes a ROM202a which is a memory for storing programs and data for implementing the various functions of the controller 210, and a RAM202b which is used for developing the programs and data, and as a drawing memory during memory printing. The programs stored in the RAM202b may be provided by being recorded in a computer-readable recording medium such as a CD-ROM, CD-R, or DVD in the form of an installable or executable file.

[0029] The SB 204 is a bridge for connecting the NB 203 to PCI devices and peripheral devices. The ASIC 206 is an integrated circuit (IC) for image processing purposes that has hardware elements for image processing, and serves as a bridge for connecting the AGP bus 221, the PCI bus 222, the HDD controller 208, and the MEM-C 207.

[0030] The ASIC 206 includes a PCI target and an AGP master, an arbiter (ARB) that is the core of the ASIC 206, a memory controller that controls the MEM-C 207, a plurality of DMACs (Direct Memory Access Controllers) that perform image data rotation and the like using hardware logic, and a PCI unit that transfers data between the scanner unit 231 and the printer unit 232 via a PCI bus 222. The ASIC 206 may be connected via an interface such as a Universal Serial Bus (USB) interface or an IEEE1394 (Institute of Electrical and Electronics Engineers 1394) interface.

[0031] The MEM-C 207 is a local memory used as a copy image buffer and a code buffer. The HD 209 is a storage for storing image data, font data used during printing, forms, etc. The HD 209 controls the reading and writing of data from and to the HD 209 under the control of the CPU 201.

[0032] The AGP bus 221 is a bus interface for a graphics accelerator card proposed to speed up graphic processing. The AGP bus 221 can speed up the graphics accelerator card by directly accessing the MEM-P 202 with high throughput.

[0033] Further, the short-range communication circuit 220 includes a short-range communication antenna 220a. The short-range communication circuit 220 is a communication circuit such as NFC or Bluetooth (registered trademark).

[0034] Furthermore, the engine control unit 230 is composed of a scanner unit 231 and a printer unit 232. The operation panel 240 includes a panel display unit 240a such as a touch panel that displays current setting values, a selection screen, etc. and receives input from an operator, and operation keys 240b including a numeric keypad that receives setting values ​​for image formation conditions such as density setting conditions, and a start key that receives a copy start instruction.

[0035] The controller 210 performs overall control of the image forming apparatus 20, for example, controlling drawing, communication, and input from an operation panel 240. The scanner unit 231 or the printer unit 232 executes image processing such as error diffusion and gamma conversion.

[0036] The network I / F 250 is an interface for performing data communication using the communication network 30. The short-range communication circuit 220 and the network I / F 250 are electrically connected to the ASIC 206 via a PCI bus 222.

[0037] Next, the function of each device will be described with reference to the drawings.

[0038] FIG. 4 is a diagram illustrating an example of functions of the imaging device according to the first embodiment.

[0039] The imaging device 10 includes an imaging section 11 , an image binarization section 12 , a composite image display section 13 , an imaging operation acceptance section 14 , a composite image generation section 15 , a composite image output section 16 , and a storage section 17 .

[0040] The imaging unit 11 captures an image. Specifically, the imaging unit 11 captures a first image, a second image, and a third image. Of these, the first image is an image of a landscape or the like. The imaging unit 11 captures the first image, and stores data indicating the first image in the storage unit 17. The second image and the third image are images of a two-dimensional code or the like. The second image is used to capture the third image. The third image is an image that will be the material for an image formed by the image forming device 20.

[0041] The imaging unit 11 repeatedly captures the second image until an imaging operation for the subsequent third image is received. When the imaging operation receiving unit 14 receives an imaging operation, the imaging unit 11 captures the third image.

[0042] The imaging unit 11 is realized by the CPU 101 executing processes defined in a program stored in the ROM 102 or the EEPROM 104, etc., and controlling the imaging element I / F 106 or the imaging element I / F 114, etc.

[0043] The image binarization unit 12 binarizes the image captured by the imaging unit 11. Specifically, the image binarization unit 12 binarizes the second image and the third image captured by the imaging unit 11. The binarized image is composed of, for example, pixels whose value is 0 and pixels whose value is 1.

[0044] The image binarization unit 12 is realized by the CPU 101 executing processes defined in a program stored in the ROM 102, the EEPROM 104, or the like.

[0045] The composite image display unit 13 displays a composite image (first composite image) obtained by combining the first image and the second image captured by the imaging unit 11. Specifically, the composite image display unit 13 displays a composite image obtained by combining the first image stored in the storage unit 17 and the second image repeatedly captured by the imaging unit 11. The composite image display unit 13 repeatedly executes this process until an imaging operation for a subsequent third image is received.

[0046] The composite image display unit 13 is realized by the CPU 101 executing processes defined in a program stored in the ROM 102, the EEPROM 104, or the like, and controlling the display 118 and the like.

[0047] The imaging operation receiving unit 14 receives an imaging operation for a third image to be synthesized with the first image to generate a second composite image while the first composite image is being displayed. This allows the user to adjust the imaging position, angle of view, etc., for capturing the third image while viewing the first composite image, and perform the imaging operation.

[0048] The imaging operation receiving unit 14 is realized by the CPU 101 executing processes defined in a program stored in the ROM 102, the EEPROM 104, or the like, and controlling the touch panel 121 and the like.

[0049] The composite image generating unit 15 generates a composite image (second composite image) by combining the third image captured by the imaging unit 11 when the imaging operation is received and the first image. The storage unit 17 may store data indicating the generated second composite image.

[0050] The composite image generating unit 15 is realized by the CPU 101 executing processes defined in a program stored in the ROM 102, the EEPROM 104, or the like.

[0051] The composite image output unit 16 transmits data representing the second composite image to the image forming apparatus 20.

[0052] The composite image output unit 16 is realized by the CPU 101 executing processes defined in a program stored in the ROM 102, the EEPROM 104, or the like, and controlling the long-distance communication circuit 112 and the like.

[0053] The storage unit 17 stores various data used for various processes described later. For example, the storage unit 17 stores data representing a first image captured by the imaging unit 11. The storage unit 17 may also store data representing a second composite image generated by the composite image generating unit 15.

[0054] The storage unit 17 is realized by the CPU 101 executing processes defined in programs stored in the ROM 102, the EEPROM 104, or the like, and controlling the ROM 102, the EEPROM 104, or the like.

[0055] Next, the operation of the image forming system 1 will be described with reference to the drawings.

[0056] FIG. 5 is a diagram showing an example of a flow of imaging processing according to the first embodiment.

[0057] When the imaging device 10 according to the present embodiment is started or a dedicated application program or the like is called, imaging processing is started. In response to a user's operation, the imaging unit 11 captures a first image (still image) of a landscape or the like (step S101). Then, the storage unit 17 stores the first image (step S102).

[0058] FIG. 6 is a diagram for explaining capturing of a first image according to the first embodiment.

[0059] The first image 901 is an image of a subject 801 such as a landscape. In response to a user's imaging operation, the imaging unit 11 captures the subject 801 such as a landscape in step S101 of the imaging process. The storage unit 17 stores data indicating the first image 901 in step S102 of the imaging process. The first image 901 is, for example, an image in a color format such as RGB or CMYK. The imaging device 10 may display the first image 901 as shown in FIG. 6.

[0060] Returning to FIG. 5, after capturing a first image (still image), the imaging unit 11 captures a second image such as a two-dimensional code (step S103). The image binarization unit 12 binarizes the second image (step S104). The composite image display unit 13 displays a first composite image obtained by combining the first image and the second image (step S105).

[0061] Next, the imaging operation receiving unit 14 determines whether or not an imaging operation for a third image has been received (step S106). If the imaging operation receiving unit 14 determines that an imaging operation for a third image has not been received (step S106: No), the process returns to step S103, and the imaging unit 11 captures a second image such as a two-dimensional code.

[0062] The imaging device 10 may immediately return to and execute the process of step S103, or may execute the process of step S103 at predetermined intervals, for example, every second.

[0063] For example, the imaging unit 11 repeatedly captures the second image in a so-called live view mode. In this case, the image binarization unit 12 and the composite image display unit 13 execute binarization processing and display processing in real time. This allows the imaging device 10 to repeatedly capture the second image and display the first composite image in real time without receiving a user operation.

[0064] When the imaging operation receiving unit 14 determines that an imaging operation for a third image has been received (step S106: Yes), the imaging unit 11 captures the third image (step S107).

[0065] FIG. 7 is a diagram for explaining capturing of the second image and the third image according to the first embodiment.

[0066] The second image 902 is an image obtained by capturing an image of a subject 802 such as a two-dimensional code. In response to a user's imaging operation, the imaging unit 11 captures an image of the subject 802 such as a two-dimensional code in step S103 of the imaging process. The image binarization unit 12 binarizes the second image 902 in step S104 of the imaging process. The composite image display unit 13 displays a first composite image obtained by combining the first image 901 and the second image 902 in step S105 of the imaging process.

[0067] Specifically, for example, the image binarization unit 12 assigns either a value of 0 (an example of a first value) or 1 (an example of a second value) to each pixel as data representing the second image 902. Then, the composite image display unit 13 displays pixels of the binarized second image 902 after combination with pixels having a value of 0 (first value) as the pixel value of the first image 901, and displays pixels after combination with pixels having a value of 1 (second value) as black.

[0068] Note that black is a color represented by (R,G,B)=(0,0,0) in the case of image data in which the brightness of red (R), green (G) and blue (B) in RGB format is expressed as values ​​from 0 to 255. As a result, composite image display unit 13 displays a two-dimensional code such as a barcode or QR code (registered trademark) in black so as to be superimposed on first image 901.

[0069] As described above, the imaging unit 11, the image binarization unit 12, and the composite image display unit 13 repeatedly execute the processes of steps S103 to S105 of the imaging process until the imaging operation reception unit 14 receives an imaging operation. This allows the user to perform imaging operations by moving the imaging device 10 itself or adjusting the magnification ratio by a zoom function or the like while checking the displayed first composite image so that the image of the subject 802 is composited at an appropriate position and size.

[0070] Returning to FIG. 5, the image binarization unit 12 binarizes the third image (step S108). The composite image generation unit 15 generates a second composite image by combining the first image and the third image (step S109). Here, the third image is almost the same as the second image, but differs from the second image in that it is an image captured by the user performing a shooting operation in a state in which the first composite image is displayed based on the second image. In other words, the second image is an image used to be displayed as the first composite image. In contrast, the third image is an image used to generate a second composite image to be transmitted to the image forming device 20 in a process to be described later.

[0071] The composite image generating unit 15 also composites the binarized third image as a special color. A special color is a color printed using special color ink or special color toner, such as a transparent color, metallic color, or fluorescent color. Special colors enable special expressions that are not possible using only general process colors such as RGB or CMYK.

[0072] The composite image generating unit 15 generates a second composite image by combining pixels of the third image that have been combined with pixels having a value of 0 (first value) so that they become pixel values ​​of the first image 901, and by combining pixels of the third image that have been combined with pixels having a value of 1 (second value) so that they become pixels designated as black spot color. Here, the pixels designated as black spot color are printed by the image forming device 20 using IR ink or IR toner or the like. IR ink or IR toner has the property of transmitting infrared rays and can be read by an infrared sensor or the like.

[0073] Next, the composite image output unit 16 transmits data indicating the second composite image to the image forming device 20 (step S110). As a result, the image forming device 20 prints the second composite image on a predetermined printing paper or the like based on the received data. Here, the image forming device 20 prints pixels designated as the black spot color using IR ink or IR toner or the like.

[0074] According to the imaging device 10 of this embodiment, an imaging operation of a third image for generating a second composite image by compositing with the first image can be received in a state in which the first composite image is displayed. If the imaging device 10 and the subject 802 are maintained in a state in which the second image is captured, the second image and the third image will be almost the same image. In other words, the displayed first composite image serves as a reference for the position, size, etc. at which the image to be captured (third image) and the first image are composited.

[0075] This allows the user to imagine the position, size, etc. of the image to be captured and the other image (first image) when capturing the third image to be composited, eliminating the need to repeat capturing and compositing until the user is satisfied with the composite image, thereby reducing the workload.

[0076] Furthermore, according to the imaging device 10 of this embodiment, the second image is binarized and displayed, and the third image is synthesized as a special color. Therefore, when the position of the two-dimensional code or the like in the image has not been determined due to restrictions such as the method of use, the user can first image the scenery or the like, and then image the two-dimensional code or the like, thereby allowing the user to later determine the position of the two-dimensional code or the like in the image of the scenery or the like.

[0077] Second Embodiment The second embodiment will be described below with reference to the drawings. The second embodiment differs from the first embodiment in that the target of binarization and the target of synthesis as a special color are the first image. Therefore, in the following description of the second embodiment, the differences from the first embodiment will be mainly described, and the same reference numerals as those used in the description of the first embodiment will be given to components having the same functional configuration as the first embodiment, and the description thereof will be omitted.

[0078] FIG. 8 is a diagram showing an example of a flow of imaging processing according to the second embodiment.

[0079] When the imaging device 10 according to the present embodiment starts imaging processing, the imaging unit 11 captures a first image such as a two-dimensional code in response to a user's operation (step S201). Then, the image binarization unit 12 binarizes the first image (step S202). The storage unit 17 stores the first image (step S203).

[0080] FIG. 9 is a diagram for explaining capturing of a first image according to the second embodiment.

[0081] The first image 903 is an image obtained by capturing an image of a subject 803 such as a two-dimensional code. In response to a user's imaging operation, the imaging unit 11 captures an image of the subject 803 such as a landscape in step S201 of the imaging process. The image binarization unit 12 binarizes the first image 903 in step S203 of the imaging process. For example, the image binarization unit 12 assigns either a value of 0 (first value) or 1 (second value) to each pixel as data indicating the first image 903.

[0082] In step S203 of the imaging process, the storage unit 17 stores data indicating the first image 903. The imaging device 10 may display the first image 903 as shown in FIG.

[0083] 8, the imaging unit 11 captures a second image such as a landscape (step S204). The composite image display unit 13 displays a first composite image obtained by combining the first image and the second image (step S205).

[0084] Next, the imaging operation receiving unit 14 determines whether or not an imaging operation for a third image has been received (step S206). If the imaging operation receiving unit 14 determines that an imaging operation for a third image has not been received (step S206: No), the process returns to step S204, and the imaging unit 11 captures a second image such as a landscape.

[0085] Note that, similarly to the first embodiment, the imaging device 10 may immediately return to and execute the process of step S204, or may execute the process of step S204 at predetermined intervals, for example, every second.

[0086] For example, the imaging unit 11 repeatedly captures the second image in a so-called live view mode, as in the first embodiment. In this case, the composite image display unit 13 executes display processing in real time. This allows the imaging device 10 to repeatedly capture the second image and display the first composite image in real time without receiving a user operation.

[0087] When the imaging operation receiving unit 14 determines that an imaging operation for a third image has been received (step S206: Yes), the imaging unit 11 captures the third image (step S207).

[0088] FIG. 10 is a diagram for explaining capturing of the second image and the third image according to the second embodiment.

[0089] The second image 904 is an image obtained by capturing an image of a subject 804 such as a landscape. In response to an image capturing operation by the user, the image capturing unit 11 captures an image of the subject 804 such as a landscape in step S204 of the image capturing process. The composite image display unit 13 displays a first composite image obtained by combining the first image 903 and the second image 904 in step S205 of the image capturing process.

[0090] Specifically, for example, the composite image display unit 13 displays pixels of the binarized first image 903 after composition with pixels having a value of 0 (first value) as pixel values ​​of the second image 904, and displays pixels after composition with pixels having a value of 1 (second value) in black. In this way, the composite image display unit 13 displays a two-dimensional code such as a barcode or QR code (registered trademark) in black so as to be superimposed on the first image 903.

[0091] As described above, the imaging unit 11 and the composite image display unit 13 repeatedly execute the processes from step S204 to step S205 of the imaging process until the imaging operation receiving unit 14 receives an imaging operation. This allows the user to perform imaging operations by moving the imaging device 10 itself or adjusting the magnification ratio by a zoom function or the like while checking the displayed first composite image so that the image of the subject 804 is composited at an appropriate position and size.

[0092] Returning to FIG. 8, the composite image generating unit 15 generates a second composite image by combining the first image and the third image (step S208). Here, similar to the first embodiment in which the binarized third image is combined as a special color, the composite image generating unit 15 combines the binarized first image as a special color. Specifically, the composite image generating unit 15 combines pixels of the first image having a value of 0 (first value) so that the resulting pixels have pixel values ​​of the third image, and combines pixels of the first image having a value of 1 (second value) so that the resulting pixels have pixel values ​​of the third image, thereby generating a second composite image.

[0093] Next, the composite image output unit 16 transmits data indicating the second composite image to the image forming device 20 (step S209). As a result, the image forming device 20 prints the second composite image on a predetermined printing paper or the like based on the received data. Here, the image forming device 20 prints pixels designated as the black spot color using IR ink or IR toner or the like, similar to the first embodiment.

[0094] According to the imaging device 10 of this embodiment, as in the first embodiment, an imaging operation of a third image to be composited with the first image to generate a second composite image can be received while the first composite image is displayed.

[0095] Furthermore, according to the imaging device 10 of this embodiment, the first image captured first is binarized and displayed, and the first image is synthesized as a special color. Therefore, if the position of a two-dimensional code or the like in an image is determined due to restrictions such as the method of use, the user can first capture the two-dimensional code or the like, and then determine the position of the subject such as a landscape later.

[0096] Third embodiment A third embodiment will be described below with reference to the drawings. The third embodiment differs from the first embodiment in that it includes a warning display unit that displays a warning and a setting reception unit that receives an operation to set a threshold value. Therefore, in the following description of the third embodiment, the differences from the first embodiment will be mainly described, and the same reference numerals as those used in the description of the first embodiment will be given to components having the same functional configuration as the first embodiment, and the description thereof will be omitted.

[0097] FIG. 11 is a diagram illustrating an example of functions of the imaging device according to the third embodiment.

[0098] The imaging device 10 according to this embodiment has a configuration in which a setting receiving unit 18 and a warning display unit 19 are added to the configuration according to the first embodiment.

[0099] The setting reception unit 18 receives an operation to set a threshold value used in processing by the warning display unit 19 described later. For example, the setting reception unit 18 displays the set threshold value on the display 118, and receives input of a changed threshold value via the touch panel 121. Note that an initial setting threshold value may be set, or the threshold value may be required to be input initially. The setting reception unit 18 may also display a plurality of threshold value candidates as options and receive selection of the threshold value to be set.

[0100] The setting reception unit 18 is realized by the CPU 101 executing processes defined in a program stored in the ROM 102, the EEPROM 104, or the like, and controlling the display 118, the touch panel 121, and the like.

[0101] The warning display unit 19 displays a warning when a pixel having a color density equal to or greater than a predefined threshold is included in a pixel in the first image that overlaps with or is adjacent to a pixel having a second value (e.g., 1) in the binarized second image. The threshold is a value set by the setting reception unit 18.

[0102] For example, in the case of image data in which the brightness of red, green, and blue in RGB format is expressed as a value from 0 to 255, a color density equal to or greater than a threshold value refers to a pixel in which the average value of the brightness of red, green, and blue is equal to or less than a threshold value (e.g., 30). In this case, the smaller the brightness value, the darker the color. The threshold value of 30 is a value set by the setting receiving unit 18.

[0103] The warning display unit 19 is realized by the CPU 101 executing processes defined in a program stored in the ROM 102, the EEPROM 104, or the like, and controlling the display 118 and the like.

[0104] In step S205 of the imaging process shown in FIG. 5, the warning display unit 19 displays a warning when a pixel in the first image that overlaps with or is adjacent to a pixel of the second value in the binarized second image has a color intensity equal to or greater than a predefined threshold value.

[0105] FIG. 12 is a diagram for explaining capturing of the second image and the third image according to the third embodiment.

[0106] The warning display unit 19 displays a warning when the first image 901 includes a pixel having a color density equal to or greater than a threshold value among pixels that overlap with or are adjacent to black pixels in the binarized second image 902. Specifically, the warning display unit 19 may display a message on the screen of the display 118, or may display the corresponding portion of the displayed first composite image in a color such as bright red.

[0107] There is a risk that black toner or black ink will react to infrared rays in the same way as IR toner or IR ink, making it difficult to distinguish between the two. Therefore, according to the imaging device 10 of this embodiment, it is possible to capture a third image such that pixels in the first image 901 that overlap or are adjacent to black pixels in the binarized second image 902 do not include pixels having a color density equal to or greater than a threshold value.

[0108] Furthermore, with the imaging device 10 according to this embodiment, a threshold value can be set, so that it is possible to flexibly accommodate differences in the degree to which black toner or black ink responds to infrared light.

[0109] This embodiment may be combined with the second embodiment. Specifically, the warning display unit 19 may execute the same process as that shown in this embodiment as the process of step S205 of the imaging process according to the second embodiment shown in Fig. 8. That is, the warning display unit 19 may display a warning when a pixel having a color density equal to or greater than a predefined threshold is included in a pixel in the second image that overlaps with or is adjacent to a pixel having a second value in the binarized first image.

[0110] In this way, when capturing the image shown in Figure 10, the third image can be captured so that the second image 904 does not include any pixels having a color intensity equal to or greater than the threshold value that overlap or are adjacent to the black pixels in the binarized first image 903.

[0111] In each of the above-described embodiments, an example has been shown in which the first image is an image captured by the imaging unit 11. However, the scope of the present invention is not limited to this, and the first image may be another image, for example, an image received from another device, etc.

[0112] In each of the above-described embodiments, an example has been shown in which the composite image output unit 16 transmits data representing the second composite image to the image forming apparatus 20. However, the composite image output unit 16 may output the data representing the second composite image to an external storage medium such as a flash memory or an SD card. In this case, a user inserts the output external storage medium into another device or the image forming apparatus 20, and causes the image forming apparatus 20 to execute printing.

[0113] In one embodiment, imaging apparatus 10 includes multiple computing devices, such as a server cluster, configured to communicate with each other over any type of communications link, including a network, shared memory, etc., and may perform the processes disclosed herein.

[0114] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), or a conventional circuit module designed to execute each function described above.

[0115] Furthermore, the imaging device 10 according to the above-described embodiment may have an imaging function, and may be, for example, a PJ (Projector), an output device such as digital signage, a remote conferencing device, a HUD (Head Up Display) device, industrial machinery, medical equipment, network home appliances, an automobile (Connected Car), a notebook PC (Personal Computer), a mobile phone, a tablet terminal, a game console, a PDA (Personal Digital Assistant), a digital camera, a celestial sphere panoramic image imaging device, a wearable PC, a desktop PC, or the like.

[0116] Although the present invention has been described above based on the embodiments, the present invention is not limited to the requirements shown in the above embodiments. These points can be changed without departing from the spirit of the present invention, and can be appropriately determined according to the application form. [Explanation of symbols]

[0117] 1. Image forming system 2. Requester 3. Workers 10. Imaging device 11 Imaging unit 12 Image Binarization Section 13 Composite image display unit 14. Imaging operation reception section 15. Composite image generation unit 16 Composite image output section 17 Memory section 18 Settings reception section 19 Warning display section 20 Image forming device 30 Communication Network [Prior art documents] [Patent documents]

[0118] [Patent Document 1] JP 2006-304247 A

Claims

1. An imaging unit that captures an image; a composite image display unit that displays a first composite image obtained by combining a first image and a second image captured by the imaging unit; an imaging operation receiving unit that receives an imaging operation of a third image for compositing with the first image to generate a second composite image while the first composite image is being displayed; and a composite image generating unit that generates the second composite image by combining the third image with the first image as a feature. Imaging device.

2. An imaging unit that captures an image; a composite image display unit that displays a first composite image obtained by combining a first image and a second image captured by the imaging unit; an imaging operation receiving unit that receives an imaging operation of a third image for compositing with the first image to generate a second composite image while the first composite image is being displayed; and a composite image generating unit that generates the second composite image by combining the first image with the third image as a feature color. Imaging device.

3. an image binarization unit that binarizes the second image and the third image, the composite image display unit displays pixels of the binarized second image after being composited with pixels of a first value as pixel values ​​of the first image, and displays pixels of the binarized second image after being composited with pixels of a second value as black; the composite image generating unit generates the second composite image by combining the pixels of the third image with the pixels of the first value so that the pixels after combining with the pixels of the first value have pixel values ​​of the first image, and by combining the pixels of the third image with the pixels of the second value so that the pixels after combining with the pixels of the second value become pixels designated as a black special color. The imaging device according to claim 1 .

4. a warning display unit that displays a warning when a pixel having a color density equal to or greater than a predetermined threshold is included in the first image, the pixel being overlapped with or adjacent to a pixel having the second value of the binarized second image; The imaging device according to claim 3 .

5. An image binarization unit that binarizes the first image, the composite image display unit displays pixels of the binarized first image after being composited with pixels of a first value as pixel values ​​of the second image, and displays pixels of the binarized first image after being composited with pixels of a second value as black; the composite image generating unit generates the second composite image by combining pixels of the binarized first image with the pixels of the first value so as to have pixel values ​​of the third image, and combining pixels of the binarized first image with the pixels of the second value so as to have pixels designated as a black special color. The imaging device according to claim 2 .

6. a warning display unit that displays a warning when a pixel having a color density equal to or greater than a predefined threshold is included in a pixel in the second image that overlaps with or is adjacent to a pixel having the second value in the binarized first image, The imaging device according to claim 5 .

7. A setting reception unit that receives an operation to set the threshold value is further provided.

7. The imaging device according to claim 4.

8. the imaging unit and the composite image display unit repeatedly execute an imaging process of the second image by the imaging unit and a display process of the first composite image by the composite image display unit. The imaging device according to claim 1 .

9. A method implemented by an imaging device, comprising: capturing an image by an imaging unit; displaying a first composite image obtained by combining a first image and a second image captured by the imaging unit; receiving an image capturing operation of a third image for compositing with the first image to generate a second composite image while the first composite image is being displayed; and generating the second composite image by combining the third image with the first image as a feature. Imaging method.

10. On the computer, capturing an image by an imaging unit; displaying a first composite image obtained by combining a first image and a second image captured by the imaging unit; receiving an image capturing operation of a third image for compositing with the first image to generate a second composite image while the first composite image is being displayed; generating a second composite image by combining the third image with the first image as a feature; A program for executing the above.

Images