Imaging device, image processing method, and recording medium

Abstract

The invention provides an imaging apparatus, an image processing method, and a recording medium. The image processing apparatus includes: an image acquisition unit that stores a captured image; a date and time information acquisition unit that acquires first date and time information and acquires second date and time information; an elapsed date and time calculation unit that compares the first date and time information with the second date and time information and calculates the date and time elapsed from the imaging time; an image processing unit that selects an image process in accordance with the length of the elapsed date and time from among a plurality of image processes that change in accordance with the length of the elapsed date and time, and performs the selected image process on the captured image to be processed; and an imaging mode setting unit that sets one imaging mode from among a plurality of imaging modes, and the image processing unit changes the color of a part of the subject of the captured image to be processed in accordance with the length of the elapsed date and time. The image processing unit changes the plurality of image processing according to the length of the elapsed date and time in accordance with the imaging mode set by the imaging mode setting unit.

Description

[0001] This application is a divisional application of the invention patent application with the application date of March 2, 2020, application number: 202080022180.7, and invention name: "Image processing device, image processing method, photographic device and recording medium". Technical Field

[0002] The present invention relates to an image processing device, an image processing method, a photographic device and a recording medium, and relates to an image processing device, an image processing method, a photographic device and a recording medium that change image processing according to the date and length of time elapsed from the time of photography. Background Art

[0003] Conventionally, there has been proposed a technique for performing predetermined processing on an image so as to make the image more interesting to a person viewing the image.

[0004] For example, Patent Document 1 describes a technique in which, when a plurality of image contents are continuously output, an effect corresponding to attribute information of each image content is inserted and the image contents are continuously output.

[0005] Prior art literature

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Publication No. 2008-61032 Summary of the invention

[0008] Technical issues to be solved by the invention

[0009] Here, one of the changes that people find interesting is the change over time. For example, in leather products, the surface of the leather gradually changes with the years of use, and each change brings a different aesthetic appearance. Also, for example, the taste of wine gradually changes with the storage period, and the drinker can enjoy the change in taste.

[0010] The above-mentioned patent document 1 records the following technology, namely, the recording date and time of the content are compared with the playback date and time. When the value is above a threshold, a sepia effect is selected (Patent document 1: paragraph 0055), but this change is a one-time change, and is not a change over time that gradually changes according to the elapsed time.

[0011] The present invention has been made in view of such circumstances, and an object of the present invention is to provide an image processing device, an image processing method, a photographing device, and a program capable of performing image processing that changes over time.

[0012] Means for solving technical problems

[0013] An image processing device as one mode of the present invention for achieving the above-mentioned purpose comprises: an image acquisition unit, which acquires a photographic image of a processing object from a storage unit storing a photographic image having a first date and time information indicating a photographing time; a date and time information acquisition unit, which acquires the first date and time information from the photographic image of the processing object, and acquires the second date and time information indicating the date and time when the photographic image of the processing object is acquired from the storage unit by the image acquisition unit; an elapsed date and time calculation unit, which compares the first date and time information acquired by the date and time information acquisition unit with the second date and time information, and calculates the date and time elapsed from the photographing time; and an image processing unit, which selects an image processing according to the length of the elapsed date and time from a plurality of image processings that vary according to the length of the elapsed date and time, and performs the selected image processing on the photographic image of the processing object.

[0014] According to this method, the date and time elapsed from the shooting time are calculated, and image processing is performed according to the calculated length of the elapsed date and time from a plurality of image processings that vary according to the length of the elapsed date and time. Thus, this method can perform image processing that varies with time on the photographed image.

[0015] Preferably, the image processing device includes a display control unit configured to display, on a display unit, a captured image of a processing target subjected to image processing by the image processing unit.

[0016] Preferably, the image processing apparatus includes a print control unit configured to cause the printing unit to print the captured image to be processed that has been subjected to image processing by the image processing unit.

[0017] Preferably, the captured image of the processing target subjected to image processing by the image processing unit and the captured image of the processing target before being subjected to image processing by the image processing unit are stored in the storage unit.

[0018] Preferably, a captured image of a processing target that has been subjected to image processing by the image processing unit is not stored in the storage unit.

[0019] Preferably, the image processing apparatus includes a relationship input unit that receives an input of a correspondence relationship between a plurality of image processing and a length of elapsed date and time on a time axis.

[0020] Preferably, the image processing unit changes the entire color of the photographic image to be processed according to the length of the elapsed date and time.

[0021] Preferably, the image processing unit changes a color of a part of a subject in a photographic image to be processed according to a length of a date and time that has passed.

[0022] Preferably, the image processing unit lightens the background color of the photographic image to be processed according to the length of the elapsed date and time.

[0023] Preferably, the image processing unit changes a part of the color or a part of the hue of the photographic image to be processed according to the length of the elapsed date and time.

[0024] Preferably, the image processing unit changes the degree of blurring of a partial region of the photographic image to be processed according to the length of the elapsed date and time.

[0025] Preferably, the image processing unit changes the degree of blurring of the foreground or background of a person in the photographic image according to the length of the elapsed date and time.

[0026] Preferably, the image processing unit changes the decorative image added to the photographic image to be processed according to the length of the elapsed date and time.

[0027] A photographing device as another embodiment of the present invention is equipped with the above-mentioned image processing device.

[0028] Preferably, the photographing device includes a photographing mode setting unit that sets one photographing mode from a plurality of photographing modes, and the image processing unit changes a plurality of image processing steps that vary according to the length of a date and time that has passed, according to the photographing mode set in the photographing mode setting unit.

[0029] As another embodiment of the present invention, an image processing method includes: a step of acquiring a photographic image of a processing object from a storage unit storing a photographic image having first date and time information indicating a photographing time; a step of acquiring the first date and time information from the photographic image of the processing object, and acquiring second date and time information indicating the date and time when the photographic image of the processing object was acquired from the storage unit; a step of comparing the first date and time information with the second date and time information to calculate the date and time elapsed from the photographing time; and a step of selecting an image processing according to the length of the elapsed date and time from a plurality of image processings that vary according to the length of the elapsed date and time, and performing the selected image processing on the photographic image of the processing object.

[0030] As another embodiment of the present invention, a program causes a computer to execute an image processing step including the following steps: a step of acquiring a photographic image of a processing object from a storage unit storing a photographic image having first date and time information indicating a photographing time; a step of acquiring the first date and time information from the photographic image of the processing object, and acquiring second date and time information indicating the date and time when the photographic image of the processing object was acquired from the storage unit; a step of comparing the first date and time information with the second date and time information, and calculating the date and time elapsed from the photographing time; and a step of selecting an image processing according to the length of the elapsed date and time from a plurality of image processings that vary according to the length of the elapsed date and time, and performing the selected image processing on the photographic image of the processing object.

[0031] Effects of the Invention

[0032] According to the present invention, the date and time elapsed from the photographing time are calculated, and image processing is performed according to the calculated length of the elapsed date and time from multiple image processings that vary according to the length of the elapsed date and time, thereby making it possible to perform image processing that varies over time on the photographic image. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 This is a front perspective view showing an example of a digital camera with a printer.

[0034] Figure 2 It is a perspective view of the back of a digital camera with a printer.

[0035] Figure 3 This is the front view of the instant film.

[0036] Figure 4 This is the rear view of instant film.

[0037] Figure 5 This is a block diagram showing the main parts of the electrical structure of a digital camera with a printer.

[0038] Figure 6 It is a diagram showing an example of a functional configuration of an image processing device.

[0039] Figure 7 This is a conceptual diagram for explaining the image processing that changes with time performed by the image processing unit.

[0040] Figure 8 is a flowchart showing an image processing method.

[0041] Fig. 9 This is a diagram for explaining image processing in which the overall color of a photographic image changes over time.

[0042] Fig.10This is a diagram for explaining image processing in which the color of a part of a subject in a photographic image changes over time.

[0043] Fig.11 This is a diagram for explaining image processing in which the same color or hue of a photographic image changes over time.

[0044] Fig.12 This is a diagram for explaining image processing in which the degree of blurring of a partial area of ​​a photographic image changes over time.

[0045] Fig.13 This is a diagram for explaining image processing in which a decorative image added to a photographic image changes over time.

[0046] Fig.14 This is a diagram showing an example of image processing using the sound of a photographic environment.

[0047] Fig.15 This diagram shows an example of processing using information on a shooting location.

[0048] Fig.16 This is a diagram showing an example of a mood setting screen.

[0049] Fig.17 This is a diagram showing an example of image processing according to emotions. DETAILED DESCRIPTION

[0050] Hereinafter, preferred embodiments of the image processing device, image processing method, photographing device, and program according to the present invention will be described with reference to the accompanying drawings.

[0051] <Digital camera with printer>

[0052] The image processing device 101 equipped with the present invention (refer to Figure 6 ) is a digital camera with a built-in printer (photographic device) 10, which has a function of printing the captured image (photographic image) on the spot. The digital camera with a printer 10 uses an instant film packaging box to print on the instant film. In addition, the digital camera with a printer 10 of this embodiment has a recording function, which can record audio in association with the photographic image.

[0053] [Appearance structure]

[0054] Figure 1 This is a front perspective view showing an example of a digital camera with a printer. Figure 2 yes Figure 1 A rear perspective view of a digital camera with a printer is shown.

[0055] like Figure 1 and Figure 2As shown, the digital camera with a printer 10 has a portable camera body 12. The camera body 12 is thin in the front-to-back direction and has a longitudinal dimension longer than a lateral dimension, and has a vertically long rectangular parallelepiped shape.

[0056] like Figure 1 As shown, the front side of the camera body 12 is provided with a photographic lens 14, a release button 16, a recording button 18, a flash light window 20, etc. In addition, a power button 22a, a menu button 22b, an OK button 22c, a mode switching button 22d, a microphone hole 24, a speaker hole 26, etc. are provided on the side of one side of the camera body 12. The release button 16 is a button for instructing the recording of photographic images. The power button 22a is a button for turning on and off the power of the digital camera with a printer 10. The menu button 22b is a button for calling up a menu screen. The OK button 22c is a button for indicating OK. The mode switching button 22d is a button for switching between the automatic print mode and the manual print mode in the photographic mode. In addition, by calling up a menu screen with the menu button 22b, displaying a photographic mode change screen, and confirming with the OK button 22c, the photographic mode can be changed. Appropriate photographic conditions are set in each photographic mode. For example, there are a portrait mode and a landscape mode in the photographic mode. In this case, the menu button 22b and the OK button 22c constitute a shooting mode setting unit.

[0057] like Figure 2 As shown in FIG. 1 , a touch screen type display (display unit) 28, a film cover 30, and various operation buttons are provided on the back side of the camera body 12. The film cover 30 is a cover for opening and closing the film loading chamber. The operation buttons include a joystick 32a, a print button 32b, a playback button 32c, a cancel button 32d, and the like. The print button 32b is a button for instructing printing. The playback button 32c is a button for instructing switching to playback mode. The cancel button 32d is a button for instructing canceling the operation.

[0058] like Figure 1 and Figure 2 As shown in FIG. 1 , a film outlet 34 is provided on the upper surface of the camera body 12 . The printed instant film is discharged from the film outlet 34 .

[0059] [Structure of the printer section of a digital camera with a printer]

[0060] The digital camera with a printer 10 includes a film loading chamber (not shown), a film delivery mechanism 52, a film conveying mechanism 54, a print head 56, etc. as components of a printing unit, i.e., a printer portion (see FIG. 1 ). Figure 5 ). The film loading chamber is filled with an instant film packaging box having a structure in which a plurality of instant films are accommodated in a shell. Figure 3 is a front view of the instant film 42, Figure 442 is a rear view of the instant film 42. Figure 3 and Figure 4 In the figure, the direction indicated by arrow F is the use direction of the instant film 42, and the instant film 42 is transported in the direction indicated by arrow F. Therefore, when loaded into the digital camera 10 with a printer, the direction indicated by arrow F becomes the discharge direction of the instant film 42.

[0061] The instant film 42 is a self-developing instant film having a rectangular card shape. The back side of the instant film 42 is configured as an exposure surface 42a, and the front side is configured as an observation surface 42b. The exposure surface 42a is a surface on which an image is recorded by exposure, and the observation surface 42b is a surface on which the recorded image is observed.

[0062] like Figure 3 As shown in FIG. 4 , the observation surface 42b of the instant film 42 is provided with an observation area 42h. Figure 4 As shown, the exposure surface 42a of the instant film 42 is provided with an exposure area 42c, a capsule 42d and a collection part 42f. After exposure, the instant film 42 is developed by spreading the developer in the capsule 42d to the exposure area 42c. The capsule 42d has a built-in developer capsule 42e containing the developer. The instant film 42 is passed between the roller pair, whereby the developer in the capsule 42d is squeezed out from the capsule 42d and spread to the exposure area 42c. The developer remaining during the spreading process is captured by the collection part 42f. The collection part 42f has a built-in absorbent 42g.

[0063] The instant film packaging box is loaded into a film loading chamber (not shown) provided inside the camera body 12. During printing, the films are fed out one by one by a claw (claw-shaped member) (not shown) of the film feeding mechanism 52, and are fed by a roller (not shown) of the film feeding mechanism 54. In addition, during the feeding process, an unshown spreading roller pair crushes the capsule 42d of the instant film 42 to spread the developer. The print head 56 is composed of a line exposure head, and irradiates the exposure surface 42a of the instant film 42 fed by the film feeding mechanism 54 with printing light line by line, and records a photographic image on the instant film 42 by a single pass. A frame 42i is provided around the observation area 42h, and the photographic image is displayed on the inner side of the frame 42i.

[0064] [Electrical structure of a digital camera with a printer]

[0065] Figure 5 This is a block diagram showing the main parts of the electrical configuration of the digital camera with a printer 10 .

[0066] like Figure 5As shown, the digital camera with a printer 10 includes a photographic lens 14, a lens driving unit 62, an image sensor 64, an image sensor driving unit 66, an analog signal processing unit 68, a digital signal processing unit 70, a memory (storage unit) 72, a memory controller 74, a display 28, a display controller 76, a communication unit 78, and an antenna 80. In addition, the digital camera with a printer 10 includes a film delivery driving unit 82, a film transport driving unit 84, a head driving unit 86, a flash 88, a flash light control unit 90, a microphone 92, a speaker 94, an audio signal processing unit 96, a clock unit 97, an operation unit 98, and a camera control unit 100.

[0067] The photographic lens 14 forms an optical image of the subject on the light receiving surface of the image sensor 64. The photographic lens 14 has a focus adjustment function and is provided with an aperture and a shutter (not shown). The lens driving unit 62 includes a motor and a driving circuit for driving the focus adjustment function of the photographic lens 14, a motor and a driving circuit for driving the aperture, and a motor and a driving circuit for driving the shutter, and operates the focus adjustment mechanism, the aperture, and the shutter according to a command from the camera control unit 100.

[0068] The image sensor 64 is composed of a two-dimensional solid-state imaging element such as a CCD image sensor (CCD: Charge Coupled Device) or a CMOS image sensor (CMOS: Complementary Metal Oxide Semiconductor). The image sensor 64 has an imaging area with an aspect ratio corresponding to the printable area of ​​the instant film used. The image sensor driving unit 66 includes a driving circuit for the image sensor 64, and operates the image sensor 64 according to a command from the camera control unit 100.

[0069] The analog signal processing unit 68 reads the analog image signal for each pixel output from the image sensor 64 , performs signal processing (for example, correlated double sampling processing, amplification processing, etc.), and digitizes the analog image signal to output.

[0070] The digital signal processing unit 70 reads the digital image signal output from the analog signal processing unit 68 and performs signal processing (for example, grayscale conversion processing, white balance correction processing, gamma correction processing, synchronization processing, YC conversion processing, etc.) to generate image data.

[0071] The memory 72 is a non-temporary recording medium that stores image data (photographic images) and audio data obtained by shooting, and is, for example, a memory card. The memory 72 is an example of a storage unit. The memory controller 74 reads and writes data to the memory 72 under the control of the camera control unit 100.

[0072] The display 28 is composed of, for example, a liquid crystal display (LCD), an organic electro-luminescence display (OELD), etc. Alternatively, the display 28 may be composed of a plasma display, a field emission display (FED), electronic paper, etc. The display controller 76 causes the display 28 to display an image under the control of the camera control unit 100.

[0073] The communication unit 78 communicates wirelessly with other digital cameras with printers 10 (other devices) via the antenna 80 under the control of the camera control unit 100. The communication unit 78 communicates directly with other devices at a short distance through short-range wireless communication such as the NFC standard (NFC: Near Field Communication) and Bluetooth (registered trademark). In addition, the communication unit 78 can be connected to an information communication network such as the Internet via a Wi-Fi spot (Wi-Fi: registered trademark) and communicate with other digital cameras with printers 10 (other devices) regardless of the distance.

[0074] The film delivery drive unit 82 includes a motor and a drive circuit for driving a claw (claw-shaped member) (not shown) of the film delivery mechanism 52 , and drives the motor to operate the claw under the control of the camera control unit 100 .

[0075] The film transport drive unit 84 includes a motor and a driving circuit for driving a transport roller pair (not shown) of the film transport mechanism 54, and a motor and a driving circuit for driving an unfolding roller pair (not shown). Under the control of the camera control unit 100, the motor of the transport roller pair and the motor of the unfolding roller pair are driven to move the transport roller pair and the unfolding roller pair.

[0076] The head driving unit 86 includes a driving circuit for the print head 56 , and drives the print head 56 under the control of the camera control unit 100 .

[0077] The flash 88 includes, for example, a xenon tube, an LED (Light Emitting Diode) or the like as a light source, and emits light from the light source to illuminate the subject. The flash light is emitted from a flash light emission window 20 (see FIG. 1 ) provided on the front side of the camera body 12. Figure 1 The flash light emission control unit 90 includes a drive circuit for the flash light 88, and causes the flash light 88 to emit light according to an instruction from the camera control unit 100.

[0078] The microphone 92 is connected to the camera body 12 via the microphone hole 24 (see Figure 2) collects external audio. The speaker 94 outputs audio to the outside from the speaker hole 26 provided in the camera body 12. The audio signal processing unit 96 performs signal processing on the audio signal input from the microphone 92, digitizes it and outputs it. In addition, the audio signal processing unit 96 performs signal processing on the audio data provided from the camera control unit 100 and outputs it from the speaker 94. The clock unit 97 holds the information of the date and time, and the camera control unit 100 sets the shooting time (date and time) with reference to the information.

[0079] The operating unit 98 includes various operating components such as the release button 16, the recording button 18, the power button 22a, the menu button 22b, the OK button 22c, the joystick 32a, the print button 32b, the playback button 32c, and the cancel button 32d, and their signal processing circuits, and outputs signals based on the operations of each operating component to the camera control unit 100.

[0080] The camera control unit 100 is a control unit that comprehensively controls the operation of the entire digital camera with a printer 10. The camera control unit 100 includes a CPU (CPU: Central Processing Unit), a ROM (ROM: Read Only Memory), a RAM (RAM: Random Access Memory), an EEPROM (Electronically Erasable and Programmable Read Only Memory), etc. The camera control unit 100 is a computer composed of these CPUs, etc., and realizes various functions described below by executing a control program.

[0081] <Functional structure of image processing device>

[0082] The digital camera with a printer 10 is equipped with an image processing device 101 , and the main functions of the image processing device 101 are provided in a camera control unit 100 .

[0083] Figure 6 1 is a diagram showing a functional configuration example of an image processing device 101 provided in the camera control section 100. The image processing device 101 includes an image acquisition section 100A, a date and time information acquisition section 100B, an elapsed date and time calculation section 100C, an image processing section 100D, a display control section 100E, and a print control section 100F.

[0084] The functions of each part of the camera control unit 100 (image processing device 101) can be implemented using various processors and recording media. The various processors include, for example, a general-purpose processor, i.e., a CPU, which executes software (programs) to implement various functions. In addition, the various processors include programmable logic devices (PLDs), such as GPU (Graphics Processing Unit) and FPGA (Field Programmable Gate Array), which are processors specifically used for image processing. A programmable logic device is a processor that can change the circuit structure after manufacturing. In addition, processors, i.e., dedicated circuits, having a circuit structure specially designed for performing specific processing, such as ASIC (Application Specific Integrated Circuit), are also included in the various processors mentioned above.

[0085] The functions of each part can be implemented by one processor, or by multiple processors of the same or different types (for example, multiple FPGAs, or a combination of CPU and FPGA, or a combination of CPU and GPU). In addition, one processor may have multiple functions. As an example of multiple functions constituted by one processor, first, there is a method in which a processor is constituted by a combination of one or more CPUs and software, such as a computer, and the processor is implemented as multiple functions. Second, there is a method in which a processor that implements the functions of the entire system through one IC (Integrated Circuit) chip is used, such as a system on chip (System On Chip: SoC). In this way, various functions are constituted as a hardware structure using one or more of the above-mentioned various processors. Moreover, as the hardware structure of these various processors, more specifically, it is a circuit (circuitry) that combines circuit elements such as semiconductor elements. These circuits can be circuits that implement the above-mentioned functions using logical sum, logical product, logical negation, exclusive or logical sum, and logical operations combining these.

[0086] When the processor or circuit executes software (program), the computer (various processors and circuits and / or combinations thereof constituting the camera control unit 100 (image processing device 101)) readable code of the executed software is stored in a non-transitory recording medium such as a ROM, and the computer refers to the software. The software stored in the non-transitory recording medium includes a program for executing the photography and synthesis of photographic images and data used during execution. The non-transitory recording medium that records the code may not be a ROM but various optical magnetic recording devices, semiconductor memories, etc. When processing using software, for example, a RAM is used as a temporary storage area.

[0087] The image acquisition unit 100A acquires a photographic image to be processed from the photographic images stored in the memory 72. The memory 72 stores a plurality of photographic images captured by the digital camera 10 with a printer. The photographic image has first date and time information indicating the time of capturing. Here, the first date and time information is information having at least one of the year, month, day and time when the photographic image is captured. The selection of the photographic image to be processed from the plurality of photographic images stored in the memory 72 is performed in various ways. For example, the plurality of photographic images stored in the memory 72 are displayed at a glance on the display 28, and the user selects the photographic image to be processed from the photographic images displayed at a glance. In addition, the photographic image to be processed can be selected individually or in plurality, and all the photographic images stored in the memory 72 can also be selected.

[0088] The date and time information acquisition unit 100B acquires the first date and time information and the second date and time information of the photographic image acquired by the image acquisition unit 100A. Here, the second date and time information is information indicating the date and time when the photographic image to be processed is acquired from the memory 72 by the image acquisition unit 100A. When the photographic image is acquired by the image acquisition unit 100A, the image processing device 101 immediately performs image processing, so it can be considered that the second date and time information is substantially the same as the information indicating the date and time when the image processing is performed.

[0089] The elapsed date and time calculation unit 100C compares the first date and time information acquired by the date and time information acquisition unit 100B with the second date and time information, and calculates the date and time that has passed from the shooting time to the time when the image acquisition unit 100A acquires the photographed image. For example, when the first date and time information is 9:04 on December 20, 2018, and the second date and time information is 9:06 on December 21, 2018, the elapsed date and time calculation unit 100C calculates the elapsed date and time as 1 day and 2 minutes.

[0090] The image processing unit 100D performs image processing that changes according to the length of the date and time that has passed on the photographic image selected as the processing object. That is, the image processing unit 100D performs image processing that changes with time on the photographic image. Specifically, the image processing unit 100D selects image processing according to the length of the date and time that has passed from a plurality of image processings that change according to the length of the date and time that has passed, and performs the selected image processing on the photographic image that is the processing object.

[0091] Figure 7 This is a conceptual diagram for explaining the image processing that changes with time performed by the image processing unit 100D. Figure 7 An example of the relationship between three pre-set image processings (image processing A, image processing B, image processing C) (symbol 105) performed by the image processing unit 100D and the elapsed date and time T (symbol 107) is shown. When the elapsed date and time T is from Ta to Tab, image processing A is performed, when the elapsed date and time is from Tab to Tbc, image processing B is performed, and when the elapsed date and time is from Tbc to Tc, image processing C is performed. For example, when the elapsed date and time T1 is image processing A, when the elapsed date and time T2 is image processing B, and when the elapsed date and time T3 is image processing C. In addition, Figure 7 In the case shown, the period Ta to Tab of image processing A, the period Tab to Tbc of image processing B, and the period Tbc to Tc of image processing C are constant, but this is not limited to this. The correspondence between the length of multiple image processing and the elapsed date and time on the time axis can be arbitrarily determined by the user. Figure 7 In the case shown, the user can arbitrarily set the period Ta to Tab of image processing A, the period Tab to Tbc of image processing B, and the period Tbc to Tc of image processing C. At this time, the user inputs the corresponding relationship via the operation unit (relation input unit) 98. In addition, image processing A, image processing B, and image processing C are different image processings from each other, and the processing contents of image processing A, image processing B, and image processing C change, so that the photographic image changes over time. In addition, the processing contents of the pre-set multiple image processings can be changed according to the photography mode or photography conditions. For example, the processing contents of image processing A, image processing B, and image processing C can be changed according to each photography mode, and the processing contents of image processing A, image processing B, and image processing C can be changed according to each photography condition.

[0092] The photographic image of the processing object that has been image-processed by the image processing unit 100D may be stored in the memory 72, or the image-processed photographic image may not be stored in the memory 72. When the photographic image after image processing is stored in the memory 72, the user can appreciate the photographic image that changes with time after a certain time has passed. Furthermore, when the photographic image after image processing is not stored in the memory 72, the user can appreciate the change with time by printing the photographic image after image processing. In addition, the photographic image before image processing selected as the processing object may be stored in the memory 72 or may not be stored in the memory 72.

[0093] Back to Figure 6 The display control unit 100E causes the display 28 to display the photographic image to be processed by the image processing unit 100D. The user can appreciate the changes of the photographic image over time by confirming the displayed photographic image after the image processing.

[0094] The print control unit 100F controls the printing of the image processed photographic image. For example, the print control unit 100F automatically or in accordance with the user's instruction causes the printing unit to print the photographic image of the processing object that has been image processed by the image processing unit 100D. The user can appreciate the changes of the photographic image over time by confirming the printed image after image processing.

[0095] Next, an image processing method (image processing step) using the image processing device 101 will be described. Figure 8 is a flowchart showing an image processing method.

[0096] First, the image acquisition unit 100A acquires the photographic image of the selected processing object (step S10). Then, the date and time information acquisition unit 100B acquires the first date and time information and the second date and time information of the photographic image acquired by the image acquisition unit 100A (step S11). Next, the elapsed date and time calculation unit 100C calculates the elapsed date and time based on the first date and time information and the second date and time information (step S12). Then, the image processing unit 100D performs image processing based on the calculated length of the elapsed date and time (step S13).

[0097] The above structures and functions can be appropriately implemented by any hardware, software or a combination of the two. For example, the present invention can also be applied to a program that causes a computer to execute the above processing steps, a computer-readable recording medium (non-transitory recording medium) recording such a program, or a computer capable of installing such a program.

[0098] As described above, according to this embodiment, the date and time elapsed from the photographing time are calculated, and image processing is performed according to the calculated length of the elapsed date and time from multiple image processings that vary according to the length of the elapsed date and time, thereby enabling image processing that varies over time to be performed on the photographic image.

[0099] <Example of image processing that changes over time>

[0100] Next, the image processing that changes with time by the image processing unit 100D will be described. The image processing that changes with time by the image processing unit 100D can be performed in various ways. A specific example of the image processing that changes with time will be described below.

[0101] [Example 1]

[0102] In the first example, the image processing unit 100D changes the overall color of the photographic image to be processed according to the length of the date and time that has passed. For example, the image processing unit 100D changes the overall color of the photographic image by lightening, darkening, or changing the color according to the length of the date and time that has passed.

[0103] Fig. 9 This is a diagram for explaining image processing in which the overall color of a photographic image changes over time.

[0104] Reference numeral 201 indicates a photographic image P1 at a time T1, reference numeral 203 indicates a photographic image P1 at a time T2, and reference numeral 205 indicates a photographic image P1 at a time T3. The length of the time T1<T2<T3.

[0105] like Fig. 9 As shown, the image processing unit 100D performs image processing in a manner that changes the overall color of the photographic image according to the length of the date and time that has passed. Specifically, the overall color of the image (for example, sepia) is gradually darkened in the order of the photographic image P1 of symbol 201, the photographic image P1 of symbol 203, and the photographic image P1 of symbol 205. In this way, by performing image processing that changes the overall color of the photographic image according to the date and time that has passed, the photographic image P1 can be changed over time.

[0106] [Example 2]

[0107] In the second example, the image processing unit 100D changes the color of a part of the subject of the photographic image to be processed according to the length of the date and time that has passed. For example, the image processing unit 100D changes the background color of the photographic image to be processed by lightening, darkening, or changing the color according to the length of the date and time that has passed.

[0108] Fig.10 This is a diagram for explaining image processing in which the color of a part of a subject in a photographic image changes over time.

[0109] Reference numeral 207 indicates the photographic image P2 when the date and time T1 has passed, reference numeral 209 indicates the photographic image P2 when the date and time T2 has passed, and reference numeral 211 indicates the photographic image P2 when the date and time T3 has passed.

[0110] like Fig.10 As shown, the image processing unit 100D performs image processing to gradually lighten the color of the background 213 of the photographic image P2 according to the length of the date and time that has passed. Specifically, the color of the background 213 is gradually lightened in the order of the photographic image P2 of the symbol 207, the photographic image P2 of the symbol 209, and the photographic image P2 of the symbol 211. In this way, by lightening the color of the background 213 according to the date and time that has passed, the photographic image P2 can be changed over time.

[0111] [Example 3]

[0112] In the third example, the image processing unit 100D changes a part of the color or a part of the hue of the photographic image to be processed according to the length of the date and time that has passed. Here, a part of the color means the same color in the photographic image, and a part of the hue means the same hue in the photographic image. In addition, for example, the same color is a color with equal RGB signal values, and for example, the same hue is a hue that belongs to the same group when the hue circle is divided into 6 equal parts.

[0113] Fig.11 This is a diagram for explaining image processing in which the same color or hue of a photographic image changes over time.

[0114] Reference numeral 215 indicates a photographic image P3 at a time T1, reference numeral 217 indicates a photographic image P3 at a time T2, and reference numeral 219 indicates a photographic image P3 at a time T3. In addition, leaves 221 of the photographic images P3 have the same color.

[0115] like Fig.11 As shown, the image processing unit 100D performs image processing to change the color of the leaf 221 according to the length of the date and time that has passed. Specifically, the color of the leaf 221 is gradually darkened in the order of the photographic image P3 of the symbol 215, the photographic image P3 of the symbol 217, and the photographic image P3 of the symbol 219. In this way, by changing the color of the leaf 221 according to the date and time that has passed, the photographic image P3 can be changed over time.

[0116] [Example 4]

[0117] In the fourth example, the image processing unit 100D changes the degree of blurring of a part of the photographic image of the processing object according to the length of the date and time that has passed. For example, the image processing unit 100D changes the degree of blurring of the foreground or background of a person in the photographic image according to the length of the date and time that has passed. In this way, by changing the degree of blurring of the foreground or background of the photographic image, the depth of field of the photographic image can be changed in a simulated manner. In addition, the image processing unit 100D detects a part of the area whose degree of blurring is changed or an area other than the part of the area whose degree of blurring is changed and performs blurring processing. For example, the image processing unit 100D detects an area of ​​a person (face) and performs blurring processing on an area other than the detected area of ​​the person (for example, the background).

[0118] Fig.12 This is a diagram for explaining image processing in which the blur degree of the background of a photographed image changes with time.

[0119] Reference numeral 223 indicates a photographic image P4 at a time T1, reference numeral 225 indicates a photographic image P4 at a time T2, and reference numeral 227 indicates a photographic image P4 at a time T3. Photographic image P4 has a person 229 as a main subject and a mountain 231 as a background.

[0120] At the time of the passing date and time T1 (symbol 223), the photographic image P4 is not changed by image processing, and the area of ​​the mountain 231 is not blurred. At the time of the passing date and time T2 (symbol 225), the focus is on the person 229, but the mountain 231 as the background is blurred by image processing. In the figure, blur is represented by a double line, and the size of the interval between the double lines represents the degree of blur. At the time of the passing date and time T3 (symbol 227), the focus is on the person 229, but the mountain 231 as the background is blurred by image processing. And at the time of the passing date and time T3 (symbol 227), the image processing is performed in a manner that the degree of blur is greater than that of the passing date and time T2. Here, the degree of blur indicates the degree of blur, and can be adjusted from a smaller degree of blur to a larger degree of blur by image processing. If the degree of blur of the mountain 231 as the background of the photographic image P4 is increased according to the passing date and time in this way, the depth of field of the photographic image P4 can be reduced in a simulated manner, and the photographic image P4 can be changed over time.

[0121] [Example 5]

[0122] In the fifth example, the image processing unit 100D changes the decorative image added to the photographic image to be processed according to the elapsed date and time. Here, the decorative image is an image added to the photographic image by image processing, such as cracks, cinema-style vertical stripes and color spots.

[0123] Fig.13 This is a diagram for explaining image processing in which a decorative image added to a photographic image changes over time.

[0124] Reference numeral 235 indicates the photographic image P5 when the date and time T1 has passed, reference numeral 237 indicates the photographic image P5 when the date and time T2 has passed, and reference numeral 239 indicates the photographic image P5 when the date and time T3 has passed.

[0125] When the date and time T1 passes (reference numeral 235), the crack 241 as a decorative image has not yet been added to the photographic image P5. When the date and time T2 passes (reference numeral 237), the crack 241 is added to the photographic image P5 by image processing. When the date and time T3 passes (reference numeral 239), the crack 241 is added to the photographic image P5 by image processing.

[0126] exist Fig.13 In the case shown, the crack 241 changes from the date and time T2 (symbol 237) to the date and time T3 (symbol 239). Specifically, the crack 241 becomes longer or the number of cracks 241 increases from the date and time T2 (symbol 237) to the date and time T3 (symbol 239). In this way, by changing the crack 241 added to the photographic image P5 according to the date and time, the photographic image P5 can be changed over time.

[0127] In the above, a specific example of the image processing that changes with time by the image processing unit 100D has been described. However, the image processing that changes with time by the image processing unit 100D is not limited to the above specific example.

[0128] <Other>

[0129] In this embodiment, the method of changing the image processing according to the date and time that have passed since the shooting time of the photographed image has been described, but there are other processes such as making the people who view the image interested.

[0130] [Using sound processing]

[0131] The photographic image can be processed by using the sound related to the photographic environment or the photographic image. The digital camera with a printer 10 is equipped with a microphone 92, which can collect the sound of the photographic environment. Therefore, the camera control unit 100 collects the sound of the photographic environment through the microphone 92, and stores the input sound of the photographic environment together with the photographic image in the memory 72. The image processing unit 100D uses the sound of the photographic environment stored in the memory 72 to process the photographic image.

[0132] Fig.141 is a diagram showing an example of image processing using sound in a photographic environment, and is a diagram showing an image photographed in a concert hall.

[0133] Photographic image P6 is an image taken in a concert hall. For example, the sound of the concert hall is collected by microphone 92, and image processing is applied to the photographic image. In photographic image P6, the sound is collected by microphone 92 to identify that it is a concert hall, and musical notes 250 are added to photographic image P6. In addition, when the image processing unit 100D collects the sound of the photographic environment of a classical concert, it performs soft image processing, or when the sound of the photographic environment of a heavy metal or intense concert is collected, it performs edge emphasis or image processing with strong contrast. In addition, when the sound of the crowd is collected as the sound of the photographic environment, the image processing unit 100D performs image processing to add noise to the photographic image.

[0134] [Handling of information using the photography location]

[0135] By using the information of the shooting location, the photographic image is processed according to the shooting location or information related to the photographic image is added. The digital camera with a printer 10 is provided with a GPS (Global Positioning System) function to detect the shooting location, and various processing is performed on the photographic image according to the shooting location. For example, when shooting in a concert hall, the image processing unit 100D performs image processing on the photographic image with a sense of the scene.

[0136] Fig.15 1 is a diagram showing an example of processing using information on a photographing location, and is a diagram showing a photographic image of a lion.

[0137] The photographic image P7 is an image of a lion photographed in front of a lion cage in a zoo. When the digital camera 10 with a printer has a GPS function, the GPS function can be used to detect that the photographic image P7 was taken in front of a lion cage in a zoo. In addition, the roar of the lion is recorded in the memory 72 together with the photographic image P7, or the description of the lion (audio or text) is stored together with the photographic image P7.

[0138] [Using emotional processing]

[0139] The user can input his / her own emotion and perform image processing corresponding to the emotion on the photographed image. For example, the display 28 of the digital camera with a printer 10 displays an emotion setting screen, and the user inputs his / her own emotion through the emotion setting screen. The image processing unit 100D performs image processing on the photographed image according to the input emotion.

[0140] Fig.16 This is a diagram showing an example of a mood setting screen displayed on the display 28 of the digital camera with printer 10 . Fig.16 The emotion setting screen shown is circular and displays four emotions (normal (H), lucky (I), sad (J), and shocked (K)). The user inputs emotions by operating each operation lever L on the emotion setting screen. The image processing unit 100D performs image processing on the photographic image according to the input emotion.

[0141] Fig.17 This is a diagram showing an example of image processing according to emotions.

[0142] like Fig.17 As shown, the photographic image P8 is displayed according to the user's mood setting screen ( Fig.16 ) to process the input emotion. Fig.17 In the example shown in FIG. 2 , the emotion input value display 252 on the emotion setting screen is also displayed together with the photographic image P8.

[0143] As mentioned above, although the example of this invention was demonstrated, this invention is not limited to the said embodiment, It is a matter of course that various deformation|transformation is possible within the range which does not deviate from the spirit of this invention.

[0144] Explanation of symbols

[0145] 10-digital camera with printer, 12-camera body, 14-photographic lens, 16-release button, 18-recording button, 20-flash light window, 22a-power button, 22b-menu button, 22c-OK button, 22d-mode switching button, 24-microphone hole, 26-speaker hole, 28-display, 30-film cover, 32a-joystick, 32b-print button, 32c-playback button, 32d-cancel button, 34-film discharge port, 42-instant film, 42a-exposure surface, 42b-observation surface, 42c-exposure area, 42d-capsule part, 42e-development liquid capsule part, 42f-collection part, 42g-absorbent material, 42h-observation area, 42i-frame, 52-film delivery mechanism, 54-film conveying mechanism, 56-printing head, 62-lens driving unit, 64-image sensor, 66-image sensor driving unit, 68-analog signal processing unit, 70-digital signal processing unit, 72-memory, 74-memory controller, 76-display controller, 78-communication unit, 80-antenna, 82-film feeding driving unit, 84-film conveying driving unit 86-head driving unit, 88-flash, 90-flash light control unit, 92-microphone, 94-speaker, 96-audio signal processing unit, 97-clock unit, 98-operation unit, 100-camera control unit, 100A-image acquisition unit, 100B-date and time information acquisition unit, 100C-elapsed date and time calculation unit, 100D-image processing unit, 100E-display control unit, 100F-print control unit, 101-image processing device.

Claims

1. A photographing device comprising: an image acquisition unit that acquires a photographic image of a processing target from a storage unit that stores the photographic image having first date and time information indicating a photographing time; a date and time information acquisition unit that acquires the first date and time information from the photographic image of the processing object, and acquires second date and time information indicating the date and time when the photographic image of the processing object is acquired from the storage unit by the image acquisition unit; an elapsed date and time calculation unit that compares the first date and time information acquired by the date and time information acquisition unit with the second date and time information to calculate the elapsed date and time from the photographing time; an image processing unit that selects an image processing according to the length of the elapsed date and time from among a plurality of image processings that vary according to the length of the elapsed date and time, and performs the selected image processing on the photographic image of the processing object; as well as a photographing mode setting unit for setting one photographing mode from a plurality of photographing modes, in, The image processing unit changes the color of a part of the subject in the photographic image of the processing object according to the length of the elapsed date and time, and changes the multiple image processing that changes according to the length of the elapsed date and time according to the photographic mode set by the photographic mode setting unit.

2. The photographing device according to claim 1, wherein: The image processing unit lightens the background color of the photographic image to be processed according to the length of the elapsed date and time.

3. The photographing device according to claim 1, wherein: The photographing device includes a display control unit configured to display the photographed image of the processing target, which has been subjected to image processing by the image processing unit, on a display unit.

4. The photographing device according to claim 1, wherein: The photographing device includes a print control unit that causes a printing unit to print the photographed image of the processing target that has been subjected to image processing by the image processing unit.

5. The photographing device according to claim 1, wherein: The photographic image of the processing target that has been subjected to the image processing by the image processing unit and the photographic image of the processing target before being subjected to the image processing by the image processing unit are stored in the storage unit.

6. The photographing device according to claim 1, wherein: The captured image of the processing target that has been subjected to image processing by the image processing unit is not stored in the storage unit.

7. The photographing device according to claim 1, wherein: The photographing device includes a relationship input unit that receives an input of a correspondence relationship between the plurality of image processes and the length of the elapsed date and time on a time axis.

8. The photographing device according to claim 1, wherein: The image processing unit changes the entire color of the photographic image to be processed according to the length of the elapsed date and time.

9. The photographing device according to claim 1, wherein: The image processing unit changes a part of the color or a part of the hue of the photographic image to be processed according to the length of the elapsed date and time.

10. The imaging device according to any one of claims 1 to 9, wherein: The image processing unit changes the degree of blurring of a partial area of ​​the photographic image to be processed according to the length of the elapsed date and time.

11. The photographing device according to claim 10, wherein: The image processing unit changes the blurring degree of the foreground or background of the person in the photographic image according to the length of the elapsed date and time.

12. The photographing device according to claim 1, wherein: The image processing unit changes the decorative image added to the photographic image to be processed according to the elapsed date and time.

13. An image processing method comprising the following steps: acquiring a photographic image of a processing target from a storage unit storing the photographic image having first date and time information indicating a photographing time; acquiring the first date and time information from the photographic image of the processing target, and acquiring second date and time information indicating the date and time when the photographic image of the processing target was acquired from the storage unit; comparing the first date and time information with the second date and time information to calculate the date and time that has passed since the photographing time; Selecting an image process according to the length of the elapsed date and time from among a plurality of image processes that vary according to the length of the elapsed date and time, and performing the selected image process on the photographic image of the processing object; as well as Set a shooting mode from multiple shooting modes. in, In the step of performing the image processing on the photographic image of the processing object, the color of a part of the subject in the photographic image of the processing object is changed according to the length of the elapsed date and time, and according to the photographic mode set in the step of setting the photographic mode, the multiple image processings that vary according to the length of the elapsed date and time are changed.

14. A recording medium, which is a non-volatile computer-readable recording medium, storing computer instructions, The computer instructions cause the computer to execute the image processing method according to claim 13.

Images