Digital camera and data playback system

Abstract

The invention provides a digital camera and a data playback system which can easily generate a printed matter capable of playing sound. When printing image data associated with voice data, the digital camera (10) with a printer adds unique identification information and uploads the image data and the voice data to a data storage server (200) via an upload terminal (300). After a two-dimensional code which encodes access information for accessing the uploaded data is added, an image is printed on the instant film (42). The two-dimensional code printed on the instant film (42) together with the image is read by the data playback terminal (400), and image data and voice data stored in the data storage server (200) can be downloaded and played by the data playback terminal (400).

Description

[0001] This application is a divisional application of the invention patent application with application date of September 6, 2019, application number 201910846705.8, and invention name “Digital camera with printer, printing method thereof, and data storage system”. Technical Field

[0002] The invention relates to a digital camera and a data playing system. Background Art

[0003] There is known a digital camera with a printer that has a built-in printer in the camera body and can print captured images on a medium on the spot.

[0004] Patent document 1 proposes that, in a digital camera with a printer that prints captured images on instant film, when printing an image captured with associated sound, the sound data is encoded using a barcode and printed together with the image, thereby enabling the sound to be played from the printed material.

[0005] On the other hand, Patent Document 2 proposes the following: when printing an image associated with sound, the sound data associated with the image is uploaded to a server, and the access information to the sound data is encoded using a QR code and printed together with the image, thereby enabling sound to be played from the printed material.

[0006] Patent Document 1: Japanese Patent Application Laid-Open No. 2001-324757

[0007] Patent Document 2: Japanese Patent Application Laid-Open No. 2006-293580

[0008] However, the method of encoding sound data and printing it together with an image, as in Patent Document 1, has limitations on the size of the encoded data, resulting in the disadvantage of only recording short sounds. Regarding this, the method of Patent Document 2 can record and play sounds of a certain length, but requires various processing steps on a personal computer, which leads to the disadvantage of requiring more time and effort before printing. Summary of the Invention

[0009] The present invention has been made in view of such circumstances, and an object of the present invention is to provide a digital camera with a printer, a printing method for the digital camera with a printer, and a data storage system that can easily generate printed matter that can reproduce sound.

[0010] (1) A digital camera with a printer, comprising: a photographing unit for electronically photographing an image; a sound collecting unit for collecting sound; a storage unit for storing image data and sound data; a printing unit for printing an image on a medium; a communication unit; a photographing control unit for controlling the photographing unit to photograph an image and record the obtained image data in the storage unit; a sound recording control unit for controlling the sound collecting unit to obtain sound data, associate the obtained sound data with the image data and record the sound data in the storage unit; an identification information generating unit for generating inherent identification information when printing image data associated with sound data; an uploading unit for uploading the sound data to a server via the communication unit when printing image data associated with sound data, and uploading the sound data to the server after attaching the identification information generated by the identification information generating unit; a recording information generating unit for generating recording information recording access information when printing image data associated with sound data, the access information being information for accessing the sound data determined in the server based on the identification information generated by the identification information generating unit; and a printing control unit for printing image data associated with sound data by attaching the recording information generated by the recording information generating unit to the image data.

[0011] According to this method, when image data associated with audio data is printed, unique identification information is added to the audio data and uploaded to the server. Furthermore, recording information containing access information for accessing the audio data uploaded to the server is printed along with the image on the printed material (the medium on which the image is printed). This allows access to the audio data from the printed material.

[0012] (2) In the digital camera with a printer of (1) above, the communication unit communicates with the upload terminal, and the uploaded audio data is sent to the server via the upload terminal.

[0013] According to this embodiment, the audio data is uploaded to the server via the upload terminal.

[0014] (3) In the digital camera with a printer according to (2) above, the communication unit communicates with the uploading terminal in accordance with a near field wireless communication standard.

[0015] According to this embodiment, the digital camera with a printer is connected to the uploading terminal through communication conforming to the near field wireless communication standard.

[0016] (4) In any one of the digital cameras with printers described in (1) to (3), the identification information generated by the identification information generating unit includes information based on the cumulative number of prints by the printing unit.

[0017] According to this aspect, the identification information includes information on the cumulative number of prints, thereby making it possible to identify at least data obtained by the same digital camera with a printer.

[0018] (5) In the digital camera with a printer according to (4) above, the identification information generated by the identification information generating unit further includes information on a unique identification number assigned to the digital camera with a printer.

[0019] According to this aspect, the identification information includes the identification number, thereby making it possible to identify data obtained by the same model.

[0020] (6) In the digital camera with a printer according to (4) or (5) above, the identification information generated by the identification information generating unit further includes information on the model of the digital camera with a printer.

[0021] According to this aspect, the identification information includes the model information, thereby making it possible to identify data obtained by different models.

[0022] (7) In any one of the digital cameras with printers described in (1) to (6), the uploading unit uploads the audio data and the image data to the server after adding the identification information generated by the identification information generating unit.

[0023] According to this aspect, the image data is uploaded with the audio data attached, thereby making it possible to acquire the image data in addition to the audio data.

[0024] (8) Any of the digital cameras with printers described in (1) to (6) above further comprises: a communication management unit that manages communication, wherein if the communication management unit detects a communication error, the upload unit suspends uploading and performs uploading when communication is next established.

[0025] According to this method, when a communication error occurs, the upload process is suspended and the process is restarted when the communication is next established.

[0026] (9) Any of the digital cameras with printers described in (1) to (8) above further comprises: a sound data rewriting command unit for commanding the rewriting of sound data associated with image data; when the sound data rewriting command unit commands the rewriting of sound data, the recording control unit controls the sound collecting unit to obtain the rewriting sound data, and uses the rewriting sound data to rewrite the sound data of the image data commanded to be rewritten.

[0027] According to this aspect, recorded audio data can be rewritten.

[0028] (10) Any of the digital cameras with printers described in (1) to (9) above further comprises: a post-recording command unit for commanding post-recording of image data; when post-recording is commanded by the post-recording command unit, the recording control unit controls the sound collection unit to obtain sound data, and associates the obtained sound data with the image data for which post-recording is commanded and records the obtained sound data in the storage unit.

[0029] According to this aspect, it is possible to add audio data to captured image data afterward (a so-called after-recording function).

[0030] (11) In any one of the digital cameras with printers described in (1) to (10), the recording control unit controls the sound collection unit to acquire sound data for a predetermined period of time during image capture, and associates the acquired sound data with image data and records them in the storage unit.

[0031] According to this aspect, audio can be automatically recorded during shooting.

[0032] (12) Any digital camera with a printer described in (1) to (11) above further comprises: a recording information printing setting unit for setting whether or not to print the recording information when printing image data associated with corresponding sound data; when the recording information printing setting is set to "yes", the uploading unit uploads the data to the server; and when the recording information printing setting is set to "yes", the printing control unit prints the image data with the recording information generated by the recording information generating unit attached thereto.

[0033] According to this aspect, it is possible to set whether or not to print the log information.

[0034] (13) In any one of the digital cameras with printers described in (1) to (12), when printing image data associated with audio data, the print control unit exclusively prints the log information and image generated by the log information generating unit.

[0035] According to this method, the recorded information and the image are printed exclusively, that is, they are printed so that they do not overlap.

[0036] (14) In any one of the digital cameras with printers described in (1) to (13), the printing unit prints on instant film.

[0037] According to this method, the image is printed on instant film.

[0038] (15) In any one of the digital cameras with printers described in (1) to (14), the recorded information is a QR code, a barcode, or a wireless tag.

[0039] According to this aspect, the recorded information is formed of a two-dimensional code, a barcode, or a wireless tag.

[0040] (16) A printing method for a digital camera with a printer, comprising: a step of acquiring sound data for a certain period of time when photographing, and associating the acquired sound data with image data acquired by photographing and recording the acquired sound data in a storage unit; a step of generating inherent identification information according to a command for printing image data associated with the sound data; a step of uploading the sound data to a server after attaching the generated identification information; a step of generating record information in which access information is recorded, wherein the access information is information for accessing the sound data determined in the server according to the generated identification information; and a step of printing the image data by attaching the generated record information.

[0041] (17) A data storage system comprising: a digital camera with a printer according to any one of (1) to (15) above; a server for storing data based on identification information attached to the data; and an upload terminal for communicating with a communication unit of the digital camera with a printer, receiving data sent from the digital camera with a printer, and uploading the data to the server.

[0042] (18) The data storage system of (17) above further comprises a data playback terminal, which comprises: a sound output unit for outputting sound; a record information reading unit for reading record information; a download unit for accessing a server based on access information obtained by reading record information printed on a medium by the record information reading unit, and downloading sound data associated with an image printed on the medium from the server; and a playback control unit for controlling the sound output unit to play the sound data downloaded by the download unit.

[0043] Effects of the Invention

[0044] According to the present invention, a printed matter capable of playing back sound can be easily generated. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 This is a system configuration diagram showing an embodiment of a data storage and playback system to which the present invention is applied.

[0046] Figure 2 This is a front perspective view showing an example of a digital camera with a printer.

[0047] Figure 3 yes Figure 2 A perspective view of the back of a digital camera with a printer is shown.

[0048] Figure 4 This is a cross-sectional view schematically showing the structure of the printer portion.

[0049] Figure 5 It is a three-dimensional image of an instant film packaging box.

[0050] Figure 6 This is the front view of the instant film.

[0051] Figure 7 This is the rear view of instant film.

[0052] Figure 8 This is a block diagram showing the electrical structure of a digital camera with a printer.

[0053] Figure 9 This is a block diagram of the main functions implemented by the camera control unit.

[0054] Figure 10 This is a block diagram showing an example of the hardware configuration of a data storage server.

[0055] Figure 11 This is a block diagram of the main functions provided by the data storage server.

[0056] Figure 12 This is a block diagram showing an example of the hardware configuration of the upload terminal.

[0057] Figure 13 This is a block diagram of the main functions provided by the upload terminal.

[0058] Figure 14 This is a block diagram showing an example of the hardware configuration of a data broadcast terminal.

[0059] Figure 15 This is a block diagram of the main functions provided by the data playback terminal.

[0060] Figure 16 This is a flowchart showing the procedure for setting to each mode.

[0061] Figure 17 This is a flowchart showing the operation sequence in manual printing mode.

[0062] Figure 18 This is a flowchart showing the operation sequence when the recording mode is off in manual print mode.

[0063] Figure 19 This is a flowchart showing the operation sequence when the normal recording mode is turned on in the manual print mode.

[0064] Figure 20 This is a flowchart showing the operation sequence when post-recording mode is turned on in manual print mode.

[0065] Figure 21 This is a diagram showing an example of a preview screen in post-recording mode.

[0066] Figure 22 This is a flowchart showing the operation sequence in automatic printing mode.

[0067] Figure 23This is a flowchart showing the operation sequence when the recording mode is off in the automatic print mode.

[0068] Figure 24 This is a flowchart showing the operation sequence when the normal recording mode is turned on in the automatic print mode.

[0069] Figure 25 This is a flowchart showing the operation sequence when post-recording mode is turned on in automatic print mode.

[0070] Figure 26 This is a flowchart showing the operation sequence in playback mode.

[0071] Figure 27 This is a diagram showing an example of display on a monitor when displaying audio-attached video data.

[0072] Figure 28 This is a flowchart showing the processing procedure when printing an image.

[0073] Figure 29 This is a flowchart showing the upload process sequence.

[0074] Figure 30 It is a sequence diagram of upload processing.

[0075] Figure 31 This is a flowchart showing the processing sequence when communication is impossible or upload processing fails.

[0076] Figure 32 This is a conceptual diagram of generating print image data when printing image data with sound.

[0077] Figure 33 This is a diagram showing an example of a printing result of audio-attached image data.

[0078] Figure 34 This is a flowchart showing the procedure of downloading and playing image data and audio data.

[0079] Figure 35 This is a sequence diagram of the download process.

[0080] Figure 36 This figure compares an image printed on instant film and an image played back on a data playback terminal.

[0081] Figure 37 This is a flowchart showing the processing procedure for generating image data with audio after shooting in a digital camera with a printer.

[0082] Figure 38 This is a flowchart showing the procedure of recording processing.

[0083] Figure 39This is a flowchart showing the processing procedure when rewriting audio data in a digital camera with a printer.

[0084] Figure 40 This is a flowchart showing the procedure of recording processing when rewriting audio data.

[0085] Figure 41 This is a diagram showing an example of the file structure of image data when data is uploaded.

[0086] Figure 42 This is a diagram showing another example of printing when printing a two-dimensional code.

[0087] Figure 43 This is a transition diagram of the printed image displayed on the monitor of a digital camera with a printer.

[0088] Figure 44 This is a system configuration diagram showing an example of a system capable of rewriting audio data stored in a data storage server.

[0089] Figure 45 This is a sequence diagram showing the procedure for rewriting audio data.

[0090] Explanation of symbols

[0091] 1-playback system, 2-communication network, 2a-base station, 10-digital camera with printer, 12-camera body, 14-photographic lens, 16-release button, 18-recording button, 20-flashlight window, 22a-power button, 22b-menu button, 22c-OK button, 22d-mode switching button, 24-microphone hole, 26-speaker hole, 28-display, 30-film box cover, 32a-joystick, 32b-print button, 32c-play button, 32d-cancel button, 34-film discharge port, 40-instant film packaging box, 42-instant film, 42a-exposure surface of instant film, 42b-observation surface of instant film, 42c-exposure area of instant film, 42d - capsule portion of instant film, 42e - developing liquid capsule of instant film, 42f - collecting portion of instant film, 42g - absorbing material of instant film, 42h - observation area of instant film, 42i - frame of instant film, 44 - box of instant film packaging box, 44a - exposure opening of instant film packaging box, 44b - discharge port of instant film packaging box, 44c - card slot opening of instant film packaging box, 50 - film loading chamber, 52 - film delivery mechanism, 52a - card slot, 54 - film conveying mechanism, 54A - conveying roller pair, 54B - unfolding roller pair, 56 - print head, 62 - lens driving unit, 64 - image sensor, 66 - image sensor driving unit, 68 - analog signal processing unit, 70 -Digital signal processing unit, 72-Memory, 74-Memory controller, 76-Display controller, 78-Near field communication unit, 80-Antenna, 82-Film delivery drive unit, 84-Film transport drive unit, 86-Print head drive unit, 88-Flash, 90-Flash light control unit, 92-Amplifier, 94-Speaker, 96-Sound signal processing unit, 98-Operation unit, 100-Camera control unit, 100A-Photography control unit, 100B-Recording control unit, 100C-Identification information generation unit, 100D-Upload unit, 100E-Communication management unit, 100F-QR code generation unit, 100G-Print control unit, 100H-Playback control unit, 200-Data storage server, 200 A-Data Receiving Control Unit, 200B-Data Management Unit, 200C-Data Transmission Control Unit, 200D-Voice Data Rewriting Control Unit, 201-CPU, 202-ROM, 203-RAM, 204-HDD, 205-Display, 206-Network I / F, 207-Keyboard, 208-Mouse, 210-Optical Drive, 300-Upload Terminal, 300A-Upload Data Acquisition Unit, 300B-Data Transmission Unit, 301-CPU, 302-ROM, 303-RAM, 304-EEPROM, 305-Display, 306-Touch Panel, 307-GPS Receiving Unit, 308-Camera Unit, 309-Microphone Unit, 310-Speaker Unit, 311-Communication Unit,311A-antenna, 312-near field communication unit, 312A-antenna, 313-sensor unit, 314-media drive, 315-memory card, 400-data playback terminal, 400A-QR code reader, 400B-access information acquisition unit, 400C-download unit, 400D-playback processing unit, 400D1-display control unit, 400D2-sound output control unit, 400E-sound data rewrite command unit, 400F-sound collection control unit, 400G-rewrite data upload unit, 401-CPU, 402-ROM, 403-RAM, 404-EEPROM, 405-display Display, 406-touch panel, 407-GPS receiving unit, 408-camera unit, 409-microphone unit, 410-speaker unit, 411-communication unit, 411A-antenna, 412-near field communication unit, 412A-antenna, 413-sensor unit, 414-media drive, 415-memory card, IM-image, ME-message, PRI0-image, PRI1-image data, PVI-image, QR-two-dimensional code, VPB-sound play button, S1~S5-order of setting to each mode, S11~S12-operation order in manual printing mode, S21~S28-operation order in manual printing mode In the recording mode, the action sequence is as follows: S31~S38 - In the manual printing mode, the action sequence is when the normal recording mode is turned on; S41~S51 - In the manual printing mode, the action sequence is when the post-recording mode is turned on; S61~S62 - In the automatic printing mode, the action sequence is as follows: S71~S76 - In the automatic printing mode, the action sequence is when the recording mode is turned off; S81~S86 - In the automatic printing mode, the action sequence is when the normal recording mode is turned on; S91~S100 - In the automatic printing mode, the action sequence is when the post-recording mode is turned on; S110~S118 - In the playback mode, S S120 to S127 - Processing sequence for printing images, S130 to S135 - Upload processing sequence, S140 to S144 - Processing sequence for communication failure or upload processing failure, S150 to S153 - Processing sequence for downloading and playing image and audio data, S160 to S165 - Processing sequence for generating image data with audio after shooting in a digital camera with a printer, S170 to S174 - Audio recording processing sequence, S180 to S188 - Processing sequence for rewriting audio data in a digital camera with a printer, S190 to S194 - Audio recording processing sequence when audio data is rewritten. DETAILED DESCRIPTION

[0092] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0093] [System Structure]

[0094] Figure 1 This is a system configuration diagram showing an embodiment of a data storage and playback system to which the present invention is applied.

[0095] The data storage and playback system 1 of this embodiment is a system that, when printing image data with audio via a digital camera with a printer, uploads the image and audio data to a data storage server and enables playback on a terminal such as a smartphone as needed. When printing the image data with audio, the digital camera with a printer appends access information to the data storage address and then prints the image data. The user, using a terminal such as a smartphone, reads the access information and downloads and plays the target data from the data storage server.

[0096] like Figure 1 As shown, the data storage and playback system 1 includes a digital camera with a printer 10, a data storage server 200 that stores image data of images printed by the digital camera with a printer 10 and sound data associated with the image data, an upload terminal 300 for uploading data from the digital camera with a printer 10 to the data storage server 200, and a data playback terminal 400 that downloads and plays the image data and sound data associated with the image data stored in the data storage server 200.

[0097] Upload terminal 300 is comprised of a computer with communication capabilities, particularly a mobile computer such as a smartphone, tablet, laptop, or PDA (Personal Data Assistant). Communication between digital camera with printer 10 and upload terminal 300 is performed using a short-range wireless communication standard such as NFC (Near Field Communication), Bluetooth (registered trademark), or WiFi (Wireless Fidelity).

[0098] The data playback terminal 400 is composed of a computer having a photographing function and a communication function, and is particularly composed of a mobile computer with a camera, such as a smartphone, a tablet terminal, a notebook computer, or a PDA (Personal Data Assistant).

[0099] Communication between the data storage server 200 and the upload terminal 300 and data playback terminal 400 is performed via a communication network 2. This communication network 2 is constructed by, for example, wireless communication networks such as 3G (3rd Generation), WiMAX (Worldwide Interoperability for Microwave Access), and LTE (Long Term Evolution), as well as base stations 2a and the Internet.

[0100] The communication protocol between the data storage server 200 and the upload terminal 300 and the data broadcast terminal 400 is, for example, HTTP communication based on the Hyper Text Transfer Protocol (HTTP). The upload terminal 300 and the data broadcast terminal 400 act as HTTP clients, and the data storage server 200 acts as an HTTP server.

[0101] In the data storage and playback system 1 of this embodiment, the digital camera with printer 10 , the data storage server 200 , and the upload terminal 300 constitute a data storage system, and the data storage server and the data playback terminal 400 constitute a data playback system.

[0102] Digital Camera with Printer

[0103] The digital camera with a printer 10 is a digital camera with a built-in printer that can print captured images on the spot. The digital camera with a printer 10 of this embodiment uses an instant film packaging box to print onto instant film. Furthermore, the digital camera with a printer 10 of this embodiment has a recording function, recording audio in association with captured images.

[0104] <Exterior Structure>

[0105] Figure 2 This is a front perspective view showing an example of a digital camera with a printer. Figure 3 yes Figure 2 A perspective view of the back of a digital camera with a printer is shown.

[0106] like Figure 2 and Figure 3 As shown, the digital camera with a printer 10 includes a portable camera body 12. The camera body 12 has a vertically elongated rectangular parallelepiped shape that is thin in the front-to-back direction and has a longitudinal dimension longer than a lateral dimension.

[0107] like Figure 2As shown, the front side of the camera body 12 is provided with a photographic lens 14, a release button 16, a recording button 18, and a flash light window 20. Furthermore, a power button 22a, a menu button 22b, an OK button 22c, a mode switch button 22d, a microphone hole 24, and a speaker hole 26 are provided on one side of the camera body 12. The release button 16 is used to instruct the camera to record an image. The recording button 18 is used to switch the recording mode. The power button 22a turns the digital camera with a printer 10 on and off. The menu button 22b is used to call up the menu screen. The OK button is used to instruct the camera to confirm a decision. The mode switch button 22d switches between automatic and manual printing modes within the shooting mode.

[0108] like Figure 3 As shown, the back side of the camera body 12 is provided with a display 28, a film magazine cover 30, and various operating buttons. The film magazine cover 30 is a cover for opening and closing the film loading chamber. The operating buttons include a joystick 32a, a print button 32b, a play button 32c, and a cancel button 32d. The print button 32b is used to instruct printing. The play button 32c is used to switch to playback mode. The cancel button 32d is used to cancel an operation.

[0109] like Figure 2 and Figure 3 As shown in FIG. 1 , a film discharge port 34 is provided on the upper surface of the camera body 12 . The printed instant film is discharged from the film discharge port 34 .

[0110] <Structure of the Printer Section of a Digital Camera with Printer>

[0111] Figure 4 This is a cross-sectional view schematically showing the structure of the printer portion.

[0112] like Figure 4 As shown, the digital camera with a printer 10 includes a film loading chamber 50, a film feeding mechanism 52, a film transport mechanism 54, and a print head 56 as components of a printing unit, that is, a printer portion.

[0113] The film loading chamber 50 is a loading portion for the instant film package 40. The film loading chamber 50 has a recessed portion into which the instant film package 40 is inserted, and is opened and closed by the film package cover 30. When the film package cover 30 is closed, the film loading chamber 50 is sealed in a darkroom state.

[0114] The instant film package box 40 has a structure in which a plurality of instant films 42 are housed in a box 44 .

[0115] Figure 5 It is a three-dimensional picture of the instant film packaging box. Figure 6 This is the main view of the instant film. Figure 7 is the rear view of the instant film. Figures 5 to 7 , the direction indicated by arrow F is the conveying direction of the instant film 42. The instant film 42 is conveyed along the direction indicated by arrow F and discharged from the cassette 44.

[0116] Instant film 42 is an example of printing media. It is a so-called "single-sheet" (also known as loose-sheet film or integral film), in which the image appears on the back of the exposed surface. Instant film 42 has a rectangular card shape. One side of the instant film 42 is an exposure surface 42a, and the other side is an observation surface 42b. The exposure surface 42a is the surface where the image is recorded by exposure, and the observation surface 42b is the surface where the recorded image is observed.

[0117] like Figure 7 As shown, an exposure area 42c, a bag portion 42d and a collecting portion 42f are provided on the exposure surface 42a of the instant film 42.

[0118] The exposed area 42c is an area where an image is recorded by exposure. The exposed area 42c becomes a printable area of the instant film 42. The bag portion 42d and the collecting portion 42f are arranged in front and behind in the conveyance direction F with the exposed area 42c sandwiched therebetween.

[0119] The bag portion 42d is arranged on the front side relative to the exposure region 42c in the transport direction F. A developing liquid bag 42e containing a developing liquid is housed in the bag portion 42d.

[0120] The collecting portion 42f is arranged on the rear side of the exposure region 42c in the transport direction F. The collecting portion 42f has an absorbent material 42g built therein.

[0121] like Figure 6 As shown, an observation area 42h is provided on the observation surface 42b of the instant film 42. The observation area 42h is the area where the image is displayed. The image is displayed in the observation area 42h by developing the exposed area 42c. The observation area 42h is arranged to correspond to the exposed area 42c. A frame 42i is provided around the observation area 42h, so that the image is displayed within the frame. Furthermore, the observation area 42h is set slightly narrower than the exposed area 42c (set to be slightly smaller). Therefore, when an image is recorded in the entire exposed area 42c, the image is printed with the surrounding area cropped.

[0122] In addition, the instant film 42 is viewed in the orientation with the collecting portion 42f facing upward and the bag portion 42d facing downward. Therefore, the image is printed in the orientation with the collecting portion 42f facing upward and the bag portion 42d facing downward.

[0123] After exposure, the instant film 42 is developed by spreading the developer liquid in the capsule 42d over the exposure area 42c. Passing the instant film 42 between the spreading roller pair 54B, the developer liquid in the capsule 42d is squeezed out of the capsule 42d and spread over the exposure area 42c. Any remaining developer liquid from the spreading process is captured by the collection portion 42f.

[0124] The cassette 44 has a rectangular box shape. It has a rectangular exposure opening 44a on the front. It also has a slit-shaped discharge port 44b on the top. The instant film 42 is stacked and stored within the cassette, with the exposure surface 42a facing the front (exposure opening 44a side) and the bag portion 42d facing the top (discharge port 44b side) of the cassette 44. The cassette 44 also has a slit-shaped card slot opening 44c on the bottom. The instant film 42 stored in the cassette 44 is fed one sheet at a time toward the discharge port 44b by inserting the card slot 52a through the card slot opening 44c and then discharged from the discharge port 44b.

[0125] One instant film package 40 contains a plurality of (eg, ten) instant films 42 .

[0126] The film delivery mechanism 52 delivers instant films 42 one at a time from the instant film package 40 loaded in the film loading chamber 50. The film delivery mechanism 52 includes a slot 52a that moves back and forth in the direction in which the instant films 42 are conveyed. The film delivery mechanism 52 removes the instant films 42 from the package 40 one at a time through the slot 52a, thereby delivering the instant films 42 from the instant film package 40.

[0127] The film transport mechanism 54 transports the instant film 42 delivered from the instant film package 40 at a constant speed via the film delivery mechanism 52. The film transport mechanism 54 includes a transport roller pair 54A and an unwinding roller pair 54B. The transport roller pair 54A is driven by a motor (not shown) to rotate, sandwiching both sides of the instant film 42 for transport. The unwinding roller pair 54B is driven by a motor (not shown) to rotate, sandwiching the entire instant film 42 for transport. As the instant film 42 is transported by the unwinding roller pair 54B, the bladder portion 42d of the instant film 42 is flattened, causing it to be developed.

[0128] The print head 56 records an image on the instant film 42 fed from the instant film package 40. The print head 56 is a line exposure head. The print head 56 irradiates the exposure surface 42a of the instant film 42 fed by the film feed mechanism 54 with printing light line by line, and records the image on the instant film 42 in a single pass.

[0129] <Electrical structure of a digital camera with a printer>

[0130] Figure 8This is a block diagram showing the electrical structure of a digital camera with a printer.

[0131] like Figure 8 As shown, the digital camera with a printer 10 includes a photographic lens 14, a lens driving unit 62, an image sensor 64, an image sensor driving unit 66, an analog signal processing unit 68, a digital signal processing unit 70, a memory 72, a storage controller 74, a display 28, a display controller 76, a short-range wireless communication unit 78, an antenna 80, a film feeding driving unit 82, a film transport driving unit 84, a print head driving unit 86, a flash 88, a flash light control unit 90, a microphone 92, a speaker 94, a sound signal processing unit 96, an operation unit 98 and a camera control unit 100, etc.

[0132] The taking lens 14 forms an optical image of the subject onto the light-receiving surface of the image sensor 64. The taking lens 14 has a focusing function and includes an aperture and a shutter (not shown). The lens drive unit 62 includes a motor and a drive circuit for driving the focusing mechanism of the taking lens 14, a motor and a drive circuit for driving the aperture, and a motor and a drive circuit for driving the shutter. The lens drive unit 62 operates the focusing mechanism, aperture, and shutter in response to commands from the camera control unit 100.

[0133] The image sensor 64 is comprised of a two-dimensional solid-state imaging element, such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The image sensor 64 has an imaging area with an aspect ratio corresponding to the printable area of the instant film being used. The image sensor driver 66 includes a driver circuit for the image sensor 64 and operates the image sensor 64 based on commands from the camera control unit 100.

[0134] In the digital camera with a printer 10 of this embodiment, the photographic lens 14 and the image sensor 64 constitute a photographing unit.

[0135] The analog signal processing unit 68 reads the analog image signal for each pixel output from the image sensor 64 , performs predetermined signal processing (eg, correlated double sampling processing, amplification processing, etc.), digitizes the signal, and outputs the result.

[0136] The digital signal processing unit 70 reads the digital image signal output from the analog signal processing unit 68 and performs predetermined signal processing (eg, grayscale conversion, white balance correction, gamma correction, synchronization, YC conversion, etc.) to generate image data.

[0137] The memory 72 stores image data and audio data obtained by shooting. The memory 72 is an example of a storage unit. The memory controller 74 reads and writes data to the memory 72 under the control of the camera control unit 100.

[0138] The display 28 is composed of, for example, a liquid crystal display (LCD), an organic electro-luminescence display (OLED), a plasma display, a field emission display (FED), or electronic paper. The display controller 76 displays images on the display 28 under the control of the camera control unit 100 .

[0139] The short-range wireless communication unit 78 performs wireless communication with an external device via the antenna 80 under the control of the camera control unit 100. The communication is performed using short-range wireless communication such as the NFC standard, Bluetooth, or WiFi.

[0140] The film delivery drive unit 82 includes a motor for driving the card slot 52 a of the film delivery mechanism 52 and a drive circuit thereof. Under the control of the camera control unit 100 , the motor of the card slot 52 a is driven to operate the card slot 52 a .

[0141] The film transport drive unit 84 includes a motor and a driving circuit for driving the transport roller pair 54A of the film transport mechanism 54, and a motor and a driving circuit for driving the unfolding roller pair 54B. Under the control of the camera control unit 100, the motor of the transport roller pair 54A and the motor of the unfolding roller pair 54B are driven to move the transport roller pair 54A and the unfolding roller pair 54B.

[0142] The print head driving unit 86 includes a driving circuit for the print head 56 , and drives the print head 56 under the control of the camera control unit 100 .

[0143] The flash 88 includes a xenon tube and an LED (Light Emitting Diode) as a light source, and emits light to illuminate the subject. The flash light is emitted from the flash light emission window 20 (see FIG. 2 ) provided on the front of the camera body 12. Figure 2 The flash light emission control unit 90 includes a drive circuit for the flash light 88 and causes the flash light 88 to emit light in response to a command from the camera control unit 100.

[0144] The microphone 92 is connected to the camera body 12 via the microphone hole 24 (see Figure 2) collects external sound. The microphone 92 is an example of a sound collection unit. The speaker 94 outputs sound externally through the speaker hole 26 provided in the camera body 12. The sound signal processing unit 96 performs predetermined signal processing on the sound signal input from the microphone 92, digitizes it, and outputs it. Furthermore, the sound signal processing unit 96 performs predetermined signal processing on the sound data provided by the camera control unit 100, and outputs it through the speaker 94.

[0145] The operation unit 98 includes various operating components such as the release button 16, the record button 18, the power button 22a, the menu button 22b, the OK button 22c, the joystick 32a, the print button 32b, the play button 32c, and the cancel button 32d, and their signal processing circuits, and outputs signals based on the operations of each operating component to the camera control unit 100.

[0146] The camera control unit 100 centrally controls the overall operation of the digital camera with a printer 10 and is comprised of a computer equipped with a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory). This computer implements various functions of the camera control unit 100 by executing a predetermined control program.

[0147] Figure 9 This is a block diagram of the main functions implemented by the camera control unit.

[0148] like Figure 9 As shown, the camera control unit 100 functions as a photography control unit 100A, a recording control unit 100B, an identification information generation unit 100C, an upload unit 100D, a communication management unit 100E, a QR code generation unit 100F, a printing control unit 100G, and a playback control unit 100H by executing a prescribed control program.

[0149] The photography control unit 100A controls photography. Specifically, it controls the photography unit, namely the photography lens 14 and the image sensor 64, to capture images and stores the captured image data in the memory 72. Furthermore, live view processing is performed during photography. Specifically, the image captured by the image sensor 64 is displayed in real time on the display 28. This allows photography to be performed while the display 28 is used as a live view monitor. Photography for recording is initiated by pressing the release button 16.

[0150] The recording control unit 100B controls audio recording. When capturing an image with audio, the recording control unit 100B acquires audio data via the microphone 92, associates the acquired audio data with the captured image data, and stores the acquired audio data in the memory 72. Furthermore, when adding audio to an already captured image, the recording control unit 100B acquires audio data via the microphone 92, associates the acquired audio data with the target image data, and stores the acquired audio data in the memory 72. Furthermore, when a command is issued to rewrite audio for an already captured image with audio, the recording control unit 100B acquires audio data via the microphone 92, and rewrites the audio data of the target image data with the acquired audio data.

[0151] When printing image data with sound (image data associated with sound data), identification information generation unit 100C generates predetermined identification information. As will be described later, when printing image data with sound, the image and sound data are stored in data storage server 200. This identification information is used when storing the image and sound data in data storage server 200. Specifically, it is used to identify the data in data storage server 200. This will be described in more detail later.

[0152] The upload unit 100D uploads image data and audio data to the data storage server 200. In the digital camera with a printer 10 of this embodiment, data is uploaded to the data storage server 200 via the upload terminal 300. Therefore, the upload unit 100D sends data to the upload terminal 300.

[0153] The communication management unit 100E manages the communication with the upload terminal 300. More specifically, it manages the connection state of the communication with the upload terminal 300 and determines whether to transmit data to the upload terminal 300.

[0154] When printing image data with sound, the QR code generator 100F generates a QR code that encodes predetermined information. As described above, when printing image data with sound, the image and sound data are stored in the data storage server 200. The QR code generator 100F generates a QR code that encodes access information to the image and sound data stored in the data storage server 200. A QR code is an example of recorded information, and the QR code generator 100F is an example of a recorded information generator. For example, a QR code is a QR code (registered trademark).

[0155] The print control unit 100G controls printing. Printing begins by generating print image data from the image data for which printing is commanded. Next, the print head 56 is driven based on the generated print image data, and the image is printed on the instant film 42. Therefore, the print control unit 100G functions as both a print image data generation unit and a print driver unit. The print image data generation unit generates print image data, while the print driver drives the print head 56, the film delivery mechanism 52, and the film transport mechanism 54.

[0156] When printing image data with sound, the print control unit 100G adds a QR code to the printed image. Specifically, it generates image data with a QR code integrated into it as printable image data, and prints the generated image data with the QR code. The QR code is partially superimposed on the image. This will be described in detail later.

[0157] The playback control unit 100H controls the playback of recorded images. Specifically, it reads image data from the memory 72 and displays it on the display 28. If the image data being played is audio-attached, the audio data is read and output from the speaker 94. Image frame playback is performed by operating the joystick 32a.

[0158] Data Storage Server

[0159] The data storage server 200 stores image data captured by the digital camera with printer 10 and audio data associated with the image data. The data storage server 200 is an example of a server and is composed of a conventional server computer.

[0160] Figure 10 This is a block diagram showing an example of the hardware configuration of a data storage server.

[0161] like Figure 10 As shown, the data storage server 200 includes a CPU 201 for controlling the overall operation, a ROM 202 storing programs used for driving the CPU 201, such as an IPL (Initial Program Loader), a RAM 203 used as a work area for the CPU 201, an HDD (Hard Disk Drive) 204 storing various programs and data for the data storage server 200, a display 205, a network I / F 206 (I / F: interface) for performing data communication using the communication network 2, a keyboard 207, a mouse 208, and an optical drive 210.

[0162] Figure 11 This is a block diagram of the main functions provided by the data storage server.

[0163] like Figure 11 As shown, the data storage server 200 functions as a data reception control unit 200A, a data management unit 200B, and a data transmission control unit 200C when the CPU 201 executes a predetermined program.

[0164] The data reception control unit 200A communicates with the upload terminal 300 via the communication network 2 and receives storage data from the upload terminal 300 .

[0165] The data management unit 200B performs processes such as recording data received from the upload terminal 300 in the storage unit and reading corresponding data from the storage unit in response to a download request from the data playback terminal 400. The storage unit is composed of the HDD 204. The data management unit 200B constructs a predetermined database and stores image data and audio data associated with the image data in the HDD 204.

[0166] The data transmission control unit 200C communicates with the data broadcast terminal 400 via the communication network 2 , and transmits corresponding data to the data broadcast terminal 400 in response to a data download request from the data broadcast terminal 400 .

[0167] Upload Terminal

[0168] The upload terminal 300 uploads data to the data storage server 200 , receives storage data (image data of a printed image and audio data associated with the image data) from the digital camera with printer 10 , and transmits the data to the data storage server 200 .

[0169] As described above, the upload terminal 300 is comprised of a computer with communication capabilities, particularly a mobile computer such as a smartphone, tablet, laptop, or PDA. It communicates with the digital camera with a printer 10 via near-field wireless communication (e.g., NFC, Bluetooth, or WiFi). Furthermore, it communicates with the data storage server 200 via the communication network 2.

[0170] Figure 12 3 is a block diagram showing an example of the hardware configuration of the upload terminal 300. In addition, this figure shows an example of the hardware configuration when the upload terminal 300 is a smartphone.

[0171] like Figure 12As shown, the upload terminal 300 includes a CPU 301 for controlling the overall operation; a ROM 302 storing basic input and output programs, etc.; a RAM 303 serving as a work area for the CPU 301; an EEPROM (Electrically Erasable and Programmable ROM) 304 storing various programs including an operating system executed by the CPU 301 and various data; a display 305; a touch panel 306 for detecting touch operations on the display screen; and a GPS (Global Positioning Systems) satellite or an IMES (Indoor MEssaging System) serving as an indoor GPS. The system includes a GPS receiving unit 307 for receiving GPS signals containing the location information (latitude, longitude and altitude) of the uploading terminal 300; a camera unit 308 including a photographic lens and an image sensor for electronically capturing images; a microphone unit 309 including a loudspeaker for inputting sounds; a speaker unit 310 including a speaker for outputting sounds; a communication unit 311 for wirelessly communicating with the nearest base station 2a or the like using an antenna 311A; a short-range wireless communication unit 312 for short-range wireless communication with an external device using an antenna 312A; a sensor unit 313 including various sensors such as a geomagnetic sensor, a gyrocompass and an acceleration sensor; and a media drive 314 for reading and writing data to a memory card 315.

[0172] Figure 13 This is a block diagram of the main functions provided by the upload terminal.

[0173] like Figure 13 As shown, the upload terminal 300 functions as an upload data acquisition unit 300A and a data transmission unit 300B when the CPU 301 executes a predetermined program.

[0174] The upload data acquisition unit 300A performs near-field wireless communication with the digital camera with printer 10 and receives upload data (image data and audio data associated with the image data) from the digital camera with printer 10 .

[0175] The data transmission unit 300B communicates with the data storage server 200 via the communication network 2 , and transmits (uploads) the data received from the digital camera with printer 10 to the data storage server 200 .

[0176] Data playback terminal

[0177] The data playback terminal 400 is a terminal that downloads and plays image data and the audio data associated with the image data stored on the data storage server 200. Information for accessing the downloaded data is obtained from the instant film 42 printed with the downloaded image data. Specifically, a QR code for downloading the image displayed on the instant film 42 is printed on the instant film 42. The QR code is read to download the image data and the audio data associated with the image data.

[0178] The data playback terminal 400 is composed of a computer with camera and communication functions, particularly a mobile computer with a camera such as a smartphone, tablet terminal, laptop computer, or PDA, and communicates with the data storage server 200 via the communication network 2.

[0179] Figure 14 1 is a block diagram showing an example of the hardware configuration of a data broadcast terminal.

[0180] like Figure 14 As shown, the data playback terminal 400 includes a CPU 401 for controlling the overall operation; a ROM 402 storing basic input and output programs, etc.; a RAM 403 used as a work area for the CPU 401; an EEPROM 404 storing various programs including an operating system executed by the CPU 401 and various data; a display 405; a touch panel 406 for detecting touch operations on the display screen; a GPS receiving unit 407; a camera unit 408 including a photographic lens and an image sensor and electronically capturing images; a microphone unit 409 including a loudspeaker and inputting sound; a speaker unit 410 including a speaker and outputting sound; a communication unit 411 for wirelessly communicating with the nearest base station 2a, etc. using an antenna 411A; a short-range wireless communication unit 412 for short-range wireless communication with an external device using an antenna 412A; a sensor unit 413 including various sensors such as a geomagnetic sensor, a gyrocompass, and an acceleration sensor; and a media drive 414 for reading and writing data to a memory card 415.

[0181] Figure 15 This is a block diagram of the main functions provided by the data playback terminal.

[0182] like Figure 15 As shown, the data broadcast terminal 400 functions as a two-dimensional code reading unit 400A, an access information acquisition unit 400B, a downloading unit 400C, and a broadcast processing unit 400D by the CPU 401 executing a predetermined program.

[0183] The two-dimensional code reading unit 400A is implemented by the camera unit 408, and reads the two-dimensional code by photographing the two-dimensional code with the camera unit 408. The two-dimensional code reading unit 400A is an example of a recorded information reading unit.

[0184] The access information acquisition unit 400B reads the two-dimensional code printed on the instant film 42 by the two-dimensional code reading unit 400A, thereby acquiring access information to the image data and audio data of the image printed on the instant film 42 .

[0185] The downloading unit 400C accesses the data storage server 200 based on the access information acquired by the access information acquiring unit 400B, and downloads the corresponding image data and audio data.

[0186] The playback processing unit 400D plays the downloaded image data and audio data and includes a display control unit 400D1 that displays the downloaded image data on the display unit 405 and an audio output control unit 400D2 that outputs the downloaded audio data from the speaker unit.

[0187] [System Action]

[0188] Actions of a Digital Camera with a Printer

[0189] The digital camera with printer 10 has a shooting mode and a playback mode as its operation modes. The shooting mode is a mode for shooting images. The playback mode is a mode for playing back the shot images.

[0190] The photography mode includes an automatic print mode and a manual print mode. The automatic print mode automatically prints the captured image. The manual print mode prints the captured image in response to a user command. Switching between modes is performed by pressing the mode switch button 22d.

[0191] Each of the photography modes includes a mode for capturing images with audio (recording mode). Furthermore, the recording modes include a normal recording mode and an after-recording mode. Normal recording mode records sound for a certain period of time before and after the release of the image. After-recording mode allows audio to be input after the image is taken. The recording mode is switched by pressing the record button 18. Specifically, each time the record button 18 is pressed, the normal recording mode, after-recording mode, and recording mode off are switched in sequence.

[0192] Figure 16 This is a flowchart showing the procedure for setting to each mode.

[0193] First, it is determined whether the mode is photography mode (step S1). If not photography mode, it is determined to be playback mode and the processing in playback mode is performed (step S2).

[0194] If the mode is shooting mode, it is determined whether it is manual printing mode (step S3). If it is not manual printing mode, it is determined to be automatic printing mode and the process in automatic printing mode is performed (step S4). If it is manual printing mode, the process in manual printing mode is performed (step S5).

[0195] <Operation in manual print mode>

[0196] As described above, the manual print mode is a mode for printing a captured image according to a print command from the user after the capture.

[0197] Figure 17 This is a flowchart showing the operation sequence in manual printing mode.

[0198] First, it is determined whether the recording mode is on (step S11). If the recording mode is not on, the image is captured without recording. On the other hand, if the recording mode is on, it is determined whether the normal recording mode is set (step S12). If the normal recording mode is set, the image is captured in the normal recording mode. That is, the sound is recorded simultaneously with the image. On the other hand, if the normal recording mode is not set, the image is captured in the post-recording mode. That is, the sound is recorded after the image is captured.

[0199] (1) When recording mode is on

[0200] Figure 18 This is a flowchart showing the operation sequence when the recording mode is off in manual print mode.

[0201] First, a live view is displayed on the display 28 (step S21). That is, the image captured by the image sensor 64 is displayed in real time on the display 28. The user checks the composition and the focus state of the subject while observing the display on the display 28.

[0202] Then, it is determined whether or not a photography command is issued (step S22 ). A photography command is issued by pressing the release button 16 .

[0203] If a capture command is issued, the capture process is performed (step S23). Specifically, an image is read via the image sensor 64. The image data obtained by the capture is converted into a specified file format, such as JPEG (Joint Photographic Experts Group), RAW, TIFF (Tagged Image File Format), GIF (Graphics Interchange Format), or bitmap, and stored in the memory 72 (step S24).

[0204] If the image is captured, a preview of the image data obtained by the capture is displayed on the display 28 (step S25). The user confirms the display on the display 28 and decides whether to print or not. To print, the user presses the print button 32b; to not print, the user presses the cancel button 32d or the release button 16.

[0205] During the preview, the system determines whether a print command has been issued based on the user's operation (step S26). If a print command has been issued, the system proceeds to print (step S27). The print process will be described later. Next, the system determines whether the mode has ended (step S28). Specifically, it determines whether to switch to another mode. If the mode has ended, the system terminates.

[0206] In this manner, in the manual print mode, a captured image is printed in accordance with a print command from the user after the image is captured.

[0207] (2) When normal recording mode is on

[0208] Figure 19 This is a flowchart showing the operation sequence when the normal recording mode is turned on in the manual print mode.

[0209] First, the live view is displayed on the monitor 28. Simultaneously, audio is read from the speaker 92 (step S31). The read audio is buffered for a certain period of time and then deleted sequentially. In other words, only the amount required for recording is buffered. For example, if 5 seconds of audio is recorded before and after a shot, at least the last 5 seconds of audio are buffered.

[0210] Next, a determination is made as to whether a photography command has been issued (step S32). If a photography command has been issued, photography and audio recording are performed (step S33). Specifically, images are captured via the image sensor 64, and audio is captured via the microphone 92. Audio is captured for a predetermined period of time before and after the photography.

[0211] The image data and audio data obtained by the shooting are converted into predetermined file formats, associated with each other, and stored in memory 72 (step S34). Suitable audio data files such as MP3 (MPEG-1 Audio Layer 3 (MPEG: Moving Picture Experts Group)), Real Audio (registered trademark), MIDI (registered trademark) (Musical Instruments Digital Interface) files, and WAVE files can be used as audio data files.

[0212] If captured, the image data obtained by the capture is previewed and displayed on the display 28 (step S35). During the preview, a determination is made based on the user's operation whether a print command has been issued (step S36). If a print command has been issued, the printing process is performed (step S37). The printing process will be described later. A determination is then made as to whether the mode has ended (step S38). If the mode has ended, the process ends.

[0213] Thus, in the normal recording mode, the sound of a certain time before and after the shooting is recorded and stored together with the image in the memory 72. In addition, the shot image data is printed according to the print command from the user.

[0214] (3) When post-recording mode is on

[0215] Figure 20 This is a flowchart showing the operation sequence when post-recording mode is turned on in manual print mode.

[0216] First, a live view is displayed on the display 28 (step S41). Next, a determination is made as to whether a shooting command has been issued (step S42). If a shooting command has been issued, shooting is performed (step S43), and image data obtained by the shooting is stored in the memory 72 (step S44). Furthermore, if the shooting has been completed, a preview of the image data obtained by the shooting is displayed on the display 28 (step S45).

[0217] Figure 21 This is a diagram showing an example of a preview screen in post-recording mode.

[0218] like Figure 21 As shown, the image PVI obtained by shooting and the message ME for confirming whether to record or not are displayed on the screen of the display 28. When recording (post-recording), press the recording button 18 (refer to Figure 2 ). When not recording, press the cancel button 32d. During the preview, based on the user's operation, it is determined whether there is a recording command (step S46).

[0219] When a recording command is issued, the recording process is performed (step S47). Specifically, a predetermined duration (e.g., 10 seconds) of sound is recorded via the microphone 92. The recorded sound data is then associated with the image data obtained by the capture and stored in the memory 72 (step S48).

[0220] Next, a determination is made as to whether a print command has been issued (step S49). Furthermore, even if recording has been canceled in step S46, a determination as to whether a print command has been issued is still made. If a print command has been issued, the printing process is performed (step S50). The printing process will be described later. Next, a determination is made as to whether the mode has ended (step S51). If the mode has ended, the process ends.

[0221] Thus, in post-recording mode, sound is recorded for a certain time after shooting according to a user command. The recorded sound data is associated with the image data and stored in the memory 72. In addition, the shot image data is printed according to a print command from the user.

[0222] <Operation in automatic print mode>

[0223] As described above, the automatic print mode is a mode for automatically printing a captured image after shooting.

[0224] Figure 22 This is a flowchart showing the operation sequence in automatic printing mode.

[0225] First, a determination is made as to whether recording mode is on (step S61). If recording mode is not on, filming is performed without recording. On the other hand, if recording mode is on, a determination is made as to whether normal recording mode is set (step S62). If normal recording mode is set, filming is performed in normal recording mode. That is, sound is recorded simultaneously with filming. On the other hand, if normal recording mode is not set, filming is performed in post-recording mode. That is, sound is recorded after filming.

[0226] (1) When recording mode is off

[0227] Figure 23 This is a flowchart showing the operation sequence when the recording mode is off in the automatic print mode.

[0228] First, a live view is displayed on the display 28 (step S71). Next, a determination is made as to whether a shooting command has been issued (step S72). If a shooting command has been issued, shooting processing is performed (step S73), and the image data obtained by the shooting is stored in the memory 72 (step S74). The captured image is then printed (step S75). The printing process will be described later. Next, a determination is made as to whether the mode has ended (step S76). If the mode has ended, processing ends.

[0229] In this manner, in the automatic print mode, the captured image is automatically printed after being captured.

[0230] (2) When normal recording mode is on

[0231] Figure 24 This is a flowchart showing the operation sequence when the normal recording mode is turned on in the automatic print mode.

[0232] First, a live view is displayed on the display 28. Simultaneously, audio is read from the speaker 92 (step S81). The read audio is buffered for a certain period of time and then deleted. A determination is then made as to whether a photography command has been issued (step S82). If a photography command has been issued, photography and audio recording are performed (step S83), and the image and audio data obtained by the photography are stored in the memory 72 (step S84). The captured image is then printed (step S85). The printing process will be described later. A determination is then made as to whether the mode has ended (step S86). If the mode has ended, the process ends.

[0233] Thus, in the normal recording mode, the sound of a certain time before and after the shooting is recorded and stored together with the image in the memory 72. In addition, the shot image is automatically printed.

[0234] (3) When post-recording mode is on

[0235] Figure 25 This is a flowchart showing the operation sequence when post-recording mode is turned on in automatic print mode.

[0236] First, the live view is displayed on the display 28 (step S91). Then, it is determined whether there is a shooting command (step S92). If the shooting command is given, the shooting process is performed (step S93), and the image data obtained by shooting is stored in the memory 72 (step S94). And, if the shooting is performed, the image data obtained by shooting is previewed and displayed on the display 28 (step S95). Figure 21 As shown, the image PVI obtained by the capture and a message ME confirming whether to record or not are displayed on the screen of the display 28. To record (post-recording), the record button 18 is pressed. To not record, the cancel button 32d is pressed. During the preview, the user's operation determines whether a recording instruction has been issued (step S96).

[0237] When a recording command is issued, the recording process is performed (step S97). Specifically, a predetermined duration (e.g., 10 seconds) of sound is recorded via the microphone 92. The recorded sound data is then associated with the image data obtained by the capture and stored in the memory 72 (step S98).

[0238] Then, the captured image is printed (step S99). The printing process will be described later. In addition, even if the recording is canceled in step S96, the printing process (step S99) is still performed.

[0239] Then, it is determined whether the mode has ended (step S100 ). If the mode has ended, the process ends.

[0240] Thus, in the post-recording mode, sound is recorded for a certain time after shooting according to a user's command. The recorded sound data is associated with the image data and stored in the memory 72. In addition, the captured image data is automatically printed.

[0241] <Actions in Playback Mode>

[0242] The switch from the shooting mode to the playback mode is performed by pressing the playback button 32c. In addition, the switch from the playback mode to the shooting mode is performed by pressing the release button 16.

[0243] Figure 26 This is a flowchart showing the operation sequence in playback mode.

[0244] If the playback mode is set, the image data of the last captured image is read from the memory 72 and is played and displayed on the display 28 (step S110 ).

[0245] Next, it is determined whether the image data being played is image data with audio (step S111). If it is image data with audio, it is determined whether there is an audio playback command (step S112). The audio playback command is issued by pressing the play button 32c.

[0246] Figure 27 This is a diagram showing an example of display on a monitor when displaying audio-attached video data.

[0247] like Figure 27 As shown, when the image data is accompanied by sound, an icon IC indicating that the image IM being displayed is accompanied by sound is displayed. This allows the user to confirm that the image IM being displayed is accompanied by sound.

[0248] When the play button 32c is pressed while image data with sound is displayed on the display 28, the sound playback process is performed (step S113). Specifically, the sound data associated with the image data being played is read from the memory 72 and output from the speaker 94. This allows the user to hear the sound associated with the image.

[0249] During playback, a determination is made as to whether a print command has been issued (step S114). A print command is issued by pressing the print button 32b. Pressing the print button 32b prints the image being played (step S115). The print process will be described later.

[0250] During playback, a determination is made as to whether a frame playback command has been issued (step S116). Frame playback is performed using the joystick 32a. Moving the joystick 32a horizontally initiates frame playback. Specifically, the next frame is read from the memory 72 and displayed on the display 28 (step S117). Furthermore, moving the joystick 32a vertically causes the displayed image to zoom in or out.

[0251] Then, it is determined whether the mode has ended (step S118 ). If the mode has ended, the process ends.

[0252] Thus, in the playback mode, the image being played can be printed according to a print command from the user. Furthermore, if the image being played has sound, the sound associated with the image can be played according to a command from the user.

[0253] <Printing Operation>

[0254] Figure 28 This is a flowchart showing the processing procedure when printing an image.

[0255] First, it is determined whether the image data to be processed is image data with audio (step S120 ). In other words, it is determined whether the audio data is recorded in a correlated manner.

[0256] If the image data is not audio-attached, the printing process is performed in the normal order. First, the printing image data is generated (step S121). That is, the image data for printing on the instant film 42 using the print head 56 is generated.

[0257] Furthermore, the digital camera with a printer 10 of this embodiment uses a single-sheet instant film 42. Therefore, the printed image is generated with the image being reversed left and right relative to the displayed image. Furthermore, the instant film 42 is loaded upside down, resulting in an upside-down image.

[0258] After generating the print image data, printing is performed (step S122). First, a sheet of instant film 42 is ejected from the instant film package 40. The ejected instant film 42 is conveyed at a constant speed toward the film outlet 34. During this conveyance, light is irradiated from the print head 56, and an image is recorded on the exposed surface. The exposed instant film 42 is developed by the unwinding roller pair 54B and then ejected from the film outlet 34.

[0259] On the other hand, when the image data to be printed is image data with sound, first, it is determined whether the image data and the sound data are to be uploaded to the data storage server 200 (step S123 ).

[0260] If the image data to be printed is audio-attached image data, a message appears on the display 28 asking whether or not to upload the data to the data storage server 200. The user determines whether to upload the data according to the message displayed on the screen. If uploading is to be performed, the user presses the OK button 22c; if not, the user presses the Cancel button 32d. The camera control unit 100 determines whether or not to upload the data based on the presses of the OK button 22c and the Cancel button 32d.

[0261] When uploading is not necessary, the printing process is performed in the normal order (steps S121 - S122 ), similar to the case of printing image data without sound.

[0262] On the other hand, when the image data to be printed and the audio data associated with the image data are uploaded, an upload process is performed (step S124 ).

[0263] Furthermore, as will be described later, when data is uploaded, a two-dimensional code (record information) encoding access information to the uploaded data is printed along with the image on instant film 42. Therefore, the series of operations up to the upload command is an example of a record information print setting unit that sets whether or not to print the record information.

[0264] Figure 29 This is a flowchart showing the upload process sequence.

[0265] First, unique identification information is generated (step S130). This identification information is generated to distinguish the data from other data at the data storage address. In the system of this embodiment, unique identification information is generated by combining information about the model of the digital camera with a printer 10, the serial number of the digital camera with a printer 10, and the cumulative number of prints.

[0266] Here, the “model information” refers to information that specifies the model of the digital camera with a printer 10 , such as the product name, product code, etc.

[0267] A "serial number" is an identification number assigned to a product, etc., specifically a number composed of numbers and alphanumeric characters assigned according to a specific rule or system. It is also called a manufacturing number. A serial number is an example of a unique identification number assigned to a digital camera with a printer.

[0268] Furthermore, the "cumulative print count" refers to the total number of prints performed since the digital camera with printer 10 was shipped. Therefore, if no prints have been made since shipment, the value is "0," and if ten prints have been made, the value is "10." The camera control unit 100 counts the cumulative print count and stores it in the memory 72. The cumulative print count information is displayed using a predetermined number of digits (e.g., five digits).

[0269] In the system of this embodiment, identification information is generated by arranging each piece of information in the order of "model," "serial number," and "cumulative print count." For example, if the model name is "instax_mini_xx," the serial number is "7T00XXX," and the cumulative print count is "00098," the identification information becomes "instax_mini_xx7T00XXX00098."

[0270] After the identification information is generated, upload data is generated (step S131). Specifically, data is generated for uploading to data storage server 200. This data is generated as data containing identification information. For example, the data may include identification information in a header. Alternatively, the data may be generated using the file name as identification information. The upload data may be generated separately for image data and audio data, or they may be combined into a single file.

[0271] Next, communication is performed with the upload terminal 300 (step S132 ), and it is determined whether the communication is established (step S133 ).

[0272] Once communication is established, upload data is transmitted to the upload terminal 300 (step S134 ). The upload terminal 300 receives the data and uploads it to the data storage server 200 .

[0273] Then, the camera control section 100 determines whether the upload is successful or not based on the result of the transmission of the upload data by the upload terminal 300 (step S135 ). If the upload is successful, the upload process ends.

[0274] Figure 30 It is a sequence diagram of upload processing.

[0275] First, the upload terminal 300 makes a connection request to the data storage server 200. The data storage server 200 responds to the request, and communication between the upload terminal 300 and the data storage server 200 is established.

[0276] Next, the digital camera with a printer sends a connection request to the upload terminal 300. The upload terminal 300 responds to the request, and communication between the digital camera with a printer 10 and the upload terminal 300 is established.

[0277] Next, the upload data is transmitted from the digital camera with printer 10 to the upload terminal 300. Upon receiving the upload data, the upload terminal 300 notifies the digital camera with printer 10 of the completion of the reception. The received upload data is temporarily stored in the memory.

[0278] Next, upload terminal 300 transmits the received upload data to data storage server 200. Data storage server 200 stores the received data. More specifically, the received image data and the audio data associated with the image data are associated with each other and stored in a database. At this time, the image data and audio data are recorded in the database using identification information attached to the data. This allows the image data and audio data to be identified.

[0279] When storage of the image data is completed, the data storage server 200 transmits a reception completion notification to the upload terminal 300. Upon receiving the reception completion notification, the upload terminal 300 notifies the digital camera with printer 10 of the completion of the upload.

[0280] Through the above series of processes, the image data and audio data are uploaded from the digital camera with printer 10 to the data storage server 200 .

[0281] Figure 31 This is a flowchart showing the processing sequence when communication is impossible or upload processing fails.

[0282] When communication with the upload terminal 300 fails (in Figure 29 If the result of step S133 is "No," the camera control unit 100 of the digital camera with printer 10 displays a predetermined error message (e.g., "Communication Error") on the display 28 (step S140). Simultaneously, a message asking whether to continue uploading (e.g., "Continue uploading?") is displayed.

[0283] The camera control section 100 determines whether the upload process has been canceled based on the user's operation input (step S141). If the upload process has been canceled, the cancel button 32d is pressed. If the upload process has not been canceled, the OK button 22c is pressed. If the upload process has not been canceled, the process returns to step S132 and attempts to communicate with the upload terminal 300 again ( Figure 29 Step S132).

[0284] On the other hand, if the upload process is canceled, the camera control section 100 displays an error message indicating that the upload has been canceled (e.g., "Upload canceled") on the display 28 (step S142). At the same time, a message inquiring whether to cancel printing (e.g., "Print?") is displayed.

[0285] The camera control unit 100 determines whether printing is canceled based on the user's operation input (step S143). If canceling is desired, the cancel button 32d is pressed, and if not, the OK button 22c is pressed. If not, printing is performed. In this case, printing is performed in the same order as for image data without sound. That is, Figure 28As shown, first, print image data is generated (step S121 ), and printing is performed based on the generated image data (step S122 ).

[0286] On the other hand, if printing is not to be performed, a message indicating that printing is stopped is displayed on the display 28 (step S144 ), and the printing process is terminated.

[0287] The same applies to the case where the upload terminal 300 fails in uploading. The upload terminal 300 inquires whether to cancel the upload process and the print process, and performs the process according to the command from the user.

[0288] In this manner, when communication is impossible or the upload process fails, an inquiry is made as to whether or not to cancel the upload process and the print process, and the process is performed according to the instruction from the user.

[0289] When printing image data with sound, if the upload process is completed, Figure 29 As shown, a QR code is generated (step S125). This QR code encodes access information for accessing the uploaded image data and audio data. More specifically, it is a QR code that encodes information for accessing the image data and audio data stored on the data storage server 200 on the network, and is a QR code that encodes the URL (Universal Resource Locator) of the data. The uploaded image data and audio data are assigned inherent identification information and are stored in a specified data storage server 200 using this inherent identification information. Therefore, the storage location can be determined by each digital camera with a printer 10. The camera control unit 100 of the digital camera with a printer 10 generates the access information, i.e., the URL, based on the identification information assigned to the uploaded image data and audio data and the storage address information (information of the data storage server 200), and encodes it in a QR code. In this embodiment, a QR code (registered trademark) is generated as the QR code.

[0290] When the two-dimensional code is generated, print image data is generated (step S126 ). The print image data includes the two-dimensional code.

[0291] Figure 32 This is a conceptual diagram of the generation of print image data when printing image data with sound.

[0292] like Figure 32As shown, the print image data PRI1 is generated by synthesizing a two-dimensional code QR with the printed image PRI0. The two-dimensional code QR overlaps with a portion of the printed image PRI0, effectively covering it. Therefore, the portion of the printed image PRI0 covered by the two-dimensional code QR is not visually recognizable. The two-dimensional code QR is synthesized at a predetermined position. In this embodiment, it is synthesized at the lower right corner of the printed image PRI0.

[0293] The digital camera with a printer 10 of this embodiment uses a single-sheet instant film 42, and therefore further performs a left-right inversion process on the image. Furthermore, the digital camera with a printer 10 of this embodiment loads the instant film 42 upside down, and therefore performs a top-down inversion process on the image.

[0294] After the print image data is generated, printing is performed (step S127). Specifically, the instant film 42 is fed from the instant film package 40. During this transport, light is irradiated from the print head 56, and an image is recorded on the exposed surface of the instant film 42. The exposed instant film 42 passes through the unwinding roller pair 54B, undergoes development processing, and is then discharged from the film discharge port 34.

[0295] Figure 33 This is a diagram showing an example of a printing result of audio-attached image data.

[0296] like Figure 33 As shown, a QR code QR is printed along with the image on the printed material, or instant film 42. Furthermore, as described above, the image is displayed on the viewing surface 42b, opposite the exposure surface, and in the viewing area 42h within the frame 42i. The viewing area 42h is slightly narrower than the exposure area, effectively displaying a cropped image.

[0297] By reading the two-dimensional code QR printed on the instant film 42 by the data broadcast terminal 400 , the image printed on the instant film 42 and the sound associated with the image can be viewed and heard on the data broadcast terminal 400 .

[0298] Operation of the Data Playback Terminal

[0299] As described above, by reading the QR code QR printed along with the image on the instant film 42 by the data playback terminal 400, the image and the sound associated with the image printed on the instant film 42 can be played on the data playback terminal 400. The data playback terminal 400 obtains access information to the image data and sound data from the QR code QR, and based on the obtained access information, accesses the data storage address, downloads, and plays the corresponding data.

[0300] Figure 34 This is a flowchart showing the procedure of downloading and playing image data and audio data.

[0301] The user who has obtained the instant film 42 with the QR code reads the QR code QR printed on the instant film 42 through the data playback terminal 400 (step S150 ).

[0302] The data playback terminal 400 obtains access information from the read QR code (step S151). Specifically, it obtains information (URL) for accessing the image data and the audio data associated with the image data, both of which are printed on the instant film 42. Furthermore, based on the obtained access information, it accesses the data storage address and downloads the data (step S152).

[0303] Figure 35 This is a sequence diagram of the download process.

[0304] The data broadcast terminal 400 makes a connection request to the data storage server 200. The data storage server 200 responds to the request, and communication between the data broadcast terminal 400 and the data storage server 200 is established.

[0305] Next, the data playback terminal 400 requests the data storage server 200 to transmit the corresponding data. Specifically, it requests the transmission of the image data to be printed on the instant film 42 and the audio data associated with the image data. In response to this request, the data storage server 200 searches the database and reads the corresponding data. The read data is then transmitted to the data playback terminal 400. The data playback terminal 400 receives the data transmitted from the data storage server 200. This completes the download process.

[0306] The data broadcast terminal 400 broadcasts the image data and audio data downloaded from the data storage server 200 (step S153 ). Specifically, the downloaded image data is displayed on the display 405 , and the downloaded audio data is output from the speaker unit 410 .

[0307] Figure 36 This figure compares an image printed on instant film and an image played back on a data playback terminal.

[0308] like Figure 36 As shown, a QR code QR is superimposed on the image printed on the instant film 42. Meanwhile, the image without the QR code is displayed on the display 405 of the data playback terminal 400. This allows viewing of the entire image. Furthermore, as described above, an image with its edges cropped is printed on the instant film 42, but the original image, without the cropping, is displayed on the display 405. This allows viewing of the unprinted portion of the instant film 42.

[0309] Furthermore, smartphones and the like generally have a function for magnifying images, so by using this function, it is possible to confirm the details of an image, thereby improving the convenience of image browsing.

[0310] Furthermore, when zooming in on a displayed image, a zoom-in operation is performed on the screen of display 405. This operation involves increasing the distance between the fingers while keeping two fingers touching the screen. Furthermore, when zooming out on a displayed image, a zoom-out operation is performed on the screen of display 405. This operation involves decreasing the distance between the fingers while keeping two fingers touching the screen. Data playback terminal 400 zooms in or out on the displayed image based on screen operations performed by the user.

[0311] The data broadcast terminal 400 displays a sound playback button VPB along with an image on the display 405. The user can repeatedly play the sound by touching the sound playback button VPB. The data broadcast terminal 400 plays the sound data in response to the user's screen operation.

[0312] In this way, the data playback terminal 400 can play the image printed on the instant film 42 and the sound associated with the image by reading the two-dimensional code QR printed on the instant film 42 .

[0313] [Modification]

[0314] Modification of a Digital Camera with a Printer

[0315] Printing method

[0316] In the above embodiment, printing on instant film is described as an example. However, the printing method performed by the digital camera with a printer 10 is not particularly limited. For example, a configuration may be employed in which thermal printing is performed using thermal paper or an ink ribbon. Furthermore, a configuration may be employed in which printing is performed using an inkjet method or the like.

[0317] <Voice Recording>

[0318] In the above embodiment, audio data is acquired during shooting and recorded in association with the image data obtained by the shooting, thereby generating image data with audio. However, the method of generating image data with audio is not limited to this. For example, image data with audio can also be generated by inputting audio at any time after shooting and recording it in association with any image data.

[0319] Figure 37 This is a flowchart showing the processing procedure for generating image data with audio after shooting in a digital camera with a printer.

[0320] This process is performed in playback mode. Specifically, in playback mode, the captured images are played back, and audio is input after selecting any image. Audio input is performed based on a recording command. The recording command is issued by pressing the recording button 18. Recording button 18 is an example of a post-recording command unit.

[0321] First, the captured image is played back (step S160). Specifically, one image (e.g., the most recently captured image) stored in the memory 72 is read and displayed on the display 28. While the image is being played back, the camera control unit 100 determines whether a recording command has been issued based on the operation information of the record button 18 (step S161).

[0322] When a command is issued to record the image being played, the camera control section 100 executes a recording process (step S162 ).

[0323] Figure 38 This is a flowchart showing the procedure of recording processing.

[0324] The camera control unit 100 determines whether a recording start command has been issued based on user input (step S170). The recording start command can be issued, for example, by pressing the record button 18. Pressing the cancel button 32d cancels the recording process. If the recording start command has not been issued, the camera control unit 100 determines whether a cancel command has been issued (step S171). If a cancel command has been issued, the recording process ends.

[0325] When recording is requested by pressing the record button 18, a predetermined period of sound is collected via the loudspeaker 92 (step S172). For example, 10 seconds of sound are collected. Sound data is generated from the collected sound (step S173). The generated sound data is then associated with the image data of the image being played and stored in the memory 72 (step S174).

[0326] The recording process is completed through the above steps. Figure 37 As shown, it is determined whether a frame playback command has been issued (step S163). If a frame playback command has been issued, the next frame is read from the memory 72 and played and displayed on the display 28 (step S164). Then, it is determined whether the playback mode has ended (step S165). If so, the process ends.

[0327] In this way, it is preferable to set the audio data in a format that can be freely added later. This can improve convenience.

[0328] In addition, a configuration is provided in which the sound recorded a certain time before and after the shooting is recorded in normal recording mode. However, when the sound is automatically recorded in conjunction with the shooting, the time of recording is not limited to the example of the above embodiment. Sound recorded a certain time after the shooting can be recorded, or a certain time before the shooting can be recorded. Furthermore, when recording sound a certain time before and after the shooting, the recording time before the shooting can be different from the recording time after the shooting. Alternatively, a configuration can be provided in which the user can arbitrarily set the recording time. Similarly, a configuration can be provided in which the user can arbitrarily set the recording time. For example, the configuration can be provided in which the recording setting option is called up from a menu screen.

[0329] <Rewriting of sound data>

[0330] It is preferable that the audio data associated with the image data be rewritable.

[0331] Figure 39 This is a flowchart showing the processing procedure when rewriting audio data in a digital camera with a printer.

[0332] This process is performed in playback mode. First, a captured image is played (step S180). Specifically, a single image stored in memory 72 (e.g., the most recently captured image) is read and displayed on display 28. While the image is being played, the camera control unit 100 determines whether a recording command has been issued based on the operation information of the record button 18 (step S181). If a recording command has been issued for the image being played, the camera control unit 100 determines whether the image has already been recorded (step S182). Specifically, it determines whether the image data for which recording has been requested is image data with audio.

[0333] When the image data for which recording is commanded is not image data with sound, Figure 38 The recording process is performed in the order shown (step S189).

[0334] On the other hand, when the image data commanded to be recorded is image data with audio, a message indicating that the recording has been completed (e.g., "Audio is recorded") and a message asking for rewriting (e.g., "Do you want to rewrite the audio?") are displayed on the display 28 (step S183).

[0335] The user instructs the user to rewrite the audio or cancel the recording based on the display on the display 28. The rewrite command is issued by pressing the OK button 22c. The recording is canceled by pressing the Cancel button 32d. The series of operations leading up to the rewrite command is an example of the audio data rewrite command unit.

[0336] The camera control section 100 determines whether there is a command to rewrite the audio data based on the user's operation input (step S184 ). If the command is to rewrite, the camera control section 100 performs audio recording (step S185 ).

[0337] Figure 40 This is a flowchart showing the procedure of recording processing when rewriting audio data.

[0338] The camera control unit 100 determines whether a recording start command has been issued based on user input (step S190). The recording start command can be issued, for example, by pressing the record button 18. Pressing the cancel button 32d cancels the recording process. If the recording start command has not been issued, the camera control unit 100 determines whether a cancel command has been issued (step S191). If a cancel command has been issued, the recording process ends.

[0339] When recording is requested by pressing the record button 18, a predetermined period of sound is collected via the loudspeaker 92 (step S192). For example, 10 seconds of sound are collected. Sound data is generated from the collected sound (step S193), and the generated sound data is recorded over the existing sound data (step S194). In other words, the sound data associated with the currently playing image data is replaced with the newly generated sound data.

[0340] The above steps complete the process of rewriting the sound data. Figure 39 As shown, it is determined whether a frame playback command has been issued (step S186). If a frame playback command has been issued, the next frame is read from the memory 72 and played and displayed on the display 28 (step S187). Then, it is determined whether the playback mode has ended (step S188). If so, the process ends.

[0341] In this manner, the audio data associated with the image data is preferably configured to be rewritable in the digital camera with a printer, thereby improving convenience.

[0342] <Recording format of image and audio data>

[0343] The image data and audio data can be associated with each other as long as one data item can identify the other. The method for associating the image data and audio data is not particularly limited. For example, a management file can be prepared and used to manage the association of image data and audio data. Alternatively, information about the associated data can be recorded in the data header to enable identification of the associated data.

[0344] Furthermore, when data is uploaded, identification information, a QR code, or the like may be added to the uploaded data for recording.

[0345] Figure 41 This is a diagram showing an example of the file structure of image data when data is uploaded.

[0346] like Figure 41 As shown in the figure, when data is uploaded, the QR code information generated during upload is included in the image data file. In addition, the location where the QR code is printed is recorded in the data header. This makes it easier to print the image with the QR code attached when printing it again.

[0347] Furthermore, audio data may be included in the file of image data, thereby enabling the image data and audio data to be managed in one file.

[0348] The above-described file structure is for data stored in the memory 72, but it can also be used as a file structure for uploaded data. Specifically, a structure can be adopted in which the image data includes information about the QR code, information about the location where the QR code is printed, and identification information, and a single file is generated and uploaded. Furthermore, a structure can also be adopted in which the file includes audio data and is uploaded.

[0349] <Identification Information>

[0350] In the above embodiment, identification information is generated by combining information about the model of the digital camera with a printer, information about the serial number of the digital camera with a printer, and information about the cumulative number of prints. However, the information generated as identification information is not limited to this. Any information that can uniquely identify data uploaded to the server may be used.

[0351] In addition, by including at least information about the model of the digital camera with a printer, information about the serial number of the digital camera with a printer, and information about the cumulative number of prints in the identification information, in a system that stores image data and sound data captured by multiple digital cameras with printers of different types, each uploaded data can be uniquely identified.

[0352] Furthermore, by including at least the serial number information and the cumulative number of prints of the digital camera with a printer in the identification information, the uploaded data can be uniquely identified in a system that stores image data and audio data captured by multiple digital cameras with printers of the same type.

[0353] Furthermore, by including at least the information on the cumulative number of prints in the identification information, uploaded data can be uniquely identified in a system that stores image data and audio data captured by the same digital camera with a printer.

[0354] <Record Information>

[0355] In the above embodiment, a two-dimensional code is used as the recorded information. However, a barcode, wireless tag, or the like can also be used as the recorded information and can be read using a known reading mechanism.

[0356] Furthermore, in the above embodiment, only access information is recorded in the log information. However, the log information may also include other information. For example, if a digital camera with a printer has a function for converting audio to text, the audio recorded during shooting may be converted to text and the log information may be generated including the text data.

[0357] <Upload>

[0358] In the above embodiment, when image data is printed, the printed image data and the audio data associated with the image data are uploaded. However, a configuration may be adopted in which only the audio data is uploaded. In this case, only the audio is played on the data playback terminal 400.

[0359] Furthermore, when uploading image data, you can also upload the image data with the QR code (recorded information) displayed. In other words, you can also upload the image data of the same image as the print.

[0360] Furthermore, in the above embodiment, if the digital camera with printer 10 fails to communicate with the upload terminal 300, the upload is canceled. However, a configuration may be employed in which the upload data is temporarily stored in the memory 72, for example, and automatically uploaded the next time communication is established. In this case, it is preferable to allow the user to select the automatic upload method. Similarly, if the upload terminal 300 fails to upload, the automatic upload method may be employed. For example, the upload process may be repeated after a certain period of time.

[0361] <Printing of recorded information>

[0362] In the above embodiment, the two-dimensional code (record information) is printed overlapping a portion of the image, but the printing method of the record information is not limited to this. The image and the record information may be printed exclusively so that they do not overlap.

[0363] Figure 42 This figure shows an example of exclusively printing an image and a two-dimensional code.

[0364] exist Figure 42 In the example shown, the image of the observation area 42h is reduced and printed, and the two-dimensional code QR is printed in the blank area generated by the reduction. This allows printing without overlapping the two-dimensional code QR and the image.

[0365] Furthermore, as in the above-described embodiment, when printing a QR code (recorded information) overlapping a portion of an image, it is preferable to provide a method in which the user can select the location where the QR code is to be printed. For example, a method in which the user selects one of multiple pre-prepared candidate print locations and prints the image can be provided. For example, a method in which the user selects one of four candidate print locations (the lower right corner, the upper right corner, the upper left corner, and the lower left corner) and prints the image can be provided. Preferably, the printed image is displayed on the display 28, and the location of the QR code can be adjusted.

[0366] Figure 43 This is a transition diagram of the printed image displayed on the monitor of a digital camera with a printer.

[0367] exist Figure 43 The example shown shows the QR code's printing position switching sequentially from the lower right corner of the image, to the upper right corner, the upper left corner, and the lower left corner. This switching is performed by operating the joystick 32a, for example, and the print position is confirmed by pressing the OK button 22c. This allows the printed image to be confirmed in advance.

[0368] Data Storage Server

[0369] The data storage server 200 is connected to the upload terminal 300 and the data playback terminal 400 via the communication network 2. However, the communication network 2 is not limited in form. For example, it can be formed by a LAN (Local Area Network). Furthermore, communication can be based on a wired system.

[0370] Upload Terminal

[0371] The upload terminal is preferably constituted by a portable computer such as a smartphone, but may also be constituted by a stationary computer as long as it has a communication function.

[0372] Furthermore, in the system of the above-described embodiment, when uploading data from the digital camera with printer 10 to the data storage server 200, the upload is performed via the upload terminal 300, thereby simplifying the structure of the digital camera with printer 10. In other words, the digital camera with printer 10 only needs to have a short-range wireless communication function, thereby simplifying the functions used for communication.

[0373] Furthermore, in the above embodiment, the upload data is generated by the digital camera with a printer, but the upload data may be generated by the upload terminal.

[0374] Furthermore, the uploaded data can also be stored in the upload terminal. Thus, even without accessing the data storage server, the uploaded image and sound can be viewed and listened to in the upload terminal.

[0375] Furthermore, in the system of the above embodiment, when uploading image data and audio data from the digital camera with printer 10 to the data storage server 200, the data is uploaded via the upload terminal 300. However, a configuration may also be adopted in which the digital camera with printer 10 directly uploads the data to the data storage server 200. In this case, the digital camera with printer 10 has a communication function via the communication network 2.

[0376] Furthermore, the system of the above embodiment can simplify the structure of the digital camera with printer 10 by adopting a configuration in which data is uploaded via the upload terminal 300. That is, the digital camera with printer 10 only needs to have a near-field wireless communication function, thereby simplifying the communication function.

[0377] Data playback terminal

[0378] <Device Structure>

[0379] The data playback terminal is preferably constituted by a portable computer such as a smartphone, but can also be constituted by a stationary computer as long as it has functions such as communication, QR code (recorded information) reading and playback.

[0380] <Rewriting of audio data by a data playback terminal>

[0381] Alternatively, the audio data stored in the data storage server may be rewritten by an operation from the data playback terminal.

[0382] Figure 44 This is a system configuration diagram showing an example of a system capable of rewriting audio data stored in a data storage server.

[0383] like Figure 44 As shown, data broadcast terminal 400 further includes a sound data rewriting command unit 400E that commands the rewriting of sound data for image data displayed on display unit 405; a sound collection control unit 400F that obtains rewriting sound data in response to the command to rewrite sound data; and a rewriting data upload unit 400G that uploads the rewriting sound data to data storage server 200. These functions are implemented by CPU 401 of data broadcast terminal 400 executing a predetermined control program.

[0384] The audio data rewrite command unit 400E displays a button for rewriting audio data on the display 405 along with an image, detects a touch operation on the button, and receives an audio data rewrite command. Alternatively, the audio data rewrite command may be received from a predetermined menu screen.

[0385] The sound collection control unit 400F controls the microphone unit 409, which is a sound collection unit, to acquire the rewriting audio data. The time for acquiring the rewriting audio data is a predetermined time (for example, 10 seconds).

[0386] The rewriting data upload unit 400G adds information instructing to rewrite the audio data with the image data, and uploads the rewriting audio data to the data storage server 200 .

[0387] On the other hand, the data storage server 200 also includes a function of an audio data rewriting control unit 200D that rewrites the received target data with the audio data for rewriting when the rewriting audio data is received from the data broadcasting terminal 400. This function is implemented by the CPU 201 of the data storage server 200 executing a predetermined control program.

[0388] Figure 45 This is a sequence diagram showing the procedure for rewriting audio data.

[0389] First, the rewriting audio data is acquired in the data broadcast terminal 400. Then, the data broadcast terminal 400 makes a connection request to the data storage server 200. The data storage server 200 responds to the request, and communication between the data broadcast terminal 400 and the data storage server 200 is established.

[0390] Next, the rewriting audio data is uploaded from the data broadcast terminal 400 to the data storage server 200. If the data is successfully received, the data storage server 200 notifies the data broadcast terminal 400 of the completion of the reception.

[0391] Upon receiving the rewriting audio data, the data storage server 200 searches for the image data to be rewritten. The rewriting is then performed using the rewriting audio data associated with the searched image data. When the rewriting is complete, the data broadcast terminal 400 is notified of the completion of the rewriting.

[0392] Through the above series of steps, the sound data is rewritten. Then, the newly rewritten sound data is downloaded and played.

[0393] <Image Data Playback Processing>

[0394] In the system of the above embodiment, if the uploaded image does not contain image data showing a QR code (image data not including recorded information), the image without the QR code is played on the data playback terminal 400 .

[0395] The image uploaded to the data storage server 200 may be image data containing a QR code (recorded information) in the image. In this case, if the image data is downloaded and directly played back, the QR code will also be displayed together with the image. When the image data is played back in the data playback terminal 400, if a QR code is displayed, it may sometimes hinder viewing. Therefore, when playing image data containing a QR code in the image, the data playback terminal 400 preferably masks the portion of the QR code before playing. For example, when a QR code is covered, the portion of the QR code may be masked by whitening it out and not displayed. And, for example, as Figure 42 As shown, when a QR code QR is displayed in the blank area, only the area of the playback image can be cropped for playback.

Claims

1. A digital camera comprising: Processing Department; loudspeaker; Image sensor; Printing Department; as well as The operation unit is configured to receive a user operation, The processing unit is configured to: obtaining sound data of the sound acquired via the loudspeaker; Obtaining image data of an original image captured by the image sensor; generating identification information for identifying and associating the acquired image data with the acquired sound data; generating a two-dimensional code encoding the identification information; generating printing image data for a printed image by combining an original image with the two-dimensional code so as to place the two-dimensional code on a portion of the original image and adjusting a position of the two-dimensional code on the original image according to an operation of the user; as well as The printing unit is caused to print the printed image on a medium.

2. The digital camera according to claim 1, wherein The identification information includes information on the cumulative number of printing times.

3. The digital camera according to claim 2, wherein: The identification information further includes information on a unique identification number assigned to the digital camera and / or information on the model of the digital camera.

4. The digital camera according to any one of claims 1 to 3, wherein: The processing unit is further configured to: receiving a command for rewriting the sound data associated with the image data; and When rewriting of the sound data is instructed, rewriting sound data is acquired, and the sound data of the image data instructed to be rewritten is rewritten with the rewriting sound data.

5. The digital camera according to any one of claims 1 to 3, wherein: The processing unit is further configured to: receiving a command to post-record the image data; and When the after-recording is instructed, sound data is acquired, and the acquired sound data is recorded in association with the image data for which the after-recording is instructed.

6. The digital camera according to any one of claims 1 to 3, wherein: The processing unit is configured to acquire sound data for a certain period of time when photographing, and record the acquired sound data in association with image data.

7. The digital camera according to any one of claims 1 to 3, wherein: The medium is instant film.

8. The digital camera according to any one of claims 1 to 3, wherein: The processing unit is configured to select one from a plurality of candidate positions on the original image as a position for placing the two-dimensional code according to the user's operation.

9. The digital camera according to claim 8, wherein: The candidate positions include the lower right corner, upper right corner, upper left corner and lower left corner of the original image.

10. The digital camera according to any one of claims 1 to 3, wherein: The digital camera further includes a display, The processing unit is configured to cause the display to display the printed image, and to enable the position of the two-dimensional code to be adjusted on the displayed printed image according to an operation by the user.

11. A data playback system, comprising: The digital camera according to any one of claims 1 to 10, further comprising a first short-range wireless communication device; a server including a storage unit, wherein the server is configured to store the printing image data and sound data associated with the printing image data in the storage unit, the printing image data including record information including access information; as well as a data uploading terminal configured to upload the printing image data, the sound data and the identification information; The data upload terminal includes: Second processing unit; a second short-range wireless communication device; and wireless communication equipment, The second processing unit is configured to: obtain uploaded data related to the playback data through the second short-range wireless communication device, and transmit the obtained uploaded data to the server through the wireless communication device, The processing unit in the digital camera is further configured to upload the uploaded data including the print image data, the sound data, and the identification information to the data upload terminal via the first short-range wireless communication device.

12. The data playback system according to claim 11, wherein: The processing unit in the digital camera is further configured to: Managing communications with the data upload terminal; and If an error is detected in the communication with the data uploading terminal, uploading is stopped and the data is uploaded when the next communication is established.

Images