Data playback system, data playback method, terminal, printer, and server

Abstract

The present invention provides a data playback system, a data playback method, a data playback terminal, a printer, and a server that can play sound from printed matter and display good images. Image data of an image printed on an instant film (42) and sound data associated with and corresponding to the image data are stored in a data storage server (200). If a two-dimensional code printed on the instant film (42) together with the image is read by the data playback terminal (400), access information for accessing the image data of the printed image and the sound data associated with and corresponding to the image data is obtained. The data playback terminal (400) accesses the data storage server (200) according to the obtained access information, and downloads and plays the image data and the sound data of the printed image.

Description

Technical Field

[0001] The present invention relates to a data playback system, a data playback method, a data playback terminal, a printer, and a server. Background Art

[0002] There is known a technique in which when printing image data associated with sound data, by encoding the sound data with a two-dimensional code or the like and printing it together with the image, the sound can be played from the printed matter (for example, Patent Documents 1, 2, etc.).

[0003] There is also known a technique in which when printing image data associated with sound data, by uploading the sound data to a server, encoding the access information to the sound data with a two-dimensional code or the like, and printing it together with the image, the sound can be played from the printed matter (for example, Patent Documents 3, 4, etc.).

[0004] Patent Document 1: Japanese Patent Application Laid-Open No. 2001-324757

[0005] Patent Document 2: Japanese Patent Application Laid-Open No. 2007-104109

[0006] Patent Document 3: Japanese Patent Application Laid-Open No. 2005-345632

[0007] Patent Document 4: Japanese Patent Application Laid-Open No. 2006-293580

[0008] However, when printing a two-dimensional code or the like together with an image, there is a drawback that it hinders the viewing of the image. In particular, when overlapping and printing a two-dimensional code or the like on an image, there is a drawback that a part of the image is missing due to the two-dimensional code or the like. Summary of the Invention

[0009] The present invention has been made in view of such circumstances, and an object thereof is to provide a data playback system, a data playback method, a data playback terminal, a printer, and a server that can play sound from a printed matter and can view a good image.

[0010] (1) A data playback system, comprising: a server that stores image data of an image printed on a medium and sound data associated with and corresponding to the image data; and a data playback terminal that downloads and plays the image data and the sound data associated with and corresponding to the image data from the server. The data playback terminal includes: a display unit that displays the image; a sound output unit that outputs sound; a recording information reading unit that reads recording information; an access information acquisition unit that acquires access information for accessing the image data of the image printed on the medium by reading the recording information with the recording information reading unit. The recording information records access information for accessing the image data of the image printed on the medium and is printed on the medium together with the image; a download unit that downloads the image data of the image printed on the medium and the sound data associated with and corresponding to the image data from the server according to the access information acquired by the access information acquisition unit; a display control unit that displays the image data downloaded by the download unit on the display unit; and a sound output control unit that outputs and plays the sound data downloaded by the download unit from the sound output unit.

[0011] According to this mode, if the recording information printed on the medium together with the image is read by the data playback terminal, the access information for accessing the image data of the image printed on the medium and the sound data associated with and corresponding to the image data can be acquired, and the image data and the sound data can be downloaded and played from the server at the storage address.

[0012] (2) In the data playback system of (1) above, image data that does not include recording information is stored in the server.

[0013] According to this mode, image data that does not include recording information is stored in the server. Thus, when the image data is played on the data playback terminal, an image without recording information can be played.

[0014] (3) In the data playback system of (1) above, image data that includes recording information is stored in the server, and the display control unit masks the recording information and then displays the image data on the display unit.

[0015] According to this mode, image data that includes recording information is stored in the server. Also, when the image data is played on the data playback terminal, it is played after the recording information is masked. Thus, it is possible to prevent the recording information from interfering with viewing.

[0016] (4) Any of the data playback systems in (1) to (3) above further includes a printer, which includes: an upload unit that, when printing image data associated with sound data, uploads the printed image data and the sound data associated with the image data to the server; a recording information generation unit that generates recording information recording access information for accessing the image data uploaded to the server; and a printing control unit that, when printing image data associated with sound data, prints the recording information generated by the recording information generation unit together with the image.

[0017] According to this mode, in the printer, printing is used as a trigger signal, and the image data and the sound data are uploaded to the server.

[0018] (5) In the data playback system in (4) above, the printer further includes: a photographing unit that electronically photographs the printed image; and a sound collection unit that collects sound associated with the printed image.

[0019] According to this mode, the printer has a photographing function.

[0020] (6) Any of the data playback systems in (4) or (5) above further includes: an upload terminal that uploads the received data to the server, and the upload unit uploads the printed image data and the sound data associated with the image data to the server via the upload terminal.

[0021] According to this mode, the image data and the sound data are uploaded from the printer to the server via the upload terminal.

[0022] (7) In any of the data playback systems in (1) to (6) above, the data playback terminal further includes: a sound collection unit that collects sound; a sound data rewriting command unit that commands rewriting of the sound data associated with the image data displayed on the display unit; a sound collection control unit that, when the rewriting of the sound data is commanded by the sound data rewriting command unit, controls the sound collection unit to obtain the sound data for rewriting; and a data upload unit for rewriting that uploads the sound data for rewriting to the server after attaching information of the image data for which rewriting has been commanded. The server further includes: a sound data rewriting control unit that, when receiving the sound data for rewriting, rewrites the sound data of the image data for which rewriting has been commanded using the received sound data.

[0023] According to this mode, the sound data saved in the server can be rewritten afterwards.

[0024] (8) In any of the data playback systems in (1) to (7) above, for the image data saved in the server, the information determined at the time of printing is attached as unique identification information.

[0025] According to this mode, the information determined at the time of printing is attached as unique identification information to the image data saved in the server.

[0026] (9) In the data playback system described in (8) above, the identification information includes information on the cumulative number of prints of the printer that printed the image data.

[0027] According to this method, information on the cumulative number of prints of the printer that printed the image data is included in the identification information.

[0028] (10) In the data playback system described in (9) above, the identification information further includes information on the unique identification number of the printer that printed the image data.

[0029] According to this method, information on the unique identification number of the printer that printed the image data is included in the identification information.

[0030] (11) In the data playback system described in (9) or (10) above, the identification information further includes information on the model of the printer when the image data was printed.

[0031] According to this method, information on the model of the printer when the image data was printed is included in the identification information.

[0032] (12) In any of the data playback systems described in (1) to (11) above, the cropped image is printed on a medium.

[0033] According to this method, the cropped image is printed on a medium.

[0034] (13) In any of the data playback systems described in (1) to (12) above, the medium is a self-developing film.

[0035] According to this method, a self-developing film is used as the printing medium.

[0036] (14) In any of the data playback systems described in (1) to (13) above, the recorded information is a QR code, a barcode, or a wireless tag.

[0037] According to this method, the recorded information consists of a QR code, a barcode, or a wireless tag.

[0038] (15) A data playback terminal, comprising: a display unit for displaying an image; a sound output unit for outputting sound; a recorded information reading unit for reading recorded information; an access information acquisition unit for acquiring access information for accessing image data of an image printed on a medium by reading the recorded information with the recorded information reading unit, the recorded information recording the access information for accessing the image data of the image printed on the medium and being printed on the medium together with the image; a download unit for downloading the image data of the image printed on the medium and the sound data associated with and corresponding to the image data from a storage address according to the access information acquired by the access information acquisition unit; a display control unit for displaying the image data downloaded by the download unit on the display unit; and a sound output control unit for outputting and playing the sound data downloaded by the download unit from the sound output unit.

[0039] (16) A printer configured to form any one of the data playback systems in (4) to (6) above.

[0040] (17) A server configured to form any one of the data playback systems in (1) to (13) above.

[0041] (18) A data playback method, comprising: a step of acquiring printed image data and sound data associated with and corresponding to the image data; a step of uploading the acquired image data and the sound data associated with and corresponding to the image data to a server; a step of generating recorded information recording access information for accessing the image data uploaded to the server; a step of printing the generated recorded information on a medium together with the image; a step of acquiring access information for accessing the image data of the image printed on the medium by reading the recorded information printed on the medium together with the image; a step of downloading the image data of the image printed on the medium and the sound data associated with and corresponding to the image data from the server according to the acquired access information; a step of displaying the downloaded image data; and a step of playing the downloaded sound data.

[0042] Advantages of the Invention

[0043] According to the present invention, it is possible to play sound from printed matter and view good-quality images. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 FIG. is a system configuration diagram showing an embodiment of a data storage and playback system to which the present invention is applied.

[0045] Figure 2 FIG. is a front perspective view showing an example of a printer-equipped digital camera.

[0046] Figure 3 is Figure 2 a rear perspective view of the printer-equipped digital camera shown in FIG.

[0047] Figure 4 It is a cross-sectional view showing the schematic structure of the printer section.

[0048] Figure 5 It is a perspective view of the instant film cartridge.

[0049] Figure 6 It is a front view of the instant film.

[0050] Figure 7 It is a rear view of the instant film.

[0051] Figure 8 It is a block diagram showing the electrical structure of the digital camera with a printer.

[0052] Figure 9 It is a block diagram of the main functions implemented by the camera control unit.

[0053] Figure 10 It is a block diagram showing an example of the hardware structure of the data storage server.

[0054] Figure 11 It is a block diagram of the main functions provided by the data storage server.

[0055] Figure 12 It is a block diagram showing an example of the hardware structure of the upload terminal.

[0056] Figure 13 It is a block diagram of the main functions provided by the upload terminal.

[0057] Figure 14 It is a block diagram showing an example of the hardware structure of the data playback terminal.

[0058] Figure 15 It is a block diagram of the main functions provided by the data playback terminal.

[0059] Figure 16 It is a flowchart showing the sequence of setting for each mode.

[0060] Figure 17 It is a flowchart showing the sequence of operations in the manual printing mode.

[0061] Figure 18 It is a flowchart showing the sequence of operations in the manual printing mode when the recording mode is off.

[0062] Figure 19 It is a flowchart showing the sequence of operations in the manual printing mode when the normal recording mode is on.

[0063] Figure 20 It is a flowchart showing the sequence of operations in the manual printing mode when the post-recording mode is on.

[0064] Figure 21 This is a diagram showing an example of a preview screen in the post-recording mode.

[0065] Figure 22 This is a flowchart showing the sequence of operations in the automatic printing mode.

[0066] Figure 23 This is a flowchart showing the sequence of operations when the recording mode is turned off in the automatic printing mode.

[0067] Figure 24 This is a flowchart showing the sequence of operations when the normal recording mode is turned on in the automatic printing mode.

[0068] Figure 25 This is a flowchart showing the sequence of operations when the post-recording mode is turned on in the automatic printing mode.

[0069] Figure 26 This is a flowchart showing the sequence of operations in the playback mode.

[0070] Figure 27 This is a diagram showing an example of the display on a monitor when displaying image data with sound.

[0071] Figure 28 This is a flowchart showing the sequence of processes when printing an image.

[0072] Figure 29 This is a flowchart showing the sequence of upload processes.

[0073] Figure 30 This is a sequence diagram of the upload process.

[0074] Figure 31 This is a flowchart showing the sequence of processes when communication fails or the upload process fails.

[0075] Figure 32 This is a conceptual diagram of generating print image data when printing image data with sound.

[0076] Figure 33 This is a diagram showing an example of the print result of image data with sound.

[0077] Figure 34 This is a flowchart showing the sequence of processes for downloading and playing image data and sound data.

[0078] Figure 35 This is a sequence diagram of the download process.

[0079] Figure 36 This is a diagram comparing the image printed on the instant film with the image played on the data playback terminal.

[0080] Figure 37It is a flowchart showing the sequence of processes when generating sound - accompanied image data after shooting in a printer - equipped digital camera.

[0081] Figure 38 It is a flowchart showing the sequence of recording processes.

[0082] Figure 39 It is a flowchart showing the sequence of processes when rewriting sound data in a printer - equipped digital camera.

[0083] Figure 40 It is a flowchart showing the sequence of recording processes when rewriting sound data.

[0084] Figure 41 It is a diagram showing an example of the file structure of image data when data is uploaded.

[0085] Figure 42 It is a diagram showing another example of printing when printing a QR code.

[0086] Figure 43 It is a transition diagram of the printed image displayed on the monitor of a printer - equipped digital camera.

[0087] Figure 44 It is a system structure diagram showing an example of a system that can rewrite sound data stored in a data storage server.

[0088] Figure 45 It is a sequence diagram showing the sequence of rewriting sound data.

[0089] Symbol Explanation

[0090] 1 - Playback system, 2 - Communication network, 2a - Base station, 10 - Digital camera with printer, 12 - Camera body, 14 - Photographic lens, 16 - Release button, 18 - Recording button, 20 - Flashlight emission window, 22a - Power button, 22b - Menu button, 22c - OK button, 22d - Mode switch button, 24 - Microphone hole, 26 - Speaker hole, 28 - Display, 30 - Film cassette cover, 32a - Joystick, 32b - Print button, 32c - Play button, 32d - Cancel button, 34 - Film discharge port, 40 - Instant film packaging box, 42 - Instant film, 42a - Exposure surface of instant film, 42b - Observation surface of instant film, 42c - Exposure area of instant film, 42d - Pocket of instant film, 42e - Developing solution pocket of instant film, 42f - Collection part of instant film, 42g - Absorbent material of instant film, 42h - Observation area of instant film, 42i - Frame of instant film, 44 - Box of instant film packaging box, 44a - Exposure opening of instant film packaging box, 44b - Discharge port of instant film packaging box, 44c - Card slot opening part of instant film packaging box, 50 - Film loading chamber, 52 - Film feeding mechanism, 52a - Card slot, 54 - Film conveying mechanism, 54A - Conveyor roller pair, 54B - Unfolding roller pair, 56 - Print head, 62 - Lens drive unit, 64 - Image sensor, 66 - Image sensor drive unit, 68 - Analog signal processing unit, 70 - Digital signal processing unit, 72 - Memory, 74 - Storage controller, 76 - Display controller, 78 - Short - range wireless communication unit, 80 - Antenna, 82 - Film feeding drive unit, 84 - Film conveying drive unit, 86 - Print head drive unit, 88 - Flashlight, 90 - Flashlight emission control unit, 92 - Loudspeaker, 94 - Speaker, 96 - Sound signal processing unit, 98 - Operation unit, 100 - Camera control unit, 100A - Photography control unit, 100B - Recording control unit, 100C - Identification information generation unit, 100D - Upload unit, 100E - Communication management unit, 100F - QR code generation unit, 100G - Print control unit, 100H - Playback control unit, 200 - Data storage server, 200A - Data reception control unit, 200B - Data management unit, 200C - Data transmission control unit, 200D - Sound data rewriting control unit, 201 - CPU, 202 - ROM, 203 - RAM, 204 - HDD, 205 - Display, 206 - Network I / F, 207 - Keyboard, 208 - Mouse, 210 - Optical drive, 300 - Upload terminal, 300A - Upload data acquisition unit, 300B - Data transmission unit, 301 - CPU, 302 - ROM, 303 - RAM, 304 - EEPROM, 305 - Display, 306 - Touch panel, 307 - GPS receiver, 308 - Camera unit, 309 - Microphone unit, 310 - Speaker unit, 311 - Communication unit311A - Antenna, 312 - Near - field wireless communication unit, 312A - Antenna, 313 - Sensor unit, 314 - Media driver, 315 - Memory card, 400 - Data playback terminal, 400A - QR code reader, 400B - Access information acquisition unit, 400C - Download unit, 400D - Playback processing unit, 400D1 - Display control unit, 400D2 - Sound output control unit, 400E - Sound data rewrite command unit, 400F - Sound collection control unit, 400G - Rewrite data upload unit, 401 - CPU, 402 - ROM, 403 - RAM, 404 - EEPROM, 405 - Display, 406 - Touch panel, 407 - GPS receiver, 408 - Camera unit, 409 - Microphone unit, 410 - Speaker unit, 411 - Communication unit, 411A - Antenna, 412 - Near - field wireless communication unit, 412A - Antenna, 413 - Sensor unit, 414 - Media driver, 415 - Memory card, IM - Image, ME - Message, PRI0 - Image, PRI1 - Image data, PV1 - Image, QR - QR code, VPB - Sound play button, S1~S5 - Sequence of setting to each mode, S11~S12 - Action sequence in manual printing mode, S21~S28 - Action sequence in manual printing mode when recording mode is off, S31~S38 - Action sequence in manual printing mode when normal recording mode is on, S41~S51 - Action sequence in manual printing mode when post - recording mode is on, S61~S62 - Action sequence in automatic printing mode, S71~S76 - Action sequence in automatic printing mode when recording mode is off, S81~S86 - Action sequence in automatic printing mode when normal recording mode is on, S91~S100 - Action sequence in automatic printing mode when post - recording mode is on, S110~S118 - Action sequence in playback mode, S120~S127 - Processing sequence when printing an image, S130~S135 - Upload processing sequence, S140~S144 - Processing sequence when communication fails or upload processing fails, S150~S153 - Processing sequence for downloading and playing image data and sound data, S160~S165 - Processing sequence for generating sound - attached image data after shooting in a printer - equipped digital camera, S170~S174 - Recording processing sequence, S180~S188 - Processing sequence for rewriting sound data in a printer - equipped digital camera, S190~S194 - Recording processing sequence when rewriting sound data., Detailed implementation mode

[0091] Hereinafter, preferred implementation modes of the present invention will be described in detail with reference to the accompanying drawings.

[0092] [Structure of the system]

[0093] Figure 1 It is a system structure diagram showing an embodiment of the data storage and playback system to which the present invention is applied.

[0094] The data storage and playback system 1 of this embodiment is a system in which when printing image data with sound by a digital camera with a printer, the image data and sound data are uploaded to a data storage server, and if necessary, playback can be achieved on a terminal such as a smartphone. When the digital camera with a printer prints image data with sound, access information to the data storage address is added and then the image data is printed. The user reads the access information through a terminal such as a smartphone, and downloads and plays the target data from the data storage server.

[0095] As Figure 1 shown, the data storage and playback system 1 includes a digital camera with a printer 10, a data storage server 200 that stores the image data of the image printed by the digital camera with a printer 10 and the sound data associated with the image data, an upload terminal 300 for uploading data from the digital camera with a printer 10 to the data storage server 200, and a data playback terminal 400 for downloading and playing the image data stored in the data storage server 200 and the sound data associated with the image data.

[0096] The upload terminal 300 is composed of a computer with a communication function, and in particular, is composed of mobile computers such as smartphones, tablet terminals, laptop computers, and PDAs (Personal Data Assistant). The communication between the digital camera with a printer 10 and the upload terminal 300 performs communication following a short-range wireless communication standard such as the NFC (Near Field Communication) standard, Bluetooth (registered trademark), and WiFi (Wireless Fidelity).

[0097] The data playback terminal 400 is composed of a computer with a photography function and a communication function, and in particular, is composed of mobile computers with a camera such as smartphones, tablet terminals, laptop computers, and PDAs (Personal Data Assistant).

[0098] Communication between the data storage server 200, the upload terminal 300, and the data playback terminal 400 is carried out via the communication network 2. The communication network 2 is constructed, for example, by wireless communication networks such as 3G (3rd Generation), WiMAX (Worldwide Interoperability for Microwave Access), and LTE (Long Term Evolution), each base station 2a, and the Internet.

[0099] Moreover, the communication protocol between the data storage server 200, the upload terminal 300, and the data playback terminal 400 is, for example, HTTP communication based on the Hyper Text Transfer Protocol (HTTP). The upload terminal 300 and the data playback terminal 400 are equivalent to HTTP clients, and the data storage server 200 is equivalent to an HTTP server.

[0100] In addition, in the data storage and playback system 1 of the present embodiment, the printer-equipped digital camera 10, the data storage server 200, and the upload terminal 300 constitute a data storage system, and the data storage server and the data playback terminal 400 constitute a data playback system.

[0101] 《Printer-Equipped Digital Camera》

[0102] The printer-equipped digital camera 10 is a digital camera with a built-in printer and has the function of printing the captured images on the spot. The printer-equipped digital camera 10 of the present embodiment uses a self-developing film cartridge to print on self-developing film. Moreover, the printer-equipped digital camera 10 of the present embodiment has a recording function and has the function of recording sounds in association with the captured images.

[0103] <External Structure>

[0104] Figure 2 is a front perspective view showing an example of the printer-equipped digital camera. Figure 3 is Figure 2 a rear perspective view of the printer-equipped digital camera shown.

[0105] As Figure 2 and Figure 3 shown, the printer-equipped digital camera 10 has a portable camera body 12. The camera body 12 has a longitudinally long rectangular parallelepiped shape with a relatively thin thickness in the front-rear direction and a longitudinal dimension longer than the lateral dimension.

[0106] As Figure 2As shown, on the front side of the camera body 12, there are provided a photographic lens 14, a release button 16, a recording button 18, a flash emission window 20, etc. And on one side surface of the camera body 12, there are provided a power button 22a, a menu button 22b, an OK button 22c, a mode switching button 22d, a microphone hole 24, a speaker hole 26, etc. The release button 16 is a button for commanding the recording of an image. The recording button 18 is a button for switching the recording mode. The power button 22a is a button for turning on and off the power of the digital camera with printer 10. The menu button 22b is a button for calling up a menu screen. The OK button is a button for commanding OK. The mode switching button 22d is a button for switching between an automatic printing mode and a manual printing mode in a photographic mode.

[0107] As Figure 3 shown, on the back side of the camera body 12, there are provided a display 28, a film cartridge cover 30, and various operation buttons. The film cartridge cover 30 is a cover for opening and closing a film loading chamber. Among the operation buttons, there are included a joystick 32a, a print button 32b, a play button 32c, a cancel button 32d, etc. The print button 32b is a button for commanding printing. The play button 32c is a button for commanding switching to a play mode. The cancel button 32d is a button for commanding cancellation of an operation.

[0108] As Figure 2 and Figure 3 shown, on the upper surface of the camera body 12, there is provided a film discharge port 34. The printed instant film is discharged from the film discharge port 34.

[0109] <Structure of the Printer Portion of the Digital Camera with Printer>

[0110] Figure 4 is a cross-sectional view showing a schematic structure of the printer portion.

[0111] As Figure 4 shown, the digital camera with printer 10 includes, as components of a printing section, i.e., the printer portion, a film loading chamber 50, a film feeding mechanism 52, a film conveying mechanism 54, a print head 56, etc.

[0112] The film loading chamber 50 is a loading portion for an instant film cartridge 40. The film loading chamber 50 has a recess for inserting the instant film cartridge 40, and is opened and closed by the film cartridge cover 30. The film loading chamber 50 is sealed in a light-tight state by closing the film cartridge cover 30.

[0113] The instant film cartridge 40 has a structure in which a plurality of instant films 42 are accommodated in a case 44.

[0114] Figure 5 is a perspective view of the instant film cartridge. And Figure 6 is a front view of the instant film,Figure 7 is a rear view of the instant film. Additionally, in Figures 5 to 7 , the direction indicated by the arrow F is the conveyance direction of the instant film 42. The instant film 42 is conveyed in the direction indicated by the arrow F and discharged from the cassette 44.

[0115] The instant film 42 is an example of a printing medium. The instant film 42 is a so-called "single-sheet type" (also known as the loose-leaf film method, integral film, etc.) instant film, and is an instant film in which an image appears on the back of the exposure surface. The instant film 42 has a rectangular card shape. The instant film 42 is configured such that one side is the exposure surface 42a and the other side is the viewing surface 42b. The exposure surface 42a is the surface on which an image is recorded by exposure, and the viewing surface 42b is the surface for viewing the recorded image.

[0116] As Figure 7 shown, an exposure area 42c, a sac portion 42d, and a collection portion 42f are provided on the exposure surface 42a of the instant film 42.

[0117] The exposure area 42c is the area where an image is recorded by exposure. The exposure area 42c becomes the printable area of the instant film 42. The sac portion 42d and the collection portion 42f are arranged before and after the exposure area 42c in the conveyance direction F.

[0118] The sac portion 42d is arranged on the front side of the exposure area 42c in the conveyance direction F. A developing processing liquid sac 42e containing a developing processing liquid is provided inside the sac portion 42d.

[0119] The collection portion 42f is arranged on the rear side of the exposure area 42c in the conveyance direction F. An absorbent material 42g is provided inside the collection portion 42f.

[0120] As Figure 6 shown, a viewing area 42h is provided on the viewing surface 42b of the instant film 42. The viewing area 42h is the area where an image is displayed. By developing the exposure area 42c, an image is displayed in the viewing area 42h. The viewing area 42h is arranged corresponding to the exposure area 42c. A frame 42i is provided around the viewing area 42h. Therefore, the image is displayed within the frame. Also, the viewing area 42h is set to be slightly narrower than the exposure area 42c (set to be one size smaller). Therefore, when an image is recorded in the entire area of the exposure area 42c, an image with the surrounding area cropped is printed.

[0121] Additionally, the instant film 42 is viewed with the collection portion 42f on top and the sac portion 42d on the bottom. Therefore, the image is printed with the collection portion 42f on top and the sac portion 42d on the bottom.

[0122] The instant film 42 is developed after exposure by spreading the developing solution in the capsule portion 42d onto the exposed area 42c. The developing solution in the capsule portion 42d is spread onto the exposed area 42c by being extruded from the capsule portion 42d as the instant film 42 passes between the spreading roller pair 54B. The developing solution remaining during the spreading process is captured by the collecting portion 42f.

[0123] The cassette 44 has a rectangular box shape. The cassette 44 has a rectangular exposure opening 44a in the front portion. And, the cassette 44 has a slit-shaped discharge port 44b in the top surface portion. The instant film 42 is overlapped and accommodated in the cassette with the exposure surface 42a facing the front side of the cassette 44 (the exposure opening 44a side) and the capsule portion 42d facing the top surface side of the cassette 44 (the discharge port 44b side). And, the cassette 44 has a slit-shaped card slot opening 44c in the bottom surface portion. The instant film 42 accommodated in the cassette 44 is fed out one by one from the discharge port 44b by making the card slot 52a enter from the card slot opening 44c toward the discharge port 44b.

[0124] A plurality of (e.g., 10 sheets) instant films 42 are accommodated in one instant film packaging cassette 40.

[0125] The film feeding mechanism 52 feeds out one instant film 42 at a time from the instant film packaging cassette 40 loaded in the film loading chamber 50. The film feeding mechanism 52 has a card slot 52a that moves back and forth along the conveying direction of the instant film 42, and feeds out the instant film 42 in the cassette one by one through the card slot 52a, and feeds out the instant film 42 from the instant film packaging cassette 40.

[0126] The film conveying mechanism 54 conveys the instant film 42 fed out from the instant film packaging cassette 40 at a constant speed by the film feeding mechanism 52. The film conveying mechanism 54 has a conveying roller pair 54A and a spreading roller pair 54B. The conveying roller pair 54A is driven by a motor (not shown) to rotate, and clamps both sides of the instant film 42 to convey it. The spreading roller pair 54B is driven by a motor (not shown) to rotate, and clamps the entire instant film 42 to convey it. The capsule portion 42d of the instant film 42 is flattened during the conveyance by the spreading roller pair 54B to be developed.

[0127] The print head 56 records an image on the instant film 42 fed out from the instant film packaging cassette 40. The print head 56 is composed of a line-type exposure head. The print head 56 irradiates printing light line by line on the exposure surface 42a of the instant film 42 conveyed by the film conveying mechanism 54, and records an image on the instant film 42 in a single-pass manner.

[0128] <Electrical Structure of Digital Camera with Printer>

[0129] Figure 8It is a block diagram showing the electrical structure of a digital camera with a printer.

[0130] As Figure 8 shown, the digital camera 10 with a printer includes a photographic lens 14, a lens driving unit 62, an image sensor 64, an image sensor driving unit 66, an analog signal processing unit 68, a digital signal processing unit 70, a memory 72, a storage controller 74, a display 28, a display controller 76, a short-range wireless communication unit 78, an antenna 80, a film feeding driving unit 82, a film conveying driving unit 84, a print head driving unit 86, a flash 88, a flash emission control unit 90, a microphone 92, a speaker 94, a sound signal processing unit 96, an operation unit 98, a camera control unit 100, etc.

[0131] The photographic lens 14 forms an optical image of a subject on the light-receiving surface of the image sensor 64. The photographic lens 14 has a focusing function and includes an aperture and a shutter (not shown). The lens driving unit 62 includes a motor for driving the focusing mechanism of the photographic lens 14 and its driving circuit, a motor for driving the aperture and its driving circuit, and a motor for driving the shutter and its driving circuit, and operates the focusing mechanism, the aperture, and the shutter according to an instruction from the camera control unit 100.

[0132] The image sensor 64 is composed of a two-dimensional solid imaging element such as a CCD image sensor (CCD: Charge Coupled Device) or a CMOS image sensor (CMOS: Complementary Metal Oxide Semiconductor). The image sensor 64 has an imaging area with an aspect ratio corresponding to the printable area of the instant film used. The image sensor driving unit 66 includes a driving circuit of the image sensor 64 and operates the image sensor 64 according to an instruction from the camera control unit 100.

[0133] In the digital camera 10 with a printer of the present embodiment, the photographic unit is composed of the photographic lens 14 and the image sensor 64.

[0134] The analog signal processing unit 68 reads the analog image signal of each pixel output from the image sensor 64, performs prescribed signal processing (for example, correlated double sampling processing, amplification processing, etc.), and outputs it after digitization.

[0135] The digital signal processing unit 70 reads the digital image signal output from the analog signal processing unit 68, performs prescribed signal processing (for example, gray-scale conversion processing, white balance correction processing, gamma correction processing, synchronization processing, YC conversion processing, etc.) to generate image data.

[0136] The memory 72 stores the image data and sound data obtained by shooting. The memory 72 is an example of a storage unit. The storage controller 74 reads and writes data to and from the memory 72 under the control of the camera control unit 100.

[0137] The display 28 is composed of, for example, a liquid crystal display (LCD), an organic electro-luminescence display (OLED), a plasma display, a field emission display (FED), and an electronic paper. The display controller 76 displays an image on the display 28 under the control of the camera control unit 100.

[0138] The short-range wireless communication unit 78 performs wireless communication with an external device via the antenna 80 under the control of the camera control unit 100. The communication is performed by short-range wireless communication such as the NFC standard, Bluetooth, and WiFi.

[0139] The film feed driving unit 82 includes a motor for driving the card slot 52a of the film feed mechanism 52 and its driving circuit, and drives the motor of the card slot 52a to operate the card slot 52a under the control of the camera control unit 100.

[0140] The film conveyance driving unit 84 includes a motor for driving the conveyance roller pair 54A of the film conveyance mechanism 54 and its driving circuit, and a motor for driving the deployment roller pair 54B and its driving circuit, and drives the motor of the conveyance roller pair 54A and the motor of the deployment roller pair 54B to operate the conveyance roller pair 54A and the deployment roller pair 54B under the control of the camera control unit 100.

[0141] The print head driving unit 86 includes a driving circuit for the print head 56, and drives the print head 56 under the control of the camera control unit 100.

[0142] The flash 88, as a light source, includes, for example, a xenon tube and an LED (Light Emitting Diode), and emits light from its light source to irradiate the subject with flash light. The flash light is irradiated from the flash light window 20 provided on the front of the camera body 12 (refer to Figure 2 ). The flash light emission control unit 90 includes a driving circuit for the flash 88, and causes the flash 88 to emit light according to an instruction from the camera control unit 100.

[0143] The microphone 92 is provided via the microphone hole 24 provided on the camera body 12 (refer to Figure 2)Collect external sounds. The microphone 92 is an example of a sound collection unit. The speaker 94 outputs sound to the outside through the speaker hole 26 provided in the camera body 12. The sound signal processing unit 96 performs prescribed signal processing on the sound signal input from the microphone 92, digitizes it, and then outputs it. Also, the sound signal processing unit 96 performs prescribed signal processing on the sound data provided from the camera control unit 100 and outputs it from the speaker 94.

[0144] The operation unit 98 includes various operation components such as a release button 16, a recording button 18, a power button 22a, a menu button 22b, an OK button 22c, a joystick 32a, a print button 32b, a play button 32c, a cancel button 32d, etc., and their signal processing circuits, and outputs signals based on the operations of the respective operation components to the camera control unit 100.

[0145] The camera control unit 100 is a control unit that centrally controls the overall operation of the digital camera with a printer 10, and is composed of a computer having a CPU (CPU: Central Processing Unit / central processing unit), a ROM (ROM: Read Only Memory / read-only memory), a RAM (RAM: Random Access Memory / random access memory), etc. This computer realizes various functions as the camera control unit 100 by executing a prescribed control program.

[0146] Figure 9 It is a block diagram of the main functions implemented by the camera control unit.

[0147] As Figure 9 shown, the camera control unit 100 functions as a shooting control unit 100A, a recording control unit 100B, an identification information generation unit 100C, an upload unit 100D, a communication management unit 100E, a QR code generation unit 100F, a print control unit 100G, a play control unit 100H, etc. by executing a prescribed control program.

[0148] The shooting control unit 100A controls shooting. That is, it controls the shooting unit, namely the shooting lens 14 and the image sensor 64, to shoot an image, and performs the process of storing the image data obtained by shooting in the memory 72. In addition, real-time preview processing is performed during shooting. That is, the image captured by the image sensor 64 is displayed on the display 28 in real time. Thus, the display 28 can be used as a real-time preview display while shooting. Recording shooting is performed by pressing the release button 16.

[0149] The recording control unit 100B controls recording. When shooting video with sound, the recording control unit 100B acquires sound data via the microphone 92, and performs processing to associate the acquired sound data with the image data obtained by shooting and store it in the memory 72. Also, when adding sound to a captured image, the recording control unit 100B acquires sound data via the microphone 92, and performs processing to associate the acquired sound data with the target image data and store it in the memory 72. Further, when a command to rewrite the sound of a captured video with sound is given, the recording control unit 100B acquires sound data via the microphone 92, and performs processing to rewrite the sound data of the target image data with the acquired sound data.

[0150] When printing image data with sound (image data associated with sound data), the identification information generation unit 100C performs processing to generate prescribed identification information. As will be described later, when printing image data with sound, the image data and the sound data are saved in the data storage server 200. The identification information is used when the data storage server 200 saves the image data and the sound data. That is, it is used to identify the data in the data storage server 200. This will be described in further detail later.

[0151] The upload unit 100D performs processing to upload the image data and the sound data to the data storage server 200. Additionally, in the printer-equipped digital camera 10 of the present embodiment, the data is uploaded to the data storage server 200 via the upload terminal 300. Therefore, the upload unit 100D sends the data to the upload terminal 300.

[0152] The communication management unit 100E manages the communication with the upload terminal 300. More specifically, it manages the connection state of the communication with the upload terminal 300 and determines whether to send data to the upload terminal 300.

[0153] When printing image data with sound, the QR code generation unit 100F generates a QR code encoding prescribed information. As described above, when printing image data with sound, the image data and the sound data are saved in the data storage server 200. The QR code generation unit 100F generates a QR code encoding access information for the image data and the sound data saved in the data storage server 200. The QR code is an example of information recording, and the QR code generation unit 100F is an example of an information recording generation unit. The QR code is constituted by, for example, a QR code (registered trademark).

[0154] The printing control unit 100G controls printing. First, printing generates print image data from the image data for which printing has been commanded. Next, based on the generated print image data, the print head 56 is driven, and the image is printed on the instant film 42. Therefore, the printing control unit 100G has the functions of a print image data generation unit and a print driving unit. The print image data generation unit performs the process of generating print image data, and the print driving unit performs the processes of driving the print head 56, the film feeding mechanism 52, and the film conveying mechanism 54.

[0155] In addition, when printing image data with sound, the printing control unit 100G prints the image after attaching a QR code. Specifically, image data with the QR code synthesized therein is generated as the print image data, and the generated image data with the QR code is printed. The QR code is synthesized by overlapping a part of the image. This will be described in detail later.

[0156] The playback control unit 100H controls the playback of the recorded image. That is, it performs the process of reading out the image data from the memory 72 and displaying it on the display 28. At this time, when the image data of the playback target is image data with sound, the sound data is read out and output from the speaker 94. The frame playback of the image is performed by operating the joystick 32a.

[0157] 《Data Storage Server》

[0158] The data storage server 200 stores the image data captured by the printer-equipped digital camera 10 and the sound data associated with and corresponding to the image data. The data storage server 200 is an example of a server. The data storage server 200 is composed of a general server computer.

[0159] Figure 10 is a block diagram showing an example of the hardware configuration of the data storage server.

[0160] As Figure 10 shown, the data storage server 200 includes a CPU 201 that controls the overall operation, a ROM 202 that stores programs used in the driving of the CPU 201 such as an IPL (Initial Program Loader), a RAM 203 that serves as the work area of the CPU 201, an HDD (Hard Disk Drive) 204 that stores various programs and various data for the data storage server 200, a display 205, a network I / F 206 (I / F: interface) that is used for data communication using the communication network 2, a keyboard 207, a mouse 208, and an optical drive 210, etc.

[0161] Figure 11 is a block diagram of the main functions provided by the data storage server.

[0162] As Figure 11 shown, the data storage server 200 functions as a data reception control unit 200A, a data management unit 200B, and a data transmission control unit 200C by the CPU 201 executing a prescribed program.

[0163] The data reception control unit 200A communicates with the upload terminal 300 via the communication network 2 and receives data for storage from the upload terminal 300.

[0164] The data management unit 200B performs processes such as recording the data received from the upload terminal 300 in the storage unit and reading out corresponding data from the storage unit according to a download request from the data playback terminal 400. The storage unit is constituted by the HDD 204. The data management unit 200B constructs a prescribed database and stores image data and sound data associated with and corresponding to the image data in the HDD 204.

[0165] The data transmission control unit 200C communicates with the data playback terminal 400 via the communication network 2 and transmits the corresponding data to the data playback terminal 400 according to a download request for data from the data playback terminal 400.

[0166] 《Upload Terminal》

[0167] The upload terminal 300 is a terminal for uploading data to the data storage server 200, receives data for storage (image data of the printed image and sound data associated with and corresponding to the image data) from the printer-equipped digital camera 10, and transmits it to the data storage server 200.

[0168] As described above, the upload terminal 300 is constituted by a computer having a communication function, particularly by a mobile computer such as a smart phone, a tablet terminal, a notebook computer, and a PDA, and communicates with the printer-equipped digital camera 10 by short-range wireless communication (for example, NFC standard, Bluetooth, WiFi, etc.). And it communicates with the data storage server 200 via the communication network 2.

[0169] Figure 12 is a block diagram showing an example of the hardware configuration of the upload terminal. In addition, this figure shows an example of the hardware configuration when the upload terminal 300 is a smart phone.

[0170] As Figure 12As shown in the figure, the uploading terminal 300 includes a CPU 301 that controls the overall operation; a ROM 302 that stores basic input / output programs, etc.; a RAM 303 that serves as the working area of the CPU 301; an EEPROM (Electrically Erasable and Programmable ROM) 304 that stores various programs and various data including the operating system executed by the CPU 301; a display 305; a touch panel 306 that detects touch operations on the display screen; a GPS receiving unit 307 that receives GPS signals containing the location information (latitude, longitude, and altitude) of the uploading terminal 300 through GPS (Global Positioning Systems) satellites or an IMES (Indoor Messaging System) as an indoor GPS; a camera unit 308 that includes a photographic lens and an image sensor and captures images electronically; a microphone unit 309 that includes a microphone and inputs sound; a speaker unit 310 that includes a speaker and outputs sound; a communication unit 311 that performs wireless communication with the nearest base station 2a, etc. using an antenna 311A; a short-range wireless communication unit 312 that performs short-range wireless communication with external devices using an antenna 312A; a sensor unit 313 that includes various sensors such as a geomagnetic sensor, a gyrocompass, and an acceleration sensor; and a medium drive 314 that reads and writes data to and from a memory card 315, etc.

[0171] Figure 13 It is a block diagram of the main functions provided by the uploading terminal.

[0172] As Figure 13 shown in the figure, the uploading terminal 300 functions as an uploading data acquisition unit 300A and a data transmission unit 300B by the CPU 301 executing a specified program.

[0173] The uploading data acquisition unit 300A performs short-range wireless communication with the printer-equipped digital camera 10 and receives uploading data (image data and sound data associated with and corresponding to the image data) from the printer-equipped digital camera 10.

[0174] The data transmission unit 300B communicates with the data storage server 200 via the communication network 2 and transmits (uploads) the data received from the printer-equipped digital camera 10 to the data storage server 200.

[0175] 《Data Playback Terminal》

[0176] The data playback terminal 400 is a terminal that downloads and plays the image data saved in the data storage server 200 and the sound data associated with and corresponding to the image data. Information for accessing the downloaded data is obtained from the instant film 42 on which the downloaded image data is printed. That is, a QR code for downloading the image shown thereon is printed on the instant film 42, and the QR code is read to download the image data and the sound data associated with and corresponding to the image data.

[0177] The data playback terminal 400 is composed of a computer with a camera function and a communication function, particularly composed of a mobile computer with a camera such as a smart phone, a tablet terminal, a notebook computer, and a PDA, and communicates with the data storage server 200 via the communication network 2.

[0178] Figure 14 It is a block diagram showing an example of the hardware structure of the data playback terminal. In addition, this figure shows an example of the hardware structure when the data playback terminal 400 is a smart phone.

[0179] As Figure 14 shown, the data playback terminal 400 includes a CPU 401 that controls the overall operation; a ROM 402 that stores basic input / output programs, etc.; a RAM 403 that serves as the working area of the CPU 401; an EEPROM 404 that stores various programs including the operating system executed by the CPU 401 and various data; a display 405; a touch panel 406 that detects touch operations on the display screen; a GPS receiver 407; a camera unit 408 that includes a photographic lens and an image sensor and captures images electronically; a microphone unit 409 that includes a microphone and inputs sound; a speaker unit 410 that includes a speaker and outputs sound; a communication unit 411 that performs wireless communication with the nearest base station 2a, etc. using an antenna 411A; a short-range wireless communication unit 412 that performs short-range wireless communication with external devices using an antenna 412A; a sensor unit 413 that includes various sensors such as a geomagnetic sensor, a gyrocompass, and an acceleration sensor; and a medium drive 414 that performs reading and writing of data to a memory card 415, etc.

[0180] Figure 15 It is a block diagram of the main functions provided by the data playback terminal.

[0181] As Figure 15 shown, the data playback terminal 400 functions as a QR code reading unit 400A, an access information acquisition unit 400B, a download unit 400C, a playback processing unit 400D, etc. by the CPU 401 executing a prescribed program.

[0182] The QR code reading unit 400A is implemented by the camera unit 408, and the QR code is read by the camera unit 408 capturing the QR code. The QR code reading unit 400A is an example of a recorded information reading unit.

[0183] The access information acquisition unit 400B reads the two-dimensional code printed on the instant film 42 through the two-dimensional code reading unit 400A, thereby acquiring the access information for the image data and the audio data of the image printed on the instant film 42.

[0184] The download unit 400C accesses the data storage server 200 according to the access information acquired by the access information acquisition unit 400B, and downloads the corresponding image data and audio data.

[0185] The playback processing unit 400D performs processing for playing the downloaded image data and audio data. The playback processing unit 400D includes a display control unit 400D1 that displays the downloaded image data on the display unit, i.e., the display 405, and an audio output control unit 400D2 that outputs the downloaded audio data from the audio output unit, i.e., the speaker unit.

[0186] [Operation of the system]

[0187] [Operation of the digital camera with printer]

[0188] The digital camera with printer 10 has a shooting mode and a playback mode as its operation modes. The shooting mode is a mode for shooting images. The playback mode is a mode for playing the captured images.

[0189] In the shooting mode, there are an automatic printing mode and a manual printing mode. The automatic printing mode is a mode for automatically printing the captured images. The manual printing mode is a mode for printing the captured images according to the user's command. The switching between the modes is performed by pressing the mode switching button 22d.

[0190] In each mode of the shooting mode, there is a mode for shooting an image with sound (recording mode). And in the recording mode, there are a normal recording mode and an after-recording mode. The normal recording mode is a mode for recording sounds for a certain period before and after the recording release. The after-recording mode is a mode for inputting sounds after shooting. The recording mode is switched by pressing the recording button 18. Specifically, each time the recording button 18 is pressed, the normal recording mode, the after-recording mode, and the off state of the recording mode are switched in sequence.

[0191] Figure 16 It is a flowchart showing the setting order for each mode.

[0192] First, it is determined whether it is the shooting mode (step S1). When it is not the shooting mode, it is determined as the playback mode, and the processing in the playback mode is performed (step S2).

[0193] When in the photography mode, it is determined whether it is the manual printing mode (step S3). When it is not the manual printing mode, it is determined as the automatic printing mode, and the processing in the automatic printing mode is performed (step S4). When it is the manual printing mode, the processing in the manual printing mode is performed (step S5).

[0194] <Actions in the manual printing mode>

[0195] As described above, the manual printing mode is a mode in which the captured image is printed according to a printing command from the user after shooting.

[0196] Figure 17 It is a flowchart showing the action sequence in the manual printing mode.

[0197] First, it is determined whether the recording mode is enabled (step S11). When the recording mode is not enabled, there is no recording for shooting. On the other hand, when the recording mode is enabled, it is determined whether it is set to the normal recording mode (step S12). When it is set to the normal recording mode, shooting is performed in the normal recording mode. That is, the sound is recorded simultaneously with shooting. On the other hand, when it is not set to the normal recording mode, shooting is performed in the post-recording mode. That is, the sound is recorded after shooting.

[0198] (1) When the recording mode is enabled

[0199] Figure 18 It is a flowchart showing the action sequence when the recording mode is off in the manual printing mode.

[0200] First, live view is displayed on the display 28 (step S21). That is, the image captured by the image sensor 64 is displayed on the display 28 in real time. The user confirms the composition and the focus state of the subject while observing the display of the display 28.

[0201] Then, it is determined whether there is a shooting command (step S22). The shooting command is given by pressing the release button 16.

[0202] If the shooting is commanded, shooting processing is performed (step S23). That is, the image is read in via the image sensor 64. The image data obtained by shooting is converted into a specified file format such as JPEG (Joint Photographic Experts Group), RAW, TIFF (Tagged Image File Format), GIF (Graphics Interchange Format), and bitmap, and stored in the memory 72 (step S24).

[0203] If photographed, the image data obtained by photographing is preview-displayed on the monitor 28 (step S25). The user confirms the display on the monitor 28 and determines whether to print or not. When printing is to be performed, the print button 32b is pressed. When printing is not to be performed, the cancel button 32d or the release button 16 is pressed.

[0204] During preview, according to the user's operation, it is determined whether there is a print command (step S26). When a print command is given, printing processing is performed (step S27). The printing processing will be described later. Then, it is determined whether the mode ends (step S28). That is, it is determined whether to switch to another mode. When the mode ends, the processing ends.

[0205] In this way, in the manual printing mode, after photographing, according to the print command from the user, the photographed image is printed.

[0206] (2) When the normal recording mode is turned on

[0207] Figure 19 is a flowchart showing the operation sequence when the normal recording mode is turned on in the manual printing mode.

[0208] First, live view is displayed on the monitor 28. And at the same time, the sound is read in from the speaker 92 (step S31). The read-in sound is buffered for a certain period of time and then deleted sequentially. That is, only the amount required for recording is buffered. For example, when the sound for 5 seconds before and after shooting is recorded, at least the sound for 5 seconds is buffered.

[0209] Then, it is determined whether there is a shooting command (step S32). If a shooting command is given, shooting processing and recording processing are performed (step S33). That is, the image is read in via the image sensor 64, and the sound is read in via the speaker 92. Regarding the sound, the sound for a certain period of time before and after shooting is read in.

[0210] The image data and sound data obtained by shooting are respectively converted into a prescribed file format, and are associated with each other and stored in the memory 72 (step S34). As the sound data file, appropriate sound files such as MP3 (MPEG-1 Audio Layer 3 (MPEG: Moving Picture Experts Group / Active Picture Experts Group)), Real audio (registered trademark), MIDI (registered trademark) (Musical Instruments Digital Interface / Instrument Digital Interface) file, and WAVE file can be used.

[0211] If it is photographed, the image data obtained by photographing is previewed and displayed on the display 28 (step S35). During the preview, it is determined whether there is a print command according to the operation of the user (step S36). When a print is commanded, print processing is performed (step S37). The print processing will be described later. Then, it is determined whether the mode has ended (step S38). When the mode ends, the processing ends.

[0212] In this way, in the normal recording mode, the sound for a certain period of time before and after the photographing is recorded and stored in the memory 72 together with the image. Also, the photographed image data is printed according to a print command from the user.

[0213] (3) When the post-recording mode is turned on

[0214] Figure 20 is a flowchart showing the operation sequence when the post-recording mode is turned on in the manual print mode.

[0215] First, live view is displayed on the display 28 (step S41). Then, it is determined whether there is a shooting command (step S42). If a shooting is commanded, shooting processing is performed (step S43), and the image data obtained by shooting is stored in the memory 72 (step S44). Also, if it is photographed, the image data obtained by photographing is previewed and displayed on the display 28 (step S45).

[0216] Figure 21 is a diagram showing an example of a preview screen in the post-recording mode.

[0217] As Figure 21 shown, the image PVI obtained by photographing and the message ME for confirming whether to record are displayed on the screen of the display 28. When recording (post-recording) is performed, the recording button 18 is pressed (refer to Figure 2 ). When recording is not performed, the cancel button 32d is pressed. During the preview, it is determined whether there is a recording command according to the operation of the user (step S46).

[0218] When a recording is commanded, recording processing is performed (step S47). That is, the sound for a certain period of time (for example, 10 seconds) is read in via the microphone 92. Also, the sound data of the read-in sound is associated with the image data obtained by photographing and stored in the memory 72 (step S48).

[0219] Then, it is determined whether there is a print command (step S49). In addition, in step S46, even when the recording is canceled, it is determined whether there is a print command. When a print is commanded, print processing is performed (step S50). The print processing will be described later. Then, it is determined whether the mode has ended (step S51). When the mode ends, the processing ends.

[0220] Thus, in the post-recording mode, sound is recorded for a certain period of time according to a command from the user after shooting. The recorded sound data is associated with the image data and stored in the memory 72. And, the captured image data is printed according to a print command from the user.

[0221] <Actions in the automatic print mode>

[0222] As described above, the automatic print mode is a mode in which the captured image is automatically printed after shooting.

[0223] Figure 22 It is a flowchart showing the sequence of actions in the automatic print mode.

[0224] First, it is determined whether the recording mode is on (step S61). When the recording mode is off, shooting is performed without recording. On the other hand, when the recording mode is on, it is determined whether the normal recording mode is set (step S62). When the normal recording mode is set, shooting is performed in the normal recording mode. That is, sound is recorded simultaneously with shooting. On the other hand, when the normal recording mode is not set, shooting is performed in the post-recording mode. That is, sound is recorded after shooting.

[0225] (1) When the recording mode is off

[0226] Figure 23 It is a flowchart showing the sequence of actions when the recording mode is off in the automatic print mode.

[0227] First, live view is displayed on the display 28 (step S71). Then, it is determined whether there is a shooting command (step S72). If a shooting command is given, shooting processing is performed (step S73), and the image data obtained by shooting is stored in the memory 72 (step S74). And, the captured image is printed (step S75). The print processing will be described later. Then, it is determined whether the mode ends (step S76). When the mode ends, the processing ends.

[0228] Thus, in the automatic print mode, the captured image is automatically printed after shooting.

[0229] (2) When the normal recording mode is on

[0230] Figure 24 It is a flowchart showing the sequence of actions when the normal recording mode is on in the automatic print mode.

[0231] First, display the live view on the monitor 28. And, at the same time, start reading the sound from the microphone 92 (step S81). The read sound is buffered for a certain period of time and then deleted sequentially. Then, determine whether there is a shooting command (step S82). If a shooting command is given, perform the shooting process and the recording process (step S83), and store the image data and sound data obtained by shooting in the memory 72 (step S84). And, print the captured image (step S85). The printing process will be described later. Then, determine whether the mode has ended (step S86). When the mode ends, end the process.

[0232] In this way, in the normal recording mode, the sound for a certain period of time before and after shooting is recorded and stored in the memory 72 together with the image. And, the captured image is automatically printed.

[0233] (3) When the post-recording mode is turned on

[0234] Figure 25 It is a flowchart showing the operation sequence when the post-recording mode is turned on in the automatic printing mode.

[0235] First, display the live view on the monitor 28 (step S91). Then, determine whether there is a shooting command (step S92). If a shooting command is given, perform the shooting process (step S93), and store the image data obtained by shooting in the memory 72 (step S94). And, if it is shot, the image data obtained by shooting is preview-displayed on the monitor 28 (step S95). As Figure 21 shown, the captured image PVI and the message ME for confirming whether to record are displayed on the screen of the monitor 28. When recording (post-recording) is performed, press the recording button 18. When recording is not performed, press the cancel button 32d. During the preview, according to the user's operation, determine whether there is a recording command (step S96).

[0236] When a recording command is given, perform the recording process (step S97). That is, read the sound for a certain period of time (for example, 10 seconds) via the microphone 92. Moreover, the sound data of the read sound is associated with the image data obtained by shooting and stored in the memory 72 (step S98).

[0237] Then, print the captured image (step S99). The printing process will be described later. In addition, in step S96, even if the recording is canceled, the printing process is performed (step S99).

[0238] Then, determine whether the mode has ended (step S100). When the mode ends, end the process.

[0239] Thus, in the post-recording mode, sound is recorded for a certain period of time according to a command from the user after shooting. The recorded sound data is associated with the image data and stored in the memory 72. Also, the captured image data is automatically printed.

[0240] <Actions in Playback Mode>

[0241] The switch from the shooting mode to the playback mode is performed by pressing the playback button 32c. In addition, the switch from the playback mode to the shooting mode is performed by pressing the release button 16.

[0242] Figure 26 It is a flowchart showing the sequence of actions in the playback mode.

[0243] If the playback mode is set, the image data of the last captured image is read out from the memory 72 and played and displayed on the display 28 (step S110).

[0244] Next, it is determined whether the image data being played is sound-added image data (step S111). When it is sound-added image data, it is determined whether there is a command for sound playback (step S112). The command for sound playback is performed by pressing the playback button 32c.

[0245] Figure 27 It is a diagram showing an example of the display of the display when sound-added image data is displayed.

[0246] As Figure 27 shown, when it is sound-added image data, an icon IC indicating that the displayed image IM is sound-added is displayed. Thus, the user can confirm that the displayed image IM has sound.

[0247] If the playback button 32c is pressed while sound-added image data is being displayed on the display 28, sound playback processing is performed (step S113). That is, the sound data associated with the image data being played is read out from the memory 72 and output from the speaker 94. Thus, the user can hear the sound associated with the image.

[0248] Also, during playback, it is determined whether there is a command for printing (step S114). The command for printing is performed by pressing the print button 32b. If the print button 32b is pressed, the image being played is printed (step S115). The printing process will be described later.

[0249] Also, during playback, a command for determining whether there is frame playback is made (step S116). The operation of frame playback is performed by the joystick 32a. If the joystick 32a is operated horizontally, frame playback is performed. That is, the next frame is read out from the memory 72 and played and displayed on the display 28 (step S117). In addition, when the joystick 32a is operated in the up and down directions, the image being displayed is zoomed in and out.

[0250] Then, it is determined whether the mode has ended (step S118). When the mode ends, the process ends.

[0251] In this way, in the playback mode, according to the print command from the user, the image being played can be printed. And when the image being played has sound, according to the command from the user, the sound associated with the image can be played.

[0252] <Actions during printing>

[0253] Figure 28 It is a flowchart showing the processing sequence when printing an image.

[0254] First, it is determined whether the image data to be processed is image data with sound (step S120). That is, it is determined whether the sound data is recorded in an associated manner.

[0255] When it is not image data with sound, the printing process is performed in the normal order. First, print-use image data is generated (step S121). That is, image data for printing on the instant film 42 using the print head 56 is generated.

[0256] In addition, since the digital camera 10 with a printer of the present embodiment uses a single-sheet instant film 42, for the print-use image, an image that is horizontally reversed with respect to the display-use image is generated. And since the instant film 42 is loaded upside down (vertically), an image that is upside down is generated.

[0257] After generating the print-use image data, printing is performed (step S122). First, one instant film 42 is sent out from the instant film cartridge 40. The sent instant film 42 is conveyed at a certain speed toward the film discharge port 34. During this conveyance process, light is irradiated from the print head 56, and an image is recorded on the exposure surface. The exposed instant film 42 is developed by the developing roller pair 54B and discharged from the film discharge port 34.

[0258] On the other hand, when the image data to be printed is image data with sound, first, it is determined whether the image data and the sound data are uploaded to the data storage server 200 (step S123).

[0259] When the image data of the printing object is image data with sound, a message asking whether to upload to the data storage server 200 is displayed on the display 28. The user determines whether to upload according to the message displayed on the screen. When uploading, the OK button 22c is pressed, and when not uploading, the cancel button 32d is pressed. The camera control unit 100 determines whether to upload according to the operations of the OK button 22c and the cancel button 32d.

[0260] When uploading is not required, the printing process is performed in the normal order (steps S121 - S122) in the same manner as when printing image data without sound.

[0261] On the other hand, when uploading the printed image data and the sound data associated with the image data, an upload process is performed (step S124).

[0262] In addition, as will be described later, if data is uploaded, a two-dimensional code (record information) that encodes the access information to the uploaded data is printed on the instant film 42 together with the image. Therefore, the series of operating systems up to the upload command is an example of a record information printing setting unit that sets the presence or absence of printing of record information.

[0263] Figure 29 It is a flowchart showing the order of the upload process.

[0264] First, unique identification information is generated (step S130). This identification information is generated to distinguish from other data in the data storage address. In the system of this embodiment, information combining the model information of the printer - equipped digital camera 10, the information of the serial number of the printer - equipped digital camera 10, and the information of the cumulative number of prints is generated as the unique identification information.

[0265] Here, the "model information" refers to information that determines the model of the printer - equipped digital camera 10, such as the product name, product code, etc.

[0266] And the "serial number" refers to the identification number assigned to a product, etc., especially a number composed of digits and alphanumeric characters assigned according to a certain rule and system. It is also called the manufacturing number. The serial number is an example of the unique identification number assigned to the printer - equipped digital camera.

[0267] And the "cumulative number of prints" refers to the total number of prints made so far since the shipment of the printer - equipped digital camera 10. Therefore, it is "0" when no printing has been done since shipment, and becomes "10" when printed 10 times. The camera control unit 100 counts the cumulative number of prints and stores it in the memory 72. The information of the cumulative number of prints is displayed in a specified number of digits (for example, 5 digits).

[0268] In the system of the present embodiment, identification information is generated by arranging each piece of information in the order of "model", "serial number", and "cumulative print count". For example, when the model name is "instax_mini_xx", the serial number is "7T00XXX", and the cumulative print count is "00098", the identification information becomes "instax_mini_xx7T0OXXX00098".

[0269] After generating the identification information, upload data is generated (step S131). That is, data for uploading to the data storage server 200 is generated. This data is generated as data containing the identification information. For example, data containing the identification information in the data header is generated. Or, the file name is used as the identification information to generate the data. Regarding the upload data, image data and sound data can be generated separately, or they can be combined in one file for generation.

[0270] Next, communication is performed with the upload terminal 300 (step S132). Then, it is determined whether communication has been established (step S133).

[0271] If communication is established, the upload data is sent to the upload terminal 300 (step S134). The upload terminal 300 receives this data and uploads it to the data storage server 200.

[0272] Then, the camera control unit 100 determines the success or failure of the upload based on the transmission result of the upload data from the upload terminal 300 (step S135). If the upload is successful, the upload process ends.

[0273] Figure 30 It is a sequence diagram of the upload process.

[0274] First, the upload terminal 300 sends a connection request to the data storage server 200. In response to this, communication is established between the upload terminal 300 and the data storage server 200.

[0275] Next, the printer-equipped digital camera sends a connection request to the upload terminal 300. In response to this, communication is established between the printer-equipped digital camera 10 and the upload terminal 300.

[0276] Next, the upload data is sent from the printer-equipped digital camera 10 to the upload terminal 300. If the upload data is received, the upload terminal 300 notifies the printer-equipped digital camera 10 of the completion of reception. The received upload data is temporarily stored in the memory.

[0277] Next, the upload terminal 300 sends the received upload data to the data storage server 200. The data storage server 200 stores the received data. More specifically, the received image data and the voice data associated with the image data are associated with each other and stored in the database. At this time, the image data and the voice data are recorded in the database using the identification information attached to the data. Thus, the image data and the voice data can be identified.

[0278] If the saving of the image data is completed, the data storage server 200 sends a reception completion notice to the upload terminal 300. If the upload terminal 300 receives the reception completion notice, it notifies the printer digital camera 10 of the completion of the upload.

[0279] Through the above series of processes, the image data and the voice data are uploaded from the printer digital camera 10 to the data storage server 200.

[0280] Figure 31 It is a flowchart showing the processing sequence when communication is impossible or the upload process fails.

[0281] When communication with the upload terminal 300 is impossible (when it is "No" in step S133 of Figure 29 ), the camera control unit 100 of the printer digital camera 10 displays a prescribed error message (for example, "Communication error") on the display 28 (step S140). And at the same time, a message asking whether to continue the upload (for example, "Do you want to continue the upload?") is displayed.

[0282] The camera control unit 100 determines whether the upload process is cancelled based on the operation input from the user (step S141). When cancelling, the cancel button 32d is pressed, and when not cancelling, the OK button 22c is pressed. When not cancelling, it returns to step S132 and attempts to communicate with the upload terminal 300 again ( Figure 29 step S132 of

[0283] On the other hand, when the upload process is cancelled, the camera control unit 100 displays an error message indicating the upload has been aborted (for example, "Upload aborted") on the display 28 (step S142). And at the same time, a message asking whether to cancel the printing (for example, "Do you want to print?") is displayed.

[0284] The camera control unit 100 determines whether the printing is cancelled based on the operation input from the user (step S143). When cancelling, the cancel button 32d is pressed, and when not cancelling, the OK button 22c is pressed. When not cancelling, the printing process is performed. At this time, similar to the image data without sound, the printing process is performed in the normal order. That is, as Figure 28As shown, first, image data for printing is generated (step S121), and printing is performed based on the generated image data (step S122).

[0285] On the other hand, when printing is not performed, a message indicating the suspension of printing is displayed on the display 28 (step S144), and the printing process ends.

[0286] The same applies to the case where the upload by the upload terminal 300 fails. The user is asked whether to cancel the upload process and the printing process, and processing is performed according to the command from the user.

[0287] Thus, when communication fails or the upload process fails, the user is asked whether to cancel the upload process and the printing process, and processing is performed according to the command from the user.

[0288] When printing image data with sound, if the upload process is completed, then as Figure 29 shown, a two-dimensional code is generated (step S125). This two-dimensional code is a two-dimensional code that encodes access information for accessing the uploaded image data and sound data. More specifically, it is a two-dimensional code that encodes information for accessing the image data and sound data stored in the data storage server 200 on the network, and is a two-dimensional code that encodes the URL (Universal ReSource Locator) of this data. The uploaded image data and sound data are given unique identification information, and using this unique identification information, they are stored in a specified data storage server 200. Therefore, this storage location can be determined by each printer-equipped digital camera 10. The camera control unit 100 of the printer-equipped digital camera 10 generates access information, that is, a URL, based on the identification information given to the uploaded image data and sound data and the information on the storage address (information on the data storage server 200), and encodes it as a two-dimensional code. In the present embodiment, a QR code (registered trademark) is generated as the two-dimensional code.

[0289] If a two-dimensional code is generated, image data for printing is generated (step S126). This image data for printing includes the two-dimensional code.

[0290] Figure 32 It is a conceptual diagram of the generation of image data for printing when printing image data with sound.

[0291] As Figure 32As shown, the print image data PRI1 is generated by synthesizing the two-dimensional code QR with the printed image PRI0. The two-dimensional code QR is overlapped and synthesized with a part of the printed image PRI0. That is, it is covered. Therefore, the covered part of the printed image PRI0 with the two-dimensional code QR cannot be visually recognized. The two-dimensional code QR is synthesized at a preset position. In this embodiment, it is synthesized at the lower right corner of the printed image PRI0.

[0292] In addition, since the printer-equipped digital camera 10 of this embodiment uses a single-sheet instant film 42, further processing for inverting the left and right of the image is performed. And since the printer-equipped digital camera 10 of this embodiment loads the instant film 42 upside down, processing for inverting the image up and down is performed.

[0293] After generating the print image data, printing is performed (step S127). That is, the instant film 42 is sent out from the instant film cartridge 40, and during this conveyance process, light is irradiated from the print head 56, and an image is recorded on the exposure surface of the instant film 42. The exposed instant film 42 is developed by the developing roller pair 54B and then discharged from the film discharge port 34.

[0294] Figure 33 It is a diagram showing an example of the print result of the image data with sound.

[0295] As Figure 33 shown, the two-dimensional code QR is printed on the printed matter, that is, the instant film 42, together with the image. In addition, as described above, the image is displayed on the viewing surface 42b on the side opposite to the exposure surface and in the viewing area 42h inside the frame 42i. Since the viewing area 42h is slightly narrower than the exposure area, an actually cropped image is displayed.

[0296] By the data playback terminal 400 reading the two-dimensional code QR printed on the instant film 42, the image printed on the instant film 42 and the sound associated with and corresponding to the image can be viewed and listened to in the data playback terminal 400.

[0297] "Operation of the Data Playback Terminal"

[0298] As described above, by the data playback terminal 400 reading the two-dimensional code QR printed on the instant film 42 together with the image, the image printed on the instant film 42 and the sound associated with and corresponding to the image can be played back in the data playback terminal 400. The data playback terminal 400 obtains access information to the image data and the sound data from the two-dimensional code QR, and according to the obtained access information, accesses the storage address of the data, downloads and plays back the corresponding data.

[0299] Figure 34 It is a flowchart showing the order of the process of downloading and playing back the image data and the sound data.

[0300] A user who has obtained the instant film 42 with a two-dimensional code reads the two-dimensional code QR printed on the instant film 42 through the data playback terminal 400 (step S150).

[0301] The data playback terminal 400 obtains access information from the read two-dimensional code QR (step S151). That is, information (URL) for accessing the image data of the image printed on the instant film 42 and the sound data associated with and corresponding to the image data is obtained. Moreover, according to the obtained access information, the storage address of the data is accessed, and the data is downloaded (step S152).

[0302] Figure 35 It is a sequence diagram of the download process.

[0303] The data playback terminal 400 makes a connection request to the data storage server 200. In response to this, the communication between the data playback terminal 400 and the data storage server 200 is established.

[0304] Next, the data playback terminal 400 requests the data storage server 200 to send the matching data. That is, it requests the transmission of the image data of the image printed on the instant film 42 and the sound data associated with and corresponding to the image data. The data storage server 200 searches the database for and reads the matching data in response to this request. Moreover, the read data is sent to the data playback terminal 400. The data playback terminal 400 receives the data sent from the data storage server 200. Through the above, the download process is completed.

[0305] The data playback terminal 400 performs a playback process on the image data and sound data downloaded from the data storage server 200 (step S153). Specifically, the downloaded image data is displayed on the display 405. And the downloaded sound data is output from the speaker unit 410.

[0306] Figure 36 It is a diagram comparing the image printed on the instant film with the image played on the data playback terminal.

[0307] As Figure 36 shown, the two-dimensional code QR is overlapped and displayed in the image printed on the instant film 42. On the other hand, an image without a two-dimensional code is displayed on the display 405 of the data playback terminal 400. Thus, a complete image can be viewed. And as described above, an image with the peripheral part cropped is printed on the instant film 42, but the original image without cropping is displayed on the display 405. Thus, the unprintable part can also be viewed on the instant film 42.

[0308] Also, generally, smartphones and the like have a function of magnifying images. Therefore, by using this function, the details of the images can be confirmed. As a result, the convenience of image viewing can be improved.

[0309] In addition, when magnifying the image being displayed, a magnification operation is performed on the screen of the display 405. The magnification operation refers to an operation of expanding the finger interval while keeping the state of touching the screen with two fingers. And when reducing the image being displayed, a reduction operation is performed on the screen of the display 405. The reduction operation refers to an operation of shortening the finger interval while keeping the state of touching the screen with two fingers. The data playback terminal 400 magnifies or reduces the image being played back according to the screen operation by the user.

[0310] In the display 405 of the data playback terminal 400, a sound playback button VPB is displayed together with the image. By touching this sound playback button VPB, the user can repeat the playback of the sound. The data playback terminal 400 performs the playback process of the sound data according to the screen operation by the user.

[0311] In this way, the data playback terminal 400 can play back the image printed on the instant film 42 and the sound associated with and corresponding to the image by reading the QR code QR printed on the instant film 42.

[0312] [Modification Example]

[0313] 《Modification Example of Digital Camera with Printer》

[0314] <Printing Method>

[0315] In the above-described embodiment, the case of printing on the instant film has been described as an example, but the printing method by the digital camera 10 with a printer is not particularly limited. For example, it can also be configured to use thermal paper or an ink ribbon and perform printing by a thermal method. In addition, it can also be configured to perform printing by an inkjet method or the like.

[0316] <Recording of Sound>

[0317] In the above-described embodiment, sound data is acquired during shooting and recorded in association with the image data obtained by shooting, thereby generating image data with sound. However, the method of generating image data with sound is not limited to this. For example, it is also possible to generate image data with sound by inputting sound at any time after shooting and recording it in association with arbitrary image data.

[0318] Figure 37 It is a flowchart showing the order of processing when generating image data with sound after shooting in a digital camera with a printer.

[0319] This process is performed in the playback mode. That is, the captured images are played in the playback mode, and after selecting an arbitrary image, a sound is input. The input of the sound is performed according to a recording command. The recording command is given by pressing the recording button 18. The recording button 18 is an example of a post-recording command section.

[0320] First, the captured images are played (step S160). That is, one image stored in the memory 72 (for example, the last captured image) is read out and displayed on the display 28. During the playback of the image, the camera control unit 100 determines whether there is a recording command based on the operation information of the recording button 18 (step S161).

[0321] If a recording command is given for the image being played, the camera control unit 100 performs a recording process (step S162).

[0322] Figure 38 This is a flowchart showing the order of the recording process.

[0323] The camera control unit 100 determines whether there is a recording start command based on the operation input from the user (step S170). The recording start command is given, for example, by pressing the recording button 18. In addition, when the cancel button 32d is pressed, the recording process is canceled. If it is determined that there is no recording start command, the camera control unit 100 determines whether there is a cancel command (step S171). When a cancel is commanded, the recording process ends.

[0324] If the recording button 18 is pressed to command recording, the sound is collected for a certain period of time via the microphone 92 (step S172). For example, the sound is collected for 10 seconds. Sound data is generated from the collected sound (step S173), and the generated sound data is associated with the image data of the image being played and stored in the memory 72 (step S174).

[0325] The recording process ends through the above steps. Then, as Figure 37 shown, it is determined whether there is a command for frame playback (step S163). If a frame playback command is given, the next frame is read out from the memory 72 and played and displayed on the display 28 (step S164). Then, it is determined whether the playback mode has ended (step S165), and when it has ended, the process ends.

[0326] In this way, the sound data is preferably set to be freely attachable later. Thereby, convenience can be improved.

[0327] In addition, it is configured to record sounds for a certain period of time before and after recording and shooting in the normal recording mode. However, when automatically recording sounds in association with shooting, the recording time is not limited to the examples of the above-described embodiments. Sounds for a certain period of time after shooting can be recorded, and sounds for a certain period of time before shooting can also be recorded. Moreover, when recording sounds for a certain period of time before and after shooting with shooting as the boundary, the recording time before shooting and the recording time after shooting can be made different. It can also be configured such that the user can arbitrarily set the recording time. Similarly, it can also be configured such that the user can arbitrarily set the recording time. The setting can be, for example, a configuration in which a recording setting option is called up from a menu screen for setting.

[0328] <Rewriting of Sound Data>

[0329] The sound data associated with the image data is preferably configured to be rewritable.

[0330] Figure 39 It is a flowchart showing the order of processing when rewriting sound data in a printer-equipped digital camera.

[0331] This processing is performed in the playback mode. First, the captured image is played back (step S180). That is, one image stored in the memory 72 (for example, the last captured image) is read out and displayed on the display 28. During the playback of the image, the camera control unit 100 determines whether there is a recording command based on the operation information of the recording button 18 (step S181). If a recording is commanded for the playing image, the camera control unit 100 determines whether the image has already been recorded (step S182). That is, it is determined whether the image data for which recording has been commanded is sound-containing image data.

[0332] When the image data for which recording has been commanded is not sound-containing image data, the recording process is performed in the Figure 38 shown order (step S189).

[0333] On the other hand, when the image data for which recording has been commanded is sound-containing image data, a message indicating that recording has been performed (for example, "Sound is recorded") and a message asking for rewriting (for example, "Do you want to rewrite the sound?") are displayed on the display 28 (step S183).

[0334] Based on the display on the display 28, the user commands rewriting of the sound or cancellation of the recording. The command for rewriting is performed by pressing the OK button 22c. The cancellation of the recording is performed by pressing the cancel button 32d. The series of operation systems up to the command for rewriting is an example of a sound data rewriting command unit.

[0335] The camera control unit 100 determines whether there is a command to rewrite the audio data based on the operation input from the user (step S184). If a rewrite command is given, the camera control unit 100 performs a recording process (step S185).

[0336] Figure 40 It is a flowchart showing the order of the recording process when rewriting audio data.

[0337] The camera control unit 100 determines whether there is a command to start recording based on the operation input from the user (step S190). The command to start recording is given, for example, by pressing the recording button 18. In addition, when the cancel button 32d is pressed, the recording process is canceled. If it is determined that there is no command to start recording, the camera control unit 100 determines whether there is a cancel command (step S191). When a cancel command is given, the recording process ends.

[0338] If the recording button 18 is pressed to command recording, the sound is collected for a certain period of time through the microphone 92 (step S192). For example, the sound is collected for 10 seconds. Audio data is generated from the collected sound (step S193), and the generated audio data is overwritten and recorded (step S194). That is, the audio data recorded in association with the playing image data is replaced with the newly generated audio data.

[0339] Through the above process, the process of rewriting the audio data ends. Then, as Figure 39 shown, it is determined whether there is a command to play a frame (step S186). If a frame play command is given, the next frame is read out from the memory 72 and played and displayed on the display 28 (step S187). And it is determined whether the play mode has ended (step S188), and when it has ended, the process ends.

[0340] In this way, the audio data associated with the image data is preferably set to be arbitrarily rewritten in the printer-equipped digital camera. Thereby, convenience is improved.

[0341] <Recording Form of Image Data and Audio Data>

[0342] The image data and audio data that are associated with each other only need to be able to determine one from the other. The method of associating the image data and audio data is not particularly limited. For example, a management file may be prepared to manage the association of the image data and audio data. Also, it may be set such that information on the associated data is recorded in the data header part so that the associated data can be determined.

[0343] Moreover, when the data is uploaded, information such as identification information and QR codes may be added to the uploaded data for recording.

[0344] Figure 41 This is an example of the file structure of image data when data is uploaded.

[0345] As Figure 41 shown, when data is uploaded, the information of the QR code generated at the time of upload is included in the file of this image data. Also, information such as the position where the QR code is printed is recorded in the data header. Thus, when printing the image with the attached QR code again, it can be easily printed.

[0346] In addition, sound data can be included in the file of the image data. Thus, the image data and the sound data can be managed with one file.

[0347] Moreover, the above file structure is the file structure of the data stored in the memory 72, but it can also be used as the file structure of the uploaded data. That is, it can be configured to generate one file by including information such as the information of the QR code, the information of the position where the QR code is printed, and the identification information in the image data and upload this file. Also, it can be configured to include sound data in this file and upload it.

[0348] <Identification information>

[0349] In the above embodiment, information combining the information of the model of the printer-equipped digital camera, the information of the serial number of the printer-equipped digital camera, and the information of the cumulative number of prints is generated as the identification information, but the information generated as the identification information is not limited to this. Any information that can uniquely identify the data uploaded to the server is sufficient.

[0350] In addition, by including at least the information of the model of the printer-equipped digital camera, the information of the serial number of the printer-equipped digital camera, and the information of the cumulative number of prints in the identification information, in a system that stores image data and sound data taken by multiple printer-equipped digital cameras of different models, each uploaded data can be uniquely determined.

[0351] Moreover, by including at least the information of the serial number of the printer-equipped digital camera and the information of the cumulative number of prints in the identification information, in a system that stores image data and sound data taken by multiple printer-equipped digital cameras of the same model, the uploaded data can be uniquely determined.

[0352] Furthermore, by including at least the information of the cumulative number of prints in the identification information, in a system that stores image data and sound data taken by the same printer-equipped digital camera, the uploaded data can be uniquely determined.

[0353] <Recording information>

[0354] In the above-described embodiment, a two-dimensional code is used as the recorded information. However, in addition to this, a bar code, a wireless tag, or the like that can be read by a known reading mechanism can also be used for the recorded information.

[0355] Moreover, in the above-described embodiment, the structure is such that only access information is recorded in the recorded information. However, other information may also be included in the recorded information. For example, when the printer-equipped digital camera has a function of textifying sound, the sound recorded during shooting can be textified and the data obtained by the textification can be included to generate the recorded information.

[0356] <Upload>

[0357] When uploading image data, it is also possible to upload image data in a state where a two-dimensional code (recorded information) is displayed. That is, it is also possible to upload image data of the same image as the print.

[0358] Moreover, in the above-described embodiment, the structure is such that when the printer-equipped digital camera 10 cannot communicate with the upload terminal 300, the upload is cancelled. However, it may also be configured to temporarily store the upload data in the memory 72 or the like and automatically upload it when the next communication is established. In this case, it is preferable to configure it so that the user can select the automatic upload method. The same applies to the case where the upload by the upload terminal 300 fails, and it may also be configured to perform automatic upload. For example, the process of re-uploading is performed after a certain period of time.

[0359] <Printing of Recorded Information>

[0360] In the above-described embodiment, the two-dimensional code (recorded information) is printed overlapping a part of the image. However, the printing method of the recorded information is not limited to this. It is also possible to print the two exclusively in a manner such that the image and the recorded information do not overlap.

[0361] Figure 42 FIG. is an example showing a case where an image and a two-dimensional code are printed exclusively.

[0362] In Figure 42 In the example shown, the printed image is reduced in size for the observation region 42h, and a two-dimensional code QR is printed in the blank region generated by the reduction. Thus, it is possible to print the two-dimensional code QR and the image without overlapping.

[0363] In addition, as in the above-described embodiment, when the two-dimensional code (recorded information) is printed overlapping a part of the image, it is preferably configured such that the user can select the position where the two-dimensional code is printed. For example, it can be configured such that when printing, the user selects one from a plurality of prepared printing candidate positions and performs printing. For example, it can be configured as follows: As printing candidate positions, four positions, namely the lower right corner, the upper right corner, the upper left corner, and the lower left corner, are prepared, and when printing, the user selects any one of them and performs printing. It is preferably configured such that the printed image is displayed on the display 28 and the position where the two-dimensional code is printed can be adjusted.

[0364] Figure 43 is a transitional diagram of the printed image displayed on the display of the printer-equipped digital camera.

[0365] In Figure 43 In the example shown, the case where the positions of the printed two-dimensional code QR are sequentially switched in the order of the lower right corner, the upper right corner, the upper left corner, and the lower left corner of the image is shown. The switching is performed, for example, by operating the joystick 32a, and the printing position is determined by pressing the OK button 22c. Thus, the printed image can be confirmed in advance.

[0366] 《Data Storage Server》

[0367] The data storage server 200 is connected to the upload terminal 300 and the data playback terminal 400 via the communication network 2, but the form of the communication network 2 is not limited. For example, it can be constituted by a LAN (Local Area Network). And the communication can be a wired-based form.

[0368] 《Upload Terminal》

[0369] The upload terminal is preferably constituted by a portable computer such as a smart phone, but as long as it has a communication function, it can also be constituted by a stationary computer.

[0370] And, in the above-described embodiment, it is configured such that the upload data is generated by the printer-equipped digital camera, but it can also be configured such that it is generated by the upload terminal.

[0371] Also, the uploaded data can be saved in the upload terminal. Thus, even without accessing the data storage server, the uploaded images and sounds can be viewed and listened to in the upload terminal.

[0372] Also, in the system of the above-described embodiment, it is configured such that when uploading image data and sound data from the printer-equipped digital camera 10 to the data storage server 200, the data is uploaded via the upload terminal 300. However, it may also be configured to directly upload data from the printer-equipped digital camera 10 to the data storage server 200. In this case, the printer-equipped digital camera 10 is provided with a communication function via the communication network 2.

[0373] In addition, in the system of the above-described embodiment, by configuring it to upload data via the upload terminal 300, the structure of the printer-equipped digital camera 10 can be simplified. That is, the printer-equipped digital camera 10 only needs to have a function of short-range wireless communication, so the communication function can be simplified.

[0374] 《Data playback terminal》

[0375] <Device structure>

[0376] The data playback terminal is preferably composed of a portable computer such as a smartphone. However, as long as it has functions such as a communication function, a function of reading a two-dimensional code (recorded information), and a playback function, it can also be composed of a stationary computer.

[0377] <Rewrite of sound data based on the data playback terminal>

[0378] It may also be configured such that the sound data stored in the data storage server is rewritten by an operation of the data playback terminal.

[0379] Figure 44 It is a system configuration diagram showing an example of a system capable of rewriting the sound data stored in the data storage server.

[0380] As Figure 44 shown, the data playback terminal 400 is further provided with a sound data rewrite command unit 400E for commanding the rewrite of sound data for the image data displayed on the display unit, i.e., the display 405, a sound collection control unit 400F for obtaining the sound data for rewrite according to the command for rewriting the sound data, and a rewrite data upload unit 400G for uploading the sound data for rewrite to the data storage server 200. Each function is realized by the CPU 401 of the data playback terminal 400 executing a prescribed control program.

[0381] The sound data rewrite command unit 400E, for example, displays a button for commanding the rewrite of sound data on the display 405 together with the image, detects a touch operation on the button, and receives a command for rewriting the sound data. In addition, a command for rewriting the sound data is received from a prescribed menu screen.

[0382] The sound collection control unit 400F controls the sound collection unit, i.e., the microphone unit 409, and acquires the sound data for rewriting. The time for acquiring the sound data for rewriting is a preset fixed time (e.g., 10 seconds).

[0383] The data upload unit 400G for rewriting attaches the information of the image data of the rewritten sound data and uploads the sound data for rewriting to the data storage server 200.

[0384] On the other hand, the data storage server 200 also has the function of the sound data rewriting control unit 200D that rewrites using the data of the received object data when the sound data for rewriting is received from the data playback terminal 400. This function is realized by the CPU 201 of the data storage server 200 executing a prescribed control program.

[0385] Figure 45 It is a sequence diagram showing the order of rewriting the sound data.

[0386] First, in the data playback terminal 400, the sound data for rewriting is acquired. Next, the data playback terminal 400 makes a connection request to the data storage server 200. In response to this, the communication between the data playback terminal 400 and the data storage server 200 is established.

[0387] Next, the sound data for rewriting is uploaded from the data playback terminal 400 to the data storage server 200. If the reception of the data is successful, the data storage server 200 notifies the data playback terminal 400 of the completion of reception.

[0388] If the sound data for rewriting is received, the data storage server 200 searches for the image data to be rewritten. Moreover, it rewrites using the sound data for rewriting that has received the sound data associated with and corresponding to the searched image data. If the rewriting is completed, it notifies the data playback terminal 400 of the completion of the rewriting.

[0389] Through the above series of processes, the rewriting of the sound data is completed. Then, the newly rewritten sound data is downloaded and played.

[0390] <Playback processing of image data>

[0391] In the system of the above embodiment, the image data without a QR code displayed in the uploaded image (image data not including recorded information) is uploaded. In this case, the image without a QR code is played on the data playback terminal 400.

[0392] The image uploaded to the data storage server 200 may be image data that includes a two-dimensional code (recording information) in the image. In this case, if the image data is downloaded and directly played, the two-dimensional code is also displayed together with the image. When the image data is played on the data playback terminal 400, if the two-dimensional code is displayed, it may sometimes interfere with viewing. Therefore, when playing image data that includes a two-dimensional code in the image, it is preferable for the data playback terminal 400 to play the data after masking a part of the two-dimensional code or the like. For example, when the two-dimensional code is covered, the part of the two-dimensional code may be masked by whitening or the like so that it is not displayed. Also, for example, as Figure 42 shown, when the two-dimensional code QR is displayed in the blank part, it is also possible to play only by cropping the area of the playback image.

[0393] 《Other Embodiments》

[0394] In the above embodiment, the case of using a digital camera with a printer for printing has been described as an example, but the printer constituting the system of the present invention can also be constituted by a printer without an imaging unit and a sound collection unit. In this case, the printer is not limited to being portable, and can also be constituted by a so-called stationary printer.

Claims

1. A data playback system, characterized in that, it comprises: a server that stores image data of an image printed on a medium and sound data associated with and corresponding to the image data; and a data playback terminal that downloads and plays the image data and the sound data associated with and corresponding to the image data from the server, wherein the data playback terminal comprises: a display unit that displays an image; a sound output unit that outputs sound; a recording information reading unit that reads recording information; an access information acquisition unit that acquires access information for accessing the image data of the image printed on the medium by reading the recording information with the recording information reading unit, the recording information recording the access information for accessing the image data of the image printed on the medium, being overlapped and synthesized with the image, and being printed on the medium together with the image; a download unit that downloads the image data of the image printed on the medium and the sound data associated with and corresponding to the image data from the server according to the access information acquired by the access information acquisition unit; a display control unit that displays the image data downloaded by the download unit on the display unit; and a sound output control unit that outputs and plays the sound data downloaded by the download unit from the sound output unit, in the image printed on the medium, the part where the recording information is synthesized is not visually recognizable due to the recording information, the server stores image data that does not contain recording information in the image, and the recording information records the access information for accessing the image data.

2. A data playback system, characterized in that, it comprises: a server that stores image data of an image printed on a medium and sound data associated with and corresponding to the image data; and a data playback terminal that downloads and plays the image data and the sound data associated with and corresponding to the image data from the server, wherein the data playback terminal comprises: a display unit that displays an image; a sound output unit that outputs sound; a recording information reading unit that reads recording information; an access information acquisition unit that acquires access information for accessing the image data of the image printed on the medium by reading the recording information with the recording information reading unit, the recording information recording the access information for accessing the image data of the image printed on the medium, being overlapped and synthesized with the image, and being printed on the medium together with the image; a download unit that downloads the image data of the image printed on the medium and the sound data associated with and corresponding to the image data from the server according to the access information acquired by the access information acquisition unit; a display control unit that displays the image data downloaded by the download unit on the display unit; and a sound output control unit that outputs and plays the sound data downloaded by the download unit from the sound output unit, in the image printed on the medium, the part where the recording information is synthesized is not visually recognizable due to the recording information, the server stores image data that contains recording information in the image, and the recording information records the access information for accessing the image data, after masking the recording information recording the access information for accessing the image data, the display control unit displays the image data on the display unit.

3. The data playback system according to claim 1 or 2, wherein, it further includes a printer, and the printer includes: an upload unit that, when printing an image data associated with sound data, uploads the printed image data and the sound data associated with the image data to the server; a record information generation unit that generates record information recording access information for accessing the image data uploaded to the server; and a print control unit that, when printing an image data associated with sound data, prints the record information generated by the record information generation unit together with the image.

4. The data playback system according to claim 3, wherein, the printer further includes: a photographing unit that electronically photographs the printed image; and a sound collection unit that collects sound associated with the printed image.

5. The data playback system according to claim 3, wherein, it further includes: an upload terminal that uploads the received data to the server, and the upload unit uploads the printed image data and the sound data associated with the image data to the server via the upload terminal.

6. The data playback system according to claim 1 or 2, wherein, the data playback terminal further includes: a sound collection unit that collects sound; a sound data rewrite command unit that commands to rewrite the sound data associated with the image data displayed on the display unit; a sound collection control unit that, when the rewrite of the sound data is commanded by the sound data rewrite command unit, controls the sound collection unit to obtain sound data for rewriting; and a rewrite data upload unit that uploads the sound data for rewriting to the server after attaching information of the image data for which the rewrite has been commanded, and the server further includes: a sound data rewrite control unit that, when receiving the sound data for rewriting, rewrites the sound data of the image data for which the rewrite has been commanded using the received sound data.

7. The data playback system according to claim 1 or 2, wherein, for the image data stored in the server, information determined at the time of printing is attached as unique identification information.

8. The data playback system according to claim 7, wherein, the identification information includes information on the cumulative number of prints of the printer that printed the image data.

9. The data playback system according to claim 8, wherein, the identification information further includes information on the unique identification number of the printer that printed the image data.

10. The data playback system according to claim 8, wherein, the identification information further includes information on the model of the printer at the time of printing the image data.

11. The data playback system according to claim 1 or 2, wherein, a cropped image is printed on the medium.

12. The data playback system according to claim 1 or 2, wherein, the medium is a self-developing film.

13. The data playback system according to claim 1 or 2, wherein, the record information is a QR code, a barcode, or a wireless tag.

14. A data playback terminal, characterized in that it includes: a display unit that displays an image; a sound output unit that outputs sound; a record information reading unit that reads record information; An access information acquisition unit acquires access information for image data of an image printed on a medium by reading record information read by the record information reading unit, where the record information records access information for image data of an image printed on the medium, is overlapped and synthesized with the image, and is printed on the medium together with the image; A download unit downloads image data of an image printed on the medium and sound data associated with the image data from a storage address according to the access information acquired by the access information acquisition unit, where the image data is image data that does not include the record information, and the record information records access information for accessing the image data; A display control unit displays the image data downloaded by the download unit on the display unit; and A sound output control unit outputs and plays the sound data downloaded by the download unit from the sound output unit, In the image printed on the medium, the portion where the record information is synthesized is not visually recognizable due to the record information.

15. A printer, characterized in that it constitutes the data playback system according to any one of claims 3 to 5.

16. A server, characterized in that it constitutes the data playback system according to any one of claims 1 to 12.

17. A data playback method, characterized in that it includes: a step of acquiring printed image data and sound data associated with the image data; a step of uploading the acquired image data and sound data associated with the image data to a server; a step of generating record information recording access information for accessing the image data uploaded to the server; a step of overlapping and synthesizing the generated record information with the image and printing it on a medium together with the image; a step of acquiring access information for image data of an image printed on the medium by reading the record information printed on the medium together with the image; a step of downloading image data of an image printed on the medium and sound data associated with the image data from the server according to the acquired access information, where the image data is image data that does not include the record information, and the record information records access information for accessing the image data; a step of displaying the downloaded image data; and a step of playing the downloaded sound data, In the image printed on the medium, the portion where the record information is synthesized is not visually recognizable due to the record information.

Images