Content generation apparatus, control method thereof, storage medium, and computer program product
By designing a content generation device that can generate image files that contain or do not contain historical information, the problem in the existing technology that users cannot select image files according to purpose is solved, and higher information security and user experience are achieved.
Patent Information
- Application Number
- CN202410959606.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-07-21
- Filing Date
- 2024-07-17
- Publication Date
- 2025-01-21
AI Technical Summary
The prior art is difficult to select whether to include historical information based on the purpose of using the image file, resulting in the user being unable to select a suitable image file as needed.
A content generation device is designed that is capable of generating image files containing metadata and hash values of the original comparison information, as well as image files that do not contain this information, for users to choose according to their purposes.
It enables users to choose whether to include historical information according to the purpose of use of image files, thereby configuring image files to meet the needs of different users and improving information security and user experience.
Smart Images

Figure CN119342327A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a content generating device capable of imparting history information, a control method thereof and a storage medium. Background Art
[0002] In recent years, information sharing via the Internet has been actively carried out, and anyone can disclose and transmit various information to an unspecified number of people. In addition, various processing can be performed on digital images. In this case, it is possible to transmit information from unreliable sources or the disclosed information is illegally tampered with, so a technology for ensuring the authenticity of the information to be disclosed and transmitted is needed.
[0003] As a technology for guaranteeing the authenticity of information to be disclosed and transmitted, for example, the technology disclosed in Japanese Patent Laid-Open No. 2008-5421 has been proposed. In Japanese Patent Laid-Open No. 2008-5421, a digital camera has a function of assigning a hash value of data obtained by combining image data and additional information such as a shooting date and time to an image file including image data and additional information obtained by shooting. As a result, by using the hash value assigned to the image file, it is possible to determine whether the image data or additional information included in the image file has changed since the time of shooting.
[0004] In addition, in order to authenticate the origin, background, and history of an image file, a technique has been proposed for assigning history information indicating the content of editing performed on the image file to the image file (see reference [1] (Coalition for Content Provenance and Authenticity (C2PA), “C2PA Specifications”,<TechnicalSpecifications Version 1.2> ,[online],November 3, 2022,[retrieved January 23, 2023],Internet<URL:https: / / c2pa.org / specifications / specifications / 1.2 / specs / C2PA_Specificatio n.html> )). For example, at the time of shooting, additional information such as the shooting location (e.g., EXIF information) and a thumbnail obtained by reducing the image data at the time of shooting are assigned to the image file as history information. In addition, each time the image file is edited, new history information including the edited content is added. Based on the history information included in the image file, the user can grasp how the image data and additional information have been edited after the time of shooting.
[0005] On the other hand, since the purpose of use of image files varies from user to user, users may feel inconvenienced when generating image files including the above-mentioned historical information. For example, in the case where the image file is disclosed to a third party, from the perspective of protecting privacy rather than malicious tampering, the user may mosaic the face of the person included in the image data and / or delete the information related to the shooting location included in the additional information. Even in the case where the image file is edited for the purpose of anonymization as described above, using the technology of the above-mentioned document [1], the historical information at the time of shooting (for example, information on the shooting location and / or the thumbnail image at the time of shooting) still exists, so privacy is not protected. For users who use image files in this way, it is preferable to provide image files that do not include historical information. On the other hand, for users who want to grasp how the image data and additional information are edited after the time of shooting, it is preferable to provide image files that include historical information. As described above, the appropriate configuration of the image file varies depending on the purpose of use; however, using the existing technology, the user cannot select the image file to be used according to the purpose. Summary of the invention
[0006] The present invention provides a content generating device capable of allowing a user to select an image file to be used according to a purpose, a control method thereof, and a storage medium.
[0007] Therefore, the present invention provides a content generating device, which includes: one or more controllers, which are configured to serve as: a unit configured to generate content; a unit configured to generate metadata containing original comparison information, wherein the original comparison information is used to grasp changes from the generation time point of a content file including the content; a unit configured to generate a hash value based on the metadata containing the original comparison information and the content; a unit configured to generate a first content file, wherein the first content file includes the content, the metadata containing the original comparison information, and the hash value; and a unit configured to generate a second content file including the content but not including the original comparison information.
[0008] According to the present invention, in the content generating apparatus, a user can select an image file to be used according to a purpose.
[0009] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] Figure 1A and Figure 1B is an external view of a digital camera as a content generating apparatus according to the present embodiment.
[0011] Figure 2 It is shown Figure 1A and Figure 1B A block diagram of a configuration example of a digital camera in FIG.
[0012] Figure 3A and Figure 3B It is shown by Figure 1A and Figure 1B Flowchart of a procedure of a photographing control process performed by a digital camera in FIG.
[0013] FIG. 4A to FIG. 4G It is shown in Figure 1B FIG. 1 is a diagram showing an example of a screen displayed on a display unit of .
[0014] Figure 5A and Figure 5B It is shown Figure 3B Flowchart of the procedure of the photographing process in S317.
[0015] FIG. 6A to FIG. 6C It is shown by Figure 1A and Figure 1B FIG. 1 is a diagram of an example of a configuration of an image file generated by a digital camera.
[0016] Figure 7 This is a table summarizing the image files to be generated in this embodiment for each condition.
[0017] Fig. 8A and Figure 8B It is shown Figure 3B Flowchart of the process of reproduction processing in S318.
[0018] 9A to 9C It is shown in Figure 1B FIG. 1 is a diagram showing an example of a screen displayed on a display unit of . DETAILED DESCRIPTION
[0019] The present invention will be described in detail below with reference to the accompanying drawings showing embodiments of the present invention. Note that the following embodiments do not limit the present invention according to the claims. Although multiple features are described in the embodiments, all features are not necessarily required for the present invention, and these features can be combined arbitrarily.
[0020] An embodiment in which a content generating apparatus according to the present invention is applied to a digital camera capable of capturing still images and recording moving images will be described in detail below with reference to the accompanying drawings.
[0021] First, refer to Figure 1A , Figure 1B and Figure 2 , the configuration and functions of the digital camera 100 as a content generating apparatus according to the present embodiment will be described.
[0022] Figure 1Ais a front perspective view of the digital camera 100 with the lens unit 150 removed. Figure 1B It is a rear perspective view of the digital camera 100 .
[0023] exist Figure 1B , the display section 28 is an external viewfinder display section that displays images and various types of information, and is a display device such as an LCD, etc., provided on the back of the camera body. The display section 28 is provided with a touch panel 70a. The touch panel 70a is a touch operation member that can detect contact (touch operation) on the display surface (touch operation surface) of the display section 28.
[0024] The external viewfinder display section 43 is a display section provided on the upper surface of the digital camera 100, and displays various setting values of the digital camera 100, such as setting values of shutter speed and aperture, etc. The shutter button 61 is an operation member for performing a shooting instruction. The mode change switch 60 is an operation member for switching various modes. The terminal cover 40 is a cover for protecting a connector (not shown) of a connection cable or the like for connecting the digital camera 100 to an external device.
[0025] The main electronic dial 71 is a rotational operating member. By rotating the main electronic dial 71, setting values such as shutter speed and aperture can be changed, or other operations can be performed. The power switch 72 is an operating member that turns the power of the digital camera 100 on and off. The sub-electronic dial 73 is a rotational operating member. By rotating the sub-electronic dial 73, a selection frame (cursor) displayed on the display section 28 or the like can be moved or a displayed image can be fed, etc. The four-way key 74 is configured to be pressed at its upper, lower, left, and right parts, and can execute processing corresponding to each pressed part of the four-way key 74. The set (SET) button 75 is a push button, and is mainly used to determine the item to be selected.
[0026] The motion image button 76 is used to indicate the start / stop of motion image shooting (recording). The AE lock button 77 is a push button. In the shooting standby state, the exposure state can be fixed by pressing the AE lock button 77. The zoom button 78 is an operation button for switching the on / off of the zoom mode in the live view display (LV display) of the shooting mode. By turning on the zoom mode and then operating the main electronic dial 71, the live view image (LV image) can be enlarged / reduced. In the reproduction mode, the zoom button 78 is used as an operation button to enlarge the reproduced image or increase its magnification.
[0027] The playback button 79 is an operation button for switching between the shooting mode and the playback mode. By pressing the playback button 79 during the shooting mode, the mode can be changed to the playback mode, and the video recorded in the recording medium 200 ( Figure 2) is displayed. The menu button 81 is a push button for performing an instruction operation to display a menu screen. When the menu button 81 is pressed, a menu screen is displayed on the display unit 28, through which various settings can be made. The user can intuitively make various settings using the menu screen displayed on the display unit 28 and the four-way key 74 and / or the setting button 75.
[0028] The touch bar 82 (multi-function bar: M-Fn bar) is a linear touch operation member (latch sensor) capable of receiving a touch operation. The touch bar 82 is arranged at a position where the user can touch-operate (touchable) the touch bar 82 with the thumb of the user's right hand while the user (photographer) holds the grip portion 90 with the user's right hand (with the little finger, ring finger, and middle finger of the right hand) so as to be able to press the shutter button 61 with the index finger of the right hand. That is, the touch bar 82 is arranged at a position where the user can operate the touch bar 82 in a holding state (shooting posture) where the user can press the shutter button 61 at any time while the user brings the user's eye close to the eyepiece portion 16 and looks through the viewfinder. The touch bar 82 is a receiving section that can receive a tap operation (e.g., an operation of touching the touch bar 82 with a finger and moving the finger away from the touch bar 82 within a predetermined period of time without shifting the finger) and a leftward and rightward sliding operation (e.g., an operation of touching the touch bar 82 with a finger and then moving the touched position without moving the finger away from the touch bar 82), etc. The touch bar 82 is an operating member different from the touch panel 70a, and does not have a display function.
[0029] The communication terminal 10 is used for communication between the digital camera 100 and the lens unit 150 ( Figure 2 ) for communication. The eyepiece portion 16 is an eyepiece portion of an eyepiece viewfinder 17 (viewing type viewfinder). The user can visually identify the internal electronic viewfinder (EVF) 29 ( Figure 2 ) is displayed on the eyepiece 16. The eye detection unit 57 is an eye approach detection sensor that detects whether the user's (photographer's) eyes are approaching (approaching) the eyepiece 16. The cover 202 is for accommodating the recording medium 200 ( Figure 2 ) slot cover.
[0030] The grip portion 90 is a holding portion having a shape that is easy to hold with the user's right hand when the user holds the digital camera 100. The shutter button 61 and the main electronic dial 71 are arranged at positions that can be operated by the index finger of the right hand in a state where the user holds the digital camera 100 by holding the grip portion 90 with the little finger, ring finger, and middle finger of the right hand. The sub-electronic dial 73 and the touch bar 82 are arranged at positions that can be operated by the thumb of the right hand in a state where the user holds the digital camera 100 in a manner similar to the above. The thumb rest portion 91 (thumb standby position) is a grip member provided at a position on the back side of the digital camera 100 where the thumb of the right hand holding the grip portion 90 is easily placed when no operating member is operated. The thumb rest portion 91 is formed of a rubber member or the like that enhances the holding strength (gripping feeling).
[0031] Figure 2 It is shown Figure 1A and Figure 1B A block diagram of a configuration example of a digital camera 100 in FIG. Figure 2 The lens unit 150 is a lens unit equipped with an interchangeable photographing lens and is detachable from the digital camera 100. The lens 103 is generally composed of a plurality of lenses; however, in Figure 2 1 and 2. Only one lens is shown in a simplified manner. The communication terminal 6 is a communication terminal for the lens unit 150 to communicate with the digital camera 100 via the communication terminal 10 of the digital camera 100. The communication terminal 10 is a communication terminal for the digital camera 100 to communicate with the lens unit 150. The lens unit 150 communicates with the system control section 50 of the digital camera 100 via the communication terminal 6 and the communication terminal 10. In the lens unit 150, the lens system control circuit 4 inside the lens unit 150 controls the aperture 1 via the aperture drive circuit 2. The lens unit 150 is focused by shifting the position of the lens 103 by the lens system control circuit 4 via the AF drive circuit 3.
[0032] In the digital camera 100 , the shutter 101 is a focal plane shutter capable of freely controlling the exposure time of the imaging section 22 under the control of the system control section 50 .
[0033] The imaging section 22 is an image sensor including an imaging device such as a CCD or a CMOS that converts an optical image into an electrical signal. Note that the imaging section 22 may include an imaging plane phase difference sensor that outputs defocus amount information to the system control section 50. The A / D converter 23 converts an analog signal output from the imaging section 22 into a digital signal.
[0034] The image processing section 24 performs predetermined processing (resize processing such as pixel interpolation and reduction and / or color conversion processing, etc.) on the data from the A / D converter 23 or the data from the memory control section 15. In addition, the image processing section 24 performs predetermined calculation processing using the captured image data, and the system control section 50 performs exposure control and / or distance measurement control based on the calculation results obtained by the image processing section 24. As a result, automatic focus (AF) processing, automatic exposure (AE) processing, and / or pre-flash light emission (EF) processing of the through-the-lens (TTL) method are performed. The image processing section 24 also performs predetermined calculation processing using the captured image data, and performs automatic white balance (AWB) processing of the TTL method based on the obtained calculation results.
[0035] The output data from the A / D converter 23 is written to the memory 32 via the image processing section 24 and the memory control section 15. Alternatively, the output data from the A / D converter 23 is written to the memory 32 via the memory control section 15 without passing through the image processing section 24. The memory 32 stores image data obtained by converting analog data obtained by the imaging section 22 into digital data by the A / D converter 23 and image data to be displayed on the display section 28 and / or the EVF 29. The memory 32 has a storage capacity sufficient to store a predetermined number of still images and / or a predetermined time of moving images and sounds.
[0036] The memory 32 is also used as a memory (video memory) for image display. The D / A converter 19 converts the data for image display stored in the memory 32 into an analog signal, and supplies the analog signal to the display section 28 and / or the EVF 29. The image data for image display written in the memory 32 is displayed on the display section 28 and / or the EVF 29 via the D / A converter 19. The display section 28 and / or the EVF 29 performs a display corresponding to the analog signal from the D / A converter 19. The digital signal generated by the A / D converter 23 through A / D conversion and accumulated in the memory 32 is converted into an analog signal by the D / A converter 19, and is sequentially transmitted to the display section 28 and / or the EVF 29 and displayed on the display section 28 and / or the EVF 29, thereby enabling live view display (LV). Hereinafter, the image displayed in the live view display is referred to as a "live view image (LV image)".
[0037] The system control section 50 is a control section including at least one processor and / or at least one circuit, and controls the entire digital camera 100. The system control section 50 is a processor and also a circuit. The system control section 50 implements each process of the present embodiment described later by executing a program recorded in the nonvolatile memory 56. The system control section 50 also performs display control by controlling the memory 32, the D / A converter 19, the display section 28, the EVF 29, and the like.
[0038] The system memory 52 is, for example, a RAM. The system control unit 50 develops constants and variables used for the operation of the system control unit 50 , and programs read from the nonvolatile memory 56 , etc., in the system memory 52 .
[0039] The nonvolatile memory 56 is an electrically erasable / recordable memory and is an EEPROM etc. In the nonvolatile memory 56, constants and programs etc. for the operation of the system control section 50 are recorded. The programs mentioned here are programs for executing the processing of various flowcharts described later in this embodiment.
[0040] The system timer 53 is a timing section that measures time for various types of control and measures time of a built-in clock.
[0041] The communication unit 54 transmits a video signal (or image signal) and an audio signal to an external device connected to the communication unit 54 by wireless or wired cables, and receives a video signal (or image signal) and an audio signal from the external device. The communication unit 54 can also be connected to a wireless local area network (LAN) and the Internet. In addition, the communication unit 54 can also communicate with an external device via Bluetooth (a registered trademark) or Bluetooth Low Energy. The communication unit 54 can transmit images (including LV images) taken by the camera unit 22 and images recorded on the recording medium 200 to an external device, and can also receive various types of information such as image data and a motion image recording start indication from an external device. In addition, when the communication unit 54 receives a motion image recording start indication from an external device, a notification indicating reception of the indication can be provided to the user by emitting light through the light emitting unit 102 and / or emitting an electronic sound through the speaker 92. Examples of external devices communicating with the communication unit 54 include smart phones, tablet terminals, and desktop PCs.
[0042] The posture detection section 55 detects the posture of the digital camera 100 with respect to the gravity direction. Based on the posture detected by the posture detection section 55, it can be determined whether the image captured by the camera section 22 is an image captured by the user holding the digital camera 100 horizontally or vertically. The system control section 50 can add orientation information corresponding to the posture detected by the posture detection section 55 to the image file of the image captured by the camera section 22, and can record the image while rotating the image according to the posture detected by the posture detection section 55. As the posture detection section 55, an acceleration sensor or a gyro sensor or the like can be used. When an acceleration sensor or a gyro sensor is used as the posture detection section 55, the movement (pan, pitch, lift, whether it is still, etc.) of the digital camera 100 can also be detected.
[0043] The eye detection section 57 is a sensor that detects the approach (eye approach) and separation (eye separation) of the eye (object) relative to the eyepiece section 16 of the eyepiece finder 17. The system control section 50 switches between display (display state) and non-display (non-display state) on the display section 28 and the EVF 29 according to the state detected by the eye detection section 57. More specifically, at least in the case of "being in a shooting standby state, and the switching setting of the display destination is set to automatic switching", during the non-eye (being) approaching state, the display section 28 is set as the display destination of the image, and the display of the display section 28 is turned on, and the EVF 29 is set to non-display (that is, the display on the EVF 29 is turned off). At least in the case of "being in a shooting standby state, and the switching setting of the display destination is set to automatic switching", during the eye (being) approaching state, the EVF 29 is set as the display destination of the image, and the display of the EVF 29 is turned on, and the display section 28 is set to non-display.
[0044] For example, an infrared proximity sensor may be used as the eye detection section 57, and may detect the approach of an object to the eyepiece section 16 of the eyepiece finder 17 including the EVF 29. When the object approaches, infrared light projected from a light projection section (not shown) of the eye detection section 57 is reflected by the object and received by a light receiving section (not shown) of the infrared proximity sensor. The distance (approach distance) between the object and the eyepiece section 16 (how close the object is to the eyepiece section 16) can also be judged by the amount of infrared light received.
[0045] In this way, the eye detection unit 57 performs eye detection to detect the approach distance of an object to the eyepiece unit 16. When it is detected that an object approaches to within a predetermined distance relative to the eyepiece unit 16 after the start of the non-eye approach state (non-approach state), it is determined that the eye is approaching the eyepiece unit 16 (eye approach detection). When it is detected that the approaching object moves away from the eyepiece unit 16 by a predetermined distance or more after the start of the eye approach state (approach state), it is determined that the eye is separated from the eyepiece unit 16 (eye separation detection). The threshold for detecting eye approach and the threshold for detecting eye separation may be different, for example, a hysteresis or the like may be set. Note that the state after the detection of eye approach until the detection of eye separation is defined as the "eye approach state". The state after the detection of eye separation until the detection of eye approach is defined as the "non-eye approach state". Note that the infrared proximity sensor is an example of the eye detection unit 57, and other sensors may be used as the eye detection unit 57 as long as it can detect a state that can be regarded as eye approach.
[0046] The GPS receiving section 119 receives a GPS signal including position information and time information from a GPS satellite (artificial satellite). The digital camera 100 specifies the position of the digital camera 100 and sets a reference time of the digital camera 100 based on the GPS signal received by the GPS receiving section 119. The digital camera 100 can add information indicating the specified position and the shooting date and time based on the time-set reference time to the captured image.
[0047] The hash value generation section 210 performs a hash function on the image file to generate (calculate) a hash value. It should be noted that the system control section 50 may generate a hash value instead of the hash value generation section 210.
[0048] Various setting values of the digital camera 100 including setting values of shutter speed and aperture are displayed on the external viewfinder display section 43 via the external viewfinder display section drive circuit 44 .
[0049] The power control section 80 includes a battery detection circuit, a DC-DC converter, and a switch circuit for switching a module to be powered on, etc. The power control section 80 detects whether a battery is attached, the type of the attached battery, and the remaining battery power, etc. In addition, the power control section 80 controls the DC-DC converter based on the detection result and the instruction of the system control section 50 to supply necessary voltages to various sections including the recording medium 200 in necessary time periods. The power supply section 30 includes primary batteries such as alkaline batteries and lithium batteries and / or secondary batteries such as NiCd batteries, NiMH batteries, and Li batteries, as well as an AC adapter, etc.
[0050] The recording medium I / F 18 is an interface with a recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and includes a semiconductor memory or a magnetic disk. Figure 2 1 and 2, only one recording medium 200 is shown, but it is assumed that the digital camera 100 of the present embodiment has a configuration including a double slot and includes a first slot and a second slot (not shown). The digital camera 100 having such a configuration can record a captured image on any one of the recording medium 200 installed in the first slot and the recording medium 200' installed in the second slot and having a configuration similar to that of the recording medium 200.
[0051] The operation member 70 is an input unit that receives an operation from a user, and is used to input various operation instructions to the system control unit 50. Figure 2 As shown, the operation unit 70 includes a shutter button 61, a mode change switch 60, a power switch 72, a touch panel 70a, and other operation members 70b, etc. The "other operation members 70b" include a main electronic dial 71, a sub-electronic dial 73, a four-way key 74, a set (SET) button 75, a moving image button 76, an AE lock button 77, an enlargement button 78, a reproduction button 79, a menu button 81, and a touch bar 82, etc.
[0052] The shutter button 61 includes a first shutter switch 62 and a second shutter switch 64. The first shutter switch 62 is turned on when the shutter button 61 is being operated, that is, when the shutter button 61 is half-pressed (shooting preparation instruction), and generates and outputs a first shutter switch signal SW1. When receiving the first shutter switch signal SW1, the system control section 50 starts shooting preparation operations such as AF processing, AE processing, AWB processing, and EF processing.
[0053] The second shutter switch 64 is turned on when the operation of the shutter button 61 is completed, that is, when the shutter button 61 is fully pressed (shooting instruction), and generates and outputs a second shutter switch signal SW2. When receiving the second shutter switch signal SW2, the system control section 50 starts a series of shooting processing operations from reading a signal from the imaging section 22 to writing a captured image as an image file on the recording medium 200.
[0054] The mode change switch 60 switches the operation mode of the system control unit 50 to one of a still image shooting mode, a moving image shooting mode, a reproduction mode, and the like. The still image shooting mode includes an automatic shooting mode, an automatic scene determination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode (P mode). In addition, there are various scene modes as shooting settings set for various shooting scenes, as well as a custom mode, and the like. The mode change switch 60 allows the user to directly switch to one of these modes. Alternatively, the following configuration may be adopted: after the user temporarily switches the display screen to the list screen of the shooting mode through the mode change switch 60, the user selectively switches the display screen to one of the displayed multiple modes using other operating members. Similarly, the moving image shooting mode may include multiple modes.
[0055] The touch panel 70a is a touch sensor that detects various touch operations on the display surface of the display unit 28 (the operation surface of the touch panel 70a). The touch panel 70a and the display unit 28 may be configured integrally. For example, the touch panel 70a is configured to have a light transmittance set not to interfere with the display of the display unit 28, and is attached to the upper layer of the display surface of the display unit 28. In addition, the input coordinates on the touch panel 70a correspond to the display coordinates on the display surface of the display unit 28. As a result, a graphical user interface (GUI) can be provided, through which the user can operate as if the user directly operates the screen displayed on the display unit 28.
[0056] The system control unit 50 can detect the following operations on the touch panel 70a or the states of the touch panel 70a:
[0057] A finger and / or pen that has not touched the touch panel 70a touches the touch panel 70a anew. That is, the start of touch (hereinafter, this is referred to as "Touch-Down").
[0058] The touch panel 70a is being touched with a finger and / or a pen (hereinafter referred to as "Touch-On").
[0059] The finger and / or pen is moving while being in contact with the touch panel 70a (hereinafter referred to as "Touch-Move").
[0060] The finger and / or pen touching the touch panel 70a is separated from the touch panel 70a (released), that is, the touch ends (hereinafter referred to as "Touch-Up").
[0061] A state where nothing is touching the touch panel 70a (hereinafter referred to as "Touch-Off").
[0062] When a touch is detected, touch continuation is also detected. After a touch, unless a touch stop is detected, touch continuation is usually detected. When a touch move is detected, touch continuation is detected. Even if touch continuation is detected, touch move is not detected unless the touch position is moved. After the touch stop of all touching fingers and / or touch pens is detected, it becomes untouched.
[0063] The detection of these operations / states and the position coordinates of the touch panel 70a touched by the finger and / or pen are notified to the system control unit 50 via the internal bus. Then, the system control unit 50 determines what kind of operation (touch operation) is performed on the touch panel 70a based on the notified information. Regarding touch movement, the movement direction of the finger and / or pen on the touch panel 70a can be determined for each vertical component and horizontal component on the touch panel 70a based on the change in the position coordinates.
[0064] In the case where a touch movement of a predetermined distance or more is detected, it is determined that a sliding operation has been performed. The operation of quickly moving a finger a certain distance while touching the touch panel 70a and then releasing the finger from the touch panel 70a is called "flicking". In other words, flicking is an operation of quickly sliding the touch panel 70a as if flicking with a finger. In the case where it is detected that the touch movement has been carried out for a predetermined distance or more at a predetermined speed or more and the touch stop is detected while the touch movement is detected, it can be determined that a flick has been performed (that is, it can be determined that a flick has been performed after the sliding operation). In addition, a touch operation of simultaneously touching (multi-touching) multiple parts (for example, two points) with a finger and / or a pen to bring the touch positions closer to each other is called "pinch", and a touch operation of simultaneously touching multiple parts with a finger and / or a pen to move the touch positions away from each other is called "pinch-in". Pinch-out and pinch-in are collectively referred to as "pinch operation".
[0065] The touch panel 70a may be any type of touch panel among various types of touch panels such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. There are a method of detecting a touch due to contact with the touch panel and a method of detecting a touch due to proximity of a finger and / or a pen to the touch panel, and any of these methods may be employed.
[0066] Figure 3A and Figure 3B It is shown by Figure 1A and Figure 1BFlowchart of the procedure of the shooting control process executed by the digital camera 100 in FIG. When the power switch 72 is turned on, the shooting control process is realized by the system control section 50 expanding the program stored in the nonvolatile memory 56 into the system memory 52 and executing the program. Note that it is assumed that the tampering inhibition mode is disabled in the digital camera 100 and the display section 28 displays the shooting control process at the start of the shooting control process. Figure 4A The setting screen 400 in the figure. The setting screen 400 includes a setting item 401, which can be set to "ON" for enabling the tampering inhibition mode or "OFF" for disabling the tampering inhibition mode. In the present embodiment, when shooting is performed while the setting item 401 is set to "ON", the image file generated by shooting includes the following historical information. On the other hand, when shooting is performed while the setting item 401 is set to "OFF", the image file generated by shooting does not include the following historical information. In the present embodiment, whether malicious tampering has been performed can be judged based on whether the hash value and / or signature value included in the historical information has changed.
[0067] exist Figure 3A and Figure 3B In the embodiment, first, in S301 ("S" represents step), the system control unit 50 determines whether an instruction for enabling the tampering prohibition mode has been made. Specifically, the system control unit 50 determines whether an instruction for setting "on" or "off" has been made in the setting item 401.
[0068] In the case where it is determined in S301 that an instruction for enabling the tampering inhibition mode has not been made, that is, in the case where an instruction for setting "OFF" has been made in the setting item 401, the shooting control process proceeds to S302. In S302, the system control section 50 sets the setting value of the tampering inhibition mode to "OFF" which is a setting value for disabling the tampering inhibition mode. The setting value "OFF" is stored in the memory 32. Next, the shooting control process proceeds to S317 described later.
[0069] In the case where it is determined in S301 that an instruction for enabling the tampering inhibition mode has been made, that is, in the case where an instruction for setting “ON” has been made in the setting item 401, the shooting control process proceeds to S303. In S303, the system control unit 50 sets the setting value of the tampering inhibition mode to “ON” as the setting value for enabling the tampering inhibition mode. The setting value “ON” is also stored in the memory 32. In the case where the setting value of the tampering inhibition mode is set to “ON”, a setting item 402 is added to the setting screen 400 ( Figure 4B ). In the setting item 402, “ON” for enabling the “original comparison information providing function” or “OFF” for disabling the “original comparison information providing function” can be set.
[0070] In the present embodiment, in the case where shooting is performed while setting item 402 is set to "ON", the image file generated by shooting includes the following history information, wherein the history information includes original comparison information. The original comparison information is information for grasping changes in the image file from the time point of generation of the image file, and is, for example, metadata at the time of shooting including thumbnail data (thumbnail image) obtained by reducing the image data at the time of shooting and / or information such as the shooting location. By generating such an image file including history information, not only is tampering of the image file detected, but also changes in the image data or metadata from the time point of shooting can be grasped by comparing the image file with the original comparison information.
[0071] Next, the system control unit 50 determines whether an instruction for enabling the original comparison information providing function has been made (S304). Specifically, the system control unit 50 determines whether an instruction for setting to "ON" for enabling the original comparison information providing function or setting to "OFF" for disabling the original comparison information providing function has been made in the setting item 402.
[0072] In a case where it is determined in S304 that an instruction for enabling the raw comparison information providing function is not made, that is, in a case where an instruction for setting to "OFF" is made in the setting item 402, the shooting control process proceeds to S305. In S305, the system control section 50 sets the setting value of the raw comparison information providing function to "OFF" which is a setting value for disabling the raw comparison information providing function. The setting value "OFF" is also stored in the memory 32. Next, the shooting control process proceeds to S317 described later.
[0073] In the case where it is determined in S304 that an instruction for enabling the raw comparison information providing function is made, that is, in the case where an instruction for setting to “ON” is made in the setting item 402, the shooting control process proceeds to S306. In S306, the system control section 50 sets the setting value of the raw comparison information providing function to “ON” as a setting value for enabling the raw comparison information providing function. The setting value “ON” is also stored in the memory 32.
[0074] In the case where "ON" is set in the setting item 402, a setting item 403 for setting the "original comparison information provision automatic determination function" is added to the setting screen 400 ( Figure 4C ). In the setting item 403, any one of "On (with history)", "On (without history)" and "Off" can be set. "On (with history)" and "On (without history)" are setting values for enabling the original comparison information providing automatic judgment function. "Off" is a setting value for disabling the original comparison information providing automatic judgment function.
[0075] In the case where "On (with history)" or "On (without history)" is set in setting item 403 and shooting is performed, whether to include the original comparison information in the image file is controlled based on the characteristics of the subject. In the case where "On (with history)" is set in setting item 403 and shooting is performed, when it is determined based on the characteristics of the subject that the image file does not include the original comparison information, an image file including the history information is generated. The history information does not include the original comparison information. On the other hand, in the case where "On (without history)" is set in setting item 403 and shooting is performed, when it is determined based on the characteristics of the subject that the image file does not include the original comparison information, an image file including neither the original comparison information nor the history information is generated.
[0076] Furthermore, in the case where "ON" is set in the setting item 402, a setting item 404 for setting a function of simultaneously generating an image without original comparison information is also added to the setting screen 400 ( Figure 4C ). In setting item 404, any one of "On (with history)", "On (without history)" and "Off" can be set. "On (with history)" and "On (without history)" are setting values for enabling the function of simultaneously generating an image without original comparison information. "Off" is a setting value for disabling the function of simultaneously generating an image without original comparison information. It should be noted that setting item 404 can be operated only when "Off" is set in setting item 403.
[0077] In the case where "ON (with history)" is set in the setting item 404 and shooting is performed, two image files are generated, specifically, an image file including original comparison information and an image file not including original comparison information are generated, wherein the image file not including original comparison information includes history information. In the case where "ON (without history)" is set in the item 404 and shooting is performed, an image file including original comparison information and an image file not including original comparison information are generated, wherein the image file not including original comparison information does not include history information.
[0078] Next, the system control section 50 determines whether an instruction for enabling the raw comparison information provision automatic determination function has been made (S307). Specifically, the system control section 50 determines whether an instruction has been made to set "ON (with history)", "ON (without history)" and "OFF" in the setting item 403. In a case where it is determined in S307 that an instruction for enabling the raw comparison information provision automatic determination function has been made, that is, in a case where an instruction for setting to "ON (with history)" or "ON (without history)" has been made in the setting item 403, the shooting control process proceeds to S308.
[0079] In S308, the system control unit 50 determines whether an instruction for setting to “ON (no history)” has been made in the setting item 403. In the case where it is determined in S308 that an instruction for setting to “ON (no history)” has not been made in the setting item 403, that is, in the case where an instruction for setting to “ON (with history)” has been made in the setting item 403 (for example, refer to Figure 4D The system control unit 50 sets the setting value of the original comparison information automatic determination function to "ON (with history)". The setting value "ON (with history)" is also stored in the memory 32. Next, the shooting control process proceeds to S317 described later.
[0080] In the case where it is determined in S308 that an instruction for setting to “ON (no history)” has been made in the setting item 403 (for example, see Figure 4E The shooting control process moves to S310. In S310, the system control unit 50 sets the setting value of the original comparison information providing automatic judgment function to "ON (no history)". The setting value "ON (no history)" is also stored in the memory 32. Next, the shooting control process proceeds to S317 described later.
[0081] In a case where it is determined in S307 that an instruction for enabling the raw comparison information provision automatic determination function has not been made, that is, in a case where an instruction for setting to “OFF” is made in the setting item 403, the shooting control process proceeds to S311. In S311, the system control section 50 sets the setting value of the raw comparison information provision automatic determination function to “OFF”. The setting value “OFF” is also stored in the memory 32.
[0082] Next, the system control unit 50 determines whether an instruction has been made to enable the function of generating an image without original comparison information at the same time (S312). Specifically, the system control unit 50 determines which of "On (with history)", "On (without history)" and "Off" has been instructed to be set in the setting item 404.
[0083] In the case where it is determined in S312 that an instruction to enable the function for simultaneously generating an image without original comparison information has been made, that is, in the case where an instruction to set to “ON (with history)” or “ON (without history)” has been made in the setting item 404, the shooting control process proceeds to S313. In S313, the system control section 50 determines whether an instruction to set to “ON (without history)” has been made in the setting item 404.
[0084] In the case where it is determined in S313 that an instruction for setting to “ON (no history)” has not been made in the setting item 404, that is, in the case where an instruction for setting to “ON (with history)” has been made in the setting item 404 (for example, referring to Figure 4F The system control section 50 sets the setting value of the function for simultaneously generating images without original comparison information to "ON (with history)". The setting value "ON (with history)" is also stored in the memory 32. Next, the shooting control process proceeds to S317 described later.
[0085] In the case where it is determined in S313 that an instruction to set to “ON (no history)” has been given in the setting item 404 (for example, referring to Figure 4G The system control section 50 sets the setting value of the function for simultaneously generating an image without original comparison information to "ON (no history)". The setting value "ON (no history)" is also stored in the memory 32. Next, the shooting control process proceeds to S317 described later.
[0086] In a case where it is determined in S312 that an instruction for enabling the function of simultaneously generating an image without original comparison information has not been made, that is, in a case where an instruction for setting to “off” has been made in the setting item 404 (for example, refer to Figure 4C The system control unit 50 sets the setting value of the function for simultaneously generating an image without original comparison information to “off”. The setting value “off” is also stored in the memory 32.
[0087] Next, the system control unit 50 executes Figure 5A and Figure 5B Next, the system control unit 50 performs the shooting process described later. Fig. 8A and Figure 8B ) of the reproduction process (S318). Next, the system control unit 50 determines whether a power-off instruction has been received from the user (S319). The system control unit 50 waits until a power-off instruction is received from the user. When a power-off instruction is received from the user ("Yes" in S319), the shooting control process ends.
[0088] Figure 5A and Figure 5B It is shown Figure 3B Flowchart of the procedure of the photographing process in S317. Figure 5A and Figure 5BThe photographing process is started by receiving a photographing start operation such as pressing the shutter button 61, and is ended by receiving a photographing end operation such as stopping pressing the shutter button 61.
[0089] exist Figure 5A and Figure 5B In the embodiment, the system control section 50 drives the shutter 101 disposed on the subject side of the imaging section 22 to control the exposure time (S501). Next, the system control section 50 performs an imaging process for converting the light from the subject received by the imaging section 22 via the shutter 101 into an electrical signal (analog image data) (S502). Next, the system control section 50 performs image processing such as development processing and encoding processing on the electrical signal obtained by the imaging process in S502 to generate image data (S503). Next, the system control section 50 determines whether the setting value of the tampering inhibition mode is "ON" (S504).
[0090] When it is determined in S504 that the setting value of the tampering prohibition mode is not "ON", that is, when the setting value of the tampering prohibition mode is "OFF", the system control unit 50 generates the following Fig. 6A The metadata 601a (S505) shown. The metadata 601a includes shooting information 602a. It should be noted that the metadata 601a generated in S505 does not include the historical information described below. The shooting information 602a is information when the camera processing for generating the image data 603a is performed, and includes, for example, the shooting date and time, the photographer, the image size, the manufacturer and model of the camera device, various shooting parameters set when shooting, the shooting location, and the thumbnail image. The shooting information 602a is generated according to a predetermined technical standard (for example, the Exchangeable Image File Format (EXIF)).
[0091] Next, the system control unit 50 generates an image file that does not include history information (S506). Specifically, the system control unit 50 generates an image file composed of the metadata 601a generated in S505 and the image data 603a generated in S503. Fig. 6A Note that in S506, in the case where the image data is a still image, an image file is generated according to the JPEG format, and in the case where the image data is a moving image, an image file is generated according to the MPEG format. Thereafter, the photographing process ends.
[0092] In a case where it is determined in S504 that the setting value of the tampering inhibition mode is "ON", the system control section 50 determines whether the setting value of the original comparison information providing function is "ON" (S507). In a case where it is determined in S507 that the setting value of the original comparison information providing function is not "ON", that is, in a case where the setting value of the original comparison information providing function is "OFF", the shooting process proceeds to S508. In step S508, the system control section 50 determines whether the setting value of the recording image quality, which is a setting item related to the number of pixels of the image data to be recorded, is "Lightweight" with the minimum number of pixels.
[0093] In a case where it is determined in S508 that the setting value of the recording image quality is not "light", the photographing process proceeds to S505. In this case, as described above, the image file 600a including no history information is generated.
[0094] In a case where it is determined in S508 that the setting value of the recording image quality is "light", the system control unit 50 determines whether the remaining amount of the storage capacity of the recording medium 200 as the storage location of the generated image file is less than a predetermined value (S509). In a case where it is determined in S509 that the remaining amount of the storage capacity of the recording medium 200 is less than the predetermined value, the shooting process proceeds to S505. In this case as well, as described above, an image file 600a that does not include history information is generated. As a result, in the present embodiment, even when the setting value of the tampering inhibition mode is "on", in a case where the setting value of the recording image quality is not "light", or in a case where the remaining amount of the storage capacity of the recording medium 200 as the storage location of the generated image file is less than a predetermined value, an image file 600a with a reduced data amount and not including history information is generated.
[0095] If it is determined in S509 that the remaining amount of the storage capacity of the recording medium 200 is not less than the predetermined value, the system control unit 50 generates the following Figure 6BThe metadata 601b (S510) shown. In addition to the shooting information 602b having a configuration similar to that of the above-mentioned shooting information 602a, the metadata 601b also includes historical information 604b. The metadata 601b generated in S510 does not include original comparison information. The historical information 604b is information for proving the credibility of the image data 603b, and is used when verifying the source and history of the image data 603b. The historical information 604b is generated according to a predetermined technical standard (for example, C2PA (Coalition for Content Provenance and Authenticity)) and has a prescribed structure. The historical information 604b includes a history 613b (Assertion), a hash value 623b for guaranteeing the history 613b, and a digital signature 633b.
[0096] The history 613b includes "history identification information" (list ID) for uniquely identifying the history 613b, "edit history" for indicating the content of editing performed on the image data 603b, "editing tool" for indicating the tool used for editing, and "production source" for indicating the producer (production source) of the image data 603b. It should be noted that the image data generated in S503 is just generated by shooting. The image data just generated has not been edited; therefore, in this case, information indicating "generated" is recorded in the edit history, and information indicating the digital camera 100 is recorded in the "editing tool".
[0097] Next, the system control unit 50 generates a hash value 623b (S511). For example, the system control unit 50 performs a hash function on the binary data of each of the image data 603b and the history 613b to generate a hash value 624b of the image data and a hash value 626b of the history included in the hash value 623b. The hash function may be performed on the binary data of the shooting information 602b to generate a hash value 625b of the shooting information. It should be noted that for the binary data of the history 613b, in order to detect tampering in finer units, a hash value may be generated for each finer unit such as "editing history" or "production source".
[0098] Next, the system control section 50 generates a digital signature 633b (S512). The digital signature 633b includes information indicating a signature value, a signer, and a signature date and time. The "signature value" is generated by encrypting the generated hash value 623b using a key prepared in advance. The public key to be paired with the key used this time is also included in the digital signature 633b. Note that in order to prove that the public key is a credible manufacturer, information indicating the manufacturer of the digital camera 100 and / or a public key certificate indicating that the public key is authenticated by a certification authority may be included in the digital signature 633b as a "signer". By assigning the digital signature 633b including such a signer to the image file 600b, information indicating that the image file 600b is credible can be provided. Note that, instead of the information indicating the manufacturer, information indicating the model of the digital camera 100 may be used as the signer. The "signature date and time" is the date and time when the generation of the digital signature 633b is completed. In addition, the shooting date and time may also be included in the history 613b.
[0099] Next, the system control unit 50 generates an image file that does not include the original comparison information (S513). Specifically, the system control unit 50 generates a file consisting of the metadata 601b and the image data 603b generated in S503. Figure 6B Note that, also in S513, in the case where the image data is a still image, an image file is generated according to the JPEG format, and in the case where the image data is a moving image, an image file is generated according to the MPEG format. Thereafter, the photographing process ends.
[0100] If it is determined in S507 that the setting value of the raw comparison information providing function is "ON", the photographing process proceeds to S514. In S514, the system control section 50 determines whether the setting value of the raw comparison information providing automatic determination function is "OFF".
[0101] When it is determined in S514 that the setting value of providing the automatic determination function for the original comparison information is "off", the system control unit 50 generates the following Figure 6C The metadata 601c (S515) shown. In addition to the shooting information 602c having a configuration similar to the shooting information 602a described above, the metadata 601c also includes history information 604c. The history information 604c includes a history 613c, a hash value 623c, and a digital signature 633c. In addition to the information included in the history 613b described above, the history 613c also includes original comparison information. The hash value 623c and the digital signature 633c have configurations similar to the hash value 623b and the digital signature 633b described above, respectively.
[0102] Next, the system control unit 50 generates a hash value 623c (S516). For example, the system control unit 50 performs a hash function on the binary data of each of the image data 603c and the history 613c to generate a hash value 624c of the image data and a hash value 626c of the history included in the hash value 623c. The hash function is performed on the binary data of the shooting information 602c to generate a hash value 625c of the shooting information. It should be noted that similar to the case of the above-mentioned history 613b, also for the binary data of the history 613c, in order to detect tampering in finer units, a hash value can be generated for each finer unit such as "editing history" or "production source".
[0103] Next, the system control unit 50 generates a digital signature 633c (S517). Next, the system control unit 50 generates an image file including the original comparison information (S518). Specifically, the system control unit 50 generates a digital signature 633c composed of the metadata 601c and the image data 603c generated in S503. Figure 6C Note that, also in S518, in the case where the image data is a still image, an image file is generated according to the JPEG format, and in the case where the image data is a moving image, an image file is generated according to the MPEG format.
[0104] Next, the system control unit 50 determines whether the setting value of the function for simultaneously generating images without original comparison information is "off" (S519). If it is determined in S519 that the setting value of the function for simultaneously generating images without original comparison information is "off", the shooting process ends.
[0105] In a case where it is determined in S519 that the setting value of the function for simultaneously generating images without original comparison information is not "Off", that is, in a case where the setting value of the function for simultaneously generating images without original comparison information is "On (with history)" or "On (without history)", the shooting process proceeds to S520.
[0106] In step S520 , the system control section 50 determines whether the setting value of the above-mentioned recording image quality is “light”.
[0107] In the case where it is determined in S520 that the setting value of the recording image quality is "light", the shooting process proceeds to S521. In S521, the system control section 50 determines whether the remaining amount of the storage capacity of the storage location, in which the image file generated together with the image file 600c generated in S518 and not including the original comparison information is to be stored, is less than a predetermined value. Note that the storage location in which the image file not including the original comparison information is to be stored is a recording medium different from the recording medium 200 in which the image file 600c generated in S518 is recorded, specifically, the recording medium 200' installed in the second slot.
[0108] In the case where it is determined in S521 that the remaining amount of the storage capacity of the recording medium 200' is not less than the predetermined value, the photographing process proceeds to S522. In S522, the system control section 50 changes the storage location of the image file that does not include the original comparison information to the recording medium 200' installed in the second slot. As a result, when both the image file that includes the original comparison information and the image file that does not include the original comparison information are generated, these generated image files can be recorded in different storage locations to simplify data organization.
[0109] Next, the system control section 50 stores information associating the two image files with each other in the memory 32 (S523). For example, the system control section 50 stores information indicating that the image file 600c generated in S518 and the image file not including the original comparison information generated in the processing to be described later are image files generated by the same shooting processing in the memory 32. As a result, the two image files (the image file including the original comparison information and the image file not including the original comparison information) can be processed in association with each other.
[0110] Note that in the present embodiment, the method of associating two image files is not limited to the above method. For example, the file name of the image file that does not include the original comparison information generated in the process to be described later may be a file name (e.g., "AAA_C2PA") made by adding a predetermined character string indicating the correlation with the image file 600c to the file name of the image file 600c generated in S518 (e.g., "AAA"). In the case where both the image file that includes the original comparison information and the image file that does not include the original comparison information include history, it can be determined whether these image files are generated by the same shooting process based on their history identification information (list ID).
[0111] Next, the system control section 50 determines whether the setting value of the function for simultaneously generating an image without original comparison information is “ON (with history)” ( S524 ).
[0112] In the case where it is determined in S524 that the setting value of the function for simultaneously generating an image without original comparison information is "ON (with history)", the photographing process proceeds to S508, and then the processes in S509 to S513 are performed. As described above, in the present embodiment, in the case where the setting value of the function for simultaneously generating an image without original comparison information is "ON (with history)", an image file 600c including original comparison information and an image file 600b are generated. As described above, the image file 600b includes the history information 604b, and the history information 604b does not include the original comparison information.
[0113] In the case where it is determined in S524 that the setting value of the function for simultaneously generating images without original comparison information is not "ON (with history)", that is, in the case where the setting value of the function for simultaneously generating images without original comparison information is "ON (without history)", the shooting process proceeds to S505. Thereafter, S506 is performed. As described above, in the present embodiment, in the case where the setting value of the function for simultaneously generating images without original comparison information is "ON (without history)", the image file 600c including the original comparison information and the image file 600a are generated. As described above, the image file 600a does not include any original comparison information and history information.
[0114] In the case where it is determined in S520 that the setting value of the recording image quality is not "light", or in the case where it is determined in S521 that the remaining amount of the storage capacity of the recording medium 200' is less than the predetermined value, the photographing process ends. As described above, in the present embodiment, even when the setting value of the function for simultaneously generating an image without original comparison information is "ON (with history)" or "ON (without history)", in the case where the setting value of the recording image quality is not "light" or in the case where the remaining amount of the storage capacity of the storage location of the image file not including the original comparison information is less than the predetermined value, only the image file 600c including the original comparison information is generated.
[0115] In the case where it is determined in S514 that the setting value of the raw comparison information providing automatic determination function is not "off", that is, in the case where the setting value of the raw comparison information providing automatic determination function is "on (with history)" or "on (without history)", the shooting process proceeds to S525. In S525, the system control section 50 determines whether a person is included in the subject. In the case where it is determined in S525 that the subject does not include a person, the shooting process proceeds to S515, and then the processes of S516 to S519 are performed.
[0116] In the present embodiment, as described above, only when the setting item 403 for the original comparison information providing automatic judgment function is "off", the setting item 404 for the function of simultaneously generating an image without original comparison information can be operated. That is, both the original comparison information providing automatic judgment function and the function for simultaneously generating an image without original comparison information cannot be enabled at the same time. In S514, it is determined that the setting value of the original comparison information providing automatic judgment function is "on (with history)" or "on (without history)"; therefore, in S519 after S525, it is determined that the setting value of the function for simultaneously generating an image without original comparison information is "off", and the shooting process ends. As described above, in the present embodiment, in the case where the setting value of the original comparison information providing automatic judgment function is "on (with history)" or "on (without history)" and no person is included in the subject, an image file 600c including original comparison information is generated.
[0117] When it is determined in S525 that a person is included in the subject, the system control section 50 determines whether the setting value of the raw comparison information provision automatic determination function is “ON (with history)” ( S526 ).
[0118] In the case where it is determined in S526 that the setting value of the automatic determination function for providing raw comparison information is "ON (with history)", the shooting process proceeds to S508, and then the processes in S509 to S513 are performed. As described above, in the present embodiment, in the case where the setting value of the automatic determination function for providing raw comparison information is "ON (with history)" and the subject includes a person, the image file 600b is generated. As described above, the image file 600b includes the history information 604b, and the history information 604b does not include the raw comparison information.
[0119] In the case where it is determined in S526 that the setting value of the original comparison information providing automatic determination function is not "ON (with history)", that is, in the case where the setting value of the original comparison information providing automatic determination function is "ON (without history)", the shooting process proceeds to S505 and then proceeds to S506. As described above, in the present embodiment, in the case where the setting value of the original comparison information providing automatic determination function is "ON (without history)" and the subject includes a person, an image file 600a including neither original comparison information nor history information is generated.
[0120] Figure 7 is a table summarizing the image files to be generated in this embodiment for various conditions. Figure 7 As shown, in the present embodiment, image files having different configurations are generated based on the setting values of the setting items 401 to 404 and the characteristics of the subject.
[0121] As described above, in the present embodiment, when the digital camera 100 performs shooting, any one of the image files 600a to 600c is generated. Note that any one of these image files 600a to 600c can be edited after being generated. For example, when the image file 600c is edited by a legal process using an authorized editing tool, historical information is newly generated according to a predetermined technical standard based on the edited content, and the newly generated historical information is added to the metadata 601c of the image file 600c. Each time the image file 600c is edited, historical information is newly generated, and the historical information is added to the metadata 601c of the image file 600c. On the other hand, in the case where the image file 600c is edited using an unauthorized editing tool and / or the image file 600c is edited by an unauthorized process, the historical information may not be assigned to the image file 600c and / or the historical information assigned to the image file 600c may not meet the predetermined technical standard.
[0122] In addition, in the present embodiment, tampering of the image files 600b and 600c can be detected by generating a hash value or a signature value. For example, a hash function is performed on the binary data of the image data 603c of the image file 600c to generate a hash value. Then, the generated hash value is compared with the hash value 624c of the image data of the image file 600c. As a result, it can be verified whether the image data 603c has been changed. Similarly, a hash function is performed on the binary data of the shooting information 602c of the image file 600c to generate a hash value. Then, the generated hash value is compared with the hash value 625c of the shooting information of the image file 600c. As a result, it can be verified whether the shooting information 602c including the shooting date and time and the shooting location, etc. has been changed. In addition, a hash function is performed on the binary data of the history 613c to generate a hash value. Then, the generated hash value is compared with the hash value 626c of the history of the image file 600c. As a result, it can be verified whether the history 613c has been changed.
[0123] Note that this comparison can be performed using binary data of finer units such as editing history, production source, thumbnail data, or metadata. In addition, since the signature value can be decrypted with a public key, it is also possible to use the hash value obtained in the decryption for comparison, and judge that the signature value has been successfully verified when the hash values match. In this way, a mechanism for detecting tampering can be incorporated into the image file.
[0124] According to the above embodiment, the image file 600c including the original comparison information and the image file not including the original comparison information are generated. As a result, two image files having different configurations can be provided to the user, so the user can select the image file to be used according to the purpose.
[0125] In the above-described embodiment, the original comparison information may be a thumbnail image obtained by reducing the image data. As a result, the user can select whether to use the image file 600c that can grasp the change of the image data from the time of shooting, or to use an image file (an image file that does not include the original comparison information) having a structure that cannot grasp the change of the image data from the time of shooting but is easy to perform editing processing for protecting privacy, according to the purpose.
[0126] In addition, in the above-described embodiment, the original comparison information may be metadata at the time of shooting including information indicating the shooting location. As a result, the user can select whether to use the image file 600c capable of detecting tampering of the information of the shooting location, etc., or to use an image file (an image file not including the original comparison information) having a structure that cannot detect tampering of the information of the shooting location, etc. but is easy to perform editing processing for protecting privacy, according to the purpose.
[0127] Note that in the above Figure 5A and Figure 5B In the photographing process of , the configuration of determining whether a person is included in the subject in S525 has been described; however, the present invention is not limited to this configuration. For example, the present invention can be configured to determine whether the photographing location is a location that is not recommended for photographing.
[0128] In addition, in the above Figure 5A and Figure 5B In the shooting process of , a configuration has been described in which an image file is controlled not to include original comparison information; however, the present invention is not limited to this configuration. For example, instead of generating an image file that does not include original comparison information, image processing such as mosaic processing may be performed on thumbnail data as original comparison information, and alternatively, metadata (location data such as shooting location) as original comparison information may be processed to hide metadata. Note that control may also be performed so that the original comparison information is processed but the image data is not processed. In addition, information indicating that the original comparison information has been processed may be included in the image file.
[0129] Next, the reproduction process of S318 will be described. In the present embodiment, when the setting value of the function for simultaneously generating images without original comparison information is "On (with history)" or "On (without history)", an image file including the original comparison information and an image file not including the original comparison information are generated. When two image files with different configurations are generated, the user may want to operate only one of the two image files, or the user may want to operate both image files at the same time. In order to respond to such a demand, in the present embodiment, the process of S318 is performed to enable the optimal operation of the two image files.
[0130] Fig. 8Aand Figure 8B It is shown Figure 3B Flowchart of the process of reproduction processing in S318. Fig. 8A and Figure 8B The reproduction process starts when a reproduction start operation such as pressing the reproduction button 79 is received, and ends when a reproduction end operation such as pressing the shutter button 61 is received. 9A to 9C It is shown in Figure 1B FIG. 2 is a diagram showing an example of a screen displayed on the display unit 28.
[0131] exist Fig. 8A and Figure 8B In the embodiment of the present invention, the system control unit 50 reproduces an image file designated by a user from among image files stored in the recording medium 200 or the recording medium 200' (S801). As a result, an image corresponding to the designated image file is displayed on the display unit 28. Next, the system control unit 50 determines whether an instruction for erasing the designated image file has been received from the user (S802).
[0132] In the case where it is determined in S802 that an instruction for erasing an image file has been received from the user, the reproduction process proceeds to S803. In S803, the system control section 50 determines whether another image file associated with the designated image file has been generated by the shooting process in S317. For example, in the case where the designated image file is an image file including original comparison information, in the shooting process in S317, it is determined whether an image file associated with the designated image file and not including original comparison information has been generated. The determination in S803 is made based on the presence or absence of information associating the two image files stored in the memory 32 in S523, for example.
[0133] If it is determined in S803 that another image file associated with the designated image file has not been generated by the shooting process in S317, the reproduction process proceeds to S804. In S804, the system control unit 50 erases the designated image file from the storage location of the image file being reproduced.
[0134] If it is determined in S803 that another image file associated with the designated image file has been generated by the shooting process in S317, the reproduction process proceeds to S805. In S805, the system control unit 50 determines whether the received erase instruction is a "simultaneous erase instruction".
[0135] For example, in the case where both an image file including the original comparison information and an image file not including the original comparison information are generated in the photographing process of S317, the user Fig.9AOne of the erase buttons 901 to 903 is selected on the screen displayed on the display unit 28 shown, and an erase instruction of the image file is issued. The erase button 901 is a button for giving an instruction for erasing an image file including original comparison information (hereinafter, it is referred to as "an instruction for erasing only an image file with original comparison information"). The erase button 902 is a button for giving an instruction for erasing an image file not including original comparison information (hereinafter, it is referred to as "an instruction for erasing only an image file without original comparison information"). The erase button 903 is a button for giving an instruction for erasing both an image file including original comparison information and an image file not including original comparison information (hereinafter, it is referred to as "a simultaneous erase instruction").
[0136] In the case where the user selects the erase button 903, it is determined in S805 that the received erase instruction is a "simultaneous erase instruction". In this case, the system control unit 50 erases both the designated image file and the image file associated with the designated image file from their storage locations. Specifically, the system control unit 50 erases the image file including the original comparison information from the recording medium 200 and erases the image file not including the original comparison information from the recording medium 200' (S806). As a result, without selecting both the image file including the original comparison information and the image file not including the original comparison information, the user can easily erase the two image files from their storage locations by simply selecting one of the two image files. Next, the reproduction process proceeds to S810 described later.
[0137] On the other hand, when the user selects any one of the erase buttons 901 and 902, it is determined in S805 that the received erase instruction is not a "simultaneous erase instruction." In this case, the system control unit 50 determines whether an "instruction for erasing only the image file with the original comparison information" has been issued (S807).
[0138] In the case where the user selects the erase button 901, it is determined in S807 that the received erase instruction is an "instruction for erasing only the image file having the original comparison information". In this case, the system control section 50 erases the image file including the original comparison information from the recording medium 200 among the designated image file and the image files associated with the designated image file (S808). Next, the reproduction process proceeds to S810 described later.
[0139] On the other hand, when the user selects the erase button 902, it is determined in S807 that the received erase instruction is not an "instruction for erasing only the image files having the original comparison information". In this case, the system control section 50 erases the image files that do not include the original comparison information from the recording medium 200' among the designated image files and the image files associated with the designated image files (S809). Next, the reproduction process proceeds to S810 described later.
[0140] If it is determined in S802 that an instruction to erase the image file has not been received from the user, the reproduction process proceeds to S810. In S810, the system control unit 50 determines whether an "image protection instruction" has been received. In this embodiment, the user can Fig. 9B The protection button 904 is selected on the screen displayed on the display unit 28 to issue an instruction to protect the image.
[0141] When it is determined in S810 that the image protection instruction has been received, the system control unit 50 determines whether another image file associated with the designated image file has been generated by the shooting process in S317 ( S811 ).
[0142] If it is determined in S811 that another image file associated with the designated image file has not been generated by the shooting process in S317, the system control section 50 protects the designated image file which is the image file being reproduced (S812). Thereafter, the reproduction process proceeds to S814 described later.
[0143] In the case where it is determined in S811 that another image file associated with the designated image file has been generated by the shooting process in S317, the reproduction process proceeds to S813. In S813, the system control section 50 protects the image file including the original comparison information among the designated image file and the image file associated with the designated image file. Thereafter, the reproduction process proceeds to S814 described later.
[0144] If it is determined in S810 that the image protection instruction has not been received, the system control unit 50 determines whether an "image transfer instruction" has been received (S814). Note that in this embodiment, the user can Fig. 9C An image transfer instruction is given by selecting the image transfer button 905 on the screen displayed on the display unit 28. If it is determined in S814 that the image transfer instruction has not been received, the reproduction process ends.
[0145] When it is determined in S814 that the image transfer instruction has been received, the system control unit 50 determines whether another image file associated with the designated image file has been generated by the imaging process in S317 ( S815 ).
[0146] In the case where it is determined in S815 that another image file associated with the designated image file has not been generated by the shooting process in S317, the reproduction process proceeds to S816. In S816, the system control section 50 transfers the image file being reproduced, that is, the designated image file, to the transfer destination designated by the user. Note that the user can designate an external device such as a smartphone, a PC, and a server as the transfer destination of the image file. Thereafter, the reproduction process ends.
[0147] In the case where it is determined in S815 that another image file associated with the designated image file has been generated in the shooting process of S317, the reproduction process proceeds to S817. In S817, the system control unit 50 transmits both the designated image file and the image file associated with the designated image file to the transmission destination specified by the user. Specifically, the system control unit 50 transmits both the image file including the original comparison information and the image file not including the original comparison information to the transmission destination specified by the user. Note that as a use case of transmitting both the image file including the original comparison information and the image file not including the original comparison information to an external device, there is a case where the two image files have different uses. For example, in the case where the image file is disclosed to the public except for information that is desired to be kept confidential to the outside, the image file that does not include the original comparison information is used. In addition, in the case where the image file is used internally with limited use to, for example, be able to compare and confirm the history including information that is desired to be kept confidential to the outside, the image file that includes the original comparison information is used. Thereafter, the reproduction process ends.
[0148] In the above-described embodiment, in the case where an erase instruction is received from the user in a state where one of the image file including the original comparison information and the image file not including the original comparison information is selected, whether to erase both image files or only one of the two image files is controlled according to which one of the erase buttons 901 to 903 is selected by the user. As a result, the user can realize a desired erase process by selecting only one of the image file including the original comparison information and the image file not including the original comparison information without selecting both the image file including the original comparison information and the image file not including the original comparison information.
[0149] Furthermore, in the above-described embodiment, when an image protection instruction is received from the user in a state where one of an image file including original comparison information and an image file not including original comparison information is selected, control is performed so that the image file including original comparison information is to be protected. Therefore, it is possible to prevent the image file including original comparison information having a large amount of information from being erased by an erroneous operation of the user.
[0150] Note that when it is more useful to protect image files that do not include original comparison information, image files that do not include original comparison information may be protected instead of (or in addition to) image files that include original comparison information.
[0151] Furthermore, in the above-described embodiment, in the case where an image transfer instruction is received from the user in a state where one of the image file including the original comparison information and the image file not including the original comparison information is selected, both the image file including the original comparison information and the image file not including the original comparison information are transferred to the external device. As a result, the user can easily transfer the two image files to the external device by selecting only one of the image file including the original comparison information and the image file not including the original comparison information without selecting both the image file including the original comparison information and the image file not including the original comparison information.
[0152] In the present embodiment, an image file including the original comparison information and an image file not including the original comparison information are transmitted in the reproduction process; however, the transmission timing of these image files is not limited to the reproduction process. For example, these image files may be transmitted by an automatic transmission process in which the image files generated by shooting are immediately transmitted to an external device. In the automatic transmission process, in the case where both an image file including the original comparison information and an image file not including the original comparison information are generated, the two image files are transmitted to the external device. In the case where one of the image file including the original comparison information and the image file not including the original comparison information is generated, the generated image file is transmitted to the external device.
[0153] Other embodiments
[0154] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.
[0155] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
[0156] This application claims the benefit of Japanese Patent Application No. 2023-119089, filed Jul. 21, 2023, which is hereby incorporated by reference herein in its entirety.
Claims
1. A content generating device, comprising: One or more controllers configured to function as: A unit configured to generate content; a unit configured to generate metadata including original comparison information for grasping changes from a point in time of generation of a content file including the content; a unit configured to generate a hash value based on metadata including the original comparison information and the content; a unit configured to generate a first content file, the first content file comprising the content, metadata including the original comparison information, and the hash value; as well as A unit is configured to generate a second content file including the content but not including the original comparison information.
2. The content generating device according to claim 1, wherein: The one or more controllers are further configured to function as: When an instruction for performing a predetermined process is received from a user while one of the first content file and the second content file is selected, whether the predetermined process is performed on both the first content file and the second content file or on only one of the first content file and the second content file is controlled according to the user's operation content.
3. The content generating device according to claim 2, wherein: The predetermined process is a process for erasing a content file from a storage location.
4. The content generating device according to claim 1, wherein: The one or more controllers are further configured to function as: When an instruction to perform a predetermined process is received from a user in a state where one of the first content file and the second content file is selected, control is performed so that the predetermined process is performed on the first content file.
5. The content generating device according to claim 4, wherein: The predetermined process is a content file protection process.
6. The content generating device according to claim 1, wherein: The one or more controllers are further configured to function as: When an instruction to perform a predetermined process is received from a user in a state where one of the first content file and the second content file is selected, control is performed so that the predetermined process is performed on both the first content file and the second content file.
7. The content generating device according to claim 6, wherein: The predetermined process is a process for transferring the content file to an external device.
8. The content generating device according to claim 1, wherein: The first content file and the second content file are stored in different storage locations.
9. The content generating device according to claim 1, wherein: The content is image data obtained by photographing a subject, and The original comparison information is a thumbnail image obtained by reducing image data generated by a unit configured to generate the content.
10. The content generating device according to claim 1, wherein: The content is image data obtained by photographing a subject, and The original comparison information is metadata at the time of shooting including information indicating a shooting location.
11. The content generating device according to claim 1, further comprising a memory, wherein: The one or more controllers are further configured to function as: Recording the first content file and the second content file in the memory is data generated by the same photographing process.
12. The content generating device according to claim 1, wherein: The file name of the second content file is a file name made by adding a predetermined character string indicating the relevance to the first content file to the file name of the first content file.
13. The content generating device according to claim 1, wherein: The second content file includes: the content; metadata not including the original comparison information; and a hash value generated based on the metadata not including the original comparison information and the content.
14. The content generating device according to claim 13, wherein: Based on predetermined identification information included in the metadata including the original comparison information and predetermined identification information included in the metadata not including the original comparison information, it is determined whether the content files having the metadata are data generated by the same photographing process.
15. The content generating device according to claim 1, wherein: The second content file includes the content, does not include metadata that does not include the original comparison information, and does not include a hash value generated based on the metadata that does not include the original comparison information and the content.
16. A method for controlling a content generating device, the method comprising: The steps used to generate the content; a step of generating metadata including original comparison information for grasping changes from a point in time of generation of a content file including the content; a step for generating a hash value based on metadata including said original comparison information and said content; A step for generating a first content file, the first content file comprising the content, metadata including the original comparison information, and the hash value; as well as A step for generating a second content file including the content but not including the original comparison information.
17. A computer-readable non-transitory storage medium storing a program for executing a control method of a content generating device, the control method comprising: The steps used to generate the content; a step of generating metadata including original comparison information for grasping changes from a point in time of generation of a content file including the content; a step for generating a hash value based on metadata including said original comparison information and said content; A step for generating a first content file, the first content file comprising the content, metadata including the original comparison information, and the hash value; as well as A step for generating a second content file including the content but not including the original comparison information.
18. A computer program product comprising a program for executing a control method of a content generating device, the control method comprising: The steps used to generate the content; a step of generating metadata including original comparison information for grasping changes from a point in time of generation of a content file including the content; a step for generating a hash value based on metadata including said original comparison information and said content; A step for generating a first content file, the first content file comprising the content, metadata including the original comparison information, and the hash value; as well as A step for generating a second content file including the content but not including the original comparison information.
Citation Information
Patent Citations
Digital camera and image handling system
JP2008005421A
Air conditioning system
JP2023119089A