Information processing device, imaging apparatus, information processing method, and program

Abstract

To prove that imaging is being performed according to rules set by a licensing source.SOLUTION: An information processing device is configured to acquire authorization information indicating approval from a licensor regarding an imaging act and imaging rule information indicating rules concerning imaging, and process the data of a captured image obtained by imaging to conform to rules concerning imaging when imaging is not performed according to the rules concerning imaging while the authorization information is acquired.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to information processing techniques in licensed imaging. [Background technology]

[0002] In recent years, the spread of video sharing sites, smartphones, and low-cost, high-performance imaging devices has led to an increasing demand for personal video production, including video blogs (Vlogs). Examples of video production include images taken while traveling or eating out, or images taken of pets or everyday life. These images are sometimes taken in public places, including restaurants, theme parks, and other commercial facilities. When taking images in public places, consideration for others, such as respecting portrait rights and good manners, is required. Patent Document 1 discloses a technology for preventing image data containing inappropriate content from being uploaded to social networking services. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2024-6289 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology disclosed in Patent Document 1 (hereinafter referred to as the "prior art") makes a unique determination using image data or location information attached to the image data, etc. Therefore, the prior art has a problem in that it is not possible to prove that a captured image has been taken with the approval of a licensee, such as a manager of a commercial facility, etc., related to the object being captured or the location where the image was taken.

[0005] Therefore, an object of the present disclosure is to provide a technology for proving that image capture is being performed in accordance with rules established by a licensing source. [Means for solving the problem]

[0006] The information processing device according to the present disclosure includes an information acquisition means for acquiring approval information indicating that approval has been obtained from a permission source for the imaging act and imaging rule information indicating rules regarding imaging, and a processing means for processing image data obtained by imaging so that it conforms to the rules regarding imaging when imaging is not performed in accordance with the rules regarding imaging when the approval information has been acquired. [Effects of the Invention]

[0007] According to the present disclosure, it is possible to prove that imaging is being performed in accordance with rules established by the licensing source. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram showing an example of a hardware configuration of an imaging apparatus according to a first embodiment. [Figure 2] 1 is a block diagram showing an example of a logical configuration of an imaging device according to a first embodiment. [Figure 3] FIG. 3 is a diagram showing an example of an imaging rule according to the first embodiment. [Figure 4] FIG. 3 is a diagram showing an example of a display screen output to the output device according to the first embodiment. [Figure 5] FIG. 10 is a diagram showing an example of a warning display screen output to the output device according to the first embodiment. [Figure 6] 5 is a flowchart showing an example of a processing flow in the imaging device according to the first embodiment. [Figure 7] 10 is a flowchart showing an example of the flow of a violation detection process according to the first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the configuration for solving the problems of the present disclosure. Although multiple features are described in the embodiments, not all of these multiple features are necessarily required to solve the problems of the present disclosure, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numbers are used to designate identical or similar components, and redundant explanations will be omitted.

[0010] [First embodiment] 1 is a block diagram showing an example of the hardware configuration of an imaging device 101 according to the first embodiment. The imaging device 101 has, as its hardware configuration, a CPU 102, a RAM 103, a ROM 104, a storage medium 105, an operation unit 106, an output I / F (interface) 107, a communication I / F 108, a sensor 110, and an output device 120. The various units that the imaging device 101 has as its hardware configuration are connected to each other via a transmission path such as a system bus so that they can communicate with each other.

[0011] The CPU 102 reads out programs stored in the ROM 104 or the storage medium 105, etc., and loads and executes the programs in the RAM 103, thereby controlling the entire imaging device 101. The ROM 104 is a read-only memory that stores a boot program executed by the CPU 102 when the imaging device 101 is started up, instruction programs for executing various processes, various data, etc. The ROM 104 is not limited to a read-only memory, and may be a readable and writable storage medium such as an HDD (hard disk drive) or an SSD (solid state drive). The RAM 103 is a work memory that temporarily stores programs and data for the CPU 102 to perform processing, and the various programs and data stored in the ROM 104, etc. are loaded into the RAM 103 by the CPU 102.

[0012] Storage medium 105 is a secondary storage area for storing various types of data, such as data of captured images obtained by imaging (hereinafter referred to as "captured image data"). Storage medium 105 is configured from a semiconductor memory such as a memory card. Note that, hereinafter, the terms "captured image" and "image" include both still images and moving images, and moving images will be described as being composed of multiple still images (frames) in time series.

[0013] The output I / F 107 is an interface for transmitting control signals to an output device 120 such as a display device or an audio output device, and the CPU 102 controls the output of the output device 120 by transmitting control signals via the output I / F 107. The output device 120 is a device that outputs visual information or auditory information recognizable to a natural person. The operation unit 106 is composed of switches, buttons, etc., and outputs operation signals corresponding to operations input by a user. The sensor 110 is an image sensor composed of a CCD (Charge Coupled Device) or CMOS (Complementary Metal-Oxide-Semiconductor) element, etc., that converts an optical image into an electrical signal and outputs it.

[0014] The communication I / F 108 is an interface for transmitting and receiving information, data, etc. to and from an external device via the network 109. The imaging device 101 receives data, etc. from an external device and transmits it to the CPU 102 via the communication I / F 108, and transmits data, etc. generated by the CPU 102, to the external device. In the following description, the imaging device 101 is assumed to be connected to a LAN (Local Area Network) via the communication I / F 108, but the network 109 is not limited to a LAN and may be any network. Furthermore, for example, the imaging device 101 may be indirectly connected to the network 109 via a mobile terminal such as a smartphone.

[0015] When analyzing or distributing image data, the imaging device 101 stores the image data in RAM 103 and then executes the processing. The imaging device 101 also stores analysis results, such as the detection of an image of a natural person in an image, in RAM 103. Hereinafter, the CPU 102 will be described as reading a program for controlling the imaging device 101 from ROM 104 or the like, loading the program into RAM 103, and executing it. However, the program may be received from an external device via the communication I / F 108. Furthermore, the entire processing related to the program does not need to be executed by the CPU 102; some or all of the processing may be executed by other processing hardware. Examples of processing hardware include an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), and a graphics processing unit (GPU).

[0016] 2 is a block diagram showing an example of the logical configuration of the imaging device 101 according to the first embodiment. The imaging device 101 has, as its logical configuration, an information processing unit 200, an imaging control unit 210, and an image generation unit 211. The processing of each unit included in the logical configuration of the imaging device 101 is realized by the CPU 102 loading a computer program stored in the ROM 104 or the like into the RAM 103 and executing the program. The information processing unit 200 executes predetermined processing, which will be described later, during imaging performed by the imaging device 101. The information processing unit 200 has an information acquisition unit 201, an approval acquisition unit 202, an analysis unit 204, a determination unit 205, an output control unit 206, a switching unit 207, an image acquisition unit 208, and a storage control unit 209.

[0017] In the information processing unit 200, the information acquisition unit 201 acquires verification information, licensee identification information, and imaging rule information. The verification information is information used when transmitting an approval request to the licensee. Specifically, the verification information is information including information for password authentication, information for accessing an authentication server device, and the like, which are preset by the licensee, and may be any information for obtaining approval from the licensee. The licensee identification information is information indicating an ID (identifier) ​​indicating the licensee or the name of the licensee, and may be any information that can uniquely identify the licensee. The imaging rule information is information indicating rules related to imaging (hereinafter referred to as "imaging rules"), including information indicating objects, etc., that are permitted to be imaged, or information indicating objects, etc., that are prohibited from being imaged, as predetermined by the licensee. Details of the imaging rules will be described later.

[0018] For example, first, a user of the imaging device 101 (hereinafter simply referred to as "user") captures an image of a barcode such as a QR code (registered trademark) using the imaging device 101. Next, the information acquisition unit 201 decodes the barcode contained as an image in the captured image obtained by the imaging, thereby acquiring verification information, license source identification information, and imaging rule information or information for acquiring the imaging rule information. Here, the information for acquiring the imaging rule information (hereinafter referred to as "rule acquisition information") is information for accessing a server device or the like that stores the imaging rule information, and may be any information that can acquire the imaging rule information. When the information acquisition unit 201 acquires the rule acquisition information, the information acquisition unit 201 uses the rule acquisition information to access a server device or the like that stores the imaging rule information, thereby acquiring the imaging rule information. In this case, the information acquisition unit 201 may use at least one of the verification information and the license source identification information to access the server device or the like.

[0019] The verification information and permission source identification information acquired by the information acquisition unit 201 are transmitted to the approval acquisition unit 202 and the switching unit 207. Furthermore, the imaging rule information acquired by the information acquisition unit 201 is transmitted to the determination unit 205 and the storage control unit 209. The method of acquiring the verification information, permission source identification information, imaging rule information, and rule acquisition information is not limited to the method of decoding a barcode, and for example, this information may be acquired via wireless communication or the like.

[0020] Alternatively, the information acquiring unit 201 may acquire the verification information, the licensee identification information, and the imaging rule information by the following method: First, a user captures an image of a barcode such as a QR code (registered trademark) using a camera function of a portable terminal such as a smartphone connected to the imaging device 101. Next, the portable terminal acquires the verification information, the licensee identification information, and the imaging rule information or the rule acquisition information by decoding the barcode contained as an image in the captured image obtained by the imaging, and transmits this information to the imaging device 101. Next, the information acquiring unit 201 acquires this information by receiving the verification information, the licensee identification information, and the imaging rule information or the rule acquisition information transmitted from the portable terminal.

[0021] When the portable terminal acquires rule acquisition information, the information acquisition unit 201 acquires the imaging rule information by using the rule acquisition information received from the portable terminal to access a server device or the like that stores imaging rule information. In this case, the portable terminal may acquire the imaging rule information by using the rule acquisition information to access a server device or the like that stores imaging rule information, and may transmit the acquired imaging rule information to the imaging device 101. Furthermore, in this case, the portable terminal may use at least one of verification information and permission source identification information to access the server device.

[0022] In the information processing unit 200, the approval acquisition unit 202 makes an approval request to the licensee, for example, by transmitting an approval request to an authentication server device using the verification information and licensee identification information transmitted from the information acquisition unit 201. The authentication server device receives the approval request from the image capture device 101 and performs password authentication or the like to transmit information indicating the result of approval of the approval request (hereinafter referred to as "approval information") to the image capture device 101, and the approval acquisition unit 202 acquires this information. The password authentication is performed, for example, using a general public key cryptosystem. The approval information acquired by the approval acquisition unit 202 is transmitted to the switching unit 207.

[0023] In the information processing unit 200, the image acquisition unit 208 acquires captured image data. Details of the image acquisition unit 208 will be described later. The captured image data acquired by the image acquisition unit 208 is transmitted to the analysis unit 204 and the storage control unit 209.

[0024] In the information processing unit 200, the analysis unit 204 analyzes the captured image data transmitted from the image acquisition unit 208 and outputs information (hereinafter referred to as "analysis information") indicating the result of the analysis (hereinafter referred to as "analysis result"). Specifically, the analysis unit 204 identifies, through the analysis, the type of object contained as an image in the captured image and the coordinates indicating the position of the image of the object in the captured image, and outputs analysis information indicating the identification result as the analysis result. The analysis information output by the analysis unit 204 is transmitted to the determination unit 205. For example, the analysis unit 204 analyzes the captured image data by image recognition using a trained model obtained as a result of machine learning, pattern matching, or the like. The analysis method of the captured image data in the analysis unit 204 may be any method as long as it is a method capable of identifying an object contained as an image in the captured image.

[0025] In the information processing unit 200, the determination unit 205 determines whether or not the captured image contains an image of an object that violates the imaging rule, using information indicating the imaging rule (imaging rule information) transmitted from the information acquisition unit 201 and analysis information transmitted from the analysis unit 204. Information (hereinafter referred to as "determination information") indicating the result of the determination by the determination unit 205 (hereinafter referred to as "determination result") is transmitted to the output control unit 206 and the storage control unit 209.

[0026] In the information processing unit 200, the output control unit 206 outputs a warning indicating a violation of the imaging rule (hereinafter simply referred to as the "imaging rule") indicated in the imaging rule information acquired by the information acquisition unit 201, based on the determination information transmitted from the determination unit 205. For example, when the determination result indicated by the determination information indicates that the captured image contains an image of an object that violates the imaging rule, the output control unit 206 outputs a signal indicating the warning to the output device 120, such as a display device or an audio output device, via the output I / F 107. The output device 120 outputs an image or light, or a sound or alarm sound, etc. corresponding to the warning so that it can be visually or audibly recognized by the user of the imaging device 101 (hereinafter simply referred to as the "user"), persons around the user, or persons corresponding to the permission source.

[0027] The output from the output device 120 is not limited to what can be recognized visually or audibly, but may also be what can be recognized tactilely through vibration, etc. Furthermore, the destination to which the warning from the output control unit 206 is output is not limited to the output device 120, and the output control unit 206 may output information indicating the warning to an external device such as a server device or a storage device, and store the information in the external device as log information.

[0028] In the information processing unit 200, the switching unit 207 switches the imaging mode of the imaging device 101 based on the verification information and licensee identification information transmitted from the information acquisition unit 201 and the approval information transmitted from the approval acquisition unit 202. The imaging modes include at least two imaging modes: a normal imaging mode and an approved imaging mode. The normal imaging mode is an imaging mode in which, when imaging by the imaging device 101, imaging is performed in the same manner as imaging by a general digital camera or a smartphone with a camera function, without forcing compliance with imaging rules. In contrast, the approved imaging mode is an imaging mode in which, when imaging by the imaging device 101, capturing of still images and moving images is prohibited until approval is obtained from the licensee, or compliance with imaging rules is forced. When switching the imaging mode, the switching unit 207 transmits mode information indicating the imaging mode after the switch to the image acquisition unit 208 and the imaging control unit 210.

[0029] The imaging control unit 210 controls the sensor 110 based on the mode information transmitted from the switching unit 207, thereby causing the sensor 110 to convert the optical image into an electrical signal. The electrical signal converted by the sensor 110 is transmitted to the image generation unit 211. The image generation unit 211 uses the electrical signal transmitted from the sensor 110 to generate an image corresponding to the electrical signal, i.e., a captured image. Data of the captured image generated by the image generation unit 211 is transmitted to the image acquisition unit 208. The image acquisition unit 208 receives the captured image data transmitted from the image generation unit 211 and thereby acquires the captured image data.

[0030] In the information processing unit 200, the storage control unit 209 outputs the captured image data transmitted from the image acquisition unit 208 to the storage medium 105 or the like based on the determination result transmitted from the determination unit 205, and performs control to store the captured image data in the storage medium 105 or the like. Specifically, when the determination result by the determination unit 205 indicates that the captured image contains an image of an object that violates the imaging rules, the storage control unit 209 processes the captured image data and stores the processed captured image data in the storage medium 105 or the like. More specifically, for example, the storage control unit 209 processes the captured image data so that it becomes captured image data that complies with the imaging rules, and stores the processed captured image data in the storage medium 105 or the like.

[0031] In this embodiment, the storage control unit 209 is described as processing captured image data and storing the processed captured image data in the storage medium 105 or the like, but is not limited to this. For example, if the determination result by the determination unit 205 indicates that the captured image contains an image of an object that violates the imaging rules, the storage control unit 209 may be configured not to store the captured image data. Also, in this embodiment, the storage control unit 209 is described as performing processing of captured image data and storing processing of the captured image data, but the storage control unit 209 may be configured separately as a logical configuration that performs processing processing and a logical configuration that performs storing processing.

[0032] The imaging rules will be described with reference to FIG. 3. FIG. 3 is a diagram showing an example of the imaging rules according to the first embodiment. As shown as an example in FIG. 3, the imaging rules include item values ​​for each of the items of type, detailed type, and level, for example. In FIG. 3, type indicates the type of object that can be imaged by the imaging device 101, and FIG. 3 shows person, table, product, and building as examples of item values ​​corresponding to type. In the example shown in FIG. 3, so-called common or general names such as person and table are used as the item values ​​of type, but any value may be used as long as it can be matched with the analysis result output by the analysis unit 204, and the method of expressing the item value of type may be determined depending on the analysis method of the captured image data.

[0033] Also, in FIG. 3 , the detailed type defines in more detail the type of object that can be captured by the imaging device 101. For example, even if the type item value indicates the same person, when taking a selfie or the like, it is necessary to distinguish the user and a natural person other than the user who has entered the field of view of the imaging device 101 as different natural persons. Also, even if the type item value indicates the same building, it may be necessary to distinguish between the exterior and interior of the building. This also applies when a wall or the like that is part of a building has the type item value. For example, it may be necessary to distinguish between an interior wall and an exterior wall. The detailed type item value is used when such type item values ​​need to be further distinguished. Note that the detailed type item value is not required, and if there is no need to further distinguish the type item values, the detailed type item value need not be set. Also, the detailed type is not a required item. In this case, the type item value may be set to a level equivalent to the item value of the detailed item, as necessary.

[0034] Furthermore, in FIG. 3, the level represents the restriction or condition for capturing an image of each object. For example, as shown as an example in FIG. 3, a person registered in advance, such as a user, may be captured clearly enough to identify the individual. In contrast, a person other than the previously registered person who happens to be present in the captured scene is prohibited from being captured. If the captured image contains images of objects for which a level such as prohibited from being captured or mosaic is specified, areas in the captured image corresponding to these images are subjected to processing such as filling in with a predetermined color or mosaic processing. Furthermore, if the captured image is a moving image, this processing is performed on all frames during the period in which these objects are captured. Through such processing, the captured image is edited into a captured image that conforms to the level (restriction or condition for capturing) specified in the image capture rule, and the edited captured image data is saved.

[0035] Note that if an object whose image is prohibited in the level is captured, the captured image data may not be saved. Furthermore, in this case, if the captured image is a moving image, the data for all frames during the period in which the object is captured may be deleted from the captured image data. Furthermore, if the analysis reveals that the captured image contains an image of an object that does not fall under any of the objects defined in the image capture rules, separate rules regarding image capture may be defined, such as uniformly treating the object as an object that may be captured.

[0036] FIG. 4 is a diagram showing an example of a display screen output to the output device 120 when the approval acquisition unit 202 according to the first embodiment acquires approval information indicating an approval result from the license source. Specifically, FIG. 4A shows an example of a display screen (input screen) when password authentication is performed by the approval acquisition unit 202. The user enters a password into the input screen shown as an example in FIG. 4A and operates the imaging device 101 to transmit an approval request including the password, thereby obtaining approval for imaging from the license source. As a result, the imaging mode of the imaging device 101 transitions to the approved imaging mode. FIG. 4B also shows an example of a display screen when the approval acquisition unit 202 connects the imaging device 101 to an authentication server device, thereby obtaining approval for imaging from the license source. When the imaging device 101 is connected to the authentication server device, the license source performs approval processing via the server device and notifies the imaging device 101 of the approval result. As a result, the imaging mode of the imaging device 101 transitions to the approved imaging mode.

[0037] FIG. 5 is a diagram showing an example of a display screen (warning display screen) output to the output device 120 when an image is captured in violation of the imaging rules in the imaging device 101 according to the first embodiment in the permitted imaging mode. Specifically, the warning display screen shown in FIG. 5 is output when an image is captured in violation of the imaging rules in the imaging device 101 in the permitted imaging mode. For example, the warning display screen is output in a state where output of a live view display or the like is stopped. The warning display screen is output by immediately analyzing captured image data obtained by imaging with the imaging device 101 and determining whether or not the captured image violates the imaging rules. The output of the warning display screen on the output device 120 allows the user to know in real time that he or she is capturing an image of an object that is not permitted under the imaging rules. Furthermore, the output of the warning display screen on the output device 120 allows the user to know in real time that some or all of the captured image data being captured will be processed and saved, or that some or all of the data will not be saved. In the above example, the imaging device 101 outputs a warning display screen to the output device 120 to warn the user that imaging is being performed in violation of imaging rules, but the method of warning is not limited to this.

[0038] For example, the imaging device 101 may output the warning by changing the light-emitting pattern or light-emitting color of a light-emitting device such as a tally lamp provided in the imaging device 101 as the output device 120. Alternatively, for example, the imaging device 101 may output the warning by outputting a warning sound or audio guidance from a speaker provided in the imaging device 101 as the output device 120. Alternatively, for example, the imaging device 101 may transmit information indicating the warning to a mobile terminal such as a smartphone connected to the imaging device 101, and the mobile terminal may output the warning. Alternatively, the imaging device 101 may issue the warning by combining two or more of the above-described multiple warning methods. When a warning is output using a light-emitting device such as a tally lamp or a speaker, it is possible to make not only the user but also people around the user or an administrator who has given permission to the user aware that an image has been captured in violation of the imaging rules.

[0039] The operation of the imaging device 101 will be described with reference to Figures 6 and 7. The processing of the flowcharts shown below is realized by the CPU 102 executing a computer program that realizes each unit that the imaging device 101 shown in Figure 2 has as a logical configuration. Also, some or all of the processing of the flowcharts shown below may be executed by processing hardware. Also, in the following description, the symbol "S" means a step (process).

[0040] FIG. 6 is a flowchart showing an example of a processing flow in the imaging device 101 according to the first embodiment. First, in S601, the information acquisition unit 201 acquires verification information, licenser identification information, and imaging rule information. Note that if the verification information, licenser identification information, and imaging rule information cannot be acquired in S601, specifically, for example, if the read barcode is not for obtaining approval for imaging, the imaging device 101 may terminate the processing of the flowchart shown in FIG. 6. In this case, the imaging device 101 may perform control to prevent the user from capturing images using the imaging device 101. Next, in S602, the approval acquisition unit 202 transmits an approval request to an authentication server device using the verification information and licenser identification information acquired in S601. Next, in S603, the approval acquisition unit 202 acquires approval information indicating the approval result for the approval request transmitted in S602.

[0041] Next, in S604, the switching unit 207 switches the imaging mode of the imaging device 101 to the authorized imaging mode based on the verification information and licenser identification information acquired in S601 and the approval information acquired in S603. Next, in S610, the imaging control unit 210 determines whether imaging by the imaging device 101 has started, for example, by determining whether a record button on the imaging device 101 has been pressed. If it is determined in S610 that recording has not started, the imaging device 101 returns to the processing of S610 and waits until it is determined in S610 that recording has started.

[0042] If it is determined in S610 that recording has started, then in S611 the image acquisition unit 208 acquires captured image data obtained by imaging by the imaging device 101. Specifically, if it is determined in S610 that recording has started, the imaging control unit 210 controls the sensor 110 based on the permitted imaging mode, causing the sensor 110 to convert an optical image into an electrical signal and output the electrical signal. Furthermore, the image generation unit 211 generates a captured image based on the electrical signal output from the sensor 110 and outputs data of the generated captured image. The image acquisition unit 208 acquires the captured image data by receiving the captured image data output from the image generation unit 211. After S611, in S612, the analysis unit 204 analyzes the captured image data acquired in S611 to identify the type of object, etc. included as an image in the captured image, and outputs analysis information indicating the analysis results of the type of the identified object, etc. Next, in S613, the image capture device 101 executes a violation detection process based on the analysis information output in S612 and the image capture rule information acquired in S601.

[0043] The processing flow of S613 will be described with reference to Fig. 7. Fig. 7 is a flowchart showing an example of the flow of violation detection processing according to the first embodiment, and is a flowchart showing an example of the processing flow of S613 shown in Fig. 6. The processing of the flowchart shown in Fig. 7 is executed after S612. First, in S710, the determination unit 205 determines whether or not the captured image data acquired in S611 violates the accepted capturing rule, and outputs determination information indicating the determination result to the output control unit 206 and the storage control unit 209. Specifically, the determination unit 205 refers to the analysis result indicated by the analysis information output in S612 and the capturing rule indicated by the capturing rule information acquired in S601, and determines whether or not the captured image includes an image of an object whose capturing is restricted by the capturing rule.

[0044] If it is determined that the imaging rule approved in S710 is violated, first, in S711, the output control unit 206 outputs a warning to the output device 120, based on the determination information output in S710, indicating that imaging has been performed in violation of the imaging rule. The output control unit 206 may notify the licenser, via a server device or the like, that imaging has been performed in violation of the imaging rule. Next, in S712, the storage control unit 209 assigns metadata indicating the violation to frame data in the captured image data acquired in S611, based on the determination information output in S710. This metadata may include, for example, information indicating the type of object captured in violation of the imaging rule, coordinates indicating the position of the image of the object in the captured image, and the time of capture. Note that the processing of S712 is intended to reduce the processing load on the imaging device 101. If processing such as mosaic processing on the captured image or deletion of partial captured image data can be performed in parallel, the processing of S712 may not be executed.

[0045] Next, in S713, the storage control unit 209 processes the frame data for the period to which metadata was added in S712 by performing processing such as mosaic processing on the frames of the captured image data for that period. The storage control unit 209 may perform processing such as partially deleting the frame data for that period from the captured image data. After S713, or if it is determined that the imaging rule approved in S710 is not violated, the imaging device 101 ends the processing of the flowchart shown in FIG. 7, i.e., the processing of S613 shown in FIG. 6.

[0046] Returning to the description of the flowchart shown in Fig. 6, after S613, i.e., after the processing of the flowchart shown in Fig. 7, in S614 the storage control unit 209 stores the captured image data in the storage medium 105. Specifically, if the frame data has been processed in S713, the storage control unit 209 stores the captured image data including the processed frame data. On the other hand, if the frame data has not been processed in S713, the storage control unit 209 stores the captured image data acquired in S611. More specifically, for example, if the imaging mode is the approved imaging mode, the storage control unit 209 stores the captured image data including the processed frame data to which approval information has been added, and the captured image data acquired in S611. This makes it possible to prove that the stored captured image data has been captured in accordance with the rules established by the approval source.

[0047] Next, in S615, the image acquisition unit 208 determines whether or not imaging by the imaging device 101 has ended, for example, by determining whether a recording stop button on the imaging device 101 has been pressed. If it is determined in S615 that recording has not ended, the imaging device 101 returns to the process of S611 and repeatedly executes the processes from S611 to S615 until it is determined in S615 that recording has ended. If it is determined in S615 that recording has ended, the switching unit 207 determines in S620 whether or not the authorized imaging mode has been canceled. The authorized imaging mode may be canceled at the user's discretion, or may be canceled at any time from an authentication server device or the like. Alternatively, the authorized imaging mode may be automatically canceled when the imaging device 101 moves out of the authorized imaging range, using location information from the imaging device 101 or a mobile terminal such as a smartphone connected to the imaging device 101.

[0048] If it is determined in S620 that the permitted imaging mode has not been canceled, that is, if the permitted imaging mode is continuing, the imaging device 101 returns to the processing of S610 and waits until imaging is resumed. If it is determined in S620 that the permitted imaging mode has been canceled, first, in S621, the switching unit 207 cancels the permitted imaging mode and switches the imaging mode to the normal mode. Next, in S622, the imaging device 101 deletes various unnecessary information acquired in S601, etc. After S622, the imaging device 101 ends the processing of the flowchart shown in FIG. 6.

[0049] The imaging device 101 configured as described above can reduce the burden on the user and the licensing authority regarding imaging permission. Furthermore, the imaging device 101 can prevent the storage of captured image data obtained by imaging that violates imaging rules established by the licensing authority. Furthermore, the imaging device 101 can prove that imaging is being performed in accordance with the rules established by the licensing authority.

[0050] [Other embodiments] In the above embodiment, the information processing unit 200 has been described as operating as a logical component of the imaging device 101, but the information processing unit 200 may also operate as a logical component of an information processing device configured by a personal computer, a server device, etc. In this case, for example, the information processing device acquires a signal indicating a captured image output from the imaging device 101 or data of the captured image, and executes processing equivalent to that of the information processing unit 200.

[0051] The present disclosure can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0052] It should be noted that within the scope of the present disclosure, the embodiments may be freely combined, any component of each embodiment may be modified, or any component of each embodiment may be omitted.

[0053] [Configuration of the present disclosure] The present disclosure includes the following configurations, methods, and programs.

[0054] <Configuration 1> an information acquisition means for acquiring approval information indicating that approval has been obtained from a licensee regarding the imaging act, and imaging rule information indicating rules regarding imaging; a processing means for processing the captured image data obtained by the imaging so that the captured image data conforms to the rules regarding imaging when the imaging is not performed in accordance with the rules regarding imaging in a state where the approval information has been acquired; An information processing device comprising:

[0055] <Configuration 2> the information acquisition means acquires verification information for obtaining approval from a licensee regarding the imaging act, and acquires the approval information using the verification information; 2. The information processing device according to configuration 1,

[0056] <Configuration 3> when the captured image is a moving image, the processing means processes data of frames of the captured image that have not been captured in accordance with the rules regarding imaging so that the data conforms to the rules regarding imaging; 3. The information processing device according to configuration 1 or 2, characterized in that:

[0057] <Configuration 4> the processing means processes the captured image data so that it conforms to the rules regarding imaging by deleting data of frames that have not been captured in accordance with the rules regarding imaging from the captured image data; 4. The information processing device according to configuration 3,

[0058] <Configuration 5> the imaging rule information includes at least one of information indicating a type of object that is permitted to be imaged and information indicating a type of object that is prohibited from being imaged; 5. The information processing device according to any one of configurations 1 to 4, characterized in that:

[0059] <Configuration 6> The imaging rule information includes type information indicating a type of an object and condition information indicating an imaging condition for the object, the type information being associated with the condition information, and the processing means processes the data of the captured image so that an image of the object included in the captured image satisfies the imaging condition; 6. The information processing device according to any one of configurations 1 to 5,

[0060] <Configuration 7> a switching means for selecting and switching one of a plurality of processing modes including a first processing mode in which the captured image data is processed in accordance with the rule regarding imaging, and a second processing mode in which the captured image data is not processed; and the switching means selects and switches to the first processing mode when the approval information has been acquired; 7. The information processing device according to any one of configurations 1 to 6,

[0061] <Configuration 8> an analysis means for analyzing the captured image to identify the type of object contained in the captured image; and the processing means processes data of the captured image based on the rule regarding imaging and the result of the analysis when the captured image includes an image other than an object whose image is permitted to be captured under the rule regarding imaging; 8. The information processing device according to any one of configurations 1 to 7,

[0062] <Configuration 9> the analysis means analyzes the captured image to identify a type of object included as an image in the captured image and a position of the image of the object in the captured image; the processing means processes the data of the captured image based on the rules regarding imaging and the result of the analysis, when the captured image contains an image other than an object whose image is permitted to be captured in the rules regarding imaging, by processing the captured image so that the image other than the object whose image is permitted to be captured in the rules regarding imaging cannot be identified; 9. The information processing device according to configuration 8,

[0063] <Configuration 10> the processing means processes an area included in the captured image corresponding to an image of an object other than those permitted to be captured under the rules regarding imaging, by performing at least one of a mosaic process, a filling process, and a deletion process, so that the image cannot be identified; 10. The information processing device according to configuration 9,

[0064] <Configuration 11> an output means for outputting a warning that the rules regarding imaging are violated when an image of an object other than an object permitted to be imaged under the rules regarding imaging is captured; further comprising: 11. The information processing device according to any one of configurations 1 to 10, characterized in that:

[0065] <Configuration 12> a storage control means for storing the captured image data in a storage medium; and the storage control means, when the captured image data has been processed so as to conform to the rules regarding imaging, stores the processed captured image data in the storage medium; 12. The information processing device according to any one of configurations 1 to 11,

[0066] <Configuration 13> the storage control means, when the approval information has been acquired, stores the data of the captured image to which the approval information has been added and the data of the captured image after processing in the storage medium; 13. The information processing device according to configuration 12,

[0067] <Configuration 14> a device control means for controlling the imaging device so that the imaging device cannot capture an image when the approval information has not been acquired; further comprising: 14. The information processing device according to any one of configurations 1 to 13,

[0068] <Configuration 15> An information processing device according to any one of configurations 1 to 14; An imaging means; a generation unit that generates the captured image by controlling the imaging unit; An imaging device comprising:

[0069] <Method> an information acquisition step of acquiring approval information indicating that approval for the imaging act has been obtained from a licensee and imaging rule information indicating rules regarding imaging; a processing step of processing the captured image data obtained by the imaging so that it complies with the rules regarding imaging when the imaging has not been performed in accordance with the rules regarding imaging after the approval information has been acquired; An information processing device comprising:

[0070] <Program> A program for causing a computer to function as the information processing device according to any one of configurations 1 to 14. [Explanation of symbols]

[0071] 200 Information Processing Department 201 Information acquisition department 202 Approval Department 209 Storage Control Unit

Claims

1. an information acquisition means for acquiring approval information indicating that approval has been obtained from a licensee regarding the imaging act, and imaging rule information indicating rules regarding imaging; a processing means for processing the captured image data obtained by the imaging so that the captured image data conforms to the rules regarding imaging when the imaging is not performed in accordance with the rules regarding imaging in a state where the approval information has been acquired; An information processing device comprising:

2. the information acquisition means acquires verification information for obtaining approval from a licensee regarding the imaging act, and acquires the approval information using the verification information; 2. The information processing device according to claim 1,

3. when the captured image is a moving image, the processing means processes data of frames of the captured image that have not been captured in accordance with the rules regarding imaging so that the data conforms to the rules regarding imaging; 2. The information processing device according to claim 1,

4. the processing means processes the captured image data so that it conforms to the rules regarding imaging by deleting data of frames that have not been captured in accordance with the rules regarding imaging from the captured image data; 4. The information processing device according to claim 3,

5. the imaging rule information includes at least one of information indicating a type of object that is permitted to be imaged and information indicating a type of object that is prohibited from being imaged; 2. The information processing device according to claim 1,

6. The imaging rule information includes type information indicating a type of an object and condition information indicating an imaging condition for the object, the type information being associated with the condition information, and the processing means processes the data of the captured image so that an image of the object included in the captured image satisfies the imaging condition; 2. The information processing device according to claim 1,

7. a switching means for selecting and switching one of a plurality of processing modes including a first processing mode in which the captured image data is processed in accordance with the rule regarding imaging, and a second processing mode in which the captured image data is not processed; and the switching means selects and switches to the first processing mode when the approval information has been acquired; 2. The information processing device according to claim 1,

8. an analysis means for analyzing the captured image to identify the type of object contained in the captured image; and the processing means processes data of the captured image based on the rule regarding imaging and the result of the analysis when the captured image includes an image other than an object whose image is permitted to be captured under the rule regarding imaging; 2. The information processing device according to claim 1,

9. the analysis means analyzes the captured image to identify a type of object included as an image in the captured image and a position of the image of the object in the captured image; the processing means processes the data of the captured image based on the rules regarding imaging and the result of the analysis, when the captured image contains an image other than an object whose image is permitted to be captured in the rules regarding imaging, by processing the captured image so that the image other than the object whose image is permitted to be captured in the rules regarding imaging cannot be identified; 9. The information processing device according to claim 8,

10. the processing means processes an area included in the captured image corresponding to an image of an object other than those permitted to be captured under the rules regarding imaging, by performing at least one of a mosaic process, a filling process, and a deletion process, so that the image cannot be identified; The information processing device according to claim 9 .

11. an output means for outputting a warning that the rules regarding imaging are violated when an image of an object other than an object permitted to be imaged under the rules regarding imaging is captured; further comprising:

2. The information processing device according to claim 1,

12. a storage control means for storing the captured image data in a storage medium; and the storage control means, when the captured image data has been processed so as to conform to the rules regarding imaging, stores the processed captured image data in the storage medium; 2. The information processing device according to claim 1,

13. the storage control means, when the approval information has been acquired, stores the data of the captured image to which the approval information has been added and the data of the captured image after processing in the storage medium; The information processing device according to claim 12 .

14. a device control means for controlling the imaging device so that the imaging device cannot capture an image when the approval information has not been acquired; further comprising:

2. The information processing device according to claim 1,

15. An information processing device according to any one of claims 1 to 14; An imaging means; a generation unit that generates the captured image by controlling the imaging unit; An imaging device comprising:

16. an information acquisition step of acquiring approval information indicating that approval for the imaging act has been obtained from a licensee and imaging rule information indicating rules regarding imaging; a processing step of processing the captured image data obtained by the imaging so that it complies with the rules regarding imaging when the imaging has not been performed in accordance with the rules regarding imaging after the approval information has been acquired; An information processing device comprising:

17. A program for causing a computer to function as the information processing device according to any one of claims 1 to 14.

Images