PHOTOGRAPHING BEHAVIOR ANALYSIS SYSTEM, PHOTOGRAPHING BEHAVIOR ANALYSIS METHOD, AND PHOTOGRAPHING BEHAVIOR ANALYSIS PROGRAM

Abstract

To provide a technology capable of estimating the preferences of an image photographer by performing behavioral analysis on the image photographer rather than the image viewer with regard to images widely published on SNS etc. [Solution] The system includes a shooting content judgment unit 1 that analyzes the content of an image taken by the photographer, a shooting mode judgment unit 2 that analyzes the shooting mode of the photographer when taking the image, a utilization mode judgment unit 3 that analyzes the mode in which the image is used by the photographer, a photographer preference information generation unit 4 that generates photographer preference information, which is information regarding the preferences of the photographer of the image, based on the analysis results of the shooting content judgment unit 1, the shooting mode judgment unit 2, and the utilization mode judgment unit 3, and a token generation unit 5 that generates a photographer token, which is a non-fungible token that corresponds to the photographer.

Description

[Technical field]

[0001] The present invention relates to a technique for analyzing photographer preferences through analysis of characteristics of photography behavior. [Background technology]

[0002] Cameras, which were once owned and used only by experts or a select few enthusiasts, have become more widely available as prices have fallen. Today, with the widespread use of portable information terminals such as smartphones equipped with digital cameras, every citizen owns a camera, and pictures are taken in all sorts of situations, including in daily life, when traveling, and when attending events.

[0003] In addition, with the widespread use of digital cameras, it is now possible to utilize captured images as digital images, and with the rapid increase in the number of users of online social networking services (SNS) to which images can be attached, the means by which captured images can be used have become more diverse. As a result, captured images can now be used in a variety of ways.

[0004] For example, Patent Document 1 discloses a technology relating to an assist function that infers the intention of the user when taking an image for the purpose of sharing it on a social networking site, etc., and then displays a guide so as to enable the user to take an image in accordance with the intention. Patent Document 2 discloses a technology that obtains information on non-verbal feedback from viewers when a video, which is one of the images, is distributed on the Internet, thereby determining an objective evaluation of the video posted by the viewer. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2022-55656 [Patent Document 2] JP 2023-36740 A Summary of the Invention [Problem to be solved by the invention]

[0006] Because Internet services such as SNS have an extremely large number of users, the behavioral history of the users, such as purchasing activities and viewing of advertising content, is analyzed to analyze the users' preferences and conduct marketing research, and many technologies related to such analysis and research have been made public. However, users are aware that such analysis and research is being conducted, and as a result, they take measures such as intentionally taking countermeasures to prevent excessive display of advertising content, etc., resulting in a so-called cat-and-mouse game situation, which is causing a problem of a decrease in the accuracy of the analysis and research.

[0007] On the other hand, as described above, in a situation where image capture devices are widely owned by the general public and the means of using captured images are diversifying, it is common for users of online services such as SNS to not only view image content, but also share images that they have taken themselves. While such user behavior also reflects the user's preferences, beliefs, etc., no technology has been disclosed for analyzing such photographic behavior, and Patent Documents 1 and 2 make no mention of it whatsoever.

[0008] The present invention has been made in consideration of the above-mentioned problems, and has an object to provide a technique capable of estimating the preferences of an image photographer by performing a behavioral analysis on the image photographer rather than the image viewer. [Means for solving the problem]

[0009] In order to achieve the above object, the photographing behavior analysis system according to claim 1 is a photographing behavior analysis system that analyzes the photographing behavior of a photographer, and identifies a photographing subject included in a photographed image as a photographing content of an image photographed by the photographer, and determines a type of the photographing subject. analysisa photographing mode determination means for determining, as a photographing mode at the time of photographing the photographed image, one or more of a type of a place where the photographed image was taken, a type of the photographer's actions before and after the photographing, and a type of photographing equipment used by the photographer at the time of photographing; a utilization mode determination means for determining, as a utilization mode of the photographed image by the photographer, one or more of an output mode, which is information regarding the presence or absence of processing of the photographed image and, if processing has been performed, the content of the processing, a type of one or more of a medium / output area on which the photographed image is output and an output device used to output the photographed image, and a disclosure range of the output photographed image; and a photographer preference information generation means for generating photographer preference information, which is information regarding the preferences of the photographer who took the photographed image, based on the determination results of the photographing content analysis means, the photographing mode determination means, and the utilization mode determination means. An information generating means for generating information including the photographer preference information regarding the photographer, the information being recorded in a distributed ledger on a distributed network corresponding to a non-fungible token that is in a corresponding relationship with the photographer; and an output instruction means for instructing the distributed network to output the information generated by the information generating means. The present invention is characterized by comprising:

[0011] In order to achieve the above object, the following claims are provided: 2 The photography behavior analysis system of the above invention is characterized in that it further comprises photographer preference information acquisition means for acquiring the photographer preference information from information recorded in the distributed ledger, information provision means for providing the photographer with warning information corresponding to the acquired photographer preference information, reaction information acquisition means for acquiring reaction information including information regarding whether or not the photographer has responded to the provided warning information and the content of the reaction if a reaction has been made, and information correction means for determining whether the photographer preference information is correct based on the acquired reaction information and correcting the photographer preference information if it is determined to be incorrect.

[0012] In order to achieve the above object, a photographing behavior analysis method according to claim 3 is a photographing behavior analysis method for analyzing photographing behavior by a photographer, comprising: a photographing content analysis step of identifying a photographing object contained in a photographed image as a photographing content of an image photographed by the photographer and determining a type of the photographing object; a photographing mode determination step of determining, as a photographing mode at the time of photographing the photographed image, one or more of a type of a place where the photographed image was taken, a type of the photographer's behavior before and after the photographing, and a type of photographing equipment used by the photographer at the time of photographing; a utilization mode determination step of determining, as a utilization mode of the photographed image by the photographer, one or more of an output mode, which is information regarding the presence or absence of processing of the photographed image and, if processing has been performed, the content of the processing, a medium / output area on which the photographed image is output, and a type of one or more of an output device used to output the photographed image, and a public range of the output photographed image; and a photographer preference information generation step of generating photographer preference information, which is information regarding the preferences of the photographer who photographed the photographed image, based on the determination results of the photographing content analysis step, the photographing mode determination step, and the utilization mode determination step. an information providing step of providing the photographer with attention-calling information corresponding to the photographer preference information; a reaction information acquiring step of acquiring reaction information including information regarding the presence or absence of a reaction of the photographer to the provided attention-calling information and the content of the reaction if a reaction is made; and an information correcting step of determining whether the photographer preference information is correct or not based on the acquired reaction information and correcting the photographer preference information if it is determined to be incorrect. The present invention is characterized by including:

[0014] In order to achieve the above object, the photography behavior analysis program according to claim 6 is a photography behavior analysis program that causes a computer to analyze photography behavior by a photographer, and includes a photography content analysis function for identifying a photography subject included in a photographed image as a photography content of an image photographed by the photographer and determining a type of the photography subject, a photography mode determination function for determining one or more of a type of a place where the photographed image was taken, a type of the photographer's behavior before and after the photographing, and a type of photography equipment used by the photographer when the photographing was taken, as a photography mode at the time of photographing the photographed image, a utilization mode determination function for determining one or more of an output mode, which is information regarding the presence or absence of processing of the photographed image and, if processing has been performed, the content of the processing, a medium / output area on which the photographed image is output, and a type of one or more of an output device used to output the photographed image, and a publication range of the output photographed image, as a utilization mode of the photographed image by the photographer, and a photographer preference information generation function for generating photographer preference information, which is information regarding the preferences of the photographer who took the photographed image, based on the determination results by the photography content analysis function, the photography mode determination function, and the utilization mode determination function. an information providing function for providing the photographer with warning information corresponding to the photographer preference information; a reaction information acquiring function for acquiring reaction information including information regarding the presence or absence of a reaction by the photographer to the provided warning information and the content of the reaction if a reaction is made; and an information correcting function for determining whether the photographer preference information is correct based on the acquired reaction information and correcting the photographer preference information if it is determined to be incorrect; The present invention is characterized in that the above-mentioned is executed. Effect of the Invention

[0015] According to the present invention, it is possible to estimate the preferences of an image photographer by performing a behavioral analysis on the image photographer. [Brief description of the drawings]

[0016] [Figure 1] FIG. 1 is a schematic diagram illustrating a configuration of a photographing behavior analysis system according to a first embodiment. [Diagram 2] FIG. 11 is a schematic diagram showing a configuration of a photographing behavior analysis system according to a second embodiment. [Diagram 3] 13 is a flowchart showing a process of correcting photographer preference information in the photographing behavior analysis system according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, the embodiments of the present invention will be described in detail with reference to the drawings. In the following embodiments, examples considered to be the most appropriate embodiments of the present invention will be described, and it goes without saying that the contents of the present invention should not be interpreted as being limited to the specific examples shown in the present embodiments. Of course, any configuration that achieves the same action and effect, even if it is a specific configuration other than that shown in the embodiments, is included in the technical scope of the present invention.

[0018] (Embodiment 1) First, a photographing behavior analysis system according to the first embodiment will be described. As shown in Fig. 1, the photographing behavior analysis system according to the first embodiment includes a photographing content determination unit 1 that analyzes the content of an image photographed by a photographer, a photographing mode determination unit 2 that analyzes the photographing mode of the photographer when the image is photographed, a utilization mode determination unit 3 that analyzes the utilization mode of the image by the photographer, a photographer preference information generation unit 4 that generates photographer preference information that is information on the preferences of the photographer of the image based on the analysis results of the photographing content determination unit 1, the photographing mode determination unit 2, and the utilization mode determination unit 3, a token generation unit 5 that generates a photographer token that is a non-fungible token corresponding to the photographer, and a holder of the photographer token. the transaction generation unit 6 generating a transaction to be stored in a block in a distributed ledger corresponding to the photographer token as information including information regarding the photographer and photographer preference information; an electronic signature generation unit 7 generating an electronic signature which is data proving that the generation and output of the information included in the transaction is in accordance with the intentions of the holder of the photographer token; an output unit 8 instructing the transaction and the electronic signature to be output to a distributed network associated with the photographer token; and a photographer preference information acquisition unit 9 accessing the distributed network to acquire the photographer preference information included in the transaction.

[0019] The shooting content determination unit 1 is for analyzing the contents of an image taken by a photographer. The image to be analyzed may be any image taken by a photographer, and may be either a still image or a video, or may be either 2D or 3D. The term "taken by a photographer" includes not only a case where a photographer presses the shutter after checking an image displayed in the viewfinder of a general camera, but also a case where an image is acquired under the specific direction and supervision of the photographer with respect to composition, shooting timing, etc. Specifically, the shooting content determination unit 1 includes a shooting image input unit 11 that inputs a shooting image, an object identification unit 12 that identifies an image part that is assumed to correspond to a shooting object among image parts included in the shooting image, a type determination unit 13 that performs type determination of the shooting object identified by the object identification unit 12, and an image content information generation unit 14 that generates image content information that is information including the determination result by the type determination unit 13.

[0020] The photographed image input unit 11 is for inputting an image photographed by a photographer. As a specific configuration, any configuration may be used as long as it has a function of inputting image data output from a digital camera, a smartphone, etc. Furthermore, the photographed image input unit 11 may be configured not only to input image data as electronic data, but also to have a camera function or a scanner function of optically reading a printed photographed image.

[0021] The object identification unit 12 is for identifying a photographing object, which is an object intentionally photographed by a photographer, in a photographed image inputted via the photographed image input unit 11. Specifically, the object identification unit 12 identifies what is photographed in the photographed image using an image recognition technique, and then identifies the photographing object based on the size (for example, a larger object is more likely to be determined as a photographing object), position (for example, an object located near the center is more likely to be determined as a photographing object), focus (for example, an object in focus is more likely to be determined as a photographing object), and the like of the recognized object (person, building, etc.) in the photographed image. Note that the photographing object identified by the object identification unit 12 does not need to be limited to one for each photographed image, and multiple photographing objects (for example, person A, person B, person C) may be identified in the same photographed image. Alternatively, the system may be configured to simply identify as the subject of the photograph anything other than something that is not clearly the subject of the photograph, such as a background that has simply appeared by chance, or it may use a method of identifying the subject of the photograph by also referring to images taken before and after the target photographed image, for example a method of identifying as the subject of the photograph only something that is captured in multiple images, including images taken before and after.

[0022] The type determination unit 13 is for determining the type of the photographing object identified by the object identification unit 12. The "type" determined by the type determination unit 13 refers to information on the attributes of the photographing object and / or information that identifies the photographing object itself. For example, if the photographing object is Kinkakuji Temple in Kyoto Prefecture, the type determination unit 13 determines the type of the photographing object as one of the "types" in addition to information on the attributes such as "architecture," "Buddhist temple," "tourist facility," and "historic building in Kyoto." Similarly, if the photographing object is a specific person, the type determination unit 13 determines the name, title, etc. that identifies the person as one of the "types" in addition to information on the attributes such as "human," "male," and "born in 1980." Furthermore, if the photographing object is an event such as a concert (or a specific person performing at the event), the type determination unit 13 determines the "type" as well as the specific performer name, event name, and the like as well as "music concert," "Western rock concert," etc. The type determination process by the type determination unit 13 preferably searches for images that are identical or similar to the image portion identified as the photographing object in a predetermined database or public information on the Internet, and performs type determination from descriptions of the discovered similar images, or may perform type determination while referring to the photographer's comments, etc. Note that, although the first embodiment is configured to determine a plurality of pieces of information as the "type," a simpler configuration may be used in which only any one of the attribute information and the specific information is determined as the "type."

[0023] The image content information generating unit 14 generates image content information, which is information about the contents of the captured image and is a result of the determination of the captured content, including information about the type of the captured object determined by the type determining unit 13, in association with the target captured image. The image content information generating unit 14 preferably generates image content information in a format that includes information about the image part corresponding to the captured object (e.g., size and position in the entire captured image) and information about the photographer's interest in the captured object (e.g., information inferring "high interest" based on the fact that the object has been captured many times in images captured before and after, and that the object is captured large enough to cover the entire screen), in addition to information about the type, but may also include only information about the type. The image content information generated by the image content information generating unit 14 is output to the photographer preference information generating unit 4, which generates photographer preference information based on the image content information.

[0024] The photographing mode determination unit 2 is for analyzing the photographing mode (for example, where, under what circumstances, using what equipment, etc.) at the time of photographing the photographed image inputted via the photographed image input unit 11. Specifically, the photographing mode determination unit 2 includes a photographing location determination unit 15 for determining the position of the photographer at the time of photographing, a photographing situation determination unit 16 for determining the situation at the time of photographing, a photographing equipment determination unit 17 for determining the photographing equipment used for photographing, and a photographing mode information generation unit 18 for generating photographing mode information, which is information on the photographing mode, based on the determination results of the photographing location determination unit 15, the photographing situation determination unit 16, and the photographing equipment determination unit 17. Note that, although the photographing behavior analysis system according to the first embodiment employs a configuration including all of the photographing location determination unit 15, the photographing situation determination unit 16, and the photographing equipment determination unit 17, a configuration in which the photographing mode determination unit 2 includes only some of these may be employed as a simpler configuration.

[0025] The photographing location determination unit 15 is for determining the type of the photographing location where the target photographed image was taken. The type of the photographing location, like the type of the image content, refers to information on the attributes of the photographing location and / or information that identifies the photographing location itself. Specifically, the photographing location determination unit 15 determines the type of the photographing location by extracting the location information when the image data of the photographed image includes the location information of the photographing location, by inputting the recorded information from the photographing device when the location at the time of photographing is recorded in the photographing device, by using the location of the photographing object when the location of the contents of the photograph (for example, the photographing object) is clear, or by using the location information of the photographing device when the photographing device is a fixed device (for example, a passport photo machine or a photographing dome for 3D photography). It is preferable that the photographing location determination unit 15 includes, as the location information, not only information on the specific coordinates (longitude, latitude, etc.) of the photographing location but also geographical information of the area to which the photographing location belongs (for example, type information such as "tourist spot" or "entertainment district" or specific information such as "Shibuya Center Street"). Note that the geographical information is information regarding the "location of the photo shoot" and is different from the type information regarding the object of the photo shoot (for example, the name of an individual building) (for example, the geographical information regarding the location of the photo shoot would be "Tokyo Disneyland," and the type information regarding the object of the photo shoot would be "Cinderella Castle.") However, the distinction between the two is not strict, and overlap between the two may occur.

[0026] The photographing situation determination unit 15 is for determining the type of the photographer's behavioral situation before and after the photographing of the target photographed image. The type of the photographer's behavioral situation refers to information on the attributes of the behavioral situation and / or information that specifies the behavioral situation itself, similar to the type of image content. Specifically, the photographing situation determination unit 15 determines whether the photographer is moving at the time of photographing, or is stationary without moving for photographing or for a certain period including the time of photographing, for example, from information on the time fluctuation of the position information. The time fluctuation of the position information may be detected or estimated from the photographing date and time and the position information recorded in the multiple photographed images, or may be detected by inputting data generated by a position detection function of a GPS device or the like built into the photographing device or the portable information terminal held by the photographer. The photographing situation determination unit 15 may also detect the behavioral state at the time of photographing and before and after photographing (for example, moving on foot, moving in a car, working at a certain place without moving, completely stationary without moving or performing any action, etc.) based on the measurement results of an acceleration sensor built into the photographing device or the portable information terminal held by the photographer.

[0027] The photographic equipment determination unit 17 is for determining what photographic equipment was used to take the target photographic image. Specifically, the photographic equipment determination unit 17 has a function of determining at least one of a specific name that identifies the photographic equipment and a category to which the photographic equipment belongs (a camera attached to a smartphone, a digital single-lens reflex camera, a photo ID camera, a photographic dome for 3D photography, etc.). As a method of determining the photographic equipment by the photographic equipment determination unit 17, for example, when information on the photographic equipment is included in the data of the photographic image, the specific name and category of the photographic equipment may be determined by extracting the information, or the specific name and category of the photographic equipment may be determined by directly acquiring information from the photographic equipment or inputting information created by the photographer.

[0028] The shooting mode information generating unit 18 is for generating shooting mode information as a result of the determination of the shooting mode, which is information related to the shooting location determining unit 15, the shooting situation determining unit 16, and the shooting equipment determining unit 17 based on the determination results of these. Specifically, the shooting mode information generating unit 18 generates shooting mode information as information including at least one or more pieces of information (preferably all of the information) among the specific coordinates of the shooting location, geographical information of the shooting location, information on the movement and operation mode of the photographer, and information on the name and category of the shooting equipment, in association with the target photographed image. The shooting mode information generated by the shooting mode information generating unit 18 is output to the photographer preference information generating unit 4, and the photographer preference information generating unit 4 generates photographer preference information based on the shooting mode information in addition to the image content information.

[0029] The utilization mode determination unit 3 is for analyzing the utilization mode by the photographer of the target photographed image. Specifically, the utilization mode determination unit 3 is for analyzing the presence / absence and content of image processing on the photographed image photographed by the photographer, the output mode of the image, the presence / absence and the extent of disclosure of the image, etc. Specifically, the utilization mode determination unit 3 includes a utilization image input unit 20 that inputs information on the utilization image to be utilized associated with the photographed image, a processing content determination unit 21 that compares the input utilization image with the photographed image to extract differences caused by processing, an output mode determination unit 22 that determines the output mode of the utilization image, a disclosure range determination unit 23 that determines the presence / absence of disclosure of the utilization image and, if disclosed, the disclosure level, and a utilization mode information generation unit 24 that generates utilization mode information including information on the determination results of the processing content determination unit 21, the output mode determination unit 22, and the disclosure range determination unit 23.

[0030] The utilization image input unit 20 is for inputting information about a utilization image generated based on a target photographed image. The term "utilized image" is a concept that includes not only an image that has been subjected to a certain processing process on a photographed image, but also the photographed image itself that has not been subjected to any processing, and includes all images that a photographer uses when utilizing the image. The term "information about the utilization image" includes not only the content (image data) of the utilization image itself, but also preferably information about the medium in which the utilization image is published and the publication settings of the medium. Regarding the association between the utilization image and the photographed image, if no processing process has been performed, an image whose image content matches the photographed image may be used as the utilization image. If some processing process has been performed, for example, if the image data has a layered structure and the layer corresponding to the processing process can be separated, the processing layer is separated and compared with the photographed image, and if there is a considerable degree of match, it is determined that the utilization image has been generated based on the photographed image. If the layer corresponding to the processing process cannot be separated, each image is compared as a whole, and if there is a considerable degree of matching, or if there is a certain percentage or more of a portion in which it is possible to estimate that a difference has occurred due to processing, it is determined that the utilization image has been generated based on the photographed image.

[0031] The processing content determination unit 21 is for determining whether or not a processing process has been performed on the original photographed image for the processed image inputted via the utilization image input unit 20, and if processing has been performed, the content of the processing. The processing content determination unit 21, for example, compares the image data of the processed image and the photographed image, and determines that no processing has been performed if the difference is equal to or less than a certain percentage, and determines that processing has been performed if there is a difference exceeding a certain percentage. In addition, when the processed image has a layered structure and the processing layer can be separated, the processing content determination unit 21 separates and extracts the processing layer to determine the processing content, and when the processing layer cannot be separated and extracted, the processing content determination unit 21 compares the processed image and the photographed image at the image data level, determines the difference as the processing part, and estimates the processing content. The processing content determination unit 21 may, for example, be configured as a group of information indicating how the pixel at a specific position has changed, but more preferably, the processing content is determined to be a content that clearly indicates the meaning of the processing, such as the eyes being processed to be larger in a human image, or the skin being processed to be whiter.

[0032] The output mode determination unit 22 is for determining the output mode of the processed image. The "output mode" includes not only the case where the visual content of the processed image is output on a physical medium such as photographic paper, but also the case where image data is electronically output to a predetermined computer program, a service on the Internet, etc. In the first embodiment, the "output mode" also includes information on the output area (including both the meaning as a geographical area and the meaning as a virtual area such as a URL on the Internet). When the output mode is output on a physical medium, the output mode determination unit 22 determines, for example, the contents of the medium, the output area, and the device used for output. In this case, it is preferable to determine the type, classification, or categorical concept in addition to the specific name for each of the medium, output area, and output device. For example, the output mode determination unit 22 determines the specific name of the medium as photographic paper, the category as "sheet-like medium," the specific location information and category as "convenience store" for the output area, and the specific model name and category as "color printer" for the output device.

[0033] Similarly, when the image data is electronically output as the output mode, the output mode determination unit 22 determines, for example, the output medium, the output area (the position in the virtual space such as the URL), and the output device, and determines, for example, the specific name of the Internet service as the output medium and the category "SNS", the specific URL as the output area and the category "shopping mall", the specific name of the server device as the output device and the category "cloud server". Note that when the image data is electronically output, the output medium, the output area, and the output device may conceptually overlap, so that the determination process may be performed only on some of the items rather than all of these items. Similarly, even when the image data is output on a physical medium, the determination process may be simplified and performed only on some of the items. Furthermore, it may be possible to determine either the specific name or the category for each item. The determination process in the output mode determination unit 22 is performed by searching for image data that is the same as or similar to the image data of the processed image to grasp the fact that it has been output, and judging information such as the output area based on the output fact and public information on the Internet, etc. In addition, a configuration may be adopted in which information such as the contents of the processed image, the output area, etc., of the processed image is output to the output mode determination unit 22 from the output device used to output the processed image for each output.

[0034] The disclosure range determination unit 23 is for determining whether the utilized image is disclosed and, if disclosed, the disclosure level. Specifically, the disclosure range determination unit 23 has a function of determining the extent to which the utilized image is disclosed, such as undisclosed (only the photographer can view), fully disclosed (everyone in the world can view), or partially disclosed (only a limited number of people can view), for each output mode determined by the output mode determination unit 22. The disclosure range determination unit 23 may determine the disclosure range for each output mode determined by the output mode determination unit 22, for example, by decoding the disclosure information displayed on the SNS on which the processed image is posted, or may determine the disclosure range based on the access results from multiple accounts (for example, viewable from account A, not viewable from account B). More simply, the disclosure range may be estimated from the output mode itself (for example, when a processed image that has not been subjected to any processing is physically output on photographic paper by a color printer in a convenience store, it is assumed that the image will not be disclosed and will be stored for record purposes, and therefore it is determined to be "undisclosed").

[0035] The utilization mode information generating unit 24 is for generating utilization mode information as a utilization mode determination result, which is information related to the processing content determining unit 21, the output mode determining unit 22, and the disclosure range determining unit 23, based on the determination results of these. Specifically, the utilization mode information generating unit 24 generates utilization mode information that includes at least one or more pieces of information (preferably all of the information) among the presence / absence and content of processing, information regarding the output medium, output area, and output device of the processed image, and information regarding the presence / absence and range of disclosure of the output processed image, in association with the target photographed image. The utilization mode information generated by the utilization mode information generating unit 24 is output to the photographer preference information generating unit 4, which generates photographer preference information based on the utilization mode information in addition to the image content information and the photographing mode information.

[0036] The photographer preference information generating unit 4 generates photographer preference information, which is information on the preferences of the photographer who has taken and utilized the target photographed image, based on at least one or more pieces of information (preferably all of the information) among image content information on the image content of the photographed image, shooting mode information on the shooting mode at the time of photographing the photographed image, and utilization mode information on the utilization mode of the photographed image. Specifically, the photographer preference information generating unit 4 includes a relationship information database 26 that records relationship information indicating the relationship between the image content information, shooting mode information, and utilization mode information and the preference content, a preference extracting unit 27 that extracts preference content corresponding to the input image content information, etc., while referring to the relationship information recorded in the relationship information database, and an information generating unit 28 that generates photographer preference information based on the preference content extracted by the preference extracting unit 27.

[0037] The relationship information database 26 is for storing relationship information that includes each item of image content information, shooting mode information, and utilization mode information and preference contents corresponding to each item. The relationship information may be generated by associating a past photographer whose preference contents have been confirmed separately with image content information related to the photographer, or may be generated by extracting the relationship between the two using machine learning or the like. The relationship information may be in a form in which specific contents related to all items of image content information, shooting mode information, and utilization mode information are associated with a single preference content, or in which specific contents related to a single item or a plurality of items extracted from all items are associated with one or more preference contents. The preference contents are preferably information on the preferences of a specific person, including, for example, internal personality, interests in objects such as other people and content, external behavioral tendencies, purchase history, etc.

[0038] The preference extraction unit 27 is for extracting the preference contents associated with the specific contents of each item described in the image content information, shooting mode information, and utilization mode information generated for the target photographed image while referring to the related information. When using specific contents related to a plurality of items, the information extraction method in the preference extraction unit 27 may refer to related information in which the item contents are completely identical, or may refer to related information in which the majority of the item contents (e.g., 80% of all items) are identical. Regarding the judgment of whether the item contents related to each item are identical or not, the item contents may be extracted as related information not only when they are completely identical in terms of wording, but also when they are deemed to be identical or similar in terms of meaning.

[0039] The information generating unit 28 is for generating photographer preference information which is information including the contents of preferences included in the related information extracted by the preference extracting unit 27. Specifically, the information generating unit 28 generates preference information in a format in which the preference contents extracted by the preference extracting unit 27 are linked to the photographer of the target photographed image, and outputs the preference information to the transaction generating unit 6.

[0040] The token generating unit 5 is for generating a photographer token, which is a non-fungible token corresponding to the photographer who took the target photographed image. The "non-fungible token" refers to a so-called NFT (Non-Fungible Token), that is, a token that has unique data and is non-fungible with other tokens, and is issued based on, for example, ERC721, which is a standard of Ethereum (registered trademark). The photographer token in the present embodiment 1 is issued based on ERC721 or other predetermined standard, and is configured to store information about the corresponding user and information about the user's interest in partial content, etc., on the blockchain.

[0041] "Blockchain" is a technology that uses encryption technology to synchronize data between multiple computers that make up a distributed network. Specifically, each block is made up of a collection of information about tokens, such as agreed-upon transaction records, and information for connecting to other blocks (information from the previous block), and a blockchain is made up of multiple blocks that are linked together. Even if data is tampered with on some of the computers, the correct data is selected by majority vote among the other computers, making it extremely difficult to destroy or tamper with data.

[0042] The correspondence between the photographer token and the photographer is a one-to-one association between the photographer token identifier and the photographer's identification information (the photographer's identification information may be the photographer's name or some other character string associated with the photographer). More directly, the photographer token identifier and the photographer's identification information may be the same, or a correspondence may be established between the identifier and the photographer's identification information that are composed of different character strings. Alternatively, the identifier and the photographer token may be associated with URL information on the Internet where data related to the photographer is stored.

[0043] In the first embodiment, the block constituting the distributed ledger corresponding to the generated photographer token records the transaction record regarding the transfer of ownership of the photographer token, as well as photographer preference information regarding the photographer. These pieces of information are converted into transactions, which are information output to the distributed network by the transaction generator 6.

[0044] The generation of the photographer token may be performed by the token generating unit 5 itself, or may be performed by an external system that is directly or indirectly connected to the token generating unit 5 by issuing a predetermined command to the external system. The specific format of the photographer token is not limited to one that complies with ERC721, which is the standard of Ethereum (registered trademark), and may be any format as long as it has a non-fungible property and the transaction history is stored on the blockchain.

[0045] The transaction generating unit 6 has a function of generating transactions to be stored in blocks in the distributed ledger, and corresponds to an example of an information generating means in the claims. Specifically, the transaction generating unit 6 generates information including the photographer preference information generated by the photographer preference information generating unit 4 (information generating unit 28) as the transaction contents, in addition to information regarding a change in the holder name of the photographer token. More preferably, the transaction generating unit 6 may include image content information, shooting mode information, and utilization mode information regarding the target photographed image in addition to the above information as the transaction contents.

[0046] The electronic signature generating unit 7 has a function of generating an electronic signature, which is data that proves that the creation and output of information included in the transaction is in accordance with the intention of the owner of the photographer token. Specifically, the electronic signature generating unit 7 has a function of generating a hash value of the transaction generated by the transaction generating unit 6, and generating an electronic signature by encrypting the hash value with a private key held by the owner of the photographer token. The "hash value" is a fixed-length value obtained by performing a certain calculation procedure on the original data. Since the calculation procedure is irreversible, it is considered impossible to restore the original data from the hash value. The "private key" is a sequence of numbers used in the encryption process, and is configured to be decryptable by a corresponding "public key." In the first embodiment, the transaction generating unit 6 and the electronic signature generating unit 7 are configured to generate the transaction and electronic signature, which are one aspect of the ownership change information, but this is not necessary, and the transaction generating unit 6 and the electronic signature generating unit 7 may only have a function of instructing an external device to generate the transaction and electronic signature.

[0047] The output unit 8 is for instructing to output the transaction generated by the transaction generation unit 6 and the electronic signature generated by the electronic signature generation unit 7 to the distributed network associated with the photographer token. The output unit 8 functions as one aspect of the output instruction means in the claims, and in this embodiment, it is configured to directly output the transaction and the electronic signature, but it may be configured to only instruct other components to output the transaction. In this embodiment 1, the output unit 8 is directly or indirectly connected to the distributed network and is configured to be able to output predetermined data to the distributed network. The distributed network generates a hash value of the output transaction and compares it with data obtained by decrypting the electronic signature with a public key (= hash value of the transaction). If the two values ​​are different, it determines that the transaction is not a proper transaction by the token holder, etc., and rejects the registration, and if the two values ​​match, it determines that the transaction is a proper transaction, and stores the information formed by the transaction in a block constituting the distributed ledger. The transaction output by the output unit 8 includes information regarding the change of the holder's name, and by outputting the transaction to the distributed network, this information is stored in a block constituting the distributed ledger provided on the distributed network.

[0048] The photographer preference information acquisition unit 9 is for accessing the corresponding distributed network and acquiring the photographer preference information included in the transaction. Specifically, the photographer preference information acquisition unit 9 acquires the photographer preference information by accessing the distributed ledger on the distributed network output from the output unit 8 and downloading the photographer preference information recorded in the distributed ledger. The photographer preference information acquired by the photographer preference information acquisition unit 9 is provided to, for example, a business providing web services on the Internet, and the business can use the information to develop new web services and products suited to the preferences described in the photographer preference information.

[0049] Next, advantages of the photographing behavior analysis system according to the first embodiment will be described. The photographing behavior analysis system according to the first embodiment employs a configuration for generating photographer preference information, which is information on the preferences of a photographer who has photographed and utilized a target photographed image, based on at least one or more pieces of information (preferably all of the information) among image content information on the image content of a photographed image, photographing mode information on the photographing mode at the time of photographing the photographed image, and utilization mode information on the utilization mode of the photographed image. In the present day, when photographing behavior using photographing equipment is widely performed by the general public, the act of photographing itself is an expression of individuality, and the individuality of the photographer is expressed in each scene, such as what to photograph, in which scene to photograph, and how to utilize the image. In the first embodiment, an analysis is performed in consideration of the characteristics of such photographing behavior, thereby providing an advantage that highly accurate information on the photographer's preferences can be obtained. In particular, the photographing behavior analysis system according to the first embodiment has an advantage that the preference information is generated based on the photographing contents, photographing mode, and utilization mode, which are not generally the subject of behavior analysis, and therefore there is no problem that inaccurate information is generated because the photographer intentionally behaves differently from usual.

[0050] In addition, the photographing behavior analysis system according to the first embodiment records the generated photographer preference information in a block in the distributed ledger in a manner to include the information in a transaction. By using the block chain technology, it is possible to prevent a third party from tampering with the recorded content, and therefore the photographing behavior analysis system according to the first embodiment has the advantage of being able to accurately record the generated photographer preference information.

[0051] (Embodiment 2) Next, a description will be given of a photographing behavior analysis system according to embodiment 2. In embodiment 2, components having the same names and symbols as those in embodiment 1 will have the same functions as those in embodiment 1 unless otherwise specified.

[0052] The photographing behavior analysis system of the second embodiment has a function of generating photographer preference information based on the analysis results of the photographing content judgment unit 1, the photographing mode judgment unit 2 and the utilization mode judgment unit 3, as in the first embodiment, and also has a function of correcting previously generated photographer preference information by modifying the content of the relationship information used to generate the photographer preference information based on reaction information, which is information including the content of the reaction to an action from a third party against the photographer based on the generated photographer preference information, and also has a function of generating more accurate photographer preference information by using the corrected relationship information when generating new photographer preference information.

[0053] As shown in FIG. 2, the photography behavior analysis system of this embodiment 2, in addition to the same configuration as in embodiment 1, includes an attention information generation unit 30 that generates attention information corresponding to the photographer preference information acquired by the photographer preference information acquisition unit 9, an information provision unit 31 that provides the generated attention information to the corresponding photographer, a reaction information acquisition unit 32 that acquires reaction information including information regarding the presence or absence of a reaction by the photographer who received the attention information and the content of the reaction if a reaction is made, and an information correction unit 33 that judges whether the photographer preference information is correct or not based on the content of the reaction information, and corrects the content of the photographer preference information and / or the corresponding relationship information if it is judged to be incorrect.

[0054] The attention information generating unit 30 is for generating attention information corresponding to the photographer preference information. Attention information is a general term for information that calls the photographer's attention, and its contents are generated based on the photographer preference information related to the target photographer, and are intended to call the photographer's attention to non-economical and economical behavior. For example, the attention information may be information introducing a shooting spot that matches the preference content included in the attention information, or information that encourages the purchase of an Internet service or product that matches the preference content. More preferably, the attention information generating unit 30 creates prediction information of the reaction content that the photographer who receives the attention information will have, separately from the attention information. In addition to information that actively calls the photographer's attention, the attention information may generate information that passively warns, that is, information that causes the photographer to have an indifferent reaction.

[0055] The reaction information acquisition unit 32 is for acquiring reaction information, which is information on the reaction of the photographer who received the photographer preference information. The reaction information does not have a particular set item or format, and includes information on the actions that the photographer took or did not take in response to the attention information. For example, the reaction information may include a purchase application or other reaction to attention information encouraging the purchase of a service or product, as well as information on the actual taking of a new photograph at a photography spot in response to an introduction of the photography spot. In addition to cases where a positive reaction was made, information on cases where no reaction was made or a hostile reaction was made is also included in the reaction information.

[0056] The information correction unit 33 compares the provided warning information with the acquired reaction information to determine whether the photographer's preference information, which was the basis for creating the warning information, is correct, and corrects the contents of the photographer's preference information and the corresponding relationship information when an error is detected. Specifically, the information correction unit 33 compares the reaction content predicted from the original photographer's preference information with the reaction information actually obtained from the photographer (including the case where the reaction information is not returned) for the provided warning information, and determines that the photographer's preference information is "correct" if the match or difference is within an expected range. On the other hand, if the predicted reaction content and the reaction information (including the case where the reaction information is not returned) differ by a certain level or more, the information correction unit 33 determines that the photographer's preference information, which is the source of the warning information, is "error" and judges that the information is an error. When an error is detected, the information correction unit 33 corrects the contents of the photographer's preference information so that the warning information and the actually obtained reaction information are consistent with each other, and outputs the corrected photographer's preference information to the transaction generation unit 6. The transaction generation unit 6 generates a transaction including the corrected photographer preference information, and outputs it to the distributed ledger corresponding to the photographer together with the electronic signature. The information correction unit 33 also corrects the relationship information used to generate the photographer preference information so that a similar error will not occur in the future. Specifically, the information correction unit 33 accesses the relationship information database 26 to detect the relationship information used to derive the photographer preference information determined to be erroneous, and corrects the preference content in the relationship information so that photographer preference information with the correct content (= as corrected by the information correction unit 33) will be generated in the future.

[0057] 3 is a flowchart showing the content of the correction process of the photographer preference information in the photographing behavior analysis system according to the second embodiment. First, the attention information generating unit 30 generates attention information based on the photographer preference information (step S201), and the information providing unit 31 provides it to the photographer (step S202). After that, the reaction information acquiring unit 32 searches for information on the reaction (including no reaction) of the photographer to whom the attention information is provided, and generates reaction information (step S203). The information correcting unit 33 compares the expected reaction of the photographer derived from the content of the photographer preference information with the content of the photographer's reaction included in the actually obtained reaction information (step S204). If the expected reaction and the actual reaction match or the difference level remains within an expected range (step S204, No), the processing of the photographing behavior analysis system according to the second embodiment ends. If the difference level between the predicted reaction and the actual reaction is outside the expected range (step S204, Yes), the information correction unit 33 corrects the photographer preference information so that the warning information and the actual reaction are consistent (step S205). Furthermore, in order to prevent erroneous content when generating author preference information in the future, the information correction unit 33 accesses the relationship information database, extracts the relationship information that caused the error, and corrects the preference content of the relationship information (step S206).

[0058] Next, the advantages of the photographing behavior analysis system according to the second embodiment will be described. The photographing behavior analysis system according to the second embodiment has an advantage that more accurate photographer preference information can be generated by adopting a configuration in which the correctness of the photographer preference information once generated is confirmed, and the contents of the photographer preference information are corrected if it is determined to be incorrect. In particular, the photographing behavior analysis system according to the second embodiment can handle general advertising information as part of attention-calling information, so that it has an advantage that even if attention-calling information is not generated specifically for inspection, a company or the like that has acquired the photographer preference information provides information to advertise its own products and services, and when the response to the information is different from that expected, the correctness of the photographer preference information can be determined.

[0059] Although the contents of the present invention have been described above in the first and second embodiments, the technical scope of the present invention should not be interpreted as being limited to the specific configurations described in the embodiments. As long as the functions of the present invention can be realized, various modifications and applications of the above-mentioned embodiments are also within the technical scope of the present invention. For example, in the second embodiment, it is assumed that the photographer preference information is obtained by accessing a transaction recorded in a distributed ledger, but the photographer preference information generated by the photographer preference information generating unit 4 may be stored as is, and the stored information may be referred to when generating alert information. [Industrial Applicability]

[0060] The present invention can be used as a technique for estimating the preferences of an image photographer by performing behavioral analysis on the image photographer. [Explanation of symbols]

[0061] 1. Shooting Content Judgment Section 2. Shooting mode determination section 3. Utilization mode determination unit 4. Photographer preference information generation unit 5 Token generation section 6 Transaction Generation 7 Electronic signature generation section 8 Output section 9. Photographer preference information acquisition unit 11. Photographed image input section 12 Target identification part 13 Type determination section 14 Image content information generation unit 15. Shooting Location Determination Department 16 Shooting situation assessment section 17. Filming Equipment Judgment Section 18 Shooting mode information generating unit 20 Image input section 21 Processing content judgment section 22 Output mode determination unit 23 Disclosure Scope Determination Department 24 Utilization mode information generation unit 26 Relationship Information Database 27 Preference extraction part 28 Information generation section 30 Alert information generation unit 31 Information Provision Department 32 Reaction information acquisition unit 33 Information correction department

Claims

1. A photographing behavior analysis system for analyzing a photographing behavior of a photographer, comprising: a photographing content analysis means for identifying a photographing subject included in a photographed image as a photographing content of the image photographed by the photographer and determining a type of the photographing subject; a photographing mode determining means for determining, as a photographing mode at the time of photographing the photographed image, one or more of a type of a photographing location of the photographed image, a type of the action of the photographer before and after the photographing, and a type of photographing equipment used by the photographer at the time of photographing; a utilization mode determination means for determining, as utilization modes of the photographed image by the photographer, one or more of the following: whether or not the photographed image has been processed, and if so, the content of the processing, an output mode, which is information regarding the type of one or more of the medium / output area on which the photographed image has been output and the output device used to output the photographed image, and a disclosure range of the output photographed image; a photographer preference information generating means for generating photographer preference information, which is information regarding the preferences of the photographer who took the photographed image, based on the determination results of the photographing content analyzing means, the photographing mode determining means, and the utilization mode determining means; An information generating means for generating information including the photographer preference information regarding the photographer, the information being recorded in a distributed ledger on a distributed network corresponding to a non-fungible token that is in a corresponding relationship with the photographer; an output instruction means for instructing the distributed network to output the information generated by the information generation means; A photographing behavior analysis system comprising:

2. a photographer preference information acquisition means for acquiring the photographer preference information from information recorded in the distributed ledger; an information providing means for providing the photographer with attention-calling information corresponding to the acquired photographer preference information; a reaction information acquisition means for acquiring reaction information including information regarding the presence or absence of a reaction of the photographer to the provided warning information and the content of the reaction if a reaction is made; an information correcting means for determining whether the photographer's preference information is correct based on the acquired reaction information, and correcting the photographer's preference information when the photographer's preference information is determined to be incorrect; 2. The photographing behavior analysis system according to claim 1, further comprising:

3. A photographing behavior analysis method for analyzing a photographing behavior of a photographer, comprising: a photographing content analysis step of identifying a photographing subject included in the photographed image as a photographing content of the image photographed by the photographer and determining a type of the photographing subject; a photographing mode determination step of determining, as a photographing mode at the time of photographing the photographed image, one or more of a type of a photographing location of the photographed image, a type of an action of the photographer before and after the photographing, and a type of photographing equipment used by the photographer at the time of photographing; a utilization mode determination step for determining, as utilization modes of the photographed image by the photographer, one or more of the following: whether or not the photographed image has been processed, and if so, the content of the processing, an output mode, which is information regarding the type of one or more of the medium / output area on which the photographed image has been output and the output device used to output the photographed image, and a disclosure range of the output photographed image; a photographer preference information generating step of generating photographer preference information, which is information regarding the preferences of the photographer who took the photographed image, based on the determination results of the photographing content analyzing step, the photographing mode determining step, and the utilization mode determining step; an information providing step of providing the photographer with attention-calling information corresponding to the photographer preference information; a reaction information acquiring step of acquiring reaction information including information regarding the presence or absence of a reaction of the photographer to the provided warning information and the content of the reaction if a reaction is made; an information correction step of determining whether the photographer preference information is correct or not based on the acquired reaction information, and correcting the photographer preference information if it is determined to be incorrect; A photographing behavior analysis method comprising:

4. A photography behavior analysis program for causing a computer to analyze a photography behavior of a photographer, the program comprising: a photographing content analysis function for identifying a photographing subject included in the photographed image as the photographing content of the image photographed by the photographer and determining the type of the photographing subject; a photographing mode determination function for determining, as a photographing mode at the time of photographing the photographed image, one or more of a type of a photographing location of the photographed image, a type of the photographer's action before and after the photographing, and a type of photographing equipment used by the photographer at the time of photographing the photographed image; a utilization mode determination function for determining, as a utilization mode of the photographed image by the photographer, one or more of the following: whether or not the photographed image has been processed, and if so, the content of the processing, an output mode, which is information regarding the type of one or more of the medium / output area on which the photographed image has been output and the output device used to output the photographed image, and a disclosure range of the output photographed image; a photographer preference information generating function that generates photographer preference information, which is information regarding the preferences of the photographer who took the photographed image, based on the results of the photographing content analysis function, the photographing mode determination function, and the utilization mode determination function; an information providing function for providing the photographer with attention-calling information corresponding to the photographer preference information; a reaction information acquisition function for acquiring reaction information including information regarding the presence or absence of a reaction of the photographer to the provided warning information and the content of the reaction if a reaction is made; an information correction function that judges whether the photographer preference information is correct or not based on the acquired reaction information, and corrects the photographer preference information if it is judged to be incorrect; A photography behavior analysis program that causes the user to execute the above steps.

Images