Information processing device, information processing method, and information processing program

Abstract

To appropriately respond to desire of a user such as photographing, for enjoyment, an actual object.SOLUTION: An information processing device comprises an acquisition unit, an identification unit, and a provision unit. The acquisition unit acquires an image photographed by a predetermined photographing device. The identification unit identifies a photographing object by performing image analysis on the image acquired by the acquisition unit. The provision unit provides a photographer of the image, with information corresponding to the photographing object identified by the identification unit.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and an information processing program.

Background Art

[0002] Conventionally, when a dedicated device equipped with artificial intelligence (AI) is held over a book, there is a known technique in which the AI recognizes characters, pictures, photos, etc. and reads them aloud.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional technology, since the object recognized by the AI is a printed matter, it has not been possible to appropriately respond to the user's desire to take a picture of a real object and enjoy it.

[0005] The present application has been made in view of the above, and an object thereof is to appropriately respond to the user's desire to take a picture of a real object and enjoy it.

Means for Solving the Problems

[0006] The information processing apparatus according to the present application includes an acquisition unit that acquires an image captured by a predetermined imaging device, a specification unit that specifies an imaging target by performing image analysis on the image acquired by the acquisition unit, and a provision unit that provides information corresponding to the imaging target specified by the specification unit to the person who captured the image.

Effects of the Invention

[0007] According to one embodiment of the system, it has the effect of appropriately meeting the user's desire to take pictures of real objects and enjoy them. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 shows an example of the configuration of an information processing system according to an embodiment. [Figure 2] Figure 2 shows an example of information processing according to the present invention. [Figure 3] Figure 3 shows an example of the configuration of the imaging device according to the embodiment. [Figure 4] Figure 4 shows an example of the configuration of a terminal device according to this embodiment. [Figure 5] Figure 5 shows an example of the configuration of an information processing device according to the embodiment. [Figure 6] Figure 6 shows an example of an image-linking information storage unit according to the embodiment. [Figure 7] Figure 7 shows an example of a content storage unit according to this embodiment. [Figure 8] Figure 8 is a flowchart showing an example of information processing according to the embodiment. [Figure 9] Figure 9 is a hardware configuration diagram showing an example of a computer that implements the functions of an information processing device. [Modes for carrying out the invention]

[0009] The following describes in detail, with reference to the drawings, the embodiments for implementing the information processing device, information processing method, and information processing program according to the present application (hereinafter referred to as "embodiments"). Note that these embodiments do not limit the information processing device, information processing method, and information processing program according to the present application. Furthermore, the same parts are denoted by the same reference numerals in each of the following embodiments, and redundant descriptions are omitted.

[0010] (Embodiment) [1. Configuration of the Information Processing System] The information processing system 1 shown in Figure 1 will now be described. As shown in Figure 1, the information processing system 1 includes a shooting device 10, a terminal device 20, and an information processing device 100. The shooting device 10, the terminal device 20, and the information processing device 100 are connected to each other via a predetermined communication network (network N) by wired or wireless means. Figure 1 is a diagram showing an example configuration of the information processing system 1 according to this embodiment.

[0011] The shooting device 10 is a camera-equipped terminal device used by the user (photographer). The shooting device 10 can be any device as long as it can realize the processing in the embodiment. For example, the shooting device 10 may be a magnifying glass-type camera-equipped terminal device. The user is, for example, a child enjoying fieldwork at a campsite. Therefore, the shooting device 10 may be, for example, an information sharing device for children. The shooting device 10 also provides the captured image to the information processing device 100. For example, the shooting device 10 provides an image with the field of view seen by the user through the lens at the time of shooting as the shooting range. The shooting device 10 may also be, for example, a device manufactured by the administrator of the information processing device 100. Since the shooting device 10 may be used underwater, it may be a completely waterproof device. The shooting method of the shooting device 10 is not particularly limited and may be, for example, 3D shooting or video.

[0012] The terminal device 20 is an information processing device used by a user who has a camera device 10. The terminal device 20 can be any device as long as it can realize the processing in the embodiment. The terminal device 20 may also be a smartphone, tablet device, notebook PC, desktop PC, mobile phone, PDA, or other device. Figure 2 shows the case where the terminal device 20 is a smartphone.

[0013] The terminal device 20 is a smart device such as a smartphone or a tablet, and is a portable terminal device capable of communicating with an arbitrary server device via a wireless communication network such as 3G to 5G (Generation) or LTE (Long Term Evolution). Further, the terminal device 20 has a screen such as a liquid crystal display, and has a screen having a touch panel function, and may receive various operations on display data such as content, such as a tap operation, a slide operation, and a scroll operation, by a finger or a stylus from a user. In FIG. 2, the terminal device 20 is used by the user U1.

[0014] The information processing device 100 is an information processing device aimed at appropriately responding to the user's desire to photograph and enjoy real objects, and may be any device as long as it can realize the processing in the embodiment. For example, the information processing device 100 provides a predetermined service aimed at appropriately responding to the user's desire to photograph and enjoy real objects. For example, when the information processing device 100 acquires an image transmitted from the photographing device 10, it identifies the photographing object by performing image analysis on the acquired image, and transmits information corresponding to the identified photographing object to the terminal device 20. The information processing device 100 is realized, for example, by a server device or a cloud system that is an administrator of a predetermined service aimed at appropriately responding to the user's desire to photograph and enjoy real objects.

[0015] [2. An Example of Information Processing] FIG. 2 is a diagram showing an example of information processing of the information processing system 1 according to the embodiment. In the following embodiment, the case where the photographing object is an insect such as a bug will be described as an example, but it may not be particularly limited. For example, the photographing object according to the embodiment may be any thing such as a plant, an animal, a fish, or a bird.

[0016] User U1, a child, is enjoying fieldwork at a campsite or similar location, equipped with a camera device 10 and a terminal device 20. User U1 discovers an insect of interest and takes a photograph of it by looking through the lens of the camera device 10 (step S11). In this case, for example, the field of view seen through the lens becomes the shooting range.

[0017] When user U1 takes a picture of something, the shooting device 10 transmits the image to the information processing device 100 (step S101). For example, when user U1 takes a picture, the shooting device 10 transmits an image to the information processing device 100 that uses the field of view seen through the lens at the time of shooting as the shooting range. In this case, the image includes, for example, the insect that user U1 took the picture of, and the surrounding scenery. In this way, the shooting device 10 uploads the captured image to a server device or the like.

[0018] The information processing device 100 acquires the image transmitted from the imaging device 10. Further, when the information processing device 100 acquires an image, it performs image analysis on the acquired image to identify the imaging target included in the image (that is, the imaging target photographed by the user U1) (step S102). As in this case, when the user U1 photographs an insect, the information processing device 100 identifies the insect photographed by the user U1. For example, the information processing device 100 identifies that the imaging target photographed by the user U1 is an insect. Further, for example, the information processing device 100 identifies the name of the insect photographed by the user U1. For example, the information processing device 100 stores in advance images of various types of insects associated with the names of the insects, and at the time of acquiring the image, identifies the name of the insect photographed by the user U1 by comparing it with the stored information. When a database storing images of various types of insects associated with the names of the insects is in an external information processing device, the information processing device 100 may identify the name of the insect photographed by the user U1 by acquiring the information of the database from the external information processing device. Also, at this time, the information processing device 100 may transmit the acquired image to such an external information processing device, have the external information processing device identify the name of the insect photographed by the user U1, and acquire information indicating the name of the insect photographed by the user U1 to identify the name of the insect photographed by the user U1. Further, each time the information processing device 100 acquires an image, it stores the acquired image in association with information indicating what the identified imaging target is and the name of the identified imaging target.

[0019] The information processing device 100 transmits information corresponding to the identified subject to be photographed to the terminal device 20 (step S103). For example, the information processing device 100 transmits information such as the name, details, and rarity of the identified subject to the terminal device 20 along with the acquired image (or an image with image processing applied (for example, a 3D image)). For example, if the identified subject to be photographed is an insect, the information processing device 100 transmits information such as the name, details (details indicating what kind of insect it is), and rarity of the identified insect to the terminal device 20. In this case, the information processing device 100 may obtain information such as the details and rarity of the identified subject to be photographed from a database that stores images of various types of insects linked to their names, or it may obtain it from another database.

[0020] Specifically, the information processing device 100 generates an encyclopedia-like content (CT1) by combining information corresponding to the identified subject and information corresponding to subjects (one or more subjects) identified by user U1's past photography, and transmits the generated content to the terminal device 20 as information corresponding to the identified subject. This content includes the acquired image and information such as the name, details, and rarity of the identified subject, as well as images acquired by user U1's past photography and information such as the name, details, and rarity of the subjects identified by user U1's past photography. Alternatively, the information processing device 100 may extract subjects from among those identified by user U1's past photography that match the attributes of the identified subject, generate an encyclopedia-like content by combining information corresponding to the identified subject and information corresponding to the extracted subject, and transmit the generated content to the terminal device 20 as information corresponding to the identified subject. For example, if the information processing device 100 identifies that the subject photographed by user U1 is an insect, it may extract insect subjects from the subjects identified by user U1's past photographs, generate a compilation of insects identified by user U1's photographs into a compilation of encyclopedia-like content, and transmit this generated content to the terminal device 20. The information processing device 100 also provides information to make the compilation of encyclopedia-like content of subjects identified by user U1's photographs viewable.

[0021] [3. Variations of processing] (3.1. Notification to relevant parties) In the above embodiment, the information processing device 100 may provide information corresponding to the identified subject to be photographed to user U1, as well as to related parties who have a predetermined relationship with user U1 (for example, guardians or friends on a predetermined service (such as social networking services)). For example, the information processing device 100 may provide information to related parties of user U1 that makes it possible to view information corresponding to the subject photographed by user U1. In addition, the information processing device 100 may acquire user U1's location information at the time of shooting and provide the information, including user U1's location information, to related parties of user U1. In this case, the information processing device 100 may acquire user U1's location information at the time of shooting from the shooting device 10 or from the terminal device 20. The terminal devices of related parties of user U1 who are to receive the information are designated in advance, and the information processing device 100 provides information corresponding to the identified subject to be photographed to the terminal devices designated as the terminal devices of related parties of user U1.

[0022] (3.2. Notification of danger) In the above embodiment, the information processing device 100 may determine whether the identified target (the target photographed by user U1) is a target predetermined as a dangerous target, and if it determines that it is a target predetermined as a dangerous target, it may provide information to warn user U1 (for example, information indicating that the target is dangerous (for example, information indicating that it is dangerous to touch)). In addition, the information processing device 100 may not only warn user U1 but also warn persons who have a predetermined relationship with user U1. For example, the information processing device 100 may provide information to warn persons related to user U1 (for example, information indicating that user U1 has encountered a dangerous object). In addition, the information processing device 100 may not only warn user U1 but also warn other users located within a predetermined range from user U1 (for example, persons who do not have a predetermined relationship with user U1 but who possess a photography device 10). For example, the information processing device 100 may provide information to warn such other users (for example, information indicating that there are users nearby who have encountered a dangerous object). The warning may also be a notification accompanied by an audible warning. Furthermore, the information processing device 100 may determine whether the identified target is a target designated in advance as a dangerous target, and if it determines that it is not a target designated in advance as a dangerous target, it may perform the processing according to the above embodiment.

[0023] The information processing device 100 may provide information to warn user U1 if U1 approaches a location predetermined as dangerous (for example, a body of water). For example, the information processing device 100 may determine whether user U1's location information at the time of shooting is within a predetermined range from a location predetermined as dangerous, and if it determines that it is within a predetermined range from a location predetermined as dangerous, it may provide information to warn user U1. In addition to warning user U1, the information processing device 100 may also warn persons who have a predetermined relationship with user U1. For example, the information processing device 100 may provide information to warn persons related to user U1 (for example, information indicating that user U1 has approached a dangerous location). The information processing device 100 may obtain user U1's location information from the shooting device 10 or from the terminal device 20. Furthermore, the information processing device 100 may determine whether the location information of user U1 at the time of shooting is within a predetermined range from a location predetermined as a dangerous place, and if it determines that it is not within a predetermined range from a location predetermined as a dangerous place, it may perform the processing according to the above embodiment.

[0024] The information processing device 100 may provide information to warn user U1 when user U1 is more than a predetermined distance away from someone related to user U1 (for example, information indicating that user U1 is far away from someone related to user U1 and therefore in danger). For example, the information processing device 100 may determine whether user U1's location information at the time of shooting is within a predetermined range from the location of someone related to user U1, and if it determines that it is not within the predetermined range from the location of someone related to user U1, it may provide information to warn user U1. In addition to warning user U1, the information processing device 100 may also warn someone related to user U1 who has a predetermined relationship with user U1. For example, the information processing device 100 may provide information to warn someone related to user U1 (for example, information indicating that user U1 is far away and therefore in danger). The information processing device 100 may obtain the location information of user U1's related person from, for example, a terminal device designated in advance as a terminal device of user U1's related person. Furthermore, the information processing device 100 may determine whether the location information of user U1 at the time of shooting is within a predetermined range from the location of user U1's associates, and if it determines that it is within a predetermined range from the location of user U1's associates, it may perform the processing according to the above embodiment.

[0025] (3.3. Put scents into the encyclopedia) In the above embodiment, the shooting device 10 may have an odor sensor or the like, and measure the odor intensity of the object to be photographed during shooting, and transmit the measurement result of the odor intensity to the information processing device 100. In this way, the shooting device 10 may upload the measurement result of the odor intensity of the object to be photographed along with the image to a server device or the like. The information processing device 100 may also acquire the measurement result of the odor intensity of the object to be photographed along with the image. Furthermore, the information processing device 100 may associate the measurement result of the odor intensity of the object to be photographed at the time of shooting with the acquired image and store it. The information processing device 100 may then transmit information corresponding to the measurement result of the odor intensity of the object to be photographed at the time of shooting (for example, information that expresses the odor intensity with color (for example, information that expresses a weaker odor as blue, and a stronger odor as red)) to the terminal device 20. For example, the information processing device 100 may transmit information that makes content containing information corresponding to the measurement result of the odor intensity of the object to be photographed at the time of shooting viewable.

[0026] (3.4. Include the size in the encyclopedia) In the above embodiment, the shooting device 10 may measure the size of the object to be photographed at the time of shooting and transmit the size measurement result to the information processing device 100. For example, the shooting device 10 may measure the size of the object to be photographed by detecting the distance to the object and the proportion of the object to be photographed within the shooting range, and transmit the size measurement result to the information processing device 100. In this way, the shooting device 10 may upload the size measurement result of the object to be photographed along with the image to a server device or the like. The information processing device 100 may also acquire the size measurement result of the object to be photographed along with the image. Furthermore, the information processing device 100 may associate the size measurement result of the object to be photographed at the time of shooting with the acquired image and store it. The information processing device 100 may then transmit information corresponding to the size measurement result of the object to be photographed at the time of shooting to the terminal device 20. For example, the information processing device 100 may transmit information that makes content containing information corresponding to the size measurement result of the object to be photographed at the time of shooting viewable.

[0027] (3.5. Assign tasks) In the above embodiment, the information processing device 100 may provide user U1 with information indicating a task that requests the user U1 to photograph a pre-set object (for example, an object pre-set as the target of a battle if there is a battle function). For example, the information processing device 100 may determine whether user U1 is in a predetermined location, and if it determines that user U1 is in the predetermined location, it may provide information indicating a task that requests the user U1 to photograph a pre-set object within a predetermined period of time. The information processing device 100 may also provide information that allows user U1 to battle with an object photographed by another user using the object photographed by user U1. The battle may be a competition to see who can photograph the largest object. Furthermore, the information processing device 100 may provide information indicating that user U1's level will increase (information indicating a level up) if user U1 completes the given task. The information processing device 100 may also determine whether user U1 is in a predetermined location, and if it determines that user U1 is not in the predetermined location, it may terminate the information processing.

[0028] (3.6. Share with other users) In the above embodiment, the information processing device 100 may notify user U1 if another user located within a predetermined range from user U1 photographs a subject that user U1 has not yet photographed. For example, the information processing device 100 may provide user U1 with information indicating that another user nearby has photographed a subject that is not in user U1's content. Alternatively, for example, the information processing device 100 may provide user U1 with information encouraging them to search for the subject together with other users in their vicinity. For example, the information processing device 100 may provide user U1 with information about other users in their vicinity.

[0029] (3.7. Collaborative Mode) In the above embodiment, the information processing device 100 may provide content that compiles photographs taken by persons having a predetermined relationship with user U1 during a predetermined period (for example, during a camp). For example, the information processing device 100 may provide content that compiles photographs taken by persons having a predetermined relationship with user U1 during a predetermined period by user U1 selecting a collaborative mode that provides content that compiles photographs taken by persons having a predetermined relationship with user U1 during a predetermined period. The collaborative mode may be used, for example, for a summer vacation project.

[0030] (3.8. Various Modes) In the above embodiment, the information processing device 100 may identify a target subject from among the identified targets by performing image analysis on the acquired image, according to the mode selected by the user U1. For example, if the mode selected by the user U1 is the insect mode for photographing insects, the information processing device 100 may identify the insect in the image even if the image contains both insects and flowers (an example of a plant). Also, for example, if the mode selected by the user U1 is the landscape mode for photographing landscapes, the information processing device 100 may identify the flower in the image even if the image contains both insects and flowers. Furthermore, the information processing device 100 may identify a target subject according to the mode after the user U1 switches modes. Here, the mode is not limited to insect mode or landscape mode, but can be any mode. The information processing device 100 may then provide information corresponding to the identified target subject and the mode after the switch. For example, in the case of landscape mode, the information processing device 100 may provide content that displays the identified flower in a display manner suitable for landscape photography (a display manner different from the display manner suitable for insect photography). For example, the information processing device 100 may provide content that compiles information corresponding to objects (objects to be photographed) related to the identified landscape and displays it in a display manner suitable for photographing the landscape. The modes may also include, for example, a travel mode for when the user takes photos while traveling, a town map mode for when the user photographs town landmarks (e.g., statues or monuments) or local specialties, a pet mode for when the user photographs pets, a "want to know" mode for when the user photographs what they want to know, or an "interesting" mode for when the user photographs something interesting. The modes may also include, for example, a security alarm mode that is activated in emergencies, such as when the user photographs something dangerous, or a "wanted item" mode that is activated when the user photographs an endangered species, something dangerous, or a pet that has escaped.

[0031] For example, when user U1 selects a travel mode, the information processing device 100 may identify travel-related objects in the image taken. The information processing device 100 may then provide information corresponding to the identified objects (travel-related objects) and the travel mode. For example, the information processing device 100 may provide content that displays the identified objects in a display manner suitable for travel photography. For example, the information processing device 100 may provide content that compiles information corresponding to the identified objects and displays it in a display manner suitable for travel photography.

[0032] For example, when user U1 selects town map mode, the information processing device 100 may identify objects related to town landmarks and specialties that appear in the captured image. The information processing device 100 may then provide information corresponding to the identified objects (objects related to town landmarks and specialties) and the town map mode. For example, the information processing device 100 may provide content that displays the identified objects in a display manner suitable for photographing town landmarks and specialties. For example, the information processing device 100 may provide content that compiles information corresponding to the identified objects and displays it in a display manner suitable for photographing town landmarks and specialties.

[0033] For example, when user U1 selects pet mode, the information processing device 100 may identify pet-related objects in the captured image. The information processing device 100 may then provide information corresponding to the identified objects (pet-related objects) and the pet mode. For example, the information processing device 100 may provide content that displays the identified objects in a display manner suitable for pet photography. For example, the information processing device 100 may provide content that compiles information corresponding to the identified objects and displays it in a display manner suitable for pet photography.

[0034] For example, if user U1 selects the security alarm mode, the information processing device 100 may provide user U1's location information to related parties or specific administrative agencies (e.g., the police) if the captured image contains dangerous objects.

[0035] For example, if user U1 selects the "Inquiry Mode," the information processing device 100 may provide the image and location information of the shooting location to a specific administrative agency (e.g., a government office) if the image taken includes endangered species, dangerous objects, or pets that have escaped.

[0036] [4. Configuration of the shooting device] Next, the configuration of the imaging device 10 according to the embodiment will be described using Figure 3. Figure 3 is a diagram showing an example of the configuration of the imaging device 10 according to the embodiment. As shown in Figure 3, the imaging device 10 has a communication unit 11, an imaging unit 12, and a control unit 13.

[0037] (Communications Section 11) The communication unit 11 is implemented, for example, by a NIC (Network Interface Card). The communication unit 11 is connected to a predetermined network N by wire or wireless connection and sends and receives information to and from the information processing device 100, etc., via the predetermined network N.

[0038] (Photography Department 12) The imaging unit 12 takes pictures in response to user input. For example, the imaging unit 12 receives various inputs from the user and takes pictures in response to those inputs. In Figure 2, it receives various inputs from user U1. For example, the imaging unit 12 may receive various inputs from the user via a touch panel display. Alternatively, the imaging unit 12 may receive various inputs from buttons on the imaging device 10 or from a keyboard or mouse connected to the imaging device 10.

[0039] (Control Unit 13) The control unit 13 is, for example, a controller, and is implemented by a CPU (Central Processing Unit) or MPU (Micro Processing Unit) executing various programs stored in the memory device inside the imaging device 10 using RAM (Random Access Memory) as the working area. For example, these various programs include application programs installed on the imaging device 10. For example, these various programs include application programs that transmit images captured by the imaging device 10 to the information processing device 100. The control unit 13 is also implemented by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0040] As shown in Figure 3, the control unit 13 has a receiving unit 14 and a transmitting unit 15, and realizes or executes the information processing operations described below.

[0041] (Receiving unit 14) The receiving unit 14 receives various types of information from other information processing devices, such as the information processing device 100. For example, the receiving unit 14 receives information indicating that the information processing device 100 has acquired an image transmitted from the imaging device 10.

[0042] (Transmitter 15) The transmitting unit 15 transmits various types of information to other information processing devices, such as the information processing device 100. For example, the transmitting unit 15 transmits images captured by the imaging device 10. Also, for example, the transmitting unit 15 transmits the position information of the imaging device 10 at the time of image transmission (or capture).

[0043] [5. Configuration of terminal equipment] Next, the configuration of the terminal device 20 according to the embodiment will be described using Figure 4. Figure 4 is a diagram showing an example of the configuration of the terminal device 20 according to the embodiment. As shown in Figure 4, the terminal device 20 has a communication unit 21, an input unit 22, an output unit 23, and a control unit 24.

[0044] (Communications Section 21) The communication unit 21 is implemented, for example, by a NIC (Network Interface Card). The communication unit 21 is connected to a predetermined network N by wire or wireless connection and sends and receives information to and from the information processing device 100, etc., via the predetermined network N.

[0045] (Input section 22) The input unit 22 receives various operations from the user. In Figure 2, it receives various operations from user U1. For example, the input unit 22 may receive various operations from the user via the display surface using a touch panel function. Alternatively, the input unit 22 may receive various operations from buttons provided on the terminal device 20, or from a keyboard or mouse connected to the terminal device 20.

[0046] (Output section 23) The output unit 23 is a display screen for a tablet terminal or the like, implemented by, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display, and is a display device for displaying various types of information. For example, the output unit 23 displays content received from the information processing device 100.

[0047] (Control Unit 24) The control unit 24 is, for example, a controller, and is implemented by a CPU or MPU, etc., executing various programs stored in the memory device inside the terminal device 20 using RAM as the working area. For example, these various programs include application programs installed on the terminal device 20. For example, these various programs include application programs that display content received from the information processing device 100. The control unit 24 is also implemented by an integrated circuit such as an ASIC or FPGA.

[0048] As shown in Figure 4, the control unit 24 has a receiving unit 241 and a transmitting unit 242, and realizes or executes the information processing operations described below.

[0049] (Receiving unit 241) The receiving unit 241 receives various types of information from other information processing devices, such as the information processing device 100. For example, the receiving unit 241 receives content transmitted from the information processing device 100. For example, the receiving unit 241 receives information corresponding to the subject photographed by the user. For example, the receiving unit 241 receives information that makes content containing the subject identified by the user's photography viewable.

[0050] (Transmitter 242) The transmitting unit 242 transmits various information to other information processing devices, such as the information processing device 100. For example, the transmitting unit 242 transmits information indicating that it has received content transmitted from the information processing device 100. Also, for example, the transmitting unit 242 transmits location information of the terminal device 20 at the time of content reception.

[0051] [6. Configuration of the Information Processing Device] Next, the configuration of the information processing device 100 according to the embodiment will be described using Figure 5. Figure 5 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Figure 5, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130. The information processing device 100 may also have an input unit (for example, a keyboard or mouse) that receives various operations from the administrator of the information processing device 100, and a display unit (for example, a liquid crystal display) for displaying various information.

[0052] (Communications Department 110) The communication unit 110 is implemented, for example, by a NIC (Network Interface Card). The communication unit 110 is connected to the network N by wire or wireless connection and sends and receives information to and from the imaging device 10, etc., via the network N.

[0053] (Storage unit 120) The storage unit 120 is implemented by, for example, semiconductor memory elements such as RAM and flash memory, or storage devices such as hard disks and optical discs. As shown in Figure 5, the storage unit 120 has an image association information storage unit 121 and a content storage unit 122.

[0054] The image-linking information storage unit 121 stores various images (which may be actually taken by the user or entered by the administrator of the information processing device 100, etc.) and information about each of the various images (for example, information about the subject being photographed in the image). Here, Figure 6 shows an example of the image-linking information storage unit 121 according to the embodiment. As shown in Figure 6, the image-linking information storage unit 121 has items such as "image ID", "image", "subject being photographed", "details", and "rarity".

[0055] "Image ID" indicates identification information for identifying an image. "Image" indicates the image. In the example shown in Figure 6, conceptual information such as "Image #1" and "Image #2" is shown as being stored in "Image," but in reality, image data is stored there. In addition, "Image" may also store, for example, the URL (Uniform Resource Locator) where the image data is located, or the file path name indicating the storage location. "Subject" indicates the subject captured in the image. "Details" indicates the details of the subject. "Rarity" indicates the rarity of the subject.

[0056] The content storage unit 122 stores content that compiles information corresponding to subjects photographed by the user in the past (content that compiles subjects identified by the user's photography). Here, Figure 7 shows an example of the content storage unit 122 according to the embodiment. As shown in Figure 7, the content storage unit 122 has items such as "Content ID", "User ID", and "Content".

[0057] "Content ID" indicates identification information for identifying content. "User ID" indicates identification information for identifying the user. "Content" indicates the content. In the example shown in Figure 7, conceptual information such as "Content #1" and "Content #2" is shown to be stored in "Content," but in reality, image data previously taken by the user and information associated with the image data (for example, shooting location, shooting date and time, details, rarity, measurement results of the odor intensity of the subject, measurement results of the size of the subject) are stored. In addition, "Content" may also store, for example, the URL where the image data is located or the file path name indicating the storage location.

[0058] (Control unit 130) The control unit 130 is a controller, and is implemented, for example, by a CPU or MPU executing various programs stored in the memory device inside the information processing device 100 using RAM as a working area. Alternatively, the control unit 130 can be implemented by an integrated circuit such as an ASIC or FPGA.

[0059] As shown in Figure 5, the control unit 130 includes an acquisition unit 131, a specification unit 132, a generation unit 133, and a provision unit 134, and realizes or executes the information processing operations described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in Figure 5, and other configurations are also acceptable as long as they perform the information processing described later.

[0060] (Acquisition part 131) The acquisition unit 131 acquires various information from the storage unit 120. The acquisition unit 131 also stores the acquired information in the storage unit 120.

[0061] The acquisition unit 131 acquires various information from external information processing devices. The acquisition unit 131 acquires various information from other information processing devices such as the information processing device 100. For example, the acquisition unit 131 acquires images captured by the imaging device 10. Also, for example, the acquisition unit 131 acquires measurement results measured by the imaging device 10 (for example, measurement results of the odor intensity and size of the object being photographed).

[0062] (Specific Section 132) The identification unit 132 identifies the subject of the photograph by performing image analysis on the image acquired by the acquisition unit 131. For example, the identification unit 132 identifies the name of the subject by comparing images of various types of subjects with information stored in association with their names. In addition, the identification unit 132 identifies details and rarity of the subject, for example.

[0063] The identification unit 132 performs image analysis on the image to identify the target subject according to the mode selected by the user. For example, if the user selects landscape mode, the identification unit 132 identifies objects related to the landscape. For example, if the user switches from landscape mode to insect mode, the identification unit 132 identifies objects related to insects, rather than objects related to the landscape, even in the same image.

[0064] (Generation unit 133) The generation unit 133 generates content that combines information corresponding to the target of photography identified by the identification unit 132 and information corresponding to the target of photography identified by the user's past photography. For example, the generation unit 133 extracts a target of photography from among the targets of photography identified by the user's past photography that matches the attributes of the target of photography identified by the identification unit 132, and generates content that combines information corresponding to the target of photography identified by the identification unit 132 and information corresponding to the extracted target of photography.

[0065] (Provider 134) The providing unit 134 provides the user (the person who took the image) with information corresponding to the subject identified by the identification unit 132. For example, the providing unit 134 provides at least one of the following: information indicating the name of the subject, information indicating the details of the subject, and information indicating the rarity of the subject. Also, for example, the providing unit 134 provides information that makes the content generated by the generation unit 133 viewable. For example, the providing unit 134 provides this information to the user's associates or other users who meet certain conditions.

[0066] The providing unit 134 provides information to enable users to view content that includes information corresponding to the measurement results of the odor intensity of the subject they have photographed. The providing unit 134 also provides information to enable users to view content that includes information corresponding to the measurement results of the size of the subject they have photographed.

[0067] The providing unit 134 provides information indicating a task, for example, that requests the user to photograph a pre-set target. The providing unit 134 also provides information indicating that the user's level will increase if the given task is completed.

[0068] For example, if the subject photographed by the user is a subject predetermined to be dangerous, the information provision unit 134 provides information to warn the user, their associates, and other users who meet the specified conditions.

[0069] The information provision unit 134 provides information to warn users and their associates, for example, when a user approaches a location predetermined as a dangerous place.

[0070] The provisioning unit 134, for example, notifies the user if another user who meets predetermined conditions photographs a subject that is not included in the user's content.

[0071] The provisioning unit 134 provides, for example, content that compiles photographs taken by multiple users who meet certain conditions during a predetermined period.

[0072] [7. Information Processing Flow] Next, the information processing procedure by the information processing system 1 according to the embodiment will be explained using Figure 8. Figure 8 is a flowchart showing the information processing procedure by the information processing system 1 according to the embodiment.

[0073] As shown in Figure 8, the information processing device 100 acquires the image captured by the imaging device 10 (step S201).

[0074] The information processing device 100 identifies the subject being photographed in the image by performing image analysis on the acquired image (step S202).

[0075] The information processing device 100 generates content that combines information corresponding to the identified target object and information corresponding to targets identified by the user's past photography (step S203).

[0076] The information processing device 100 provides the generated content (step S204).

[0077] [8. Effects] As described above, the information processing device 100 according to the embodiment includes an acquisition unit 131, a identification unit 132, and a providing unit 134. The acquisition unit 131 acquires an image captured by a predetermined imaging device. The identification unit 132 identifies the subject of the image by performing image analysis on the image acquired by the acquisition unit 131. The providing unit 134 provides information corresponding to the subject of the image identified by the identification unit 132 to the person who took the image.

[0078] As a result, the information processing device 100 according to this embodiment can appropriately respond to the user's desire to take pictures of real objects and enjoy them.

[0079] Furthermore, the providing unit 134 provides at least one of the following: information indicating the name of the subject to be photographed, information indicating the details of the subject to be photographed, and information indicating the rarity of the subject to be photographed.

[0080] As a result, the information processing device 100 according to this embodiment can appropriately respond to the user's request to understand information about the object being photographed.

[0081] Furthermore, the provision unit 134 provides information that makes it possible for the photographer to view content summarizing the subjects they have photographed.

[0082] As a result, the information processing device 100 according to this embodiment can appropriately respond to user requests such as wanting to view content that compiles the subjects of the photographs.

[0083] Furthermore, the providing unit 134 provides information that enables the photographer to view content containing information corresponding to the measurement results of the odor intensity of the subject being photographed.

[0084] As a result, the information processing device 100 according to this embodiment can appropriately respond to user requests such as wanting to include the scent of the subject being photographed in the content.

[0085] Furthermore, the providing unit 134 provides information that enables the photographer to view content containing information corresponding to the measurement results of the size of the subject being photographed.

[0086] As a result, the information processing device 100 according to this embodiment can appropriately respond to user requests such as wanting to include the size of the object being photographed in the content.

[0087] Furthermore, the provision unit 134 provides information that allows information corresponding to the subject of the photograph to be viewed, to persons who have a predetermined relationship with the photographer.

[0088] As a result, the information processing device 100 according to this embodiment can appropriately respond to requests from the user's stakeholders, such as wanting to view content that compiles the images of the subjects photographed by the user.

[0089] Furthermore, the provision unit 134 provides information that enables the photographer's content to be viewed to other photographers who have a predetermined relationship with the photographer on a predetermined service.

[0090] As a result, the information processing device 100 according to this embodiment can appropriately respond to the requests of other users, such as wanting to view content that compiles the images of subjects that the user has photographed.

[0091] Furthermore, the providing unit 134 provides information indicating a task that requests the camera to photograph a pre-set target.

[0092] This allows the information processing device 100 according to the embodiment to appropriately provide information indicating a task.

[0093] Furthermore, the providing unit 134 provides information indicating that the photographer's level will increase when the photographer completes the assigned task.

[0094] As a result, the information processing device 100 according to the embodiment can effectively facilitate the completion of tasks.

[0095] Furthermore, the information provider 134 provides information to warn the photographer if the subject photographed by the photographer is one of the subjects predetermined as dangerous subjects.

[0096] As a result, the information processing device 100 according to this embodiment can appropriately respond to user requests, such as wanting to be notified of danger.

[0097] Furthermore, if the subject photographed by the photographer is a subject predetermined to be dangerous, the information provision unit 134 provides information to warn persons who have a predetermined relationship with the photographer.

[0098] As a result, the information processing device 100 according to the embodiment can appropriately respond to requests from users and their stakeholders, such as requests to be notified of danger.

[0099] Furthermore, if the subject photographed by the photographer is a subject predetermined to be dangerous, the providing unit 134 provides information to warn other photographers located within a predetermined range from the photographer.

[0100] As a result, the information processing device 100 according to this embodiment can appropriately respond to requests from other users, such as requests to be notified of danger.

[0101] Furthermore, the information provider 134 provides information to warn the photographer if the photographer approaches a location predetermined as a dangerous place.

[0102] As a result, the information processing device 100 according to this embodiment can appropriately respond to user requests, such as wanting to be notified of danger.

[0103] Furthermore, if the photographer approaches a location predetermined as a dangerous place, the information provider 134 provides information to warn persons who have a predetermined relationship with the photographer.

[0104] As a result, the information processing device 100 according to the embodiment can appropriately respond to requests from users and their stakeholders, such as requests to be notified of danger.

[0105] Furthermore, the provisioning unit 134 notifies the photographer if another photographer located within a predetermined range from the photographer takes a photograph of a subject that is not included in the photographer's content.

[0106] As a result, the information processing device 100 according to this embodiment can appropriately respond to user requests, such as wanting to photograph objects that have been photographed by other users in the vicinity.

[0107] Furthermore, the provisioning unit 134 provides content that compiles photographs taken by multiple photographers with a predetermined relationship during a predetermined period.

[0108] As a result, the information processing device 100 according to this embodiment can appropriately respond to user requests such as wanting to view content that compiles images of subjects photographed by multiple users.

[0109] Furthermore, the identification unit 132 identifies the target subject corresponding to the mode selected by the photographer from among the identified targets by performing image analysis on the image. The providing unit 134 then provides information corresponding to the identified target subject and the mode selected by the photographer.

[0110] As a result, the information processing device 100 according to the embodiment can appropriately provide information according to the mode selected by the user.

[0111] Furthermore, the imaging device is a magnifying glass-shaped terminal device equipped with a camera.

[0112] As a result, the information processing device 100 according to this embodiment can appropriately meet the needs of users who want to take pictures of real objects and enjoy them using a magnifying glass-type camera-equipped terminal device.

[0113] [9. Hardware Configuration] Furthermore, the information processing device 100 according to the above-described embodiment is realized by a computer 1000 having the configuration shown in Figure 9. Figure 9 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device 100. The computer 1000 has a CPU 1100, RAM 1200, ROM 1300, HDD 1400, communication interface (I / F) 1500, input / output interface (I / F) 1600, and media interface (I / F) 1700.

[0114] The CPU 1100 operates based on programs stored in the ROM 1300 or HDD 1400, controlling various components. The ROM 1300 stores boot programs executed by the CPU 1100 when the computer 1000 starts up, as well as programs that depend on the computer 1000's hardware.

[0115] The HDD1400 stores programs executed by the CPU1100, as well as data used by such programs. The communication interface1500 acquires data from other devices via a predetermined communication network and sends it to the CPU1100, and transmits data generated by the CPU1100 to other devices via the predetermined communication network.

[0116] The CPU 1100 controls output devices such as displays and printers, and input devices such as keyboards and mice, via the input / output interface 1600. The CPU 1100 acquires data from input devices via the input / output interface 1600. The CPU 1100 also outputs the generated data to output devices via the input / output interface 1600.

[0117] The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase Change Rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0118] For example, when the computer 1000 functions as an information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 realizes the functions of the control unit 130 by executing a program loaded on the RAM 1200. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, these programs may be obtained from other devices via a predetermined communication network.

[0119] [10. Other] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, and various data and parameters shown in the above document and drawings can be changed at will unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown.

[0120] Furthermore, the components of each illustrated device are functionally conceptual and do not necessarily need to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads and usage conditions.

[0121] Furthermore, the embodiments described above can be combined as appropriate, as long as the processing content is not contradictory.

[0122] Although some embodiments of the present invention have been described in detail above with reference to the drawings, these are illustrative examples, and the present invention can be implemented in various other forms with modifications and improvements based on the knowledge of those skilled in the art, starting with the embodiments described in the disclosure section of the invention.

[0123] Furthermore, the terms "section, module, unit" mentioned above can be replaced with "means" or "circuit." For example, the acquisition unit can be replaced with acquisition means or acquisition circuit. [Explanation of Symbols]

[0124] 1. Information Processing System 10. Shooting devices 11 Communications Department 12 Photography Department 13 Control Unit 14 Receiving Unit 15 Transmitter 20 Terminal devices 21 Communications Department 22 Input section 23 Output section 24 Control Unit 100 Information Processing Devices 110 Communications Department 120 Storage section 121 Image linking information storage unit 122 Content Storage Unit 130 Control Unit 131 Acquisition Department 132 Specific part 133 Generation part 134 Provision Department 241 Receiving Unit 242 Transmitter N Network

Claims

1. An acquisition unit that acquires images captured by a designated imaging device, An identification unit identifies the subject to be photographed by performing image analysis on the image acquired by the acquisition unit, A providing unit provides the photographer of the image with information that allows them to view content that compiles each of the subjects identified by the identifying unit and includes information indicating the rarity of each subject. It has, The aforementioned supply unit is, Information that allows access to information relevant to the subject being photographed will be provided to the photographer and related parties who have a predetermined relationship with them. An information processing device characterized by the following:

2. The aforementioned supply unit is, Provide at least one of the following: information indicating the name of the subject being photographed, and information indicating the details of the subject being photographed. The information processing apparatus according to feature 1.

3. The aforementioned supply unit is, This provides information to enable the photographer to view the aforementioned content, which includes information corresponding to the measurement results of the odor intensity of the subject photographed. The information processing apparatus according to feature 1.

4. The aforementioned supply unit is, This provides information to enable the viewer of the aforementioned content, which includes information corresponding to the measurement results of the size of the subject photographed by the photographer. The information processing apparatus according to feature 1.

5. The aforementioned supply unit is, Information that enables the photographer to view the aforementioned content will be provided to other photographers who have a predetermined relationship with the photographer on a predetermined service. The information processing apparatus according to feature 1.

6. The aforementioned supply unit is, This provides information indicating a task that requests the photography of a pre-defined target. The information processing apparatus according to feature 1.

7. The aforementioned supply unit is, Provide information indicating that the photographer's level will increase when they complete the assigned task. The information processing apparatus according to feature 6.

8. The aforementioned supply unit is, If the subject photographed by the photographer is one of the subjects designated as dangerous to photograph, information will be provided to warn the photographer. The information processing apparatus according to feature 1.

9. The aforementioned supply unit is, If the subject photographed by the photographer is one of the subjects designated as dangerous, information will be provided to warn persons who have a predetermined relationship with the photographer. The information processing apparatus according to feature 8.

10. The aforementioned supply unit is, If the subject photographed by a photographer is one of the subjects designated as dangerous, information will be provided to warn other photographers located within a specified range of the photographer. The information processing apparatus according to feature 8.

11. The aforementioned supply unit is, If a photographer approaches a location designated as dangerous, information will be provided to warn the photographer. The information processing apparatus according to feature 1.

12. The aforementioned supply unit is, If a photographer approaches a location designated as dangerous, information will be provided to warn persons who have a predetermined relationship with the photographer. The information processing apparatus according to feature 11.

13. The aforementioned supply unit is, If another photographer located within a specified range from the photographer takes a photograph of a subject not included in the photographer's aforementioned content, that photographer will be notified. The information processing apparatus according to feature 1.

14. The aforementioned supply unit is, The content provided is a compilation of photographs taken by multiple photographers with a predetermined relationship during a predetermined period. The information processing apparatus according to feature 1.

15. The specified part is, By performing image analysis on the aforementioned image, the target subject corresponding to the mode selected by the photographer is identified from among the identified targets. The aforementioned supply unit is, Provides information corresponding to the identified subject being photographed and the mode selected by the photographer. The information processing apparatus according to feature 1.

16. The aforementioned imaging device is a magnifying glass-type camera-equipped terminal device. The information processing apparatus according to feature 1.

17. A method of information processing performed by a computer, An acquisition process in which an image captured by a predetermined imaging device is acquired, The process involves identifying the subject to be photographed by performing image analysis on the image acquired in the aforementioned acquisition process, A provision step provides the photographer of the image with information that allows them to view content that compiles each of the subjects identified in the aforementioned specific step, and includes information indicating the rarity of each subject. Includes, The aforementioned provisioning process is, Information that allows access to information relevant to the subject being photographed will be provided to the photographer and related parties who have a predetermined relationship with them. An information processing method characterized by the following:

18. Acquisition procedure for obtaining images captured by a designated imaging device, An identification procedure to identify the subject of photography by performing image analysis on the image acquired by the acquisition procedure described above, A provision procedure for providing information to the photographer of the image, which, as information corresponding to the subject identified by the aforementioned identification procedure, allows the photographer to view content that compiles each subject and includes information indicating the rarity of each subject. Have the computer run it, The aforementioned provision procedure is, Information that allows access to information relevant to the subject being photographed will be provided to the photographer and related parties who have a predetermined relationship with them. An information processing program characterized by the following features.

Images