Information processing method, program, and information processing system

Abstract

To obtain more specified information from an estimation result for an imaged object.SOLUTION: An information processing method according to one embodiment executed by an information processing device comprises: a target information acquisition step of imaging a target and acquiring target information being information about the target; an estimation information generation step of acquiring estimation information estimated from the target information; and a generation step of generating secondary information from the estimation information along a prescribed condition.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing method, a program, and an information processing system. [Background technology]

[0002] Cited Document 1 discloses a program for managing the situation in a target area from multiple angles. This program acquires a first image in a time series from multiple image capturing devices installed in the monitored area, performs image analysis, and estimates the occurrence of an event caused by equipment in the monitored area. Furthermore, the program presents information based on the estimation result. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2023-009034 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, simply being presented with information based on the estimated results may leave the recipient having to consider what to do with the information, and in this regard there is room for improvement.

[0005] In consideration of the above, an object of the present invention is to obtain more specific information from the estimation results for a photographed object. [Means for solving the problem]

[0006] According to one embodiment, the information processing method is executed by an information processing device, and includes a target information acquisition step of photographing a target and acquiring target information, which is information about the target, an estimated information generation step of acquiring estimated information estimated from the target information, and a generation step of generating secondary information from the estimated information in accordance with specified conditions. Effect of the Invention

[0007] According to an embodiment, more specific information can be obtained from the estimation result for the photographed object. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a server according to an embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a user terminal according to an embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a functional configuration of a server according to an embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of a functional configuration of a user terminal according to an embodiment. [Figure 6] 5 is a flowchart illustrating an example of processing executed by the information processing system according to the embodiment. [Figure 7] 1 is a schematic diagram showing an example of an image captured by an imaging device according to an embodiment; [Figure 8] FIG. 2 is a diagram illustrating an example of a processing flow of an information processing system according to an embodiment. [Figure 9] 5A and 5B are diagrams illustrating an example of an input and output screen of a user terminal according to an embodiment. [Figure 10] 5A and 5B are diagrams illustrating an example of an input and output screen of a user terminal according to an embodiment. [Figure 11] 5A and 5B are diagrams illustrating an example of an input and output screen of a user terminal according to an embodiment. [Figure 12] 5A and 5B are diagrams illustrating an example of an input and output screen of a user terminal according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] An embodiment of an information processing system according to the present invention will be described below with reference to Figures 1 to 12. In each drawing, the same or equivalent components and parts are given the same reference numerals. Also, the dimensional ratios in the drawings are exaggerated for the convenience of explanation and may differ from the actual ratios.

[0010] (System Overview) First, an overview of the information processing system 10 according to this embodiment will be described. The information processing system 10 according to this embodiment is a system that captures an object, estimates the state of the object from the captured image, and generates secondary information according to a predetermined condition. In this embodiment, as an example, it is assumed that a photographing device installed in a facility such as a nursery school or kindergarten captures an image of an infant or a teacher as an object. The captured image is at least one of a video and an image. At least one of position information, posture information, gaze information, motion information, and type information of the infant or teacher is obtained from the captured image, and this information corresponds to the "object information" described in claim 1.

[0011] The information processing system 10 generates estimated information estimated from the target information. The estimated information is, for example, information that estimates the relationship between the target and other objects. Specifically, the relationship between the infant, teacher, etc. is estimated from the position information, gaze information, movement information, and type information of the infant, teacher, etc. The type information is information that specifies whether the subject shown in the shooting result is an infant or a teacher, and further, information that determines whether it is a specific person. The information processing system 10 converts the estimated information into natural language using a learning model 38 that has been trained to convert the estimated information into natural language and output it.

[0012] The information processing system 10 generates secondary information from the estimated information according to a predetermined condition. Specifically, the estimated information converted into natural language is input to a large-scale language model, and the generated output result is regarded as secondary information. Specific examples of the predetermined condition include "generating information to be recorded in a contact book" and "generating advice." In addition, an image generated using an image generation model according to a predetermined condition may be used as secondary information. Examples of such images include design images of items such as novelty goods and awards (see FIG. 8), but other images may also be used.

[0013] (System Configuration) Fig. 1 is a diagram showing an example of the configuration of an information processing system 10 according to this embodiment. As shown in Fig. 1, the information processing system 10 according to this embodiment includes a user terminal 12, a server 14, and an image capturing device 16, which are communicably connected to each other via a network N. The network N is, for example, a wired LAN (Local Area Network), a wireless LAN, the Internet, a public line network, a mobile data communication network, or a combination of these.

[0014] The user terminal 12 is an example of an information processing device that displays various information generated by the information processing system 10 and performs operations for using secondary information. The user terminal 12 may be a PC (Personal Computer), a smartphone, a tablet terminal, a server device, a microcomputer, a wearable device, or a combination of these.

[0015] The server 14 is an example of an information processing device that acquires target information from a moving image captured by the image capturing device 16, estimates estimated information based on the target information, and generates secondary information from the estimated information according to a predetermined condition. The server 14 may be a PC (Personal Computer), a smartphone, a tablet terminal, a server device, a microcomputer, or a combination of these. The specific configuration and operation of the server 14 will be described later.

[0016] The image capturing device 16 is an example of a device that is installed in a facility and captures the inside and outside of the facility. The image capturing device 16 may continuously capture moving images, or may automatically capture still images repeatedly at a predetermined cycle.

[0017] (Hardware configuration - Server) 2 is a block diagram showing a hardware configuration of the server 14. The server 14 includes a processor 20, a memory 22, a storage 24, and a communication I / F 26, which are communicatively connected to each other via a bus B.

[0018] The processor 20 controls each component of the server 14 and realizes the functions of the server 14 by expanding various programs stored in the storage 24 into the memory 22 and executing them. The programs executed by the processor 20 include, but are not limited to, an OS (Operating System) and various programs described below. The execution of these programs by the processor 20 realizes a part of the state visualization method according to this embodiment. The processor 20 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), or a combination of these.

[0019] The memory 22 is, for example, a Read Only Memory (ROM), a Random Access Memory (RAM), or a combination thereof. The ROM is, for example, a Programmable ROM (PROM), an Erasable Programmable ROM (EPROM), an Electrically Erasable Programmable ROM (EEPROM), or a combination thereof. The RAM is, for example, a Dynamic RAM (DRAM), a Static RAM (SRAM), a Magnetoresistive RAM (MRAM), or a combination thereof.

[0020] The storage 24 stores the OS, various programs described below, and various data. The storage 24 is, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), a storage class memory (SCM), or a combination of these.

[0021] The communication I / F 26 is an interface for connecting the server 14 to external devices including the user terminal 12 and the image capturing device 16 via the network N and for controlling communication. The communication I / F 26 is, for example, an adapter compliant with Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), Ethernet (registered trademark), or optical communication (e.g., Fibre Channel), but is not limited thereto.

[0022] (Hardware configuration - User terminal) 3 is a block diagram showing a hardware configuration of the user terminal 12. The user terminal 12 includes a processor 20, a memory 22, a storage 24, a communication I / F 26, an input / output I / F 28, an output device 30, and an input device 32, which are communicatively connected to each other via a bus B. The communication I / F 26 is an interface for connecting the user terminal 12 to an external device including the server 14 via a network N and controlling communication. The communication I / F 26 is, for example, an adapter conforming to Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), Ethernet (registered trademark), or optical communication (for example, Fibre Channel), but is not limited thereto.

[0023] The input / output I / F 28 is an interface for connecting the input device 32 and the output device 30 to the user terminal 12. The input device 32 is, for example, a mouse, a keyboard, a touch panel, a microphone, a scanner, a camera, various sensors, an operation button, or a combination of these. The output device 30 is, for example, a display, a projector, a printer, a speaker, a vibrator, or a combination of these. In this embodiment, as an example, the output device 30 and the input device 32 are an integrally configured touch panel display.

[0024] In this embodiment, the program may be written into memory 22 or storage 24 during the manufacturing stage of the user terminal 12 and server 14, or may be provided to the user terminal 12 and server 14 via the network N, or may be provided to the user terminal 12 and server 14 via a non-temporary computer-readable recording medium such as a disk media not shown.

[0025] (Functional configuration - Server) Next, the functional configuration of the server 14 will be described. Fig. 4 is a diagram showing an example of the functional configuration of the server 14. When executing various programs, the server 14 realizes various functions using the above-mentioned hardware resources. The server 14 has a storage unit 31, a processing unit 33, and a communication unit 34 as the functional configuration realized by the server 14. Each functional configuration is realized by the processor 20 reading and executing a program 36 stored in the memory 22 or the storage 24.

[0026] The communication unit 34 is realized by the communication I / F 26. The communication unit 34 transmits and receives information to and from the user terminal 12 via the network N. The communication unit 34 receives information input from the user terminal 12. In addition, the communication unit 34 transmits information to the user terminal 12, and receives a request from the user terminal 12.

[0027] The storage unit 31 is realized by the memory 22 and the storage 24. The storage unit 31 stores a program 36, a learning model 38, a target information DB 40, an estimated information DB 42, a user DB 44, and a result DB 46.

[0028] The learning model 38 is composed of at least one trained machine learning model. As an example, the learning model 38 includes an image recognition model, an image language model, and a large-scale language model. The image recognition model is a machine learning model trained to detect at least one of an object and a person in a video image when the video image is input, and to output at least one of position information, posture information, gaze information, action information, and type information of the detected target as target information. The output of the image recognition model may be object information such as a bounding box illustrated in the video image (see FIG. 7), text information such as a programming language or a natural language, other information such as voice information, or a combination of these.

[0029] The large-scale language model is a model that has been trained on large amounts of text data from internet articles, books, websites, etc., and when text data called a prompt is input, it generates and outputs processing results in text data in response to the prompt.

[0030] The image language model is a model trained with learning data that combines images and corresponding text data, and when an image is input, it extracts information from the image to generate an explanation of the image, or generates and outputs an answer to a question based on the image. Also, the image language model, in contrast to the above-mentioned input and output, when a prompt is input, generates and outputs an image related to the prompt.

[0031] The learning model 38 in the storage unit 31 performs processing not only with the image recognition model, image language model, and large-scale language model alone, but also with an appropriate combination of each model. As an example, when an image or text data is input to the learning model 38, text data based on the image is generated and output as a processing result. As a result, when an image of a photographed result is input to the learning model 38, target information is acquired from the photographed result, and estimated information estimated from the target information is generated as text data in a natural language.

[0032] The target information DB 40 is a database that stores target information acquired from the acquired photographing results. For example, the target information DB 40 stores the photographing results and at least one of the position information, posture information, gaze information, motion information, and type information of the baby, teacher, etc. acquired from the photographing results, which are linked to each other.

[0033] The estimated information DB 42 is a database that stores estimated information estimated from target information. The estimated information DB 42 stores, for example, information resulting from estimating relationships between infants, teachers, etc. (i.e., estimated information) in association with the target information.

[0034] The user DB 44 is a database that stores user account information that is registered in advance as a user account for the information processing system 10. For example, the user DB 44 stores at least one of input information and output information that is input to the user account and that is associated with the user account information.

[0035] The result DB 46 is a database in which the generated secondary information is stored. The result DB 46 stores the secondary information, the estimated information used when the secondary information was generated, the target information used to generate the estimated information, and the shooting results used when the target information was obtained, all of which are linked to one another.

[0036] The processing unit 33 has a target information acquisition unit 50, an estimation unit 52, a generation unit 54, and an output unit 56. The target information acquisition unit 50 acquires at least one of a video and an image as a result of shooting the target, which is information about the target captured by at least one of the user terminal 12 and the imaging device 16, and acquires output data (target information) of the learning model 38 obtained by inputting the video to the learning model 38. In this embodiment, at least one of position information, posture information, gaze information, action information, and type information of an infant, a teacher, etc. is acquired as the target information, as described above.

[0037] The estimation unit 52 generates estimated information estimated from the target information. That is, the estimation unit 52 acquires output data (estimated information) of the learning model 38 obtained by acquiring the target information and inputting it to the learning model 38. In this embodiment, the estimated information is information that estimates the relationship between the target and other objects, and specifically, at least one piece of information regarding the relationship between the infants, teachers, etc. is generated from the position information, gaze information, action information, and type information of the infants, teachers, etc.

[0038] The generation unit 54 generates secondary information from the estimated information in accordance with the above-mentioned predetermined conditions. Specifically, the estimated information converted into natural language is input to the learning model 38, and the generated output result is set as the secondary information. In this embodiment, text information such as advice and records, design images of items such as novelty goods and awards, etc. are generated in accordance with the predetermined conditions.

[0039] The output unit 56 outputs the secondary information generated by the generation unit 54 to the user terminal 12. Note that the output unit 56 may output not only the secondary information but also at least one of the target information, the estimated information, and the information on the predetermined condition.

[0040] (Functional configuration - User terminal) Next, the functional configuration of the user terminal 12 will be described. Fig. 5 is a diagram showing an example of the functional configuration of the user terminal 12. When executing various programs, the user terminal 12 realizes various functions using the above-mentioned hardware resources. The user terminal 12 has a storage unit 60 in which a program 36 is stored, a processing unit 62, and a communication unit 64 as the functional configuration realized by the user terminal 12. Each functional configuration is realized by the processor 20 reading and executing the program 36 stored in the memory 22 or storage 24.

[0041] The communication unit 64 is realized by the communication I / F 26. The communication unit 64 transmits and receives information to and from the server 14 via the network N. The communication unit 64 receives information transmitted from the server 14. In addition, the communication unit 64 transmits a user request from the user terminal 12 to the server 14.

[0042] The storage unit 60 stores the program 36. The processing unit 62 has an imaging control unit 66, an acquisition unit 68, and a display unit 70. The imaging control unit 66 controls imaging by the camera of the input device 32, for example. The imaging control unit 66 may control imaging by the imaging device 16 via the network N.

[0043] The acquisition unit 68 acquires information on the photographing result and the predetermined conditions for the secondary information input by the user. The information on the predetermined conditions may be text information (see Figs. 9 to 12) or images, but is not limited thereto and may also be audio information or selection result information of multiple options presented by the acquisition unit 68.

[0044] The display unit 70 displays on the output device 30 at least one of the information on the predetermined conditions input by the user, the secondary information, the target information, the estimated information received from the server 14, and the information on the predetermined conditions used in the processing by the server 14. The display unit 70 also generates an input screen for the user to input the information on the predetermined conditions and displays it on the output device 30.

[0045] 6 is a diagram related to processing executed by the information processing system 10. The processor 20 reads out the program 36 stored in the storage 24, expands it in the memory 22, and executes it to perform the processing. Although not shown, when the processor 20 receives operation information for terminating the operation of the information processing system 10, or information on the end of an operation from the user terminal 12 during the determination processing being executed (these are simply referred to as "termination operation"), the processor 20 ends the processing based on the program 36 being processed.

[0046] The processor 20 controls the photographing device 16 and the user terminal 12 to take photographs (step S100), and obtains at least one of position information, posture information, gaze information, movement information, and type information of the infant, teacher, etc. as subject information from the photographing results (step S102).

[0047] The processor 20 generates estimated information that is estimated from the acquired target information (step S104), and requests a process to display an input screen for the user to input predetermined conditions (step S106).

[0048] The processor 20 determines whether or not information on a predetermined condition has been input through the input screen (step S108). If information on a predetermined condition has not been input (step S108: NO), the processor 20 proceeds to step S106. On the other hand, if information on a predetermined condition has been input (step S108: YES), the processor 20 generates secondary information from the estimated information according to the predetermined condition (step S110).

[0049] The processor 20 causes the user terminal 12 to display information including the generated secondary information (step S112). After that, the processor 20 judges whether or not the user has instructed to end the processing in the program 36 (step S114). If there has been no instruction to end (step S114: NO), the processor 20 transitions to step S100. On the other hand, if there has been an instruction to end (step S114: YES), the processor 20 ends this processing flow.

[0050] FIG. 7 is a diagram showing an example of an image captured by the image capturing device 16. As shown in FIG. The image captured by the image capture device 16 and the processing are as shown in Fig. 7. The frame surrounding the person's face indicates, as an example, that the person's face is detected by the learning model 38. Also, the line extending from the person's face into space (the line with a dot on the space side) indicates an example of the result of estimating the person's gaze direction and focal position by the learning model 38.

[0051] FIG. 8 is a schematic diagram showing an example of a processing flow of the information processing system 10. As shown in FIG. The flow of processing performed by the information processing system 10 is shown in FIG.

[0052] FIG. 9 is a schematic diagram showing an example of estimated information, a predetermined condition, and secondary information corresponding thereto in the information processing system 10. As shown in FIG. An example of the input and output by the information processing system 10 is shown in FIG.

[0053] FIG. 10 is a schematic diagram showing an example of estimated information, a predetermined condition, and secondary information corresponding thereto in the information processing system 10. As shown in FIG. An example of the input and output by the information processing system 10 is shown in FIG.

[0054] FIG. 11 is a schematic diagram showing an example of estimated information, a predetermined condition, and secondary information corresponding thereto in the information processing system 10. As shown in FIG. An example of the input and output by the information processing system 10 is shown in FIG.

[0055] FIG. 12 is a schematic diagram showing an example of estimated information, a predetermined condition, and secondary information corresponding thereto in the information processing system 10. As shown in FIG. An example of the input and output by the information processing system 10 is shown in FIG.

[0056] According to the information processing system 10 of the present embodiment, a target information acquisition step of photographing a target and acquiring target information, which is information about the target, an estimated information generation step of acquiring estimated information estimated from the target information, and a generation step of generating secondary information from the estimated information according to a predetermined condition are executed, so that various information based on the shooting results can be acquired from the shot video, such as information to be written in a contact book, advice, design images, etc. In other words, more specific information can be obtained from the estimated results for the photographed target.

[0057] In addition, in the present embodiment, the target information is acquired and the estimated information is estimated from the target information. However, the present embodiment is not limited to this. Target information that matches a predetermined request may be selected from the acquired target information, and the estimated information may be estimated from the selected target information. Specifically, "play", "eat", and "sleep" are prepared in advance as the predetermined request, and video image information that matches the scenes of "play", "eat", and "sleep" is selected from the acquired video image information. Then, by estimating the estimated information from the selected video image information, the estimated information and the secondary information can be made closer to the output. Note that, although "play", "eat", and "sleep" are given as the predetermined request, the present embodiment is not limited to these, and other requests may be used. Furthermore, as an example of the predetermined request, the schedule for today in the facility where the present system is installed may be input into the large-scale language model, and target information may be selected based on a predetermined requirement that is more specific than "play", "eat", and "sleep" (for example, "play ball", "hamburger steak", "nap", etc.). This makes it possible to make the estimated information and the secondary information more accurate.

[0058] Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, etc. within the scope that can achieve the object of the present invention are included in the present invention.

[0059] Also, for example, the above-mentioned series of processes can be executed by hardware or software. In other words, the functional configuration is merely an example and is not particularly limited. That is, it is sufficient that the information processing system is provided with a function capable of executing the above-mentioned series of processes as a whole, and there is no particular limit to what kind of functional block is used to realize this function. In addition, the location of the functional block is not particularly limited and may be arbitrary. For example, the functional block of the server may be transferred to a user terminal or the like. Conversely, the functional block of the user terminal may be transferred to a server or the like. In addition, one functional block may be configured by hardware alone, software alone, or a combination thereof.

[0060] For example, when a series of processes is executed by software, a program constituting the software is installed in a computer or the like from a network or a recording medium. The computer may be a computer incorporated in dedicated hardware. The computer may also be a computer capable of executing various functions by installing various programs, such as a server, a general-purpose smartphone, or a personal computer.

[0061] Furthermore, for example, a recording medium containing such a program may not only be constituted by a removable medium (not shown) that is distributed separately from the device main body in order to provide the program to the user, but may also be constituted by a recording medium that is provided to the user in a state in which it is pre-installed in the device main body.

[0062] In this specification, the steps of describing a program to be recorded on a recording medium include not only processes that are performed chronologically according to the order, but also processes that are not necessarily performed chronologically but are executed in parallel or individually. In addition, in this specification, the term "system" refers to an overall device that is composed of a plurality of devices, a plurality of means, etc.

[0063] In other words, the program to which the present invention is applied is sufficient as long as it has the following configuration, and can take various forms. That is, the program to which the present invention is applied is The process includes a target information acquisition step of photographing a target and acquiring target information, which is information about the target, an estimated information generation step of acquiring estimated information estimated from the target information, and a generation step of generating secondary information from the estimated information in accordance with specified conditions.

[0064] This makes it possible to obtain more specific information from the estimation results for the photographed subject.

[0065] In the above-described embodiment, the system generates secondary information from the photographed results in a nursery school or kindergarten, but the present invention is not limited to this, and may generate secondary information from other photographed results. As an example, there is a system that generates a report on the state of products that have flown through a production line in a factory as secondary information from the photographed results of photographing the production line, or provides reports on driving and accidents, traffic information, traffic control information such as traffic signals, etc. from the photographed results of a drive recorder installed in a vehicle. In addition, the system can be applied to various fields such as a security system that generates secondary information such as an alarm, a notification to the owner, and an automatic report to the police from the photographed results, advice on personal health conditions from the photographed results, and a customized training program from the photographed results, an agricultural support system that generates secondary information such as optimization of fertilization and irrigation, optimal harvesting time, and suggestions for pest control from the photographed results, and a shopping support system that generates purchase recommendations, suggestions for similar products, and price comparison information from the photographed results.

[0066] <Additional Notes> The present embodiment includes the following disclosure.

[0067] (Appendix 1) An information processing method executed by an information processing device, An object information acquisition step of photographing an object and acquiring object information which is information about the object; an estimated information generating step of generating estimated information estimated from the target information; a generating step of generating secondary information from the estimated information in accordance with a predetermined condition; An information processing method comprising:

[0068] (Appendix 2) The information processing device acquires the target information from at least one of a moving image and a still image in the target information acquisition step. 2. An information processing method as described in Appendix 1.

[0069] (Appendix 3) The target information is location information of the target. 10. The information processing method according to claim 1 or 2.

[0070] (Appendix 4) The target information is posture information of the target. An information processing method according to any one of Supplementary Note 1 to Supplementary Note 3.

[0071] (Appendix 5) The target information is line of sight information of the target. An information processing method according to any one of Supplementary Note 1 to Supplementary Note 4.

[0072] (Appendix 6) The target information is motion information of the target. An information processing method according to any one of Supplementary Note 1 to Supplementary Note 5.

[0073] (Appendix 7) The target information acquires type information of the target. An information processing method according to any one of Supplementary Notes 1 to 6.

[0074] (Appendix 8) The estimated information estimates a relationship between the target and other objects from the target information. An information processing method according to any one of Supplementary Notes 1 to 7.

[0075] (Appendix 9) The secondary information is advice information. An information processing method according to any one of Supplementary Note 1 to Supplementary Note 8.

[0076] (Appendix 10) The information processing device selects, from the acquired target information, the target information that has a high degree of coincidence with a predetermined request, and Estimating the estimated information from the selected target information; An information processing method according to any one of Supplementary Notes 1 to 9.

[0077] (Appendix 11) An object information acquisition step of photographing an object and acquiring object information which is information about the object; an estimated information generating step of acquiring estimated information estimated from the target information; a generating step of generating secondary information from the estimated information in accordance with a predetermined condition; A program that causes a computer to execute the following.

[0078] (Appendix 12) An information processing device and an imaging device capable of communicating with the information processing device, An object information acquisition step of photographing an object and acquiring object information which is information about the object; an estimated information generating step of acquiring estimated information estimated from the target information; a generating step of generating secondary information from the estimated information in accordance with a predetermined condition; An information processing system that executes the above. [Explanation of symbols]

[0079] 10 Information Processing Systems 12 User terminal (information processing device, subject information acquisition device, display device) 14 Server (information processing device, subject information acquisition device, estimation device)

Claims

1. An information processing method executed by an information processing device, An object information acquisition step of photographing an object and acquiring object information which is information about the object; an estimated information generating step of generating estimated information estimated from the target information; a generating step of generating secondary information based on the estimated information in accordance with a predetermined condition for a generation result arbitrarily inputted; An information processing method comprising:

2. The information processing device acquires the target information from at least one of a moving image and a still image in the target information acquisition step. The information processing method according to claim 1 .

3. The target information is location information of the target. The information processing method according to claim 1 .

4. The target information is posture information of the target. The information processing method according to claim 1 .

5. The target information is line of sight information of the target. The information processing method according to claim 1 .

6. The target information is motion information of the target. The information processing method according to claim 1 .

7. The target information acquires type information of the target. The information processing method according to claim 1 .

8. The estimated information estimates a relationship between the target and other objects from the target information. The information processing method according to claim 1 .

9. The secondary information is advice information. The information processing method according to claim 1 .

10. The information processing device selects, from the acquired target information, the target information that has a high degree of coincidence with a predetermined request prepared in advance, and Estimating the estimated information from the selected target information; The information processing method according to claim 1 .

11. An object information acquisition step of photographing an object and acquiring object information which is information about the object; an estimated information generating step of acquiring estimated information estimated from the target information; a generating step of generating secondary information based on the estimated information in accordance with a predetermined condition for a generation result arbitrarily inputted; A program that causes a computer to execute the following.

12. An information processing device and an imaging device capable of communicating with the information processing device, An object information acquisition step of photographing an object and acquiring object information which is information about the object; an estimated information generating step of acquiring estimated information estimated from the target information; a generating step of generating secondary information based on the estimated information in accordance with a predetermined condition for a generation result arbitrarily inputted; An information processing system that executes the above.

Images