Program, method, information processing device, and system

Abstract

To reduce burdens of an operator when acquiring images with excellent manageability.SOLUTION: There is provided a program for causing a computer having a processor and a memory to execute. The program causes the processor to execute the steps of: extracting candidate tags based on information related to photography from a plurality of tags, any of which includes characters related to a target to be photographed; presenting the extracted candidate tags in a selectable manner; accepting a designation of a user for the presented candidate tags; photographing the target to be photographed; and storing the photographed image in association with the tag designated by the user.SELECTED DRAWING: Figure 10

Description

Technical Field

[0001] The present disclosure relates to a program, a method, an information processing apparatus, and a system.

Background Art

[0002] A construction photo management method for further reducing the burden on workers has been proposed (see Patent Document 1). In Patent Document 1, a construction photo management system creates a tag composed of a one-dimensional or two-dimensional code and incorporates it into an image, so that necessary construction data can be automatically read by an information processing unit.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In Patent Document 1, a tag composed of a one-dimensional or two-dimensional code is created, and a terminal for displaying tag data is placed at the shooting location to take a photo. However, there is a demand for further reducing the burden on workers.

[0005] An object of the present disclosure is to further reduce the burden on workers when acquiring an image with excellent manageability.

Means for Solving the Problems

[0006] A program for causing a computer including a processor and a memory to execute. The program causes the processor to perform steps of extracting candidate tags from a plurality of tags including characters related to a shooting target based on shooting-related information, presenting the extracted candidate tags in a selectable manner, receiving a designation from a user for the presented candidate tags, shooting the shooting target, and associating and storing the shot image with the tag designated by the user.

Effect of the Invention

[0007] According to the present disclosure, the burden on the operator when acquiring an image with excellent manageability can be further reduced.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Mode for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed descriptions thereof will not be repeated.

[0010] <Overview> The terminal device installed with the program according to the present embodiment presents a plurality of tags with high probability assigned to the image data to the user. The terminal device stores the captured image in association with the tags selected by the user.

[0011] When the user creates a report, when an image attached to the report is selected by the user, the terminal device reads the tags attached to the selected image and inputs the characters related to the tags into the report in an editable manner. The user creates a report using the characters related to the tags.

[0012] <1 Configuration Diagram of the Whole System> FIG. 1 is a block diagram showing an example of the overall configuration of the system 1. The system 1 shown in FIG. 1 includes, for example, a terminal device 10 and a server 20. The terminal device 10 and the server 20 are communicatively connected via, for example, a network 80.

[0013] In FIG. 1, an example is shown in which the system 1 includes one terminal device 10. However, the number of terminal devices 10 included in the system 1 is not limited to one. The terminal device 10 is, for example, a terminal possessed by a user. The number of terminal devices 10 included in the system 1 may be two or more.

[0014] In FIG. 1, an example is shown in which the system 1 includes the server 20. However, the servers included in the system 1 are not limited to these. For example, servers other than the server 20 may be included.

[0015] In the present embodiment, an aggregate of a plurality of devices may be regarded as one server. The way of distributing the plurality of functions required to implement the server 20 according to the present embodiment to one or more pieces of hardware can be appropriately determined in view of the processing capabilities of each piece of hardware and / or the specifications required for the server 20.

[0016] The terminal device 10 shown in FIG. 1 is an information processing device operated by a user. In the present embodiment, the user is, for example, a person who performs a predetermined diagnostic task. In the present embodiment, the predetermined diagnostic task includes, for example, tasks related to house diagnosis or tasks related to diagnosis for farmers' insurance. The terminal device 10 is realized by, for example, a mobile terminal such as a smartphone or a tablet having a camera function. If the terminal device 10 has a camera function, it may be a wearable terminal such as an HMD (Head Mount Display) or a wristwatch-type terminal. Note that the terminal device 10 may be a stationary PC (Personal Computer) or a laptop PC.

[0017] The terminal device 10 includes a communication IF (Interface) 12, an input device 13, an output device 14, a memory 15, a storage 16, and a processor 19. The input device 13 is a device for receiving an input operation from a user (for example, a pointing device such as a touch panel, a touch pad, a mouse, etc., a keyboard, etc.). The output device 14 is a device for presenting information to the user (a display, a speaker, etc.).

[0018] Server 20 is an information processing device that manages, for example, tags attached to image data. Server 20 is realized by, for example, a computer connected to network 80. As shown in FIG. 1, server 20 includes a communication IF 22, an input / output IF 23, a memory 25, a storage 26, and a processor 29. The input / output IF 23 functions as an interface with an input device for receiving input operations from a user and an output device for outputting information to the user.

[0019] Each information processing device is composed of a computer including an arithmetic unit and a storage device. The basic hardware configuration of the computer and the basic functional configuration of the computer realized by the hardware configuration will be described later. For each of terminal device 10 and server 20, descriptions overlapping with the basic hardware configuration of the computer and the basic functional configuration of the computer described later are omitted.

[0020] <1.1 Configuration of Terminal Device> FIG. 2 is a block diagram showing a configuration example of terminal device 10 shown in FIG. 1. As shown in FIG. 2, terminal device 10 includes a communication unit 120, an input device 13, an output device 14, an audio processing unit 17, a microphone 171, a speaker 172, a camera 160, a position information sensor 150, a storage unit 180, and a control unit 190. Each block included in terminal device 10 is electrically connected by, for example, a bus or the like.

[0021] The communication unit 120 performs processes such as modulation / demodulation processing for terminal device 10 to communicate with other devices. The communication unit 120 performs transmission processing on the signal generated by the control unit 190 and transmits it to the outside (for example, server 20). The communication unit 120 performs reception processing on the signal received from the outside and outputs it to the control unit 190.

[0022] The input device 13 is a device for a user operating the terminal device 10 to input instructions or information. The input device 13 is realized by, for example, a touch-sensitive device 131 where an instruction is input by touching an operation surface. When the terminal device 10 is a PC or the like, the input device 13 may be realized by a reader, a keyboard, a mouse, or the like. The input device 13 converts an instruction input from the user into an electrical signal and outputs the electrical signal to the control unit 190. Note that the input device 13 may include, for example, a reception port for receiving an electrical signal input from an external input device.

[0023] The output device 14 is a device for presenting information to the user operating the terminal device 10. The output device 14 is realized by, for example, a display 141. The display 141 displays data according to the control of the control unit 190. The display 141 is realized by, for example, an LCD (Liquid Crystal Display), an organic EL (Electro-Luminescence) display, or the like.

[0024] The audio processing unit 17 performs, for example, digital-to-analog conversion processing of an audio signal. The audio processing unit 17 converts a signal given from the microphone 171 into a digital signal and gives the converted signal to the control unit 190. Also, the audio processing unit 17 gives an audio signal to the speaker 172. The audio processing unit 17 is realized by, for example, a processor for audio processing. The microphone 171 receives an audio input and gives an audio signal corresponding to the audio input to the audio processing unit 17. The speaker 172 converts an audio signal given from the audio processing unit 17 into an audio and outputs the audio to the outside of the terminal device 10.

[0025] The camera 160 is a device for receiving light by a light-receiving element and outputting it as image data.

[0026] The location information sensor 150 is a sensor that detects the location of the terminal device 10 and is, for example, a GPS (Global Positioning System) module. The GPS module is a receiving device used in a satellite positioning system. In the satellite positioning system, signals from at least three or four satellites are received, and based on the received signals, the current location of the terminal device 10 on which the GPS module is installed is detected. The location information sensor 150 may detect the current location of the terminal device 10 from the location of the wireless base station to which the terminal device 10 is connected. The location information sensor 150 may acquire the current location of the terminal device 10 using a beacon signal. Also, the location information sensor 150 may acquire the current location of the terminal device 10 using the IP address of the terminal device 10. The current location acquired by the location information sensor 150 may be the coordinates or address where the terminal device 10 is currently located, or may be the name of a facility or the like where the terminal device 10 is currently staying.

[0027] The storage unit 180 is realized by, for example, the memory 15 and the storage 16, etc., and stores data and programs used by the terminal device 10. The storage unit 180 stores, for example, user information 181, tag information 182, related information 183, image information 184, and report information 185.

[0028] The user information 181 stores, for example, personal information about the user who uses the terminal device 10. Details will be described later. The tag information 182 stores, for example, information about the stored tags. Details will be described later. The related information 183 stores, for example, the relationship between tags. Details will be described later. The image information 184 stores, for example, information about the captured images. Details will be described later. The report information 185 stores, for example, information about the report. Details will be described later.

[0029] The control unit 190 is realized by the processor 19 reading the program stored in the storage unit 180 and executing the instructions included in the program. The control unit 190 controls the operation of the terminal device 10. By operating according to the program, the control unit 190 exhibits functions as, for example, an operation reception unit 191, a transmission / reception unit 192, a management unit 193, a shooting control unit 194, a creation unit 195, and a presentation control unit 196.

[0030] The operation reception unit 191 performs processing for receiving an instruction or information input from the input device 13. Specifically, for example, the operation reception unit 191 receives an instruction or information input from the touch-sensitive device 131 or the like.

[0031] Also, the operation reception unit 191 receives a voice instruction input from the microphone 171. Specifically, for example, the operation reception unit 191 receives a voice signal input from the microphone 171 and converted into a digital signal by the voice processing unit 17. The operation reception unit 191 obtains an instruction from the user, for example, by analyzing the received voice signal and extracting a predetermined noun.

[0032] The transmission / reception unit 192 performs processing for the terminal device 10 to transmit and receive data to and from an external device such as the server 20 according to a communication protocol. Specifically, for example, the transmission / reception unit 192 transmits an instruction input by the user to the server 20. Also, the transmission / reception unit 192 receives information provided from the server 20.

[0033] The management unit 193 manages information related to the tags stored in the tag information 182. Specifically, for example, the management unit 193 manages the information related to the tags so that the information related to the tags stored in the tag information 182 is the latest information. More specifically, for example, the management unit 193 checks with the server 20 at a predetermined cycle whether there has been an update to the information related to the tags. The predetermined cycle may be, for example, once a day, once every few days, once every predetermined week, etc. When there is an update to the information related to the tags, such as an increase or decrease in the tags, the server 20 transmits the information related to the tags stored in the server 20 to the terminal device 10. The management unit 193 receives the information transmitted from the server 20 and updates the information stored in the tag information 182.

[0034] The server 20 may transmit the information related to the tags stored in the server 20 to the terminal device 10 at a predetermined cycle. The server 20 may transmit the information only when there is an update, or may transmit the information even when there is no update.

[0035] The shooting control unit 194 controls the storage of the images captured by the camera 160 of the terminal device 10. Specifically, for example, the shooting control unit 194 extracts, as candidate tags, tags suitable for the shooting target by the user from the tags stored in the tag information 182. The shooting control unit 194 extracts, as candidate tags, tags that satisfy a predetermined requirement related to shooting, for example, from among a plurality of tags stored in the tag information 182. Tags that satisfy the predetermined requirement include, for example, the following. These requirements may be adopted independently, or at least two of them may be combined and adopted. · Tags associated with a management group that manages the acquired image data · Tags associated with a predetermined attribute included in the personal information of the user · Tags associated with the shooting target · Tags associated with the shooting target recognized by image analysis · Tags associated with the shooting target identified by decoding a code related to the shooting target (for example, a QR code (registered trademark) attached to the shooting target) · Tags associated with the situation grasped based on the user's schedule · Tags associated with the situation grasped from the user's current location

[0036] Image analysis may be performed, for example, by an image analysis model. The image analysis model is a trained model generated, for example, by causing a machine learning model to perform machine learning according to a model learning program. More specifically, the image analysis model is generated, for example, using a feedforward multi-layer network. As the multi-layer network, for example, a deep neural network (DNN) that is a multi-layer neural network targeted for deep learning can be used. Note that the image analysis model may be generated using existing technologies. The shooting control unit 194 estimates the devices included in the image, for example, by inputting the image into the image analysis model. The information to be estimated is, for example, the name of the device, the identification information of the device, etc.

[0037] The shooting control unit 194 may, for example, create tags based on the user's current state, and extract candidate tags from the tags stored in the tag information 182 and the created tags. The user's current state includes, for example, the user's schedule. The schedule may be stored, for example, in the user information 181 or may be managed by a predetermined server. The shooting control unit 194 creates tags, for example, using the text corresponding to the current time in the schedule. Specifically, for example, when the schedule is organized as "14:00 to 15:00: Diagnosis of BBBB at Factory AAAA" and the time is 14:00, the shooting control unit 194 creates tags related to Factory AAAA and tags related to BBBB that is the diagnosis target.

[0038] The current state of the user includes, for example, the user's current location. The user's current location is obtained by, for example, the position information sensor 150. The shooting control unit 194 creates a tag using the text related to the obtained current location. Specifically, for example, when the obtained current location is "Facility: Factory AAAA", the shooting control unit 194 creates a tag related to Factory AAAA. Also, for example, when the obtained current location is information that does not directly represent a facility, such as "Coordinates: (X, Y)" or "Address: CCCC", the shooting control unit 194 acquires the facility associated with "Coordinates: (X, Y)" or "Address: CCCC", and creates a tag related to the acquired facility.

[0039] The shooting control unit 194 receives, for example, a designation from the user for the extracted candidate tags. The shooting control unit 194 controls the camera 160 to shoot the shooting target. Note that in this embodiment, shooting the shooting target is not limited to, for example, storing the image data generated by the camera 160 in the storage unit 180. That is, shooting is not limited to storing the image data executed by pressing the shooting button, and also includes displaying the image obtained by the camera 160 on the display 141.

[0040] The shooting control unit 194 stores, for example, the image data generated by the camera 160 in the image information 184 in response to the pressing of the shooting button. At this time, the shooting control unit 194 associates the tag designated by the user with the image data.

[0041] When there is no designation from the user for the extracted candidate tags, the shooting control unit 194, for example, identifies the shooting target, and acquires the tag associated with the identified shooting target from the candidate tags. The shooting control unit 194 may associate the acquired tag with the image data stored in the image information 184. Specifically, the shooting control unit 194 identifies the shooting target being shot, for example, by image analysis. Also, when the image includes a code, the shooting control unit 194 acquires information for identifying the shooting target by decoding the code, and identifies the shooting target based on the information.

[0042] When the imaging control unit 194 associates a tag with image data by recognizing the imaging object, it may notify the user that the tag has been associated without the user's designation. The imaging control unit 194 may change the tag associated with the image data in response to an instruction from the user after storing the image data. The imaging control unit 194 stores, for example, that the tag has been changed. The imaging control unit 194 may improve the accuracy of the process of automatically attaching tags based on, for example, the information that the tags have been changed.

[0043] The creation unit 195 creates a report. Specifically, for example, the creation unit 195 creates a report regarding a predetermined diagnosis in response to an instruction from the user. The creation unit 195 accepts the designation of an image to be attached to the report. The creation unit 195 inputs, in an editable manner, the characters related to the tag associated with the designated image into the input form of the report. The creation unit 195 accepts an edit from the user and creates a report.

[0044] The presentation control unit 196 controls the output device 14 in order to present predetermined information to the user. Specifically, for example, the presentation control unit 196 causes the image at the time of imaging the imaging object to be displayed on the display 141. Further, the presentation control unit 196 causes, for example, the candidate tags extracted by the imaging control unit 194 to be displayed on the display 141. At this time, the presentation control unit 196 displays the candidate tags based on, for example, the relevance of the tags.

[0045] Further, the presentation control unit 196 causes, for example, the image at the time of creating a report to be displayed on the display 141.

[0046] <1.2 Functional Configuration of Server> FIG. 3 is a diagram showing an example of the functional configuration of the server 20. As shown in FIG. 3, the server 20 functions as a communication unit 201, a storage unit 202, and a control unit 203.

[0047] The communication unit 201 performs processes for the server 20 to communicate with external devices.

[0048] The storage unit 202 has, for example, a tag table 2021 and the like. Note that the table stored in the storage unit 202 is not limited to this.

[0049] The tag table 2021 is a table that stores information regarding tags. The tag table 2021 is a table having columns such as a tag (content), related attributes, related devices, related facilities, related groups, etc., with the tag ID as a key.

[0050] The control unit 203 is realized by the processor 29 reading a program stored in the storage unit 202 and executing instructions included in the program. By operating according to the program, the control unit 203 exhibits functions shown as, for example, a reception control module 2031, a transmission control module 2032, and a management module 2033.

[0051] The reception control module 2031 controls the process in which the server 20 receives a signal from an external device according to a communication protocol.

[0052] The transmission control module 2032 controls the process in which the server 20 transmits a signal to an external device according to a communication protocol.

[0053] The management module 2033 manages information of the table stored in the storage unit 202. Specifically, for example, the management module 2033 manages information regarding tags stored in the tag table 2021.

[0054] <2 Data Structure> FIGS. 4 to 8 are diagrams showing the data structure of information stored in the terminal device 10. Note that FIGS. 4 to 8 are examples and do not exclude data not described. Also, even data included in the same information may be stored in separate storage areas in the storage unit 180.

[0055] FIG. 4 is a diagram showing the data structure of user information 181. The user information 181 shown in FIG. 4 has columns such as name, age, gender, date of birth, contact information, and affiliation, with the user ID as the key.

[0056] The user ID is an item that stores an identifier for uniquely identifying a user. The name is an item that stores the user's name. The age is an item that stores the user's age. The gender is an item that stores the user's gender. The date of birth is an item that stores the user's date of birth. The contact information is an item that stores the user's contact information. The affiliation is an item that stores the user's affiliation. The user's affiliation represents, for example, an attribute related to a predetermined diagnostic service. For example, the item "affiliation" includes departments, sections, etc. of a predetermined company involved in home diagnosis. Also, for example, the item "affiliation" includes departments, sections, etc. of a predetermined company involved in diagnosis for farmers' insurance.

[0057] FIG. 5 is a diagram showing the data structure of tag information 182. The tag information 182 shown in FIG. 5 has columns such as tag ID, tag, related attributes, related devices, related facilities, related groups, etc., with the tag ID as the key.

[0058] The tag ID is an item that stores an identifier for uniquely identifying a tag. The tag is an item that stores the content of the tag. In the item "tag", for example, text information representing the content of the tag is stored. In the example shown in FIG. 5, in the item "tag", tags including text related to the area to be diagnosed, for example, are stored. Also, in the item "tag", tags including text related to the device used in the diagnosis are stored. Also, in the item "tag", tags including text related to the parts used in the device are stored.

[0059] Tags related to the area may include, for example, the following. · Text related to the equipment or facility to be diagnosed · Text related to the area where the equipment is constructed · Text related to the process being carried out on the equipment to be diagnosed ·Text related to the facility or establishment where the device to be diagnosed is used

[0060] Tags related to the area include, for example, ash treatment (high-concentration treatment facility), ash treatment (low-concentration treatment facility), ash treatment (fly ash treatment facility), etc.

[0061] Tags related to the device may include, for example, the following. ·Text related to the device used in the facility or establishment to be diagnosed ·Text related to the device to be diagnosed ·Text related to the device used in the diagnosis

[0062] Tags related to the device include, for example, ammonia injection device, ammonia extraction device, nitrogen oxide treatment device, hydroxide treatment device, oxide treatment device, ampere breaker, etc. Tags related to parts include, for example, text related to the name of a predetermined part.

[0063] The item "tag" includes, for example, text that can be utilized as a document when creating a report. For example, in a report, there is an item for reporting the content of the diagnosis. In this item, for example, a report on the diagnosis performed in the facility or establishment is described. The item "tag" stores, for example, words related to the diagnosis that are used when explaining the diagnosis.

[0064] The related attribute is an item that stores the attributes of the user associated with the tag. The attributes to which the user belongs, specifically, for example, depending on the affiliation, the facility or establishment to be diagnosed may be determined. Also, the attributes to which the user belongs, specifically, for example, depending on the affiliation, the device used in the diagnosis or the device to be diagnosed may be determined. Also, the attributes to which the user belongs, specifically, for example, depending on the affiliation, the parts used in the device may be determined. The item "related attribute" stores the attributes of the user associated with each tag.

[0065] The related device is an item that stores devices associated with tags. The item "related device" stores, for example, the devices used in such a diagnosis or the devices that are the subject of the diagnosis. Depending on the device, the facilities or establishments used may be specified. Also, depending on the device, related devices may be specified. Further, depending on the device, the parts used may be specified. The item "related device" stores the devices associated with each tag.

[0066] The related facility is an item that stores the area (facility or establishment) associated with a tag. The item "related facility" stores, for example, the area where the diagnosis is performed. Depending on the area, the facility or establishment that is the subject of the diagnosis may be specified. Also, depending on the area, the devices used in the diagnosis or the devices that are the subject of the diagnosis may be specified. Further, depending on the area, the parts used in the device may be specified. The item "related facility" stores the areas associated with each tag.

[0067] The management group is an item that stores the management group that manages the captured images. The management group is, for example, a group for collectively managing the information obtained in related diagnoses. Similar tags are associated with the image data managed by the management group. For example, when starting a diagnosis, the user sets a group for managing the information obtained. The image data obtained in the diagnosis is managed by, for example, the set management group. The item "management group" stores, for each tag, the management group with a high tendency for the tag to be associated.

[0068] Figure 6 is a diagram showing the data structure of the related information 183. The related information 183 shown in Figure 6 stores the relevance between tags. Specifically, for example, the tags have a tree structure, and each element has a plurality of child elements. More specifically, the tags have a three-layer tree structure, with "device" as a child element of the element related to "area" and "part" as a child element of the element related to "device".

[0069] FIG. 7 is a diagram showing the data structure of the image information 184. The image information 184 shown in FIG. 7 has columns such as the shooting date and time, tags, the photographer, and image data, with the image ID as the key.

[0070] The image ID is an item that stores an identifier for uniquely identifying the image data. The shooting date and time is an item that stores the date and time when the image data was stored. The tag is an item that stores tags associated with the image data. In the example shown in FIG. 7, a plurality of tags are associated with each image data. Note that the number of tags associated with the image data may be one. The information stored in the "tag" item may be the text information of the tag or the tag ID. The photographer is an item that stores the user who took the image. In the "photographer" item, for example, the user ID of the user who took the image is stored. Note that the name of the user who took the image may be stored in the "photographer" item. The image data is an item that stores the image data itself. The "image data" item may store reference information to an image data file located elsewhere.

[0071] FIG. 8 is a diagram showing the data structure of the report information 185. The report information 185 shown in FIG. 8 is a table having columns such as the report name, the creator, the creation date, and report data, with the report ID as the key.

[0072] The report ID is an item that stores an identifier for uniquely identifying report data. The report name is an item that stores the name of the report. The report name may be set by the user, for example, or may be automatically set from the diagnosis content. The creator is an item that stores the user who created the report. In the item "creator", for example, the user ID of the user who created the report is stored. Note that the name of the user who created the report may be stored in the item "creator". The creation date is an item that stores the date and time when the report was created. The report data is an item that stores the report data itself. The item "report data" may store reference information for a report data file located elsewhere.

[0073] <3 Operations> (Image recording process) In a predetermined diagnosis operation, the processing of the terminal device 10 when the user operates the terminal device 10 and stores the images necessary for the diagnosis will be described.

[0074] First, when the user starts operating the terminal device 10, for example, the user operates the terminal device 10 to input their login ID and password. When the user starts the diagnosis, for example, the user operates the terminal device 10 to select a management group that manages the information obtained in the diagnosis to be performed.

[0075] Figure 9 is a flowchart showing an example of the operation of the terminal device 10 when storing image data. When the user needs to store an image of a predetermined target during a predetermined diagnosis, the user operates the terminal device 10 to photograph the target. The user instructs the terminal device 10 to extract candidate tags on the photographing screen, for example.

[0076] In step S11, the terminal device 10 acquires information related to diagnosis. Specifically, for example, when extraction of candidate tags is instructed, the shooting control unit 194 reads out the affiliation of the user stored in the user information 181 as a related attribute. Further, the shooting control unit 194 acquires, for example, the schedule of the user, and based on the acquired schedule, acquires the currently executing schedule. The shooting control unit 194 acquires facilities or installations etc. included in the acquired schedule as related facilities. Further, the shooting control unit 194 acquires, for example, the facility or installation etc. where the user is currently located as a related facility based on the current position acquired by the position information sensor 150. Further, the shooting control unit 194 recognizes, for example, the device to be photographed and identifies the device. The shooting control unit 194 acquires the identified device as a related device.

[0077] Note that the information related to diagnosis acquired by the shooting control unit 194 may be a part of the above, or further different information may be added.

[0078] In step S12, the terminal device 10 extracts candidate tags. Specifically, for example, the shooting control unit 194 extracts candidate tags from a plurality of tags stored in the tag information 182 based on the set management group, the acquired information related to diagnosis, or a combination thereof. More specifically, the shooting control unit 194 extracts, for example, tags in which a management group, a related attribute, a related device, a related facility, or a combination of at least two of these are stored in the record from the tag information 182.

[0079] Thereby, for example, the following tags are extracted as candidate tags. · Tags associated with the group that manages the acquired image data · Tags associated with a predetermined attribute included in the personal information of the user · Tags associated with the device as the shooting target

[0080] In step S13, the terminal device 10 presents the extracted candidate tags to the user. Specifically, for example, the presentation control unit 196 causes the display 141 to display the extracted candidate tags in a selectable manner for the user. The user selects a desired candidate tag from among the plurality of candidate tags displayed on the display 141.

[0081] In step S14, the terminal device 10 receives the user's selection of the candidate tags. Specifically, for example, the shooting control unit 194 receives a selection instruction from the user for the plurality of candidate tags displayed on the display 141. The user selects, for example, a plurality of tags that can be expected to contribute when extracting image data. Also, the user selects, for example, a plurality of tags that can be expected to be useful when creating a report. There is no limit to the number of tags selected. When the user selects a tag, the user presses a predetermined icon to switch the display to a screen for inputting an instruction to store the image.

[0082] FIG. 10 is a schematic diagram showing an example of the display of the terminal device 10 when storing an image necessary for diagnosis. In the example shown on the left in FIG. 10, the presentation control unit 196 causes the display 141 to display a first display area 1411, a button 1412, and an icon 1413. The first display area 1411 is an area for displaying the object being photographed. The button 1412 is a button for inputting an instruction to store the photographed content as image data. The icon 1413 is an icon for inputting an instruction to switch the display to a screen for selecting tags. That is, the icon 1413 is an icon for instructing the extraction of candidate tags. The icon 1413 has, for example, a shape imitating the shape of a tag. When the icon 1413 is pressed by the user, the presentation control unit 196 switches the display to the right in FIG. 10.

[0083] In the example shown on the right in FIG. 10, the presentation control unit 196 causes the display 141 to display a first display area 1411 and a second display area 1414. The second display area 1414 is an area for displaying candidate tags. The presentation control unit 196 displays the candidate tags in the second display area 1414 so that the user can select them. When a candidate tag displayed in the second display area 1414 is selected by the user, the presentation control unit 196 changes the appearance of the selected candidate tag so that it can be recognized that it has been selected. The presentation control unit 196 displays the tag selected from the candidate tags in the first display area 1411. The presentation control unit 196 may attach an indicator that can cancel the selection to the tag displayed in the first display area 1411. When the selection of the tag is completed, the user inputs a predetermined operation to switch the display of the display 141 from the right in FIG. 10 to the left in FIG. 10. When the display is switched to the left in FIG. 10 after the tag is selected, the presentation control unit 196 may maintain the tag displayed in the first display area 1411 as it is in the right in FIG. 10.

[0084] In FIG. 10, an example in which candidate tags are arranged and displayed in the second display area 1414 has been described. However, the display of the candidate tags is not limited to this. The presentation control unit 196 may display the candidate tags in a manner that takes into account the relevance between the tags, for example. The presentation control unit 196 may display the tags starting from the tags to which the upper hierarchy is assigned, and display the lower tags when the upper tag is selected, for example. Specifically, for example, the presentation control unit 196 first causes the display 141 to display candidate tags whose element is "area". When a candidate tag whose element is "area" is selected, the presentation control unit 196 causes the display 141 to display candidate tags of "device" belonging to the selected candidate tag. When a candidate tag whose element is "device" is selected, the presentation control unit 196 causes the display 141 to display candidate tags of "parts" belonging to the selected candidate tag.

[0085] In step S15, the terminal device 10 receives an instruction to store the captured content. For example, when the user selects a tag and switches the display of the display 141 to the left in FIG. 10, the user presses the button 1412. When the button 1412 is pressed, the shooting control unit 194 determines that an instruction to store an image has been input from the user. Note that the image to be stored may be a still image or a moving image.

[0086] In step S16, the terminal device 10 stores the image data. Specifically, when the button 1412 is pressed, the presentation control unit 196 stores the image captured when the button 1412 was pressed in the image information 184 in association with the selected tag.

[0087] In step S12, the shooting control unit 194 may create a tag based on, for example, the current state of the user. Specifically, when an instruction to extract candidate tags is received from the user, the shooting control unit 194 creates a tag based on, for example, the words included in the user's schedule. Further, the shooting control unit 194 creates a tag based on, for example, the words related to the current position of the user. The shooting control unit 194 extracts candidate tags from the tags stored in the tag information 182 and the created tags. The shooting control unit 194 may create a tag in response to the user's login.

[0088] For example, when an instruction to store is input from the user in step S15 without a tag being specified in step S14, the shooting control unit 194 may obtain a tag from candidate tags based on various information and associate the obtained tag with the image data to be stored. Specifically, for example, the shooting control unit 194 identifies the shooting target by image analysis or based on a predetermined code attached to the shooting target. The shooting control unit 194 obtains the tags stored for the identified shooting target as related devices. Further, the shooting control unit 194 grasps the current state of the user based on, for example, the current position or schedule. The shooting control unit 194 obtains the tags stored for the grasped state as related facilities.

[0089] When the imaging control unit 194 automatically associates a tag with image data (when associating a tag without going through the selection of a tag by the user), it notifies the user that the tag has been automatically associated. When there is a modification instruction from the user for the automatically associated tag, the imaging control unit 194 may replace it after storing the image data.

[0090] (Report creation process) In a predetermined diagnostic task, the processing of the terminal device 10 when the user operates the terminal device 10 to create a report related to the diagnosis will be described.

[0091] FIG. 11 is a flowchart showing an example of the operation of the terminal device 10 when creating a report. When a predetermined diagnosis is completed, the user creates a report. The user operates the terminal device 10 to display an image related to the report.

[0092] FIG. 12 is a schematic diagram showing an example of the display of the terminal device 10 when displaying a list of reports. In the example shown in FIG. 12, the presentation control unit 196 causes the display 141 to display a list of created reports. The user can check the content of the report by tapping the report displayed in the list. Also, the user can edit the report by tapping the report displayed in the list.

[0093] In the example shown in FIG. 12, the presentation control unit 196 displays the button 1415. The button 1415 is a button for inputting an instruction to start creating a report. The user instructs the terminal device 10 to create a report by pressing the button 1415.

[0094] In step S21, the terminal device 10 presents a report creation screen to the user. Specifically, for example, when the creation unit 195 receives a report creation instruction from the user, it presents a report creation screen to the user. The creation unit 195 creates a report related to a predetermined diagnosis, for example, in response to an instruction from the user for the creation screen.

[0095] FIG. 13 is a schematic diagram showing an example of a display of a report creation screen. In the example shown in FIG. 13(a), the report is for inputting reports before and after work. Note that the content of the report is not limited to this, and it may be in a format for inputting only the report after work, or in a format for inputting reports before, during, and after work.

[0096] When the creation unit 195 detects a tap from the user on an inputtable area, it displays a report form for inputting report content into the area. Specifically, for example, when the first editing area 1416 located below "before work" is tapped by the user, the creation unit 195 displays a report form for inputting report content into the first editing area 1416.

[0097] FIG. 13(b) is a schematic diagram showing a report form for inputting report content into a predetermined area. In the example shown in FIG. 13(b), the creation unit 195 causes the display 141 to display a first editing area 14161 and a second editing area 14162. The first editing area 14161 is an area for attaching an image. The second editing area 14162 is an area for inputting text information obtained by diagnosis.

[0098] In step S22, the terminal device 10 attaches an image to the creation screen based on an instruction from the user. Specifically, for example, the creation unit 195 attaches the image selected by the user to a predetermined area of the creation screen.

[0099] In FIG. 13(b), when attaching an image to the first editing area 14161, the user taps the first editing area 14161. When the first editing area 14161 is tapped by the user, the creation unit 195, for example, displays a selection window (not shown) for the image to be attached to the first editing area 14161. The user selects an image to be attached to the first editing area 14161 from the images listed in the selection window. The creation unit 195 attaches the image selected by the user to the first editing area 14161.

[0100] In step S23, the terminal device 10 reads information regarding the tags attached to the attached image. Specifically, for example, when an image is attached, the creation unit 195 refers to the image information 184 and acquires information regarding the tags associated with the attached image.

[0101] In step S24, the terminal device 10 outputs the text related to the read tag to the creation screen. Specifically, for example, the creation unit 195 causes the text related to the read tag to be displayed on the creation screen so that the user can edit it.

[0102] FIG. 13(c) is a schematic diagram showing an example of input to the report form. In the example shown in FIG. 13(c), an image is attached to the first editing area 14161. Further, the text of the tag attached to the image is displayed in the second editing area 14162. The text displayed in the second editing area 14162 can be edited by the user tapping the second editing area 14162. When the input of the report content is completed, the user presses the button 14163.

[0103] FIG. 13(d) is a schematic diagram showing an example of display of the created report. In the example shown in FIG. 13(d), reports on before work and after work are input.

[0104] As described above, in the above embodiment, the shooting control unit 194 extracts candidate tags from a plurality of tags including characters related to the shooting target based on the information related to shooting. The presentation control unit 196 presents the extracted candidate tags in a selectable manner. The shooting control unit 194 receives a designation from the user for the presented candidate tags. The shooting control unit 194 shoots the shooting target. The shooting control unit 194 stores the shot image in association with the tag designated by the user. As a result, when shooting an image, tags with a high probability given by the user are extracted as candidate tags. Therefore, the terminal device 10 can reduce the labor of the user searching for a desired tag from a plurality of tags when storing the image.

[0105] Therefore, according to the terminal device 10 according to the present embodiment, the burden on the operator when managing images can be further reduced.

[0106] In the above embodiment, the shooting control unit 194 extracts, as candidate tags, tags associated with a group that manages images of a shooting target. As a result, tags suitable for the management group are automatically extracted, so that candidate tags can be effectively extracted when storing images.

[0107] In the above embodiment, the shooting control unit 194 extracts, as candidate tags, tags associated with attributes included in the personal information of the user. As a result, tags related to the user are automatically extracted, so that candidate tags can be effectively extracted when storing images.

[0108] In the above embodiment, the shooting control unit 194 extracts, as candidate tags, tags associated with a shooting target. As a result, tags related to the object being shot are automatically extracted, so that candidate tags can be effectively extracted when storing images.

[0109] In the above embodiment, the shooting control unit 194 identifies a shooting target by image analysis and extracts, as candidate tags, tags associated with the identified shooting target. As a result, tags related to the object being shot are automatically extracted, so that candidate tags can be effectively extracted when storing images.

[0110] In the above embodiment, the shooting control unit 194 identifies a shooting target based on a code associated with the shooting target and extracts, as candidate tags, tags associated with the identified shooting target. As a result, tags related to the object being shot are automatically extracted, so that candidate tags can be effectively extracted when storing images.

[0111] Also, in the above embodiment, the shooting control unit 194 creates a tag based on information related to the user. The shooting control unit 194 extracts candidate tags from a plurality of tags and the created tag. As a result, it becomes possible to create a tag suitable for the current situation, and the accuracy of extracting a desired tag is improved.

[0112] Also, in the above embodiment, the presentation control unit 196 presents the candidate tags in a tree structure. As a result, the extracted candidate tags are displayed in an efficient and easily visible manner for the user, and the labor of selecting a desired tag from the candidate tags is reduced.

[0113] Also, in the above embodiment, when there is no designation from the user, the shooting control unit 194 identifies the shooting target and associates the tag associated with the identified shooting target with the image. As a result, even when the tag is not selected by the user, a related tag is attached to the image.

[0114] Also, in the above embodiment, the shooting control unit 194 notifies the user that the tag has been associated with the image based on the identified shooting target. As a result, the user can grasp that the image has been automatically tagged. Therefore, it is possible to pay attention to the image that has been automatically tagged.

[0115] Also, in the above embodiment, when an image associated with a tag is designated, the creation unit 195 displays the characters related to the tag associated with the image in an editable manner. As a result, when creating a report, only by selecting an image, the words necessary for creating the report are automatically input. Also, since the report is created based on tags, the amount of characters input can be suppressed. For this reason, even when creating a report using a smartphone, the report can be created efficiently. Since it becomes possible to create a report with a smartphone, there is no need to return to the base after diagnosis and create a report using the terminal at the base. For this reason, the burden on the user is greatly reduced.

[0116] Also, in the above embodiment, the shooting control unit 194 shoots the shooting target. The shooting control unit 194 extracts candidate tags from a plurality of tags including characters related to the shooting target based on information related to shooting. The shooting control unit 194 presents the extracted candidate tags in a selectable manner and accepts a designation from the user. The shooting control unit 194 stores the captured image in association with the tag designated by the user. As a result, when shooting an image, tags with a high probability given by the user are extracted as candidate tags. Therefore, the terminal device 10 can reduce the labor of the user to search for a desired tag from a plurality of tags when storing an image.

[0117] <Modification Example> In the above embodiment, after selecting a tag, an instruction to store the image being shot is input. Then, the image shot when the storage instruction is input is stored in association with the selected tag. However, selecting a tag is not limited to before inputting the storage instruction. The shooting control unit 194 may allow the user to select a tag after an instruction to store the image being shot is input.

[0118] FIG. 14 is a flowchart showing an example of other operations of the terminal device 10 when storing image data. When the user needs to store an image of a predetermined target while performing a predetermined diagnosis, the user operates the terminal device 10 to shoot the target.

[0119] In step S31, the terminal device 10 accepts an instruction to store the shooting content. For example, the user presses the button 1412 displayed on the left in FIG. 10. When the button 1412 is pressed, the shooting control unit 194 determines that an instruction to store an image has been input from the user.

[0120] In step S32, the terminal device 10 acquires information related to the diagnosis. Specifically, for example, when an instruction to store an image is input, the shooting control unit 194 reads out the affiliation of the user stored in the user information 181 as a related attribute. Further, the shooting control unit 194 acquires, for example, the user's schedule, and based on the acquired schedule, acquires the currently ongoing schedule. The shooting control unit 194 acquires facilities or establishments included in the acquired schedule as related facilities. Further, the shooting control unit 194 acquires, for example, the facility or establishment where the user is currently located as a related facility based on the current position acquired by the position information sensor 150. Further, the shooting control unit 194 recognizes, for example, the device to be photographed and identifies the device. The shooting control unit 194 acquires the identified device as a related device. Note that the information related to the diagnosis acquired by the shooting control unit 194 may be a part of the above, or different information may be added.

[0121] In step S33, the terminal device 10 extracts candidate tags. Specifically, for example, the shooting control unit 194 extracts candidate tags from a plurality of tags stored in the tag information 182 based on the set management group, the acquired information related to the diagnosis, or a combination thereof.

[0122] In step S34, the terminal device 10 presents the extracted candidate tags to the user. Specifically, for example, the presentation control unit 196 causes the display 141 to display the extracted candidate tags so that the user can select them. The user selects a desired candidate tag from the plurality of candidate tags displayed on the display 141.

[0123] In step S35, the terminal device 10 accepts the user's selection of the candidate tag. Specifically, for example, the shooting control unit 194 accepts a user's selection instruction for the plurality of candidate tags displayed on the display 141. When the user selects a tag, the user completes the selection of the tag by pressing a predetermined icon.

[0124] In step S36, the terminal device 10 stores the image data. Specifically, when the selection of the tag is completed, the presentation control unit 196 stores the image captured when the button 1412 was pressed in the image information 184 in association with the selected tag.

[0125] In step S33, the shooting control unit 194 may create a tag based on, for example, the current state of the user. Specifically, when instructed by the user to extract candidate tags, the shooting control unit 194 creates a tag based on, for example, the words included in the user's schedule. Also, the shooting control unit 194 creates a tag based on, for example, the words related to the current position of the user. The shooting control unit 194 extracts candidate tags from the tags stored in the tag information 182 and the created tags. The shooting control unit 194 may create a tag in response to the user's login.

[0126] For example, when no tag is specified in step S35, the shooting control unit 194 may obtain a tag from candidate tags based on various information and associate the obtained tag with the image data to be stored. Specifically, for example, the shooting control unit 194 identifies the shooting target by image analysis or based on a predetermined code attached to the shooting target. The shooting control unit 194 obtains the tags stored for the identified shooting target as related devices. Also, the shooting control unit 194 grasps the current state of the user based on, for example, the current position or schedule. The shooting control unit 194 obtains the tags stored for the grasped state as related facilities.

[0127] In the above-described embodiment, the case where the processes described in FIGS. 9, 11, and 14 are performed in the terminal device 10 has been described as an example. However, performing the processes described in FIGS. 9, 11, and 14 is not limited to the terminal device 10. The server 20 may perform some or all of the processes described in FIGS. 9, 11, and 14. That is, the user gives an instruction to the server 20 via the terminal device 10. Then, the server 20 that has received the instruction executes the process. At this time, the user information 181, tag information 182, related information 183, image information 184, and report information 185 stored in the terminal device 10 are stored in the server 20 as necessary.

[0128] In the above-described embodiment, the case where the shooting control unit 194 extracts candidate tags from a plurality of tags stored in the tag information 182 based on the set management group, the information related to the acquired diagnosis, or a combination thereof has been described. However, the information referred to when extracting candidate tags is not limited to the management group and the information related to the diagnosis. For example, information related to shooting such as information related to inspection, information related to evaluation, etc. may be used.

[0129] In the above-described embodiment, the case where, for example, related attributes, related devices, related facilities, and management groups are associated with the tag has been described. However, these pieces of information do not necessarily have to be associated with the tag. A learned model that has been learned to output tags with a high probability of being assigned based on the information at the time of shooting and the image being shot may be used. For example, the shooting control unit 194 inputs a plurality of stored tags, the information at the time of shooting, and the image being shot into the learned model, and causes the learned model to output a plurality of tags with a high probability of being assigned to the image as candidate tags.

[0130] In addition, in the above-described embodiment, when creating a report, the case where, if an image is attached, text regarding the tag associated with the image is input was described. However, the operation when creating a report is not limited to this. A learned model trained to output a text sentence representing the content of the report may be used based on the images stored during diagnosis and the tags associated with the images. The creation unit 195 inputs, for example, an image attached by the user and the tag associated with the image into the learned model, and causes the learned model to output a text sentence representing the content of the report. The learned model may be a generative AI such as a large language model. At this time, the creation unit 195 inputs, for example, an image attached by the user, the tag associated with the image, and a prompt for causing the report to be output into the generative AI, and causes the generative AI to output a text sentence representing the content of the report.

[0131] <4 Basic Hardware Configuration of Computer> FIG. 15 is a block diagram showing the basic hardware configuration of a computer 90. The computer 90 includes at least a processor 91, a main memory device 92, an auxiliary storage device 93, and a communication IF 99 (Interface). These are electrically connected to each other by a bus.

[0132] The processor 91 is hardware for executing an instruction set described in a program. The processor 91 is composed of an arithmetic unit, registers, peripheral circuits, and the like.

[0133] The main memory device 92 is for temporarily storing programs and data processed by programs and the like. For example, it is a volatile memory such as a DRAM (Dynamic Random Access Memory).

[0134] The auxiliary storage device 93 is a storage device for storing data and programs. For example, it is a flash memory, an HDD (Hard Disc Drive), a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like.

[0135] Communication IF99 is an interface for inputting and outputting signals for communicating with other computers via a network using a wired or wireless communication standard. The network is composed of various mobile communication systems constructed by the Internet, LAN, wireless base stations, etc. For example, the network includes 3G, 4G, 5G mobile communication systems, LTE (Long Term Evolution), a wireless network (e.g., Wi-Fi (registered trademark)) that can be connected to the Internet by a predetermined access point, etc. When connecting wirelessly, communication protocols include, for example, Z-Wave (registered trademark), ZigBee (registered trademark), Bluetooth (registered trademark), etc. When connecting by wire, the network also includes those directly connected by a USB (Universal Serial Bus) cable, etc.

[0136] Note that all or part of each hardware configuration can be distributed and provided to a plurality of computers 90, and the computers 90 can be virtually realized by connecting to each other via a network. Thus, the computer 90 is a concept that includes not only a single housing and the computer 90 housed in a case, but also a virtualized computer system.

[0137] <Basic Functional Configuration of Computer 90> The functional configuration of the computer realized by the basic hardware configuration of the computer 90 shown in FIG. 15 will be described. The computer includes at least functional units of a control unit, a storage unit, and a communication unit.

[0138] Note that the functional units included in the computer 90 can also be realized by distributing all or part of each functional unit to a plurality of computers 90 interconnected by a network. The computer 90 is a concept that includes not only a single computer 90, but also a virtualized computer system.

[0139] The control unit is realized by the processor 91 reading out various programs stored in the auxiliary storage device 93 and expanding them in the main storage device 92, and executing processing according to the programs. The control unit can realize functional units that perform various information processes according to the types of programs. Thereby, the computer is realized as an information processing device that performs information processing.

[0140] The storage unit is realized by the main storage device 92 and the auxiliary storage device 93. The storage unit stores data, various programs, and various databases. Also, the processor 91 can secure a storage area corresponding to the storage unit in the main storage device 92 or the auxiliary storage device 93 according to the program. Further, the control unit can cause the processor 91 to execute addition, update, and deletion processing of the data stored in the storage unit according to various programs.

[0141] The database refers to a relational database and is for managing a set of data called a table, which is structurally defined by rows and columns, in association with each other. In a database, a table is called a table, a column of a table is called a column, and a row of a table is called a record. In a relational database, the relationship between tables can be set and associated. Normally, a column serving as a key for uniquely identifying a record is set in each table, but setting a key for a column is not essential. The control unit can cause the processor 91 to execute addition, deletion, and update of records in a specific table stored in the storage unit according to various programs.

[0142] The communication unit is realized by the communication IF 99. The communication unit realizes the function of communicating with another computer 90 via a network. The communication unit can receive information transmitted from another computer 90 and input it to the control unit. The control unit can cause the processor 91 to execute information processing on the received information according to various programs. Also, the communication unit can transmit the information output from the control unit to another computer 90.

[0143] The functions realized by the components described in this specification may be implemented in circuitry or processing circuitry including a general-purpose processor, a special-purpose processor, an integrated circuit, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuits, and / or combinations thereof, programmed to realize the described functions. A processor includes transistors and other circuits and is regarded as circuitry or processing circuitry. The processor may be a programmed processor that executes a program stored in a memory. In this specification, circuitry, unit, and means are hardware programmed to realize the described functions or hardware that executes. The hardware may be any hardware disclosed in this specification or any hardware known as being programmed or executing to realize the described functions. When the hardware is a processor regarded as being of the circuitry type, the circuitry, means, or unit is a combination of hardware and software used to configure the hardware and / or the processor.

[0144] Some embodiments of the present disclosure have been described above. However, these embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are to be included in the scope and gist of the invention, as well as in the invention described in the claims and the equivalent scope thereof.

[0145] <Appendix> The matters described in each of the above embodiments are appended below. (Appendix 1) A program for causing a computer including a processor and a memory to execute. The program causes the processor to perform the steps of: extracting candidate tags from a plurality of tags including characters related to a shooting object based on shooting-related information; presenting the extracted candidate tags in a selectable manner; receiving a designation from a user for the presented candidate tags; shooting the shooting object; and associating and storing the shot image with the tag designated by the user. (Appendix 2) The program according to (Appendix 1), wherein in the extracting step, tags associated with a group that manages an image related to the shooting object are extracted as candidate tags. (Appendix 3) The program according to (Appendix 1) or (Appendix 2), wherein in the extracting step, tags associated with an attribute included in the personal information of the user are extracted as candidate tags. (Appendix 4) The program according to any one of (Appendix 1) to (Appendix 3), wherein in the extracting step, tags associated with the shooting object are extracted as candidate tags. (Appendix 5) The program according to (Appendix 4), wherein in the extracting step, the shooting object is specified by image analysis, and tags associated with the specified shooting object are extracted as candidate tags. (Appendix 6) The program according to (Appendix 4), wherein in the extracting step, the shooting object is specified based on a code related to the shooting object, and tags associated with the specified shooting object are extracted as candidate tags. (Appendix 7) The program according to any one of (Appendix 1) to (Appendix 6), wherein the processor is caused to perform a step of creating a tag based on information related to the user, and in the extracting step, candidate tags are extracted from the plurality of tags and the created tag. (Appendix 8) The program according to any one of (Appendix 1) to (Appendix 7), wherein in the presenting step, the candidate tags are presented in a tree structure. (Appendix 9) In the storing step, when there is no designation from the user, identify the shooting target and associate the tag associated with the identified shooting target with the image (a program described in any one of Supplementary Note 1 to Supplementary Note 8). (Supplementary Note 10) In the storing step, a program described in Supplementary Note 9 that notifies the user that a tag has been associated with the image based on the identified shooting target. (Supplementary Note 11) When an image associated with a tag is designated, a program described in any one of Supplementary Note 1 to Supplementary Note 10 that causes the processor to execute a step of displaying the characters related to the tag associated with the image in an editable manner. (Supplementary Note 12) A program for causing a computer including a processor and a memory to execute. The program causes the processor to execute a step of shooting a shooting target, a step of extracting candidate tags based on shooting-related information from a plurality of tags each including characters related to the shooting target, a step of presenting the extracted candidate tags in a selectable manner and receiving a designation from the user, and a step of storing the shot image in association with the tag designated by the user. (Supplementary Note 13) A method executed by a computer including a processor and a memory, wherein the processor executes all the steps included in any one of the inventions according to Supplementary Note 1 to Supplementary Note 12. (Supplementary Note 14) An information processing apparatus including a processor and a memory, wherein the processor executes all the steps included in any one of the inventions according to Supplementary Note 1 to Supplementary Note 12. (Supplementary Note 15) A system including means for executing all the steps included in any one of the inventions according to Supplementary Note 1 to Supplementary Note 12.

Explanation of Reference Numerals

[0146] 1...System 10...Terminal device 120… Communication unit 13… Input device 131… Touch - sensitive device 14… Output device 15… Memory 16… Storage 19… Processor 20… Server 22… Communication IF 23… Input / output IF 25… Memory 26… Storage 29… Processor

Claims

1. A program for causing a computer including a processor and a memory to execute, the program causing the processor to extract candidate tags from a plurality of tags including characters related to a shooting target based on information related to shooting; present the extracted candidate tags in a selectable manner; receive a designation from a user for the presented candidate tags; shoot a shooting target; associate and store the shot image with the tag designated by the user and execute the program.

2. The program according to claim 1, wherein, in the extracting step, tags associated with a group that manages an image related to a shooting target are extracted as the candidate tags.

3. The program according to claim 1, wherein, in the extracting step, tags associated with an attribute included in personal information of a user are extracted as the candidate tags.

4. The program according to claim 1, wherein, in the extracting step, tags associated with a shooting target are extracted as the candidate tags.

5. The program according to claim 4, wherein, in the extracting step, the shooting target is specified by image analysis, and tags associated with the specified shooting target are extracted as the candidate tags.

6. The program according to claim 4, wherein, in the extracting step, the shooting target is specified based on a code related to the shooting target, and tags associated with the specified shooting target are extracted as the candidate tags.

7. cause the processor to execute a step of creating a tag based on information related to a user, and the program according to claim 1, wherein, in the extracting step, the candidate tags are extracted from the plurality of tags and the created tags.

8. The program according to claim 1, wherein, in the presenting step, the candidate tags are presented in a tree structure.

9. The program according to claim 1, wherein, in the storing step, when there is no designation from the user, the shooting target is specified, and a tag associated with the specified shooting target is associated with the image.

10. The program according to claim 9, wherein, in the storing step, the user is notified that the tag has been associated with the image based on the specified shooting target.

11. The program according to claim 1, wherein when an image associated with the tag is specified, the processor is caused to perform a step of displaying in an editable manner characters related to the tag associated with the image.

12. A program for causing a computer including a processor and a memory to execute, the program causing the processor to perform a step of photographing a subject to be photographed; extract candidate tags from a plurality of tags each including characters related to the subject to be photographed, based on information related to the photographing; present the extracted candidate tags in a selectable manner and receive a designation from a user; and associate and store the photographed image with the tag designated by the user is a program for causing the execution.

13. A method executed by a computer including a processor and a memory, the method including the processor performing all steps included in any one of the inventions according to claims 1 to 12.

14. An information processing apparatus including a processor and a memory, the processor performing all steps included in any one of the inventions according to claims 1 to 12.

15. A system including means for performing all steps included in any one of the inventions according to claims 1 to 12.

Images