Program, method, information processing apparatus, and system

Abstract

To provide a program, a method, an information processing apparatus, and a system for further reducing the workload on an operator when the operator is acquiring an image with excellent manageability.SOLUTION: The program for execution by a computer including a processor and a memory causes the processor to execute: the step (S12) of extracting candidate tags from among a plurality of tags, at least one of the tags including a character related to an imaging target, on the basis of information related to imaging; the step (S13) of presenting the extracted candidate tags in a selectable manner; the step (S14) of receiving a designation from a user for one of the presented candidate tags; the step of capturing the imaging target; and the step (S16) of storing the captured image in association with the tag designated by the user.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present disclosure relates to a program, a method, an information processing device, and a system. [Background technology]

[0002] A construction photo management method that further reduces the burden on workers has been proposed (see Patent Document 1). In Patent Document 1, the construction photo management system creates tags consisting of one-dimensional or two-dimensional codes and incorporates them into images, causing an information processing unit to automatically read in the necessary construction data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-165263 Summary of the Invention [Problem to be solved by the invention]

[0004] In Patent Document 1, a tag consisting of a one-dimensional or two-dimensional code is created, a terminal displaying the tag data is placed at the photographing location, and a photograph is taken, but there is a demand for further reduction in the burden on workers.

[0005] An object of the present disclosure is to further reduce the burden on workers when acquiring images with excellent manageability. [Means for solving the problem]

[0006] A program to be executed by a computer having a processor and a memory. The program causes the processor to execute the following steps: extracting candidate tags from a plurality of tags, any of which includes characters related to the subject of photography, based on information related to photography; presenting the extracted candidate tags in a selectable manner; accepting a user's designation for the presented candidate tags; photographing the subject of photography; and storing the photographed image in association with the tag designated by the user. [Effects of the Invention]

[0007] According to the present disclosure, the burden on the worker when acquiring images with excellent manageability can be further reduced. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram showing an example of the overall configuration of a system 1. FIG. [Figure 2] 2 is a block diagram illustrating an example of the configuration of a terminal device 10 shown in FIG. [Figure 3] FIG. 2 is a diagram illustrating an example of the functional configuration of a server 20. [Figure 4] FIG. 10 is a diagram showing the data structure of user information 181. [Figure 5] FIG. 10 is a diagram showing the data structure of tag information 182. [Figure 6] FIG. 10 is a diagram showing the data structure of related information 183. [Figure 7] FIG. 10 is a diagram showing the data structure of image information 184. [Figure 8] FIG. 10 is a diagram showing the data structure of report information 185. [Figure 9] 10 is a flowchart illustrating an example of the operation of the terminal device 10 when storing image data. [Figure 10] 10 is a schematic diagram showing an example of a display on the terminal device 10 when storing images required for diagnosis. FIG. [Figure 11] 10 is a flowchart illustrating an example of the operation of the terminal device 10 when creating a report. [Figure 12]FIG. 10 is a schematic diagram illustrating an example of a display on the terminal device 10 when a list of reports is displayed. [Figure 13] FIG. 10 is a schematic diagram illustrating a display example of a report creation screen. [Figure 14] 10 is a flowchart showing another example of the operation of the terminal device 10 when storing image data. [Figure 15] FIG. 2 is a block diagram showing the basic hardware configuration of a computer 90. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. The names and functions of the components are also the same. Therefore, detailed descriptions thereof will not be repeated.

[0010] <Summary> A terminal device having a program according to this embodiment installed thereon presents a user with a plurality of tags that are likely to be assigned to image data, and stores the captured image in association with the tags selected by the user.

[0011] When a user creates a report and selects an image to be attached to the report, the terminal device reads out the tag attached to the selected image and inputs the text associated with the tag into the report in an editable format. The user then creates the report using the text associated with the tag.

[0012] <1 Overall system configuration> Fig. 1 is a block diagram showing an example of the overall configuration of a system 1. The system 1 shown in Fig. 1 includes, for example, a terminal device 10 and a server 20. The terminal device 10 and the server 20 are connected for communication via, for example, a network 80.

[0013] 1 shows an example in which the system 1 includes one terminal device 10, but the number of terminal devices 10 included in the system 1 is not limited to one. The terminal device 10 is, for example, a terminal carried by a user. The system 1 may include two or more terminal devices 10.

[0014] 1 shows an example in which the system 1 includes the server 20, but the servers included in the system 1 are not limited to this. For example, servers other than the server 20 may be included.

[0015] In this embodiment, a collection of multiple devices may be considered as one server. The allocation of multiple functions required to realize the server 20 according to this embodiment to one or more pieces of hardware can be determined appropriately in consideration of the processing capacity of each piece of hardware and / or the specifications required for the server 20.

[0016] The terminal device 10 shown in FIG. 1 is an information processing device operated by a user. In this embodiment, the user is, for example, a person who performs a predetermined diagnostic task. In this embodiment, the predetermined diagnostic task includes, for example, a task related to a home inspection or a task related to an inspection for a farmer's insurance. The terminal device 10 is realized by, for example, a mobile terminal such as a smartphone or tablet having a camera function. The terminal device 10 may be a wearable terminal such as an HMD (Head Mount Display) or a wristwatch terminal, as long as it has a camera function. The terminal device 10 may also be a desktop personal computer (PC) or a laptop PC.

[0017] The terminal device 10 includes a communication IF (Interface) 12, an input device 13, an output device 14, a memory 15, a storage 16, and a processor 19. The input device 13 is a device for receiving input operations from a user (for example, a touch panel, a touch pad, a pointing device such as a mouse, a keyboard, etc.). The output device 14 is a device for presenting information to a user (a display, a speaker, etc.).

[0018] The server 20 is, for example, an information processing device that manages tags attached to image data. The server 20 is realized by, for example, a computer connected to a network 80. As shown in Fig. 1, the server 20 includes a communication IF 22, an input / output IF 23, a memory 25, a storage 26, and a processor 29. The input / output IF 23 functions as an input device for receiving input operations from a user and as an interface with an output device for outputting information to the user.

[0019] Each information processing device is configured by a computer equipped with an arithmetic unit and a storage device. The basic hardware configuration of the computer and the basic functional configuration of the computer realized by the hardware configuration will be described later. For each of the terminal device 10 and the server 20, descriptions that overlap with the basic hardware configuration and basic functional configuration of the computer will be omitted.

[0020] <1.1 Terminal device configuration> Fig. 2 is a block diagram showing an example configuration of the terminal device 10 shown in Fig. 1. As shown in Fig. 2, the terminal device 10 includes a communication unit 120, an input device 13, an output device 14, an audio processing unit 17, a microphone 171, a speaker 172, a camera 160, a position information sensor 150, a storage unit 180, and a control unit 190. The blocks included in the terminal device 10 are electrically connected by, for example, a bus or the like.

[0021] The communication unit 120 performs processing such as modulation and demodulation for the terminal device 10 to communicate with other devices. The communication unit 120 performs transmission processing on the signal generated by the control unit 190 and transmits it to the outside (for example, the server 20). The communication unit 120 performs reception processing on the signal received from the outside and outputs it to the control unit 190.

[0022] The input device 13 is a device for inputting instructions or information by a user operating the terminal device 10. The input device 13 is realized, for example, by a touch-sensitive device 131 or the like, which inputs instructions by touching an operation surface. When the terminal device 10 is a PC or the like, the input device 13 may be realized by a reader, keyboard, mouse, or the like. The input device 13 converts instructions input by the user into electrical signals and outputs the electrical signals to the control unit 190. The input device 13 may include, for example, a receiving port that receives electrical signals input from an external input device.

[0023] The output device 14 is a device for presenting information to a user operating the terminal device 10. The output device 14 is realized, for example, by a display 141 or the like. The display 141 displays data according to the control of the control unit 190. The display 141 is realized, for example, by an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display or the like.

[0024] The audio processing unit 17 performs, for example, digital-to-analog conversion processing of an audio signal. The audio processing unit 17 converts a signal provided from the microphone 171 into a digital signal and provides the converted signal to the control unit 190. The audio processing unit 17 also provides the audio signal to the speaker 172. The audio processing unit 17 is realized, for example, by a processor for audio processing. The microphone 171 receives audio input and provides an audio signal corresponding to the audio input to the audio processing unit 17. The speaker 172 converts the audio signal provided from the audio processing unit 17 into audio and outputs the audio to the outside of the terminal device 10.

[0025] The camera 160 is a device that receives light with a light receiving element and outputs the received light as image data.

[0026] The position information sensor 150 is a sensor that detects the position of the terminal device 10, and is, for example, a GPS (Global Positioning System) module. The GPS module is a receiving device used in a satellite positioning system. The satellite positioning system receives signals from at least three or four satellites and detects the current position of the terminal device 10 equipped with the GPS module based on the received signals. The position information sensor 150 may detect the current position of the terminal device 10 from the position of a wireless base station to which the terminal device 10 is connected. The position information sensor 150 may acquire the current position of the terminal device 10 using a beacon signal. The position information sensor 150 may also acquire the current position of the terminal device 10 using the IP address of the terminal device 10. The current position acquired by the position information sensor 150 may be the coordinates or address of the current location of the terminal device 10, or the name of a facility or the like where the terminal device 10 is currently staying.

[0027] The storage unit 180 is realized by, for example, the memory 15, the storage 16, etc., and stores data and programs used by the terminal device 10. The storage unit 180 stores, for example, user information 181, tag information 182, related information 183, image information 184, and report information 185.

[0028] The user information 181 stores, for example, personal information about the user who uses the terminal device 10. Details will be described later. The tag information 182 stores, for example, information about the stored tags, which will be described in detail later. The relation information 183 stores, for example, the relation between tags, which will be described in detail later. The image information 184 stores, for example, information about the captured image, which will be described in detail later. The report information 185 stores, for example, information related to reports, which will be described in detail later.

[0029] The control unit 190 is realized by the processor 19 reading a program stored in the storage unit 180 and executing instructions included in the program. The control unit 190 controls the operation of the terminal device 10. By operating in accordance with the program, the control unit 190 fulfills functions as, for example, an operation reception unit 191, a transmission / reception unit 192, a management unit 193, an imaging control unit 194, a creation unit 195, and a presentation control unit 196.

[0030] The operation reception unit 191 performs processing for receiving instructions or information input from the input device 13. Specifically, for example, the operation reception unit 191 receives instructions or information input from the touch-sensitive device 131 or the like.

[0031] Furthermore, the operation reception unit 191 receives voice instructions input from the microphone 171. Specifically, for example, the operation reception unit 191 receives a voice signal that is input from the microphone 171 and converted into a digital signal by the voice processing unit 17. For example, the operation reception unit 191 analyzes the received voice signal and extracts a predetermined noun, thereby acquiring an instruction from the user.

[0032] The transmitting / receiving unit 192 performs processing for the terminal device 10 to transmit and receive data to and from an external device such as the server 20 in accordance with a communication protocol. Specifically, for example, the transmitting / receiving unit 192 transmits instructions input by a user to the server 20. In addition, the transmitting / receiving unit 192 receives information provided by the server 20.

[0033] The management unit 193 manages information about tags stored in the tag information 182. Specifically, for example, the management unit 193 manages information about tags so that the information about tags stored in the tag information 182 is the latest information. More specifically, for example, the management unit 193 checks with the server 20 at a predetermined cycle whether or not the information about tags has been updated. The predetermined cycle may be, for example, once a day, once every few days, once every predetermined week, etc. When there is an update to the information about tags, such as an increase in tags or a decrease in tags, the server 20 transmits the information about tags stored in the server 20 to the terminal device 10. The management unit 193 receives the information transmitted from the server 20 and updates the information stored in the tag information 182.

[0034] The server 20 may periodically transmit information about tags stored in the server 20 to the terminal device 10. The server 20 may transmit information only when there is an update, or may transmit information even when there is no update.

[0035] The photography control unit 194 controls the storage of images captured by the camera 160 of the terminal device 10. Specifically, for example, the photography control unit 194 extracts, as candidate tags, tags that are suitable for the subject photographed by the user from the tags stored in the tag information 182. The photography control unit 194 extracts, as candidate tags, tags that satisfy, for example, predetermined requirements related to photography from the multiple tags stored in the tag information 182. Tags that satisfy the predetermined requirements include, for example, the following. These requirements may be adopted independently, or at least two of them may be adopted in combination. Tags associated with management groups that manage acquired image data Tags associated with certain attributes contained in your personal information Tags associated with the subject Tags associated with the subject recognized through image analysis A tag associated with the subject that can be identified by decoding a code related to the subject (for example, a QR code (registered trademark) attached to the subject) Tags associated with situations captured based on the user's schedule Tags associated with the situation identified from the user's current location

[0036] The image analysis may be performed, for example, by an image analysis model. The image analysis model is a trained model generated by, for example, having a machine learning model perform machine learning in accordance with a model learning program. More specifically, the image analysis model is generated, for example, by using a forward propagation multi-layer network. As the multi-layer network, for example, a deep neural network (DNN), which is a multi-layer neural network that is the subject of deep learning, may be used. Note that the image analysis model may also be generated using existing technology. For example, the imaging control unit 194 inputs the image into the image analysis model to estimate the device included in the image. The estimated information may be, for example, the name of the device, device identification information, etc.

[0037] The imaging control unit 194 may, for example, create tags based on the current state of the user and extract candidate tags from the created tags and tags stored in the tag information 182. The user's current state includes, for example, the user's schedule. The schedule may be stored in, for example, the user information 181, or may be managed by a predetermined server. The imaging control unit 194 creates tags, for example, in the schedule using a phrase corresponding to the current time. Specifically, for example, if the schedule is set as "2:00 PM to 3:00 PM: Diagnosis of BBBB at factory AAAA" and the time is 2:00 PM, the imaging control unit 194 creates a tag related to factory AAAA and a tag related to BBBB, which is the diagnosis target.

[0038] The user's current state includes, for example, the user's current location. The user's current location is acquired, for example, by the location information sensor 150. The photography control unit 194 creates a tag using a phrase related to the acquired current location. Specifically, for example, if the acquired current location is "facility: factory AAAA," the photography control unit 194 creates a tag related to factory AAAA. Furthermore, for example, if the acquired current location is information that does not directly represent a facility, such as "coordinates: (X, Y)" or "address: CCCC," the photography control unit 194 acquires a facility associated with "coordinates: (X, Y)" or "address: CCCC," and creates a tag related to the acquired facility.

[0039] The photographing control unit 194, for example, receives a user's designation for the extracted candidate tag. The photographing control unit 194 controls the camera 160 to photograph the subject. Note that in this embodiment, photographing the subject is not limited to, for example, storing image data generated by the camera 160 in the storage unit 180. In other words, photographing is not limited to storing image data executed by pressing a photographing button, but also includes displaying an image obtained by the camera 160 on the display 141.

[0040] For example, in response to pressing of the shooting button, the shooting control unit 194 stores image data generated by the camera 160 in the image information 184. At this time, the shooting control unit 194 associates a tag designated by the user with the image data.

[0041] If the user does not specify a candidate tag for the extracted tag, the photographing control unit 194, for example, identifies the photographing subject and acquires a tag associated with the identified photographing subject from the candidate tag. The photographing control unit 194 may associate the acquired tag with image data stored in the image information 184. Specifically, the photographing control unit 194 identifies the photographed photographing subject, for example, by image analysis. Furthermore, if the image contains a code, the photographing control unit 194 decodes the code to acquire information identifying the photographing subject, and identifies the photographing subject based on the information.

[0042] When the imaging control unit 194 associates a tag with image data by recognizing the subject, the imaging control unit 194 may notify the user that the tag has been associated without the user's instruction. The imaging control unit 194 may replace the tag associated with image data by recognizing the subject after storing the image data in accordance with a user instruction. The imaging control unit 194, for example, stores that the tag has been replaced. The imaging control unit 194 may, for example, improve the accuracy of the process of automatically attaching tags based on information about the tag replacement.

[0043] The creation unit 195 creates a report. Specifically, for example, the creation unit 195 creates a report regarding a predetermined diagnosis in response to an instruction from a user. The creation unit 195 accepts a designation of an image to be attached to the report. The creation unit 195 inputs characters related to a tag associated with the designated image into an input form for the report in an editable manner. The creation unit 195 accepts edits from the user and creates the report.

[0044] The presentation control unit 196 controls the output device 14 to present predetermined information to the user. Specifically, for example, the presentation control unit 196 causes the display 141 to display an image of the subject being photographed. Furthermore, the presentation control unit 196 causes the display 141 to display candidate tags extracted by the photographing control unit 194, for example. At this time, the presentation control unit 196 displays the candidate tags based on the relevance of the tags, for example.

[0045] Furthermore, the presentation control unit 196 causes the display 141 to display an image when creating a report, for example.

[0046] <1.2 Functional configuration of the server> 3 is a diagram showing an example of the functional configuration of the server 20. As shown in FIG. 3, the server 20 functions as a communication unit 201, a storage unit 202, and a control unit 203.

[0047] The communication unit 201 performs processing for the server 20 to communicate with external devices.

[0048] The storage unit 202 includes, for example, a tag table 2021. Note that the tables stored in the storage unit 202 are not limited to this.

[0049] The tag table 2021 is a table that stores information about tags. The tag table 2021 is a table that uses a tag ID as a key and has columns such as tag (contents), related attributes, related devices, related facilities, and related groups.

[0050] The control unit 203 is realized by the processor 29 reading a program stored in the storage unit 202 and executing instructions included in the program. By operating in accordance with the program, the control unit 203 performs functions indicated as, for example, a reception control module 2031, a transmission control module 2032, and a management module 2033.

[0051] The reception control module 2031 controls the process by which the server 20 receives signals from external devices in accordance with a communication protocol.

[0052] The transmission control module 2032 controls the process in which the server 20 transmits signals to external devices in accordance with a communication protocol.

[0053] The management module 2033 manages the information of the tables stored in the storage unit 202. Specifically, for example, the management module 2033 manages information about tags stored in the tag table 2021.

[0054] <2 Data Structure> 4 to 8 are diagrams showing the data structure of information stored in the terminal device 10. Note that FIGS. 4 to 8 are merely examples and do not exclude data not shown. Furthermore, data included in the same information may be stored in separate storage areas in the storage unit 180.

[0055] Fig. 4 is a diagram showing the data structure of user information 181. User information 181 shown in Fig. 4 has columns such as name, age, sex, date of birth, contact information, and affiliation, with a user ID as a key.

[0056] The user ID is an item that stores an identifier for uniquely identifying a user. The name is an item that stores the user's name. The age is an item that stores the user's age. The gender is an item that stores the user's gender. The date of birth is an item that stores the user's date of birth. The contact information is an item that stores the user's contact information. The affiliation is an item that stores the user's affiliation. The user's affiliation represents, for example, an attribute involved in a specified diagnostic work. For example, the item "affiliation" includes a department, section, etc. of a specified company that is involved in home diagnostics. Also, for example, the item "affiliation" includes a department, section, etc. of a specified company that is involved in diagnostics for farm insurance.

[0057] Fig. 5 is a diagram showing the data structure of tag information 182. Tag information 182 shown in Fig. 5 has columns such as tag, related attribute, related device, related facility, related group, etc., with tag ID as a key.

[0058] The tag ID is an item that stores an identifier for uniquely identifying a tag. The tag is an item that stores the content of a tag. The "tag" item stores, for example, text information that represents the content of the tag. In the example shown in FIG. 5, the "tag" item stores, for example, a tag that includes text related to the area to be diagnosed. The "tag" item also stores a tag that includes text related to the equipment used in the diagnosis. The "tag" item also stores a tag that includes text related to the parts used in the equipment.

[0059] Tags associated with an area may include, for example: Text about the equipment or facility to be diagnosed Text about the area where the facility will be built - Text about the processes being carried out on the equipment being inspected - Text about the equipment or facility where the device to be diagnosed is used

[0060] Tags associated with an area include, for example, ash handling (high concentration treatment facility), ash handling (low concentration treatment facility), ash handling (fly ash treatment facility), and the like.

[0061] Tags associated with a device may include, for example: -Text about the equipment used in the facility or facility being diagnosed -Text about the device being diagnosed Text about the equipment used in the diagnosis

[0062] Equipment-related tags include, for example, ammonia injector, ammonia extractor, nitrogen oxide treatment device, hydrogen oxide treatment device, oxide treatment device, ampere breaker, etc. Part-related tags include, for example, text related to the name of a given part.

[0063] The "tag" item includes text that can be used as a document when creating a report, for example. For example, a report may include an item that reports the contents of a diagnosis. This item may include, for example, a report on a diagnosis performed at a facility or equipment. The "tag" item may store, for example, words related to a diagnosis that are used when describing the diagnosis.

[0064] The related attribute is an item that stores the attribute of a user associated with a tag. The attribute to which the user belongs, specifically, for example, the affiliation, may determine the equipment or facility to be diagnosed. The attribute to which the user belongs, specifically, for example, the affiliation, may determine the device to be used in the diagnosis or the device to be diagnosed. The attribute to which the user belongs, specifically, for example, the affiliation, may determine the parts used in the device. The item "related attribute" stores the attribute of a user associated with each tag.

[0065] The "related devices" is an item that stores devices that are related to a tag. The "related devices" item stores, for example, devices that are used in the diagnosis or devices that are the subject of the diagnosis. Depending on the device, the equipment or facilities that are used may be specified. Also, depending on the device, related devices may be specified. Also, depending on the device, parts that are used may be specified. The "related devices" item stores devices that are related to each tag.

[0066] The related equipment is an item that stores the area (equipment or facility) associated with the tag. The item "related equipment" stores, for example, the area where the diagnosis is performed. Depending on the area, the equipment or facility that will be the subject of the diagnosis may be specified. Also, depending on the area, the device that will be used in the diagnosis or the device that will be the subject of the diagnosis may be specified. Also, depending on the area, the parts that will be used in the device may be specified. The item "related equipment" stores the area associated with each tag.

[0067] The management group is an item that stores the management group that manages the captured images. The management group is, for example, a group for collectively managing information acquired in related diagnoses. Image data managed in a management group is associated with similar tags. For example, when starting a diagnosis, the user sets a group that manages the acquired information. The image data acquired in the diagnosis is managed, for example, in the set management group. The item "management group" stores, for each tag, the management group that the tag is likely to be associated with.

[0068] Fig. 6 is a diagram showing the data structure of the related information 183. The related information 183 shown in Fig. 6 stores the relationships between tags. Specifically, for example, the tags have a tree structure, and each element has multiple child elements. More specifically, the tags have a three-layered tree structure, and the element related to "area" has a child element called "device," and the element related to "device" has a child element called "part."

[0069] Fig. 7 is a diagram showing the data structure of image information 184. Image information 184 shown in Fig. 7 has columns such as image date and time, tag, photographer, and image data, with an image ID as a key.

[0070] The image ID is an item that stores an identifier for uniquely identifying image data. The shooting date and time is an item that stores the date and time when the image data was stored. The tag is an item that stores a tag associated with the image data. In the example shown in FIG. 7, multiple tags are associated with each image data. Note that only one tag may be associated with the image data. The information stored in the "tag" item may be the text information of the tag or the tag ID. The photographer is an item that stores the user who captured the image. For example, the "photographer" item stores the user ID of the user who captured the image. Note that the "photographer" item may also store the name of the user who captured the image. The image data is an item that stores the image data itself. The "image data" item may also store reference information for an image data file located in another location.

[0071] Fig. 8 is a diagram showing the data structure of report information 185. Report information 185 shown in Fig. 8 is a table having columns such as report name, creator, creation date, and report data, with report ID as a key.

[0072] The report ID is an item that stores an identifier for uniquely identifying report data. The report name is an item that stores the name of the report. The report name may be set by the user, for example, or may be set automatically from the diagnosis content. The creator is an item that stores the user who created the report. The item "creator" stores, for example, the user ID of the user who created the report. The item "creator" may also store the name of the user who created the report. The creation date is an item that stores the date and time the report was created. The report data is an item that stores the report data itself. The item "report data" may also store reference information for a report data file located in another location.

[0073] <3 operations> (Image recording processing) The following describes the processing of the terminal device 10 when a user operates the terminal device 10 in a predetermined diagnostic task and stores images required for the diagnosis.

[0074] First, when starting to operate the terminal device 10, the user operates the terminal device 10 to input his / her own login ID and password. When starting a diagnosis, the user operates the terminal device 10 to select a management group that manages information acquired in the diagnosis to be performed, for example.

[0075] 9 is a flowchart showing an example of the operation of the terminal device 10 when storing image data. When a user needs to store an image of a specific object while performing a specific diagnosis, the user operates the terminal device 10 to photograph the object. For example, the user instructs the terminal device 10 on the photographing screen to extract candidate tags.

[0076] In step S11, the terminal device 10 acquires information related to the diagnosis. Specifically, for example, when extraction of candidate tags is instructed, the imaging control unit 194 reads out the user's affiliation stored in the user information 181 as a related attribute. Furthermore, the imaging control unit 194 acquires, for example, the user's schedule and acquires a currently ongoing plan based on the acquired schedule. The imaging control unit 194 acquires equipment or facilities, etc. included in the acquired plan as related equipment. Furthermore, for example, the imaging control unit 194 acquires, for example, based on the current location acquired by the position information sensor 150, equipment or facilities, etc. where the user is currently located as related equipment. Furthermore, the imaging control unit 194 recognizes, for example, a device to be photographed and identifies the device. The imaging control unit 194 acquires the identified device as a related device.

[0077] The information related to the diagnosis acquired by the imaging control unit 194 may be a part of the above information, or different information may be added.

[0078] In step S12, the terminal device 10 extracts candidate tags. Specifically, for example, the imaging control unit 194 extracts candidate tags from a plurality of tags stored in the tag information 182 based on the set management group, the acquired diagnosis-related information, or a combination thereof. More specifically, the imaging control unit 194 extracts from the tag information 182 tags whose records store, for example, a management group, a related attribute, a related device, a related facility, or a combination of at least two of these.

[0079] As a result, for example, the following tags are extracted as candidate tags: Tags associated with groups that manage acquired image data Tags associated with certain attributes contained in your personal information Tags associated with the device being photographed

[0080] In step S13, the terminal device 10 presents the extracted candidate tags to the user. Specifically, for example, the presentation control unit 196 displays the extracted candidate tags on the display 141 so that the user can select one of them. The user selects a desired candidate tag from the plurality of candidate tags displayed on the display 141.

[0081] In step S14, the terminal device 10 accepts the user's selection of candidate tags. Specifically, for example, the imaging control unit 194 accepts the user's selection instruction for multiple candidate tags displayed on the display 141. The user, for example, selects multiple tags that are expected to be useful when extracting image data. The user also selects multiple tags that are expected to be useful when creating a report. There is no limit to the number of tags that can be selected. After selecting a tag, the user presses a predetermined icon to switch the display to a screen for inputting an instruction to store the image.

[0082] FIG. 10 is a schematic diagram showing a display example of the terminal device 10 when storing an image required for diagnosis. In the example shown on the left in FIG. 10, the presentation control unit 196 causes the display 141 to display a first display area 1411, a button 1412, and an icon 1413. The first display area 1411 is an area for displaying the object being photographed. The button 1412 is a button for inputting an instruction to store the photographed content as image data. The icon 1413 is an icon for inputting an instruction to switch the display to a screen for selecting a tag. In other words, the icon 1413 is an icon for instructing extraction of a candidate tag. The icon 1413 has a shape that imitates the shape of a tag, for example. When the icon 1413 is pressed by the user, the presentation control unit 196 switches the display to the right in FIG. 10.

[0083] In the example shown on the right side of FIG. 10, the presentation control unit 196 causes the display 141 to display a first display area 1411 and a second display area 1414. The second display area 1414 is an area for displaying candidate tags. The presentation control unit 196 displays candidate tags in the second display area 1414 so that the user can select them. When a candidate tag displayed in the second display area 1414 is selected by the user, the presentation control unit 196 changes the appearance of the selected candidate tag so that the user can understand that the tag has been selected. The presentation control unit 196 displays a tag selected from the candidate tags in the first display area 1411. The presentation control unit 196 may add an indicator to the tag displayed in the first display area 1411 so that the selection can be canceled. When the user has completed tag selection, the user inputs a predetermined operation to switch the display on the display 141 from the right side of FIG. 10 to the left side of FIG. 10. When the display is switched to the left side of FIG. 10 after a tag is selected, the presentation control unit 196 may maintain the tag displayed in the first display area 1411 on the right side of FIG.

[0084] FIG. 10 illustrates an example in which candidate tags are displayed side by side in the second display area 1414. However, the display of candidate tags is not limited to this. The presentation control unit 196 may display candidate tags in a manner that takes into account the relevance of the tags to each other, for example. The presentation control unit 196 may display tags, for example, starting with tags assigned to higher hierarchical levels, and when a higher-level tag is selected, display lower-level tags. Specifically, for example, the presentation control unit 196 first displays candidate tags whose element is "area" on the display 141. When a candidate tag whose element is "area" is selected, the presentation control unit 196 displays candidate tags whose element is "device" on the display 141. When a candidate tag whose element is "device" is selected, the presentation control unit 196 displays candidate tags whose element is "parts" on the display 141.

[0085] In step S15, the terminal device 10 accepts an instruction to store the captured content. For example, the user selects a tag, switches the display on the display 141 to the left in FIG. 10, and then presses the button 1412. When the button 1412 is pressed, the capture control unit 194 determines that an instruction to store the image has been input by the user. The image to be stored may be a still image or a video.

[0086] In step S16, the terminal device 10 stores the image data. Specifically, when the button 1412 is pressed, the presentation control unit 196 stores the image captured at the time the button 1412 was pressed in the image information 184 in association with the selected tag.

[0087] In step S12, the photographing control unit 194 may create tags based on, for example, the user's current state. Specifically, when the photographing control unit 194 receives an instruction from the user to extract candidate tags, the photographing control unit 194 creates tags based on, for example, a phrase included in the user's schedule. The photographing control unit 194 also creates tags based on, for example, a phrase related to the user's current location. The photographing control unit 194 extracts candidate tags from tags stored in the tag information 182 and the created tags. The photographing control unit 194 may create tags in response to a user's login.

[0088] For example, when no tag is specified in step S14 and a storage instruction is input by the user in step S15, the photography control unit 194 may acquire a tag from the candidate tags based on various information and associate the acquired tag with the image data to be stored. Specifically, for example, the photography control unit 194 identifies the photography subject by image analysis or based on a predetermined code attached to the photography subject. The photography control unit 194 acquires a tag in which the identified photography subject is stored as a related device. Furthermore, the photography control unit 194 grasps the current state of the user based on, for example, the current location or schedule. The photography control unit 194 acquires a tag in which the grasped state is stored as a related facility.

[0089] When the imaging control unit 194 automatically associates a tag with image data (when the tag is associated without the user selecting the tag), the imaging control unit 194 notifies the user that the tag has been automatically associated. When the user instructs to correct the automatically associated tag, the imaging control unit 194 may replace the tag after storing the image data.

[0090] (Report creation process) The processing of the terminal device 10 when a user operates the terminal device 10 to create a report related to a diagnosis in a predetermined diagnostic task will be described.

[0091] 11 is a flowchart showing an example of the operation of the terminal device 10 when creating a report. After completing a predetermined diagnosis, the user creates a report. The user operates the terminal device 10 to display an image related to the report.

[0092] Fig. 12 is a schematic diagram showing a display example of the terminal device 10 when displaying a list of reports. In the example shown in Fig. 12, the presentation control unit 196 causes the display 141 to display a list of created reports. The user can check the contents of a report by tapping on the report displayed in the list. The user can also edit a report by tapping on the report displayed in the list.

[0093] 12, the presentation control unit 196 displays a button 1415. The button 1415 is a button for inputting an instruction to start creating a report. By pressing the button 1415, the user instructs the terminal device 10 to create a report.

[0094] In step S21, the terminal device 10 presents a report creation screen to the user. Specifically, for example, when the creation unit 195 receives an instruction to create a report from the user, the creation unit 195 presents the report creation screen to the user. For example, the creation unit 195 creates a report related to a predetermined diagnosis in response to an instruction from the user on the creation screen.

[0095] Fig. 13 is a schematic diagram showing an example of a display screen for creating a report. In the example shown in Fig. 13(a), the report is designed to input reports about before and after the work. Note that the content of the report is not limited to this, and it may be in a format for inputting a report about only after the work, or in a format for inputting reports about before, during, and after the work.

[0096] When the creation unit 195 detects a tap by the user on an inputtable area, the creation unit 195 displays a report form for inputting report contents into the area. Specifically, for example, when the user taps on the first editing area 1416 located below "Before work," the creation unit 195 displays a report form for inputting report contents into the first editing area 1416.

[0097] Fig. 13(b) is a schematic diagram showing a report form for inputting report contents into a predetermined area. In the example shown in Fig. 13(b), the creation unit 195 displays a first editing area 14161 and a second editing area 14162 on the display 141. The first editing area 14161 is an area for attaching an image. The second editing area 14162 is an area for inputting text information acquired by diagnosis.

[0098] In step S22, the terminal device 10 attaches an image to the creation screen based on an instruction from the user. Specifically, the creation unit 195 attaches, for example, an image selected by the user to a predetermined area on the creation screen.

[0099] 13(b), when attaching an image to first editing area 14161, the user taps first editing area 14161. When first editing area 14161 is tapped by the user, creation unit 195 displays, for example, a selection window (not shown) for an image to be attached to first editing area 14161. The user selects an image to be attached to first editing area 14161 from the images displayed in a list in the selection window. Creation unit 195 attaches the image selected by the user to first editing area 14161.

[0100] In step S23, the terminal device 10 reads information about the tag attached to the attached image. Specifically, for example, when an image is attached, the creation unit 195 refers to the image information 184 and acquires information about the tag associated with the attached image.

[0101] In step S24, the terminal device 10 outputs the text related to the read tag to the creation screen. Specifically, for example, the creation unit 195 displays the text related to the read tag on the creation screen so that the user can edit it.

[0102] Fig. 13(c) is a schematic diagram showing an example of input to the report form. In the example shown in Fig. 13(c), an image is attached to a first editing area 14161. Furthermore, the text of the tag attached to the image is displayed in a second editing area 14162. The user can edit the text displayed in the second editing area 14162 by tapping the second editing area 14162. When the user has finished inputting the report content, the user presses a button 14163.

[0103] Fig. 13(d) is a schematic diagram showing an example of the display of the created report. In the example shown in Fig. 13(d), reports on the pre-work and post-work states have been entered.

[0104] As described above, in the above embodiment, the photography control unit 194 extracts candidate tags from a plurality of tags, any of which includes characters related to the subject of photography, based on information related to photography. The presentation control unit 196 presents the extracted candidate tags in a selectable manner. The photography control unit 194 accepts a user's designation for the presented candidate tags. The photography control unit 194 photographs the subject of photography. The photography control unit 194 associates the photographed image with the tag designated by the user and stores it. As a result, when photographing an image, tags that are likely to be assigned by the user are extracted as candidate tags. Therefore, the terminal device 10 can reduce the user's effort in searching for a desired tag from a plurality of tags when storing an image.

[0105] Therefore, the terminal device 10 according to this embodiment can further reduce the burden on the worker when managing images.

[0106] In the above embodiment, the photography control unit 194 extracts, as candidate tags, tags associated with a group that manages images related to the subject of photography. This automatically extracts tags suitable for the management group, so candidate tags are effectively extracted when storing images.

[0107] In the above embodiment, the photography control unit 194 extracts tags associated with attributes included in the user's personal information as candidate tags. This automatically extracts tags related to the user, so candidate tags are effectively extracted when storing images.

[0108] In the above embodiment, the photography control unit 194 extracts tags associated with the subject of photography as candidate tags. This automatically extracts tags related to the subject being photographed, so candidate tags are effectively extracted when storing the image.

[0109] In the above embodiment, the photography control unit 194 identifies the subject to be photographed by image analysis and extracts tags associated with the identified subject to be photographed as candidate tags. This automatically extracts tags related to the subject being photographed, so candidate tags are effectively extracted when storing the image.

[0110] In the above embodiment, the photography control unit 194 identifies the subject based on a code associated with the subject, and extracts tags associated with the identified subject as candidate tags. This automatically extracts tags related to the subject being photographed, so candidate tags are effectively extracted when storing the image.

[0111] In the above embodiment, the photography control unit 194 creates tags based on information related to the user. The photography control unit 194 extracts candidate tags from multiple tags and the created tags. This makes it possible to create tags that are suited to the current situation, thereby improving the accuracy with which desired tags are extracted.

[0112] In the above embodiment, the presentation control unit 196 presents the candidate tags in a tree structure, which allows the extracted candidate tags to be displayed efficiently and in a manner that is easy for the user to view, thereby reducing the effort required to select a desired tag from the candidate tags.

[0113] In the above embodiment, the photography control unit 194 identifies a subject to be photographed if there is no user designation, and associates a tag associated with the identified subject to the image. As a result, even if a tag is not selected by the user, the associated tag is attached to the image.

[0114] In the above embodiment, the photography control unit 194 notifies the user that a tag has been associated with the image based on the identified photography subject. This allows the user to understand that a tag has been automatically added to the image. This allows the user to pay attention to the automatically tagged image.

[0115] Furthermore, in the above embodiment, when an image associated with a tag is designated, the creation unit 195 displays the text related to the tag associated with the image in an editable manner. As a result, when creating a report, the words necessary to create the report are automatically entered simply by selecting the image. Furthermore, because the report is created based on the tag, the amount of text input can be reduced. Therefore, even when creating a report using a smartphone, the report can be created efficiently. Since the report can be created on a smartphone, there is no need to return to the base after the diagnosis and create the report on a terminal at the base. This significantly reduces the burden on the user.

[0116] Furthermore, in the above embodiment, the photography control unit 194 photographs the subject. Based on information related to the photography, the photography control unit 194 extracts candidate tags from multiple tags, any of which includes characters related to the subject. The photography control unit 194 presents the extracted candidate tags in a selectable manner and accepts a designation from the user. The photography control unit 194 stores the photographed image in association with the tag designated by the user. As a result, when photographing an image, tags that are likely to be assigned by the user are extracted as candidate tags. Therefore, the terminal device 10 can reduce the user's effort in searching for a desired tag from multiple tags when storing an image.

[0117] <Modification> In the above embodiment, after selecting a tag, a storage instruction for the captured image is input. Then, the image captured when the storage instruction is input is stored in association with the selected tag. However, tag selection is not limited to before inputting the storage instruction. The shooting control unit 194 may have the user select a tag after inputting the storage instruction for the captured image.

[0118] 14 is a flowchart showing another example of the operation of the terminal device 10 when storing image data. When a user needs to store an image of a predetermined object while performing a predetermined diagnosis, the user operates the terminal device 10 to photograph the object.

[0119] In step S31, the terminal device 10 receives an instruction to store the captured image. For example, the user presses the button 1412 displayed on the left side of Fig. 10. When the button 1412 is pressed, the image capture control unit 194 determines that an instruction to store the image has been input by the user.

[0120] In step S32, the terminal device 10 acquires information related to the diagnosis. Specifically, for example, when an instruction to store an image is input, the imaging control unit 194 reads out the user's affiliation stored in the user information 181 as a related attribute. Furthermore, the imaging control unit 194 acquires, for example, the user's schedule and acquires a currently ongoing plan based on the acquired schedule. The imaging control unit 194 acquires equipment or facilities, etc. included in the acquired plan as related equipment. Furthermore, the imaging control unit 194 acquires, for example, equipment or facilities, etc. where the user is currently located as related equipment based on the current location acquired by the position information sensor 150. Furthermore, the imaging control unit 194 recognizes, for example, a device to be photographed and identifies the device. The imaging control unit 194 acquires the identified device as a related device. Note that the information related to the diagnosis acquired by the imaging control unit 194 may be a part of the above information, or may further include different information.

[0121] In step S33, the terminal device 10 extracts candidate tags. Specifically, for example, the imaging control unit 194 extracts candidate tags from the multiple tags stored in the tag information 182 based on the set management group, the acquired diagnosis-related information, or a combination thereof.

[0122] In step S34, the terminal device 10 presents the extracted candidate tags to the user. Specifically, for example, the presentation control unit 196 displays the extracted candidate tags on the display 141 so that the user can select one of them. The user selects a desired candidate tag from the plurality of candidate tags displayed on the display 141.

[0123] In step S35, the terminal device 10 accepts the user's selection of a candidate tag. Specifically, for example, the photography control unit 194 accepts the user's instruction to select a candidate tag displayed on the display 141. After selecting a tag, the user presses a predetermined icon to complete the tag selection.

[0124] In step S36, the terminal device 10 stores the image data. Specifically, when the selection of the tag is completed, the presentation control unit 196 stores the image captured when the button 1412 was pressed in the image information 184 in association with the selected tag.

[0125] In step S33, the photographing control unit 194 may create tags based on, for example, the user's current state. Specifically, when the photographing control unit 194 receives an instruction from the user to extract candidate tags, the photographing control unit 194 creates tags based on, for example, a phrase included in the user's schedule. The photographing control unit 194 also creates tags based on, for example, a phrase related to the user's current location. The photographing control unit 194 extracts candidate tags from tags stored in the tag information 182 and the created tags. The photographing control unit 194 may create tags in response to a user's login.

[0126] For example, if no tag is specified in step S35, the photography control unit 194 may acquire a tag from the candidate tags based on various information and associate the acquired tag with the stored image data. Specifically, for example, the photography control unit 194 identifies the photography subject by image analysis or based on a predetermined code attached to the photography subject. The photography control unit 194 acquires a tag in which the identified photography subject is stored as a related device. Furthermore, the photography control unit 194 grasps the current state of the user based on, for example, the current location or schedule. The photography control unit 194 acquires a tag in which the grasped state is stored as a related facility.

[0127] In the above embodiment, the terminal device 10 has been described as an example in which the processes shown in FIGS. 9, 11, and 14 are performed. However, the processes shown in FIGS. 9, 11, and 14 are not limited to being performed by the terminal device 10. The server 20 may perform some or all of the processes shown in FIGS. 9, 11, and 14. That is, the user issues an instruction to the server 20 via the terminal device 10. Then, the server 20, having received the instruction, executes the process. At this time, the user information 181, tag information 182, related information 183, image information 184, and report information 185 stored in the terminal device 10 are stored in the server 20 as necessary.

[0128] In the above embodiment, the imaging control unit 194 extracts candidate tags from multiple tags stored in the tag information 182 based on a set management group, information related to an acquired diagnosis, or a combination thereof. However, the information referenced when extracting candidate tags is not limited to the management group and information related to a diagnosis. For example, any information related to imaging, such as information related to an examination or information related to an evaluation, may be used.

[0129] In the above embodiment, a case has been described in which a tag is associated with, for example, a related attribute, a related device, a related facility, or a management group. However, this information does not necessarily have to be associated with a tag. A trained model trained to output tags that are likely to be assigned based on information at the time of shooting and the captured image may be used. For example, the shooting control unit 194 inputs multiple stored tags, information at the time of shooting, and the captured image into the trained model, and outputs multiple tags that are likely to be assigned to the image as candidate tags.

[0130] In the above embodiment, a case has been described in which, when an image is attached during report creation, text related to tags associated with the image is input. However, the operation when creating a report is not limited to this. A trained model trained to output text sentences representing the contents of a report based on images stored during a diagnosis and tags associated with the images may be used. For example, the creation unit 195 inputs an image attached by a user and tags associated with the image into the trained model, and causes the trained model to output text sentences representing the contents of the report. The trained model may be a generative AI such as a large-scale language model. In this case, the creation unit 195 inputs, for example, an image attached by a user, tags associated with the image, and a prompt for outputting a report into the generation AI, and causes the generation AI to output text sentences representing the contents of the report.

[0131] <4 Basic computer hardware configuration> 15 is a block diagram showing the basic hardware configuration of a computer 90. The computer 90 includes at least a processor 91, a main memory device 92, an auxiliary memory device 93, and a communication IF (interface) 99. These are electrically connected to one another by a bus.

[0132] The processor 91 is hardware for executing an instruction set written in a program, and is composed of an arithmetic unit, registers, peripheral circuits, and the like.

[0133] The main storage device 92 is used to temporarily store programs, data to be processed by the programs, etc. For example, it is a volatile memory such as a DRAM (Dynamic Random Access Memory).

[0134] The auxiliary storage device 93 is a storage device for saving data and programs, such as a flash memory, a hard disk drive (HDD), a magneto-optical disk, a CD-ROM, a DVD-ROM, or a semiconductor memory.

[0135] The communication IF 99 is an interface for inputting and outputting signals for communicating with other computers via a network using wired or wireless communication standards. The network is composed of the Internet, a LAN, various mobile communication systems constructed by wireless base stations, etc. For example, the network includes 3G, 4G, and 5G mobile communication systems, LTE (Long Term Evolution), and wireless networks (e.g., Wi-Fi (registered trademark)) that can connect to the Internet via a predetermined access point. In the case of a wireless connection, communication protocols include, for example, Z-Wave (registered trademark), ZigBee (registered trademark), and Bluetooth (registered trademark). In the case of a wired connection, the network also includes a direct connection using a USB (Universal Serial Bus) cable, etc.

[0136] It should be noted that the computer 90 can be virtually realized by distributing all or part of each hardware configuration across multiple computers 90 and interconnecting them via a network. In this way, the computer 90 is a concept that includes not only a computer 90 housed in a single housing or case, but also a virtualized computer system.

[0137] <Basic functional configuration of computer 90> A description will be given of the functional configuration of a computer realized by the basic hardware configuration of a computer 90 shown in Fig. 15. The computer includes at least the functional units of a control unit, a storage unit, and a communication unit.

[0138] The functional units of the computer 90 can also be realized by distributing all or part of the functional units among multiple computers 90 interconnected via a network. The computer 90 is a concept that includes not only a single computer 90 but also a virtualized computer system.

[0139] The control unit is realized by the processor 91 reading various programs stored in the auxiliary storage device 93, expanding them in the main storage device 92, and executing processing in accordance with the programs. The control unit can realize functional units that perform various types of information processing depending on the type of program. In this way, the computer is realized as an information processing device that processes information.

[0140] The storage unit is realized by a main storage device 92 and an auxiliary storage device 93. The storage unit stores data, various programs, and various databases. Furthermore, the processor 91 can allocate a storage area corresponding to the storage unit in the main storage device 92 or the auxiliary storage device 93 in accordance with the programs. Furthermore, the control unit can cause the processor 91 to execute processes for adding, updating, and deleting data stored in the storage unit in accordance with the various programs.

[0141] A database refers to a relational database, which manages data sets called tables, which are structured by rows and columns, by relating them to each other. In a database, a table is called a table, a column in a table is called a column, and a row in a table is called a record. In a relational database, relationships between tables can be set and associated. Typically, each table has a column set as a key for uniquely identifying a record, but setting a key to a column is not essential. The control unit can cause the processor 91 to add, delete, or update records in a specific table stored in the storage unit according to various programs.

[0142] The communication unit is realized by the communication IF 99. The communication unit realizes the function of communicating with other computers 90 via a network. The communication unit can receive information transmitted from other computers 90 and input the information to the control unit. The control unit can cause the processor 91 to execute information processing on the received information in accordance with various programs. In addition, the communication unit can transmit information output from the control unit to other computers 90.

[0143] The functions performed by the components described herein may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuits, and / or combinations thereof, programmed to perform the described functions. A processor includes transistors and other circuits and is considered to be circuitry or processing circuitry. A processor may also be a programmed processor that executes programs stored in memory. In this specification, a circuitry, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed herein or any hardware known to be programmed to realize or perform the described functions. If the hardware is a processor considered to be a type of circuitry, the circuitry, means, or unit is a combination of the hardware and software used to configure the hardware and / or processor.

[0144] Although several embodiments of the present disclosure have been described above, these embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and modifications are intended to be included in the scope of the inventions and their equivalents as defined in the claims, as well as in the scope and spirit of the inventions.

[0145] <Additional Notes> The matters described in the above embodiments will be supplemented below. (Appendix 1) A program to be executed by a computer having a processor and a memory, the program causing the processor to execute the following steps: extracting candidate tags from a plurality of tags, any of which contains characters related to the subject of photography, based on information regarding the photography; presenting the extracted candidate tags in a selectable manner; accepting a user's designation for the presented candidate tags; photographing the subject of photography; and storing the captured image in association with the tag designated by the user. (Appendix 2) The program according to claim 1, wherein in the extracting step, tags associated with a group that manages images related to a subject to be photographed are extracted as candidate tags. (Appendix 3) The program according to (Supplementary Note 1) or (Supplementary Note 2), wherein in the extracting step, tags associated with attributes included in the user's personal information are extracted as candidate tags. (Appendix 4) The program according to any one of (Supplementary Note 1) to (Supplementary Note 3), wherein in the extracting step, a tag associated with the subject to be photographed is extracted as a candidate tag. (Appendix 5) The program according to claim 4, wherein in the extracting step, the subject to be photographed is identified by image analysis, and a tag associated with the identified subject to be photographed is extracted as a candidate tag. (Appendix 6) The program according to claim 4, wherein in the extracting step, the object to be photographed is identified based on a code associated with the object to be photographed, and a tag associated with the identified object to be photographed is extracted as a candidate tag. (Appendix 7) A program described in any of (Appendix 1) to (Appendix 6) that causes a processor to execute a step of creating tags based on information related to a user, and in an extraction step, extracts candidate tags from multiple tags and the created tags. (Appendix 8) The program according to any one of (Supplementary Note 1) to (Supplementary Note 7), wherein in the presenting step, the candidate tags are presented in a tree structure. (Appendix 9) A program described in any one of (Appendix 1) to (Appendix 8), wherein in the storing step, if no specification is given by the user, the object to be photographed is identified and a tag corresponding to the identified object to be photographed is associated with the image. (Appendix 10) The program according to claim 9, wherein the storing step notifies the user that the tag has been associated with the image based on the identified subject. (Appendix 11) A program described in any one of (Appendix 1) to (Appendix 10) that causes a processor to execute a step of displaying text related to the tag associated with the image in an editable manner when an image associated with a tag is specified. (Appendix 12) A program to be executed by a computer having a processor and a memory, the program causing the processor to execute the steps of photographing an object to be photographed, extracting candidate tags from a plurality of tags, any of which contains characters related to the object to be photographed, based on information about the photograph, presenting the extracted candidate tags in a selectable manner and accepting a designation from a user, and storing the photographed image in association with the tag designated by the user. (Appendix 13) A method executed by a computer having a processor and a memory, wherein the processor executes all of the steps of any of the inventions according to (Appendix 1) to (Appendix 12). (Appendix 14) An information processing device comprising a processor and a memory, wherein the processor executes all of the steps of any one of the inventions according to (Appendix 1) to (Appendix 12). (Appendix 15) A system comprising means for executing all steps of any of the inventions according to (Appendix 1) to (Appendix 12). [Explanation of symbols]

[0146] 1. System 10...Terminal device 120…Communications Department 13...Input device 131...Touch-sensitive devices 14...Output device 15...Memory 16…Storage 19...Processor 20...Server 22...Communication IF 23...Input / output interface 25…Memory 26…Storage 29...Processor

Claims

1. A program to be executed by a computer having a processor and a memory, the program causing the processor to: extracting candidate tags from a plurality of tags, any of which includes characters related to the subject of the photograph, based on information related to the photograph; a step of presenting the extracted candidate tags in a selectable manner; receiving a user's designation for the presented candidate tag; Photographing a subject; storing the captured image in association with a tag designated by the user; A program that executes the following.

2. 2. The program according to claim 1, wherein in the extracting step, tags associated with a group that manages images relating to a subject are extracted as the candidate tags.

3. 2. The program according to claim 1, wherein in the extracting step, tags associated with attributes included in the user's personal information are extracted as the candidate tags.

4. 2. The program according to claim 1, wherein in the extracting step, a tag associated with the subject to be photographed is extracted as the candidate tag.

5. 5. The program according to claim 4, wherein in the extracting step, the subject to be photographed is identified by image analysis, and a tag associated with the identified subject to be photographed is extracted as the candidate tag.

6. 5. The program according to claim 4, wherein the extracting step identifies the subject to be photographed based on a code associated with the subject, and extracts a tag associated with the identified subject to be photographed as the candidate tag.

7. causing the processor to create a tag based on information related to the user; 2. The program according to claim 1, wherein in the extracting step, the candidate tags are extracted from the plurality of tags and the created tags.

8. 2. The program according to claim 1, wherein the step of presenting the candidate tags comprises presenting the candidate tags in a tree structure.

9. 2. The program according to claim 1, wherein, in the storing step, if there is no designation from the user, the subject to be photographed is identified, and a tag associated with the identified subject to be photographed is associated with the image.

10. 10. The program according to claim 9, wherein the storing step notifies the user that the tag has been associated with the image based on the identified subject.

11. 2. The program according to claim 1, causing the processor to execute a step of, when an image associated with the tag is designated, displaying text relating to the tag associated with the image in an editable manner.

12. A program to be executed by a computer including a processor and a memory, the program causing the processor to: Photographing a subject; extracting candidate tags from a plurality of tags, any of which includes characters related to the subject of the photograph, based on information related to the photograph; a step of presenting the extracted candidate tags in a selectable manner and accepting designation from a user; storing the captured image in association with a tag designated by the user; A program that executes the following.

13. A method executed by a computer having a processor and a memory, wherein the processor executes all of the steps of any one of the inventions according to claims 1 to 12.

14. 12. An information processing device comprising a processor and a memory, wherein the processor executes all of the steps of any one of the inventions according to claims 1 to 12.

15. A system comprising means for executing all steps of any of the inventions according to claims 1 to 12.

Images