Information processing device, information processing method, and program

Abstract

The present invention provides an environment suitable for editing metadata. To this end, this information processing device is provided with a user interface control unit that performs, using a plurality of glossary data items which are a collection of term data in which character information and abbreviated input information are paired, user interface processing that makes it possible to edit text information as metadata added to an image file.

Description

[Technical field]

[0001] The present technology relates to an information processing device, an information processing method, and a program, and in particular to a technology for editing metadata added to image data. [Background technology]

[0002] Users who use imaging devices (also called "cameras") for work, such as professional photographers and journalists, often upload images captured with the imaging device to a server (a File Transfer Protocol (FTP) server) of a newspaper company or the like, on-site, using the communication function of the imaging device (see, for example, Patent Document 1). In addition, in newspaper companies and the like, since image data is uploaded from multiple users, the amount of image data they receive can be enormous. In newspaper companies and the like, metadata attached to image data is used to efficiently search for target image data. To achieve this, it is conceivable that the user may perform an operation on the imaging device to add metadata to image data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-138777 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the input means provided in the imaging device is not suitable for the task of inputting text to add metadata, making it difficult to quickly upload captured images.

[0005] Therefore, an object of the present technology is to provide an environment suitable for editing metadata for users, such as professional photographers, who need to add metadata to captured images and quickly upload them. [Means for solving the problem]

[0006] The information processing device according to the present technology is equipped with a user interface control unit that performs user interface processing that enables editing of text information as metadata to be added to an image file, using multiple pieces of glossary data, which are a collection of terminology data in which character information and abbreviated input information are paired. That is, a plurality of glossary data can be combined and used for editing metadata.

[0007] The user interface control unit in the information processing device may present the character information as an input candidate from the glossary data, based on input information input when editing the text information. That is, when the input information matches a part of the character information or a part of the abbreviated input information, the corresponding character information is presented as an input candidate.

[0008] The information processing device described above may further include a glossary management section that acquires the glossary data. This makes it possible, for example, to acquire glossary data created by another information processing device.

[0009] The glossary management section in the information processing device described above may store and manage the glossary data in a storage section. This makes it possible to use the glossary data stored in the storage unit even if the glossary data cannot be acquired from another information processing device due to a poor communication environment.

[0010] The glossary management section in the information processing device may manage a validity state of each of the glossary data. This makes it possible to enable / disable each glossary data item.

[0011] The user interface control unit in the above-mentioned information processing device may perform a process of providing an environment in which the validity state of the plurality of glossary data is switched, and may perform a process of changing the display order of the plurality of glossary data displayed in the environment in which the switching is performed. This makes it possible to configure the glossary data so that the glossary data that is easier for the user to use is displayed higher.

[0012] In the information processing device described above, the display order may be determined based on the number of times the items have been activated. This will bring the most commonly used glossary data to the top of the list.

[0013] In the information processing device described above, the display order may be an order of increasing elapsed time since invalidation. This will cause the most recently enabled glossary data to appear at the top of the list.

[0014] The glossary management section in the information processing device described above may obtain the glossary data from a server device via a network. This makes it possible to obtain glossary data from a server device or the like that is located far away and where short-distance communication is not possible.

[0015] The glossary management section in the information processing device may acquire the glossary data based on a synchronization setting with the server device. As a result, the glossary data stored in the server device is downloaded to the information processing device as appropriate.

[0016] In the information processing device described above, the synchronization setting may be an automatic synchronization setting and a manual synchronization setting. This makes it possible to switch between automatic and manual synchronization settings depending on the situation.

[0017] The glossary management section in the information processing device may select the glossary data to be acquired from the server device based on location information. This allows glossary data to be acquired according to the location, such as an event venue or a baseball stadium.

[0018] The glossary management section in the information processing device may select the glossary data to be acquired from the server device based on time information. This allows, for example, appropriate glossary data to be acquired depending on the time.

[0019] In the above-mentioned information processing apparatus, the server device may be a shared server device. This allows, for example, glossary data that other users have created and stored in the server device to be used.

[0020] The user interface control unit in the above-mentioned information processing device may perform processing to provide an environment in which voice data can be used to edit the text information, and the glossary data may be used in editing the text information using the voice data. Thus, when converting voice data into text information, the conversion is based on the glossary data.

[0021] In the information processing device described above, the text information may be information stored in a caption field of IPTC metadata. This allows glossary data to be used to edit the caption field of IPTC metadata.

[0022] The information processing method of the present technology involves an information processing device performing user interface processing that enables editing of text information as metadata to be added to an image file, using multiple glossary data, which is a collection of terminology data in which character information and abbreviated input information are paired.

[0023] The program of the present technology is a program that causes an information processing device to execute user interface processing that enables editing of text information as metadata to be added to an image file, using multiple glossary data, which is a collection of terminology data in which character information and abbreviated input information are paired. This makes it possible to execute editing processing of text information using multiple glossary data of the present disclosure on an information processing device. [Brief description of the drawings]

[0024] [Figure 1] 1 is an explanatory diagram of transfer and upload of image files and audio files according to an embodiment of the present technology; [Diagram 2] FIG. 2 is a block diagram of an imaging device that performs communication according to an embodiment. [Diagram 3] FIG. 2 is an explanatory diagram of IPTC metadata added to image data in the embodiment. [Figure 4] FIG. 1 is a block diagram of an information processing apparatus according to an embodiment. [Diagram 5] FIG. 2 is an explanatory diagram of a functional configuration of the information processing apparatus according to the embodiment; [Figure 6] FIG. 4 is an explanatory diagram of an image list screen according to the embodiment; [Figure 7] FIG. 4 is an explanatory diagram of a menu screen according to the embodiment. [Figure 8] FIG. 13 is an explanatory diagram of a glossary list screen according to an embodiment. [Figure 9] FIG. 13 is an explanatory diagram of a glossary submenu dialog according to an embodiment. [Figure 10] FIG. 13 is an explanatory diagram of a glossary data editing screen according to an embodiment; [Figure 11] FIG. 13 is an explanatory diagram of a terminology submenu dialog according to an embodiment. [Figure 12] FIG. 13 is an explanatory diagram of a term data editing screen according to an embodiment; [Figure 13] 13 is an explanatory diagram of a glossary addition dialog according to an embodiment. [Figure 14] FIG. 2 is an explanatory diagram of a caption editing screen according to an embodiment. [Figure 15] FIG. 4 is an explanatory diagram of an individual image screen according to the embodiment. [Figure 16] 11 is an explanatory diagram of a state in which a software keyboard is displayed on the caption editing screen of the embodiment. FIG. [Figure 17] 13 is an explanatory diagram of an audio playback state on the caption editing screen of the embodiment. FIG. [Figure 18] 13 is an explanatory diagram of a dialogue displayed on a caption editing screen according to an embodiment. FIG. [Figure 19] 13 is an explanatory diagram of a message display on a caption editing screen according to an embodiment. FIG. [Figure 20] FIG. 13 is an explanatory diagram of a caption editing screen in a state in which voice memo text has been added to caption data in the embodiment. [Figure 21] FIG. 13 is an explanatory diagram of the caption editing screen in the landscape screen state according to the embodiment. [Figure 22] 11 is an explanatory diagram of a state in which a keyboard is displayed on the horizontal screen of the caption editing screen according to the embodiment. FIG. [Diagram 23] 13 is an explanatory diagram of a voice memo automatic caption addition setting screen according to the embodiment; [Figure 24] FIG. 4 is an explanatory diagram of a setting screen according to the embodiment. [Diagram 25] 13 is an explanatory diagram of an automatic upload setting screen in an automatic upload setting off state according to an embodiment. FIG. [Figure 26] FIG. 13 is an explanatory diagram of an automatic upload setting screen in an automatic upload setting ON state according to an embodiment. [Figure 27] FIG. 13 is an explanatory diagram of an automatic upload setting screen in an automatic upload setting on state according to an embodiment. [Figure 28] 13 is an explanatory diagram of an automatic synchronization setting dialog according to an embodiment. [Figure 29] 11 is a flowchart of an example of a process for capturing an image according to an embodiment. [Diagram 30] 11 is a flowchart of an example of a process for capturing an image according to an embodiment. [Diagram 31] 11 is a flowchart illustrating an example of a text conversion process according to the embodiment. [Diagram 32] 13 is a flowchart of an upload file preparation process according to an embodiment. [Diagram 33] 13 is a flowchart of a processing example from an image list screen according to an embodiment. [Diagram 34] 13 is a flowchart of a processing example from an image list screen according to an embodiment. [Diagram 35] 13 is a flowchart of a processing example from an image list screen according to an embodiment. [Diagram 36] 11 is a flowchart illustrating an example of an input handling process according to an embodiment. [Figure 37] 13 is a flowchart of an example of a process at the time of uploading according to the embodiment. [Figure 38] 13 is a flowchart of an example of a process executed on a glossary list screen according to an embodiment; [Figure 39] 13 is a flowchart of an example of a process executed on a glossary data editing screen according to an embodiment; [Diagram 40] 11 is a flowchart illustrating an example of a glossary synchronization process according to the embodiment. [Diagram 41] 13 is a flowchart of another example of the glossary synchronization process according to the embodiment. [Diagram 42] 11 is a flowchart illustrating an example of a sorting process according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0025] The embodiments will be described below in the following order. <1. Image capture and uploading according to the embodiment> 2. Configuration of the imaging device <3. Configuration of information processing device> <4. User interface screen> <5. Example of processing when importing images> <6. Examples of processing including text conversion and caption editing> <7. Example of processing when uploading> <8. Processing of glossary data> <9. Summary and Variations> <10. This Technology>

[0026] <1. Image capture and uploading according to the embodiment> FIG. 1 shows an imaging device 1 including an information processing device 2 according to this embodiment, an FTP server 4, a text conversion engine 5, and a network 6.

[0027] There are various types of imaging devices such as video cameras and still cameras as the imaging device 1. The imaging device 1 shown in the figure is assumed to be a camera used by cameramen or journalists at sporting or event venues or on-site reporting.

[0028] The information processing device 2 is exemplified here by a portable terminal device such as a smartphone. Specific examples of the information processing device include a variety of examples such as a personal computer device, a tablet-type information processing device, a mobile phone device, a game device, an audio device, a video device, a communication device, a television device, a server device, etc. Any device capable of performing calculations as information processing, for example, a device having a built-in microcomputer, can be realized as the information processing device of the present disclosure. However, if use at an event venue or the like is envisaged as described above, a mobile terminal such as a smartphone or tablet device is preferable.

[0029] The imaging device 1 and the information processing device 2 can communicate with each other by short-range wireless communication such as Bluetooth (registered trademark), WI-FI (registered trademark), or NFC (Near Field Communication), or infrared communication. The imaging device 1 and the information processing device 2 may be capable of communicating with each other via wired communication. Furthermore, the information processing device 2 functions as an FTP server, the imaging device 1 functions as an FTP client, and image data and the like are uploaded from the imaging device 1 to the information processing device 2. That is, the imaging device 1 stores FTP setting information for performing FTP transfer, and the FTP transfer is performed with the information processing device 2 serving as the FTP server by using the FTP setting information.

[0030] In the present embodiment, a situation is assumed in which an image file PF and an audio file AF are transmitted from the imaging device 1 to the information processing device 2. The information processing device 2 holds the image file PF and audio file AF transferred from the imaging device 1, and is capable of presenting them to the user, adding metadata to them, editing them, and uploading them to an FTP server 4.

[0031] The imaging device 1 generates image data as still images or moving images through imaging operations. Note that metadata can also be added by the imaging device 1. The image file PF shown in FIG. 1 is a data file that includes this image data and metadata.

[0032] In this embodiment, the imaging device 1 has a voice memo function. This function allows the user to add annotations, explanations, etc. to the captured image by voice by inputting their voice when capturing an image. For example, when capturing a still image, the cameraman may perform a predetermined operation while vocalizing to explain the image content, or may vocalize with an image designated, and the voice is recorded and used as a voice memo associated with the image data. The audio file AF shown in FIG. 1 is a data file that includes audio data as this voice memo. When shooting video, ambient sound is also recorded as audio track data, but this audio track data is audio data included in the image file PF and is separate from the audio file AF. In this explanation, the audio file AF refers solely to a file that contains audio data as a voice memo. In the following, an example will be described in which still image capture is assumed, and the image file PF contains still image data and metadata, and the audio file AF contains voice memo data generated in association with the capture of a still image.

[0033] Note that not all image files PF are necessarily associated with an audio file AF; only when a cameraman or the like inputs audio using the voice memo function is an audio file AF generated in the imaging device 1 and associated with the image file PF. Therefore, in data transfer from the imaging device 1 to the information processing device 2, there are cases where the image file PF and the audio file AF are transmitted as a pair, and cases where only the image file PF is transmitted.

[0034] The information processing device 2 can upload the transferred image file PF and audio file AF to the FTP server 4 via the network 6 . The network 6 may be, for example, the Internet, a home network, a LAN (Local Area Network), a satellite communication network, or any other type of network. The FTP server 4 may be, for example, a server operated by a newspaper company, a broadcasting station, a news agency, etc. Of course, the FTP server 4 is not limited to such servers. The FTP server 4 may take the form of a cloud server, a home server, a personal computer, or the like.

[0035] The information processing device 2 can not only simply upload image files PF and the like from the imaging device 1 directly to the FTP server 4, but can also add and edit caption data contained in metadata, set image size, compress data, and so on, before uploading the files. In addition, for an image file PF associated with an audio file AF, the information processing device 2 can obtain the audio data in the audio file AF, i.e., text data obtained by converting the above-mentioned voice memo into text, and add it to the metadata before uploading it.

[0036] Particularly in the case of this embodiment, the information processing device 2 provides a function of assisting input when editing caption data included in metadata. Specifically, it provides functions such as presenting glossary data, which is a collection of terminology data, editing glossary data, switching between enabling (on) and disabling (off) each piece of glossary data, managing the enable / disable state of each piece of glossary data, and presenting strings obtained from glossary data as input candidates.

[0037] Here, the terminology data and glossary data will be described. The terminology data is a data in which "words" and "shortcuts" are linked, and multiple shortcuts can be set for one word. For example, a number indicating a uniform number is linked to a player's name as a shortcut. When editing caption data, by inputting a number indicating a uniform number, the player's name linked to the uniform number is suggested as an input candidate. This allows an appropriate character string to be input with a short number of characters, improving the efficiency of editing work.

[0038] In addition, in cases where multiple readings are possible for a character, such as in Japanese, the "reading" is linked to the "word" and "shortcut" to form a single term data.

[0039] Glossary data is a collection of multiple term data, and is created, for example, for each genre. For example, there is baseball glossary data that collects only baseball-related term data, and soccer glossary data that collects only soccer-related term data, etc. Furthermore, glossary data may be further subdivided to create glossary data for each team, or glossary data in which only player names are registered, etc. Note that glossary data in which only one term data is registered may also be used.

[0040] Activation information can be set for each glossary data, and the glossary data can be switched on / off by changing the activation information.

[0041] It is conceivable that the voice memo can be converted into text data by equipping the information processing device 2 with a text conversion engine, but the information processing device 2 itself may not have a text conversion function and an external text conversion engine 5 may be used. For example, the information processing device 2 transmits the audio data of the voice memo to the text conversion engine 5 via the network 6 . The text conversion engine 5 converts this voice data into text and transmits the generated text data to the information processing device 2. This allows the information processing device 2 to obtain the text data obtained by converting the voice memo into text. For the sake of explanation, the text data obtained by converting a voice memo into text will also be referred to as "voice memo text."

[0042] By constructing a communication system as shown in FIG. 1, for example, if the user of the imaging device 1 is a professional cameraman working for a newspaper company, the following becomes possible. That is, a cameraman transfers images captured at an event venue to his / her own smartphone (information processing device 2). Then, after performing necessary operations such as caption editing on the information processing device 2 such as a smartphone, the captured images are uploaded from the information processing device 2 to the FTP server 4. After transferring the images to the information processing device 2 such as a smartphone, the information processing device 2 may automatically upload the images to the FTP server 4. In this embodiment, the voice memo is converted to text, added to the metadata, and uploaded together with the image data.

[0043] 2. Configuration of the imaging device An example of the configuration of the imaging device 1 will be described with reference to FIG. The imaging device 1 has, for example, a lens system 11, an imaging element unit 12, a camera signal processing unit 13, a recording control unit 14, a display unit 15, a communication unit 16, an operation unit 17, a camera control unit 18, a memory unit 19, a driver unit 22, a sensor unit 23, an audio input unit 25, and an audio processing unit 26.

[0044] The lens system 11 includes lenses such as a zoom lens and a focus lens, an aperture mechanism, etc. The lens system 11 guides light (incident light) from a subject and collects the light on the imaging element unit 12.

[0045] The imaging element unit 12 includes an image sensor 12a (imaging element) such as a complementary metal oxide semiconductor (CMOS) type or a charge coupled device (CCD) type. The image sensor unit 12 performs, for example, CDS (Correlated Double Sampling) processing, AGC (Automatic Gain Control) processing, etc., on the electric signal obtained by photoelectrically converting the light received by the image sensor 12a, and further performs A / D (Analog / Digital) conversion processing. Then, the image signal as digital data is output to the downstream camera signal processor 13 and camera controller 18.

[0046] The camera signal processing unit 13 is configured as an image processor, for example, using a DSP (Digital Signal Processor) etc. The camera signal processing unit 13 performs various types of signal processing on the digital signal (captured image signal) from the imaging element unit 12. For example, as camera processes, the camera signal processing unit 13 performs pre-processing, synchronization processing, YC generation processing, resolution conversion processing, file formation processing, etc.

[0047] In the pre-processing, the captured image signal from the imaging element unit 12 is subjected to a clamping process for clamping the R, G, and B black levels to a predetermined level, a correction process between the R, G, and B color channels, and the like. In the synchronization process, a color separation process is performed so that the image data for each pixel has all the color components R, G, and B. For example, in the case of an image sensor that uses a Bayer array color filter, a demosaic process is performed as the color separation process. In the YC generation process, a luminance (Y) signal and a color (C) signal are generated (separated) from R, G, B image data. In the resolution conversion process, the image data that has been subjected to various types of signal processing is subjected to the resolution conversion process.

[0048] In the file creation process, for example, image data that has been subjected to the various processes described above is subjected to compression encoding for recording or communication, formatting, generation and addition of metadata, etc., to generate a file for recording or communication. For example, image files PF in formats such as JPEG (Joint Photographic Experts Group), TIFF (Tagged Image File Format), GIF (Graphics Interchange Format), etc. may be generated as still image files. It is also possible to generate image files PF in the MP4 format used for recording video and audio conforming to MPEG-4. It is also possible to generate an image file PF as raw (RAW) image data.

[0049] The camera signal processing unit 13 generates metadata that includes information on processing parameters within the camera signal processing unit 13, various control parameters obtained from the camera control unit 18, information indicating the operating status of the lens system 11 and the image sensor unit 12, mode setting information, and imaging environment information (date, time, location, etc.). In particular, in the case of this embodiment, it is assumed that the metadata includes IPTC (International Press Telecommunications Council) metadata, an example of which is shown in FIG. IPTC metadata is metadata in a format developed by a media company association. Figure 3 shows only a few of the items, but it is possible to describe a variety of information, such as "description / caption," "description writer," "headline," and "keywords."

[0050] The recording control unit 14 performs recording and reproduction on a recording medium such as a non-volatile memory, for example. The recording control unit 14 performs processing for recording image files such as moving image data and still image data, thumbnail images, and the like on the recording medium, for example. The actual form of the recording control unit 14 may be various. For example, the recording control unit 14 may be configured as a flash memory built into the imaging device 1 and a write / read circuit for the memory. The recording control unit 14 may also be in the form of a card recording / playback unit that performs recording / playback access to a recording medium that can be detached from the imaging device 1, such as a memory card (such as a portable flash memory). The recording control unit 14 may also be realized as an HDD (Hard Disk Drive) built into the imaging device 1.

[0051] The display unit 15 is a display unit that displays various information to the person taking the image, and is, for example, a display panel or viewfinder using a display device such as a liquid crystal display (LCD) or an organic EL (Electro-Luminescence) display arranged on the housing of the imaging device 1. The display unit 15 executes various displays on the display screen based on instructions from the camera control unit 18 . For example, the display unit 15 displays a reproduced image of image data read from a recording medium by the recording control unit 14. Further, image data of the captured image that has been resolution-converted for display by the camera signal processing unit 13 is supplied to the display unit 15, and the display unit 15 may perform display based on the image data of the captured image in response to an instruction from the camera control unit 18. This causes a so-called through image (monitoring image of the subject), which is an image captured while checking the composition or recording a video, to be displayed. Furthermore, based on instructions from the camera control unit 18, the display unit 15 displays various operation menus, icons, messages, etc., that is, displays as a GUI (Graphical User Interface), on the screen.

[0052] The communication unit 16 performs data communication and network communication with external devices in a wired or wireless manner. For example, the captured image data (still image files or video files) is transmitted to an external display device, recording device, playback device, or the like. Furthermore, the communication unit 16 serves as a network communication unit and performs communication via various networks 6, such as the Internet, a home network, and a LAN (Local Area Network), and can transmit and receive various data between a server, a terminal, and the like on the network. For example, although not shown in FIG. 1, the communication unit 16 may perform communication processing to upload captured image data (such as the above-mentioned image file) to the FTP server 4. In this embodiment, the communication unit 16 communicates with the information processing device 2 and transfers the image file PF and the audio file AF.

[0053] The operation unit 17 collectively refers to input devices for a user to input various operations. Specifically, the operation unit 17 refers to various operators (keys, dials, touch panel, touch pad, etc.) provided on the housing of the imaging device 1. An operation performed by the user is detected by the operation unit 17, and a signal corresponding to the input operation is sent to the camera control unit .

[0054] The camera control unit 18 is composed of a microcomputer (arithmetic processing device) equipped with a CPU (Central Processing Unit). The memory unit 19 stores information and the like used for processing by the camera control unit 18. The illustrated memory unit 19 collectively represents, for example, a Read Only Memory (ROM), a Random Access Memory (RAM), a flash memory, and the like. The memory unit 19 may be a memory area built into a microcomputer chip serving as the camera control unit 18, or may be configured by a separate memory chip. The camera control unit 18 executes a program stored in the ROM, flash memory, or the like of the memory unit 19 to control the entire imaging device 1 . For example, the camera control unit 18 controls the operation of each necessary unit regarding the control of the shutter speed of the image sensor unit 12, instructions for various signal processing in the camera signal processing unit 13, image capturing and recording operations in response to user operations, playback operations of recorded image files, transfer and upload operations of recorded images, operations of the lens system 11 such as zoom, focus, and aperture adjustment in the lens barrel, user interface operations, etc.

[0055] The RAM in the memory unit 19 is used as a working area for various data processing by the CPU of the camera control unit 18, for temporarily storing data, programs, and the like. The ROM and flash memory (non-volatile memory) in memory unit 19 are used to store the OS (Operating System) that the CPU uses to control each part, content files such as image files, application programs for various operations, firmware, various setting information, etc. The various types of setting information include the above-mentioned FTP setting information, exposure settings, shutter speed settings, and mode settings as setting information related to imaging operations, white balance settings, color settings, and settings related to image effects as setting information related to image processing, and custom key settings and display settings as setting information related to operability.

[0056] The driver unit 22 includes, for example, a motor driver for a zoom lens drive motor, a motor driver for a focus lens drive motor, a motor driver for a diaphragm mechanism motor, and the like. These motor drivers apply drive currents to the corresponding drivers in response to instructions from the camera control unit 18, thereby moving the focus lens and zoom lens, opening and closing the aperture blades of the aperture mechanism, and so on.

[0057] The sensor unit 23 collectively represents various sensors mounted on the imaging device. The sensor unit 23 is equipped with, for example, an IMU (inertial measurement unit), and can detect angular velocity using a three-axis angular velocity (gyro) sensor of pitch, yaw, and roll, and can detect acceleration using an acceleration sensor. Furthermore, the sensor unit 23 may be equipped with, for example, a position information sensor, an illuminance sensor, a proximity sensor, or the like.

[0058] The audio input unit 25 has, for example, a microphone and a microphone amplifier, and outputs an audio signal obtained by collecting surrounding sounds. The audio processing unit 26 performs processing such as converting the audio signal obtained by the audio input unit 25 into a digital audio signal, AGC processing, sound quality processing, noise reduction processing, etc. The audio data that has undergone these processes is output to the camera signal processing unit 13 and the camera control unit 18. For example, when a moving image is captured, the audio data is processed in the camera control unit 18 as audio data accompanying the moving image.

[0059] Furthermore, the audio data can be converted into a file as an audio file AF in the camera signal processing unit 13 or the camera control unit 18 as audio data for a so-called voice memo during image capture or the like. The audio file AF can be associated with the image file and recorded on a recording medium by the recording control unit 14, or can be transmitted and output from the communication unit 16 together with the image file.

[0060] <3. Configuration of information processing device> FIG. 4 shows an example of the configuration of an information processing device 2 such as a mobile terminal device. The CPU 71 of the information processing device 2 executes various processes according to a program stored in the ROM 72 or a program loaded from the storage unit 79 to the RAM 73. The RAM 73 also stores data necessary for the CPU 71 to execute various processes as appropriate. The CPU 71, the ROM 72, and the RAM 73 are interconnected via a bus 74. To this bus 74, an input / output interface 75 is also connected.

[0061] The input / output interface 75 is connected to an input unit 76 including an operator and an operating device. For example, the input unit 76 may be various types of operators or operation devices such as a keyboard, a mouse, keys, a dial, a touch panel, a touch pad, or a remote controller. An operation by the user is detected by the input unit 76, and a signal corresponding to the input operation is interpreted by the CPU 71.

[0062] Further, a display unit 77 formed of an LCD or an organic EL panel, etc., and an audio output unit 78 formed of a speaker, etc. are connected to the input / output interface 75 either integrally or separately. The display unit 77 is a display unit that performs various displays, and is configured, for example, by a display device provided in the housing of the information processing device 2, a separate display device connected to the information processing device 2, or the like. The display unit 77 displays images for various types of image processing, moving images to be processed, etc., on the display screen based on instructions from the CPU 71. Furthermore, the display unit 77 displays various operation menus, icons, messages, etc., that is, as a GUI (Graphical User Interface), based on instructions from the CPU 71.

[0063] The input / output interface 75 may be connected to a storage unit 79 configured with a hard disk or solid-state memory, or a communication unit 80 configured with a modem or the like.

[0064] The communication unit 80 performs communication processing via a transmission path such as the Internet, and communication with various devices via wired / wireless communication, bus communication, and the like. In this embodiment, the communication unit 80 has a function of communicating with the imaging device 1 via, for example, the above-mentioned FTP communication, short-range wireless communication such as Bluetooth, WI-FI, and NFC, infrared communication, and wired connection communication.

[0065] A drive 82 is also connected to the input / output interface 75 as required, and a removable recording medium 81 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory is appropriately mounted thereon. The drive 82 allows data files such as image files and various computer programs to be read from the removable recording medium 81. The read data files are stored in the storage unit 79, and images and sounds contained in the data files are output on the display unit 77 and the sound output unit 78. Furthermore, the computer programs and the like read from the removable recording medium 81 are installed in the storage unit 79 as necessary.

[0066] The information processing device 2 may be equipped with a processor serving as a text conversion engine 83 . The text conversion engine 83 performs processing such as analyzing voice data and converting it into text data. When an external text conversion engine 5 is used as described above, the information processing device 2 does not need to include a processor as the text conversion engine 83.

[0067] In the information processing device 2, for example, software for the processing of the present disclosure can be installed via network communication by the communication unit 80 or via a removable recording medium 81. Alternatively, the software may be stored in advance in the ROM 72, the storage unit 79, or the like.

[0068] For example, such software (application program) configures the functional configuration as shown in FIG. FIG. 5 shows, as functions provided in the information processing device 2, a UI (user interface) control unit 31, a communication control unit 32, a text acquisition unit 33, a data management unit , an upload processing unit 35, and a glossary management unit .

[0069] The UI control unit 31 performs user interface processing such as presenting the image files PF and audio files AF transferred from the imaging device 1 to the user and accepting user operations for setting and editing various types of information. User interface processing includes processing for providing the user with an operation input environment by providing display output, audio output, etc. to the user, processing for providing display output and audio output to present various information to the user, processing for detecting operations by the user, and processing for detecting / estimating the user's intentions. The UI control unit 31 performs processing to provide the user with an operation input environment by, for example, performing display output, audio output, and the like for the user. Alternatively, the UI control unit 31 performs a process of detecting an operation by a user, for example. Alternatively, the UI control unit 31 performs, for example, both a process of providing an operation input environment to the user and a process of detecting an operation by the user. Of course, the UI control unit 31 may perform other user interface processes.

[0070] The UI control unit 31 provides a UI environment in which a process of automatically adding voice memo text, which is a text version of a voice memo in an audio file AF, as part of caption data in metadata added to image data can be turned on / off. Furthermore, the UI control unit 31 provides a UI environment that allows a user to set whether or not to automatically perform a process of uploading the image file PF including the image data and the metadata to the FTP server 4 after the process of converting the voice memo text into metadata corresponding to the image data has been performed. In addition, the UI control unit 31 also allows a user to set whether or not to upload the audio file AF in that case. The UI control unit 31 also provides a UI environment for displaying voice memo text and playing back the voice.

[0071] The UI control unit 31 in this embodiment performs user interface processing to enable editing of text information as metadata using multiple glossary data. Specifically, in editing caption data to be added to image data obtained by shooting a baseball game between teams A and B, the glossary data for soccer, the glossary data for team A, and the glossary data for team B are turned on to present input character candidates to the user.

[0072] Candidates for input characters are, for example, frequently used words and the like that are suggested by the predictive conversion function of the information processing device 2 when words and sentences inferred from characters that have already been input are suggested, and words that start with characters that have already been input and are selected from glossary data that is controlled to be in an on state. In the following description, characters that have already been input are referred to as "input characters" and characters to be input that are inferred from the input characters are referred to as "input candidates."

[0073] The UI control unit 31 performs user interface processing for editing term data and glossary data. Moreover, the UI control unit 31 performs user interface processing for switching on / off each glossary data. Furthermore, the UI control unit 31 executes user interface processing for acquiring glossary data from another information processing device, and user interface processing for transferring glossary data to another information processing device. Furthermore, the UI control unit 31 performs user interface processing for changing the synchronization settings of the glossary data.

[0074] The communication control unit 32 has a function of controlling the communication operation by the communication unit 80 . The communication control unit 32 performs a process of causing the communication unit 80 to communicate with the imaging device 1 .

[0075] When the audio file AF is transferred from the imaging device 1, the text acquisition section 33 performs processing to acquire voice memo text obtained by converting the voice memo included in the audio file AF into text. Specifically, the text acquisition unit 33 causes the text conversion engine 83 to execute a text conversion process and acquires the voice memo text. Alternatively, the text acquisition unit 33 transmits audio data as a voice memo from the communication unit 80 to the text conversion engine 5 , and acquires the voice memo text returned from the text conversion engine 5 .

[0076] The data management unit 34 has a function of receiving an image file PF containing image data and an audio file AF containing an associated voice memo transmitted from the imaging device 1, and then processing the voice memo text acquired by the text acquisition unit 33 for the voice memo contained in the audio file AF as metadata corresponding to the image data. The data management unit 34 also performs processes such as storing and editing the image file PF and audio file AF transmitted from the imaging device 1. For example, the data management unit 34 performs processes such as editing image data, adding metadata (adding tags), and processing related to various operation settings.

[0077] The upload processing unit 35 is a function that performs upload processing to the FTP server 4 via the communication unit 80. In particular, after the data management unit 34 has performed a process of converting the voice memo text for the audio file AF into metadata corresponding to the image data, the upload processing unit 35 performs a process of uploading the image file PF (image data and metadata) to the FTP server 4. The upload processing unit 35 may also upload the audio file AF to the FTP server 4 together with the image file PF.

[0078] The glossary management unit 36 ​​performs processing such as storing term data and glossary data, controlling the on / off of glossary data, storing the on / off state of glossary data, searching for input candidates corresponding to input characters from glossary data in the on state, acquiring glossary data received from other information processing devices by the communication control unit 32, storing glossary data, and transferring glossary data via the communication control unit 32.

[0079] The above-mentioned functions are provided, for example, by the information processing device 2 installing application software that realizes the processes of the present disclosure. Of the above functions, the information processing device 2 includes the UI control unit 31 and the glossary management unit 36, thereby executing various processes for using glossary data to edit metadata.

[0080] <4. User interface screen> The following describes UI screens on the display unit 77 of the information processing device 2. Each of the following screens is an example of a screen that the CPU 71 displays on the display unit 77 using the function of the UI control unit 31. In the description, for example, a smartphone is assumed as the information processing device 2, and the display contents on a display formed on the housing of the smartphone are assumed.

[0081] FIG. 6 shows an image list screen 50. The image list screen 50 is a screen on which the image data of the image file PF transferred from the imaging device 1 is displayed as a list of thumbnail images.

[0082] The image list screen 50 is provided with an image list area 101, in which thumbnail images 103 of the image data imported from the imaging device 1 are displayed in a list. The images to be displayed in a list can be selected to be all imported images or only protected images. When there are too many images to display on one screen, each image (thumbnail image 103) can be displayed by scrolling or turning the page.

[0083] Image information 104 is displayed corresponding to each thumbnail image 103. The image information 104 displays the name of the image data, for example "DSC00000", an icon indicating the protection status, an icon relating to FTP upload, and the like.

[0084] Some of the image data (image files PF) displayed in the list may be associated with an audio file AF as a voice memo. For image data that has a corresponding voice memo, a voice memo mark 105 is displayed on the thumbnail image 103.

[0085] A menu button 102 is displayed on the image list screen 50. When the user performs an operation such as tapping the menu button 102, the display transitions to a menu screen 55, which will be described later.

[0086] 7 is an example of the menu screen 55. The menu screen 55 is provided with a close button 109 for closing the menu screen 55.

[0087] The menu screen 55 has, as menu items, an FTP upload preset item 141, an IPTC metadata preset item 142, a caption template item 143, a caption glossary item 144, an FTP import history item 145, an import item 146, a settings item 147, a voice memo automatic captioning item 148, a support page item 149, a MAC address confirmation item 150, a data deletion item 151, and an account item 152. Of course, these are merely examples, and various examples of the contents of the menu items are conceivable. Furthermore, the number of items may be greater, or the items may be organized hierarchically. When there are a large number of items, each item is displayed by scrolling or turning the pages.

[0088] Here, as an item related to the processing of this embodiment, first, the operation on the caption glossary item 144 will be described. The caption glossary item 144 is an item for performing various operations on glossary data. When the user performs an operation on the caption glossary item 144, a glossary list screen 58 is displayed.

[0089] FIG. 8 is an example of the glossary list screen 58. A back button 110 is provided on glossary list screen 58, and when back button 110 is operated, the screen returns to menu screen 55 of FIG.

[0090] The glossary list screen 58 displays a glossary list display section 111 for displaying a list of glossary data, and an add glossary button 112 for adding new glossary data. Further, for each glossary data, a sub-menu button 113 for performing operations for each glossary data, and a selection button 114 for indicating an on / off state and switching between the on / off states are displayed. The on / off state of each glossary data is stored when back button 110 is operated to return to menu screen 55.

[0091] In the state shown in Figure 8, the glossary data titled "Sports 1" is in the ON state, the glossary data titled "Sports 2" is in the OFF state, and the glossary data titled "Sports 3" is in the ON state. The user can switch the suggested words presented when editing text by operating the selection button for each glossary data.

[0092] When sub-menu button 113 provided for each glossary data is operated, glossary sub-menu dialogue 59 shown in FIG. The glossary submenu dialog 59 displays a title change button 115 for changing the title given to the glossary data (such as the above-mentioned "Sports 1"), a select button 116 for changing the state from off to on (selected), an edit button 117 for editing each term data included in the glossary data, and a delete button 118 for deleting the glossary data. Also, for example, when an operation is performed outside the area of ​​glossary submenu dialogue 59, the display of glossary submenu dialogue 59 ends and the display returns to glossary list screen 58.

[0093] The select button 116 is displayed when the sub-menu button 113 in the glossary data in the OFF state is operated, and when the sub-menu button 113 in the glossary data in the ON state is operated, the unselected button 116A which changes the state to unselected is displayed instead of the select button 116.

[0094] Edit button 117 is operated not only to change the term data registered in the glossary data, but also when adding new term data to the glossary data or deleting registered term data.

[0095] When edit button 117 is operated, glossary data edit screen 60 shown in FIG. 10 is displayed. The glossary data editing screen 60 displays a title display section 119 which displays the title given to the glossary data, a back button 120 for returning to the glossary list screen 58, a term list display section 121 which displays a list of term data registered in the glossary data, a search button 122 for searching for term data, and an add term button 123 for adding term data.

[0096] One term data is displayed in the term list display section 121. That is, Fig. 10 shows an example in which only one term "entitled to base" is registered in glossary data with the title "Sports 1".

[0097] Further, each term data is provided with a sub-menu button 124 for performing operations for each term data.

[0098] When the submenu button 124 is operated, the term submenu dialogue 62 shown in FIG. 11 is displayed. The term submenu dialog 62 is provided with an edit button 125 for editing term data and a delete button 126 for deleting term data. When an operation is performed outside the area of ​​the term submenu dialog 62, the display of the term submenu dialog 62 is terminated and the glossary data editing screen 60 is displayed again.

[0099] When the edit button 125 in the term submenu dialogue 62 is operated, a term data edit screen 63 shown in FIG. 12 is displayed. The term data editing screen 63 is provided with a back button 127 for returning to the glossary data editing screen 60, a word input field 128 for editing words of the term data, and a reading input field 129 for editing readings and shortcuts.

[0100] In the above explanation, the reading of a word indicates how to read the word, and the shortcut of a word is a character string that is input to present the word as a suggested word. That is, although it has been explained that "reading" and "shortcut" are different concepts, both are character strings that are input to present the word as a suggested word, so here, "reading" and "shortcut" are not differentiated and are referred to as "reading". For example, when you enter the "entitle" part of the "reading" "entaitoru tsu-base", "entitle to base" is suggested. Similarly, when you enter the "shortcut" "2", the associated "entitle to base" is suggested. That is, whether the user inputs part of the "reading" or part of the "shortcut," the corresponding words can be presented as suggested words, thereby improving the efficiency of editing work.

[0101] In each reading input field 129, a delete button 129a is provided for deleting the character string set as the "reading" (including "shortcut").

[0102] Returning to the explanation of the glossary list screen 58 in FIG. When the glossary addition button 112 on the glossary list screen 58 is operated, the glossary addition dialog 64 shown in FIG. 13 is displayed. The glossary addition dialog 64 displays a new creation button 180 and an import button 181 .

[0103] The new creation button 180 is an operator for operating the information processing device 2 to create new glossary data. The import button 181 is an operator for adding new glossary data to the glossary data managed by the information processing device 2 by acquiring already created glossary data from another information processing device.

[0104] Returning to the description of the image list screen 50 shown in FIG. The user can perform an image selection operation on the image list screen 50. For example, the user can select specific image data by performing an operation such as tapping on a thumbnail image 103. For example, by selecting specific image data, a caption editing screen 52 as shown in FIG. 14 is displayed.

[0105] The caption editing screen 52 is provided with an image field 130, a caption field 132, and a voice memo field 133.

[0106] The image field 130 displays a thumbnail image 103 and a forward button 107. The displayed thumbnail image 103 is the thumbnail image of the image data selected by the user. This makes it clear that the displayed caption editing screen 52 is a screen for editing the caption for the image data represented by the thumbnail image 103.

[0107] By operating the next button 107, the user can switch to a state in which image data arranged before or after the image on the image list screen 50 is selected. For example, by operating the next button 107, the thumbnail image 103 is switched on the caption editing screen 52. Then, the caption editing screen 52 becomes a screen for editing the caption for the image data represented by the new thumbnail image 103.

[0108] Furthermore, the user can, for example, pinch or tap the image displayed as thumbnail image 103 to display it in a larger size on individual image screen 51 in FIG. A forward button 107 is displayed on the individual image screen 51, and the user can switch the display to the previous or next image on the individual image screen 51 by operating this forward button 107. In addition, in the case of image data having a voice memo, a voice memo mark 105 is also displayed on the individual image screen 51.

[0109] In the caption field 132 of the caption editing screen 52 in FIG. 14, the caption data described in the "description / caption" field in the above-mentioned IPTC metadata is displayed, and it is possible to edit the caption data. For example, when the user taps on the caption field 132, a software keyboard 131 is displayed as shown in Fig. 16, and any character can be input by operating the software keyboard. The caption data input using this caption field 132 is written in the description / caption field of the IPTC metadata for the image data.

[0110] When caption editing screen 52 is opened for image data into which caption data has already been input, that is, image data into which caption data has already been described as IPTC metadata, the input caption data is displayed in caption field 132. Caption data can also be added, for example, in imaging device 1, so caption data input in imaging device 1 may be displayed in caption field 132, or caption data previously input in caption field 132 and described in IPTC metadata may be displayed. Therefore, the user can use the caption field 132 to input new caption data, or edit previously input caption data by adding, deleting, correcting, or the like.

[0111] 16 shows a state in which the characters "enta" have been input using the software keyboard 131. A caret 190 indicating the position of the input character is displayed behind the input character "enta." Between the caption field 132 and the software keyboard 131, a suggestion field 191 is provided for presenting character strings or words (that is, input candidates) that are expected to be input based on the input characters.

[0112] The suggestion column 191 is composed of a normal candidate display column 191a in which normal input candidates are displayed, and a specific candidate display column 191b in which input candidates selected from the glossary data described above are displayed.

[0113] In the normal candidate display field 191a, for example, character strings and sentences selected in consideration of frequency of use from character strings input in all application programs executable on the information processing device 2, including this application program, are displayed. As a result, for example, "entertainment" and "entertainment", which is an abbreviation of entertainment, are suggested in the normal candidate display field 191a.

[0114] The specific candidate display field 191b displays character information of term data acquired from glossary data selected by the user from glossary data in which term data that frequently appears in a specific shooting situation or term data that is cumbersome to input is registered. For example, character information of a word starting with the input character "enta" or term data that includes the input character as a part of the term data registered in the glossary data is displayed. As a result, for example, a word such as "entitled to base," which is used only in a specific situation such as baseball, is suggested in the specific candidate display field 191b.

[0115] When the user performs an operation to select a character string displayed in the normal candidate display field 191 a or the specific candidate display field 191 b, the selected character string is inserted at the display position of the caret 190 . This allows for faster editing of caption data. In addition, shortcuts are linked to the term data. For example, as shown in FIG. 12, the shortcut "2" is linked to the character information "entitlement-to-base." That is, the user can display the character string "entitlement to base" in the specific candidate display field 191b by inputting "2" as a character string that is not included in the word "entitlement to base". Therefore, by making good use of shortcuts for terminology data, the user can easily and quickly edit caption data.

[0116] Returning to the explanation of Fig. 14, the caption editing screen 52 is provided with a template button 138 and a voice input button 139. By operating the template button 138 , the user can call up a caption template and display it in the caption field 132 . Furthermore, the user can input caption data by voice by operating the voice input button 139. In this case, the input voice may be converted into text in the same manner as the conversion of a voice memo into text.

[0117] A voice memo text area 134 is provided in the voice memo field 133 of the caption editing screen 52, and the voice memo text is displayed. That is, the voice memo transferred as audio data from the imaging device 1 is converted into text and displayed in the voice memo field 133. This allows the user to check the contents of the voice memo on the caption editing screen 52. Furthermore, a play button 135, a copy button 136, and a delete button 137 are displayed in the voice memo field 133, allowing operations related to the voice memo to be performed.

[0118] When the user operates the playback button 135, audio playback of the voice memo begins. Fig. 17 shows a display in the state where audio playback is in progress. For example, during audio playback, a seek bar 160, current time 161, total playback length 162, stop button 163, and pause button 164 are displayed instead of the voice memo text area 134, play button 135, copy button 136, and delete button 137. The progress of audio playback is indicated by the seek bar 160 and the current time 161. A stop button 163 and a pause button 164 allow the user to stop or pause audio playback.

[0119] When the user operates the delete button 137 in the voice memo field 133 of the caption editing screen 52 in FIG. 14, the voice memo is deleted. In this case, in response to the operation of the delete button 137, a confirmation dialog 61 such as that shown in Fig. 18 is displayed, requesting the user to confirm the deletion. In the confirmation dialog 61, a warning message 167 regarding the deletion is displayed, along with an OK button 165 and a cancel button 166. The deletion process is executed when the user operates the OK button 165. If the user operates the cancel button 166, the deletion process is aborted.

[0120] The following are examples of how to delete a voice memo. When a voice memo corresponding to image data exists, there are cases where the voice memo text is obtained and cases where it is not converted into text. When a voice memo, which is audio data, exists but no voice memo text exists, it is possible to arrange for the voice memo (audio file AF) to be deleted by a delete operation. When there are voice memos and voice memo texts, which are audio data, depending on the deletion operation, it is possible to delete both the voice memos and the voice memo text, to delete only the voice memos, or to delete only the voice memo text. Of course, it is also possible to provide separate delete buttons for the voice memos and the voice memo text.

[0121] When the user operates the copy button 136 in the voice memo field 133 of the caption editing screen 52 in Fig. 14, the voice memo text displayed in the voice memo text area 134 is copied to the clipboard area on the system. In this case, for example, a copy message 168 as shown in Fig. 19 is displayed to notify the user of the fact that the text has been copied. The user can paste the voice memo text data copied to the clipboard area into the caption field 132 by a predetermined operation. In other words, the user can use the voice memo text as caption data by copy / paste operations.

[0122] Furthermore, the voice memo text area 134 may be automatically inserted into the caption section 132 by a setting for automatic captioning, which will be described later. 20 shows an example in which text data as voice memo text is added as caption data with the caption editing screen 52 open. In this case, "entitled double base" is the text that was previously input as caption data, and the following text data "Tanaka hit a home run in the top of the second inning" is the automatically inserted voice memo text. In this case where voice memo text is automatically inserted into caption data, if caption data text already exists, the voice memo text can be inserted before or after the caption. In the case of automatic insertion, it is preferable to add the voice memo text after the caption that has already been entered, in order to make the content of the caption that has already been entered easier to understand.

[0123] 21 and 22 show display examples when the information processing device 2, which is a smartphone, is used in landscape orientation. The display content in Fig. 21 is the same as that in Fig. 14, but the area arrangement is compatible with a landscape screen.

[0124] 22 shows the same display content as in Fig. 16, with software keyboard 131 displayed for inputting characters into caption field 132. In this case, since the vertical size of the screen is smaller than in Fig. 16, image field 130, voice memo field 133, and caption field 132 are shifted upward as a whole, and caption field 132 can be seen even when software keyboard 131 is displayed.

[0125] 14, 16, 17, 20, 21, and 22, a back button 106 is provided on the caption editing screen 52. Operating the back button 106 returns to the image list screen 50, for example.

[0126] Next, an interface screen for making settings related to voice memo processing and uploading will be described. Among the menu items on the menu screen 55 described above, operations from the setting item 147 and the voice memo automatic caption attachment item 148 will be described as items related to the processing of this embodiment. The voice memo automatic caption attachment item 148 is an item that allows the user to select whether or not, when a voice memo is converted into text, the voice memo text is automatically added to the caption data.

[0127] When the user operates the voice memo automatic captioning item 148, the voice memo automatic captioning setting screen 53 shown in Fig. 23 is displayed. The voice memo automatic captioning setting screen 53 displays a setting switch 170, which allows the user to set the voice memo automatic captioning function to ON / OFF. When the setting switch 170 is turned on, if a voice memo text is obtained, the voice memo text is automatically inserted into the caption data as shown in FIG. When the setting switch 170 is turned off, no such automatic insertion occurs.

[0128] The voice memo automatic caption addition setting screen 53 is provided with a back button 106, and when the back button 106 is operated, the screen returns to the menu screen 55 in Fig. 7. The on / off state of the setting button 170 is enabled in the state when the back button 106 is operated.

[0129] Furthermore, when the user operates setting item 147 on menu screen 55 in Fig. 7, setting screen 56 in Fig. 24 is displayed. Setting items displayed on setting screen 56 include a caption glossary synchronization item 201, an import item 202, a metadata editing item 203, and an automatic FTP upload item 204. Of course, this is just one example. When the user operates the automatic FTP upload item 204 on this setting screen 56, an automatic upload setting screen 57 shown in FIG. 25 is displayed.

[0130] The automatic upload setting screen 57 displays a setting switch 171, which allows the user to set automatic upload to on / off. The automatic upload function is a function that automatically uploads an image file PF transferred from the imaging device 1 to a set FTP server 4. FIG. 25 shows the case where the setting switch 171 is in the OFF state. When the user turns on setting switch 171, a display for setting automatic upload appears, as shown in Fig. 26. That is, an upload destination display field 175 is displayed, and also setting switches 172 for attaching a voice memo and setting switches 173 for JPEG image quality are displayed.

[0131] In Fig. 26, it is shown that no upload destination has been specified yet in the upload destination display field 175. When the user performs an operation to specify an upload destination, an upload destination specified by, for example, the name "XYZ" given by the user when setting up the FTP is displayed as shown in Fig. 27.

[0132] The user can set whether or not to upload the audio file AF as a voice memo together with the image file PF during automatic uploading by using the voice memo attachment setting switch 172. For example, when the setting switch 172 is turned on as shown in Fig. 27, the audio file AF is also included in the upload target during automatic upload processing.

[0133] The JPEG image quality setting switch 173 allows the user to set the compression rate and image size of the image data to be uploaded. When the setting switch 173 is turned on, a compression ratio setting bar 176, a long side pixel setting section 177 and setting switches 174 are displayed as shown in FIG. The user can specify the compression ratio by operating a compression ratio setting bar 176. Also, the setting switch 174 can be used to set the number of pixels on the long side.

[0134] The above user operations on the automatic upload setting screen 57 are validated when the back button 106 is operated to return to the setting screen 56 of FIG. When the back button 106 is operated on the setting screen 56, the screen returns to the menu screen of FIG.

[0135] Subsequently, when the synchronization item 201 of the caption glossary is operated on the setting screen 56 shown in FIG. 24, an automatic synchronization setting dialog 65 is displayed in a superimposed manner, as shown in FIG.

[0136] The automatic synchronization setting dialog 65 displays an ON option 210 for enabling (turning on) the automatic synchronization setting and an OFF option 211 for disabling (turning off) the automatic synchronization setting. The user can set the glossary data to be automatically synchronized by performing an operation on the ON option 210. The user can also cancel the automatic synchronization setting of the glossary data and switch to the manual synchronization setting by performing an operation on the OFF option 211.

[0137] The automatic synchronization setting of glossary data is, for example, a setting in which the information processing device 2 automatically acquires glossary data that can be used when a predetermined screen is displayed. Specifically, when the automatic synchronization setting is on, glossary synchronization processing is executed when the glossary list screen shown in Fig. 8 is displayed. In the glossary synchronization processing, glossary data that is not stored in the information processing device 2 is downloaded from a predetermined server device or the like to the information processing device 2 and saved therein. This makes the glossary data available to the information processing device 2 the latest.

[0138] Alternatively, in the glossary synchronization process, optimal glossary data that is estimated to be currently used by the user may be downloaded to the information processing device 2. For example, based on the position information and time information of the information processing device 2, a subject or event of an image file PF that is a target for caption editing is estimated, and glossary data related to the subject or event is downloaded to the information device 2 and stored. As a result, the latest glossary data to be used for caption editing that will be performed using the information processing device 2 is stored in the information processing device 2. Note that the subject and the event may be estimated from the metadata of the image file PF transferred by FTP from the imaging device 1. As a result, even when the image file PF is transferred by FTP from the imaging device 1 to the information processing device 2 located in a different location and caption editing is performed in the information processing device 2, appropriate glossary data is stored in the information processing device 2.

[0139] <5. Example of processing when importing images> Among various types of processing executed by the information processing device 2, an example of processing when an image file PF is imported from the imaging device 1 will first be described with reference to FIGS. Note that each processing example described below is executed by the CPU 71 using the functions described with reference to FIG. 5 and realized by application software.

[0140] 29 and 30 show a series of flowcharts in separate parts, with connections indicated by "C1." In step S101 of FIG. 29, the CPU 71 performs processing for importing the image file PF from the imaging device 1. The process of importing the image file PF from the imaging device 1 is performed, for example, by communication between the information processing device 2 and the imaging device 1, and the transfer of the image file PF is initiated, for example, when the user performs a specified operation on the information processing device 2 side or the imaging device 1 side. The imaging device 1 performs a process of transferring the image file PF selected as the transfer target to the information processing device 2 by FTP communication. In this case, if there is an audio file AF having a voice memo associated with the image file PF, the audio file AF is also transferred to the information processing device 2. On the information processing device 2 side, the CPU 71 performs the process of step S101 to capture the image files PF and audio files AF that are transferred in sequence.

[0141] Here, between the imaging device 1 and the information processing device 2, a rule is determined that when an audio file AF associated with an image file PF exists, the audio file AF is transmitted first, and then the image file PF is transmitted. In this way, when the CPU 71 receives one audio file AF, it can determine that the audio file AF is associated with the image file PF that will be received next. In step S102, the CPU 71 performs a process of linking the received audio file AF to the received image file PF and managing them in accordance with the above rules. In addition, for example, it is also possible to include information for identifying the associated audio file AF in the metadata of the image file PF. In step S102, a process may be performed to link the received audio file AF to the received image file PF and manage them by referring to the metadata.

[0142] When the import of one or more image files PF is completed, the CPU 71 proceeds from step S103 to step S110 and determines whether or not any of the imported image files PF is associated with an audio file AF. If the captured files are all image files PF and no audio files AF exist, the CPU 71 proceeds from step S110 to step S120 in FIG.

[0143] On the other hand, if there is an image file PF associated with at least one audio file AF, the CPU 71 advances from step S110 to step S111 in FIG. In step S111, the CPU 71 selects, from among the currently captured image files PF, one or more image files PF associated with an audio file AF as a processing target.

[0144] Then, in step S112, the CPU 71 performs a text conversion process on the voice memo of the audio file AF associated with the image file PF that is the processing target.

[0145] A specific example of the text conversion process in step S112 is shown in FIG. In step S161, the CPU 71 obtains text data corresponding to the voice memo. The text data is acquired, for example, by transmitting voice data as a voice memo to the text conversion engine 5 and receiving the text data. Alternatively, if the information processing device 2 is equipped with a text conversion engine 83, the text conversion process may be performed by the text conversion engine 83. The CPU 71 determines in the next step S162 whether or not there is selected glossary data. The glossary data can be selected by operating a selection button displayed on the glossary list screen of FIG.

[0146] If there is no selected glossary, the CPU 71 ends the text conversion process, and proceeds to step S113 in Fig. 29. That is, no correction of the text data based on the glossary data is performed.

[0147] On the other hand, if a selected glossary is found, the CPU 71 proceeds to step S163 to determine whether or not there is a homonym in the acquired text data. If a homonym is found, the CPU 71 determines in step S164 whether or not the homonym is registered in the selected glossary data. If a homonym is registered, the CPU 71 corrects the text data acquired in step S161 by replacing the homonym with a homonym registered in the glossary data in step S165.

[0148] This allows the system to convert to an appropriate name when there are multiple conversion candidates, such as for a Japanese name.

[0149] If it is determined in step S163 that there is no homonym, or if it is determined in step S164 that the homonym is not registered in the glossary data, the CPU 71 terminates the text conversion process shown in FIG. 31 and proceeds to step S113 in FIG. 29.

[0150] In step S113, the CPU 71 determines whether or not the conversion to text has been performed normally. If the text conversion was successful and the voice memo text was obtained, the CPU 71 proceeds from step S113 to step S114, and performs a process of saving the voice memo text in, for example, the memory unit 79 as the voice memo text corresponding to the image file PF being processed.

[0151] In step S115, the CPU 71 checks whether the automatic caption adding function is turned on. The automatic caption adding function is a function that the user can arbitrarily set to on / off using the voice memo automatic caption adding setting screen 53 in FIG. If the automatic caption adding function is not on, the CPU 71 proceeds to step S117.

[0152] If the automatic captioning function is on, the CPU 71 proceeds to step S116 and performs a process of inserting the voice memo text into the caption data. That is, the CPU 71 performs a process of writing the voice memo text into the description / caption field in the IPTC metadata. As described above, if caption data has already been written in the description / caption field, the CPU 71 writes the voice memo text thereafter. After performing such automatic captioning processing, the CPU 71 proceeds to step S117.

[0153] If the conversion to text in step S112 is not performed normally, for example, if the voice memo text cannot be acquired due to a processing error, a communication error, or the like, the CPU 71 proceeds from step S113 to step S117. In this case, the conversion to text process is not particularly retried to avoid prolonging the process at the time of transfer. This is because there are other opportunities for conversion to text, as described later. However, the conversion to text process may of course be retried a predetermined number of times, or the user may be allowed to select whether or not to proceed with the process without conversion to text.

[0154] When the above-mentioned text conversion process, automatic voice memo captioning process, etc. are performed on a certain image file PF and the process proceeds to step S117, or when the text conversion is not completed successfully and the process proceeds to step S117, the CPU 71 checks whether there are any other image files PF remaining that should be subjected to similar processing, and if so, returns to step S111 and processes one of them in the same manner as described above. By executing the text conversion process in step S112 at least once for all image files PF associated with audio files AF, it is determined in step S117 that all text conversions have been completed, and the process proceeds to step S120 in FIG.

[0155] In step S120, the CPU 71 checks whether the automatic upload function is turned on. The automatic upload function is a function that the user can arbitrarily set to on / off on the automatic upload setting screen 57 shown in Figs. 25, 26, and 27. If the automatic upload function is not on, the CPU 71 ends the series of processes for image capture from step S120.

[0156] When the automatic upload function is on, the CPU 71 proceeds from step S120 to step S121 to perform a preparation process for an upload file. This upload file preparation process is shown in detail in FIG.

[0157] 32, the CPU 71 specifies one of the image files PF to be uploaded. This means that one of the image files PF currently transferred from the imaging device 1 is to be subjected to preparation processing. When one image file PF is to be processed, the CPU 71 checks in step S142 whether or not an image size has been specified. This is equivalent to checking the contents set by the user in the long side pixel setting section 177 and setting switch 174 on the automatic upload setting screen 57 in Fig. 27. If an image size has been specified, the CPU 71 performs a pixel count conversion process to reflect this in step S143.

[0158] In step S144, the CPU 71 checks whether or not a compression rate has been specified. This is equivalent to checking the state of the compression rate specified by the compression rate setting bar 176 on the automatic upload setting screen 57 in Fig. 27. If a compression rate has been specified and compression is to be performed, the CPU 71 performs compression processing at the specified compression rate in step S145.

[0159] In step S146, the CPU 71 checks whether the audio file AF is attached or not. That is, the CPU 71 checks whether the user has set the voice memo to be uploaded or not by turning on / off the setting switch 172 in FIG. If uploading of the audio file AF has been selected, the CPU 71 proceeds to step S147 to check whether or not there is an audio file AF associated with the image file PF currently being processed. If there is an associated audio file AF, the CPU 71 proceeds to step S149 to set the image file PF (image data and metadata) currently being processed and the audio file AF as files to be uploaded.

[0160] If it is confirmed in step S146 that uploading of an audio file AF has not been selected as a user setting, or if in step S147 there is no audio file AF associated with the image file PF currently being processed, the CPU 71 proceeds to step S148 and sets the image file PF (image data and metadata) currently being processed as the file to be uploaded.

[0161] In step S150, it is confirmed whether or not the above preparation processing has been completed for all image files PF currently imported from the imaging device 1. If there are remaining image files PF, the CPU 71 returns to step S141, identifies one of the remaining image files PF as the processing target, and performs the same processing. If it is determined in step S150 that the above preparation process has been completed for all image files PF currently captured from the imaging device 1, the CPU 71 ends the preparation process for upload files shown in FIG. That is, the CPU 71 proceeds to step S122 in FIG.

[0162] In step S122, the CPU 71 performs FTP connection and login processing for the FTP server 4 specified by the automatic upload setting. Once the login is complete, the CPU 71 proceeds from step S123 to step S130 to execute the FTP upload process, that is, the image files PF and audio files AF that were set as files to be uploaded in the upload file preparation process are sequentially transmitted by FTP.

[0163] If communication with the FTP server 4 is not possible, or if communication is possible but login is not possible, the CPU 71 determines this to be an error and proceeds from step S124 to step S125 to perform a predetermined error process. For example, the user is notified of the error in the automatic upload process. Then, the series of processes for importing the image file PF from the imaging device 1 is completed.

[0164] If the FTP upload in step S130 is completed normally, the CPU 71 proceeds from step S131 to step S133, notifies the user of the completion, and ends the series of processes. In this case, when the image file PF is imported from the imaging device 1, the upload to the FTP server 4 is automatically performed. Furthermore, if the voice memo automatic captioning function is turned on, the voice memo text, which is the voice memo of the associated audio file AF converted to text, will be added to the IPTC metadata in the uploaded image file PF.

[0165] If an error occurs during the upload process to the FTP server 4 and the process cannot be completed normally, the CPU 71 proceeds from step S132 to step S134 and performs a predetermined error process. For example, the CPU 71 notifies the user of the error during the automatic upload process. Then, the series of processes for importing the image file PF from the imaging device 1 is completed.

[0166] <6. Examples of processing including text conversion and caption editing> Next, a processing example in the case where a transition is made from the state in which the image list screen 50 in FIG. 6 is displayed to the caption edit screen 52 in FIG. 14 or the like will be described with reference to FIGS. Note that Figures 33, 34, and 35 show a series of flowcharts in separate parts, with the connections indicated by "C2," "C3," "C4," and "C5."

[0167] In step S201 in FIG. 33, the CPU 71 is causing the image list screen 50 to be displayed. As described above, when the user specifies an image on the image list screen 50, the caption editing screen 52 for that image data is displayed. At this time, if the voice memo for the specified image data (image file PF) has not yet been converted to text, this is the opportunity to do so.

[0168] If an image designation operation by the user on the image list screen 50 is detected, the CPU 71 advances from step S202 to step S203. In step S203, the CPU 71 checks whether or not there is an audio file AF associated with the specified image data (image file PF). If the associated audio file AF does not exist, the process proceeds to step S220, and the CPU 71 displays the caption editing screen 52 for the specified image data. In this case, since there is no voice memo, the voice memo field 133 does not need to be displayed on the caption editing screen 52.

[0169] If an associated audio file AF exists, the CPU 71 proceeds to step S204 to check whether the voice memo has already been converted into text and the voice memo text has been stored. If it has already been stored, the CPU 71 proceeds to step S220 to display the caption editing screen 52 for the specified image data. In this case, the voice memo field 133 displaying the voice memo text area 134 is displayed as shown in Fig. 14. If the automatic caption adding function is turned on and the voice memo text has been inserted into the caption data, the voice memo text is also added to the caption data in the caption field 132 as shown in Fig. 20.

[0170] If it is determined that a voice memo exists but has not yet been converted to text, the CPU 71 proceeds to step S205, where it performs a text conversion process on the voice memo in the audio file AF associated with the specified image file PF. For example, the voice data as the voice memo is transmitted to the text conversion engine 5, and the converted data is received. Alternatively, if the information processing device 2 is equipped with a text conversion engine 83, the text conversion process may be performed by the text conversion engine 83. Note that in this text conversion process, as described above with reference to FIG. 31, text conversion is performed based on the selected glossary data.

[0171] If the text conversion was successful and the voice memo text was obtained, the CPU 71 proceeds from step S206 to step S207, and performs a process of saving the voice memo text in, for example, the memory unit 79 as the voice memo text corresponding to the image file PF being processed.

[0172] In step S208, the CPU 71 checks whether the automatic caption adding function is turned on. The automatic caption adding function is a function that the user can arbitrarily set to on / off via the voice memo automatic caption adding setting screen 53 in FIG. If the automatic caption adding function is not on, the CPU 71 proceeds to step S220. In this case, the voice memo field 133 is displayed on the caption editing screen 52 as shown in Fig. 14, and the caption data that has been input up to that point is displayed in the caption field 132.

[0173] On the other hand, if the automatic captioning function is on, the CPU 71 proceeds to step S209 to perform a process of inserting the voice memo text into the caption data. That is, the CPU 71 performs a process of writing the voice memo text into the description / caption field in the IPTC metadata. As described above, if caption data has already been written in the description / caption field, the CPU 71 writes the voice memo text thereafter. After performing such automatic caption assignment processing, the CPU 71 proceeds to step S220. In this case, the caption editing screen 52 is in a state in which the voice memo text has been added to the caption data in the caption field 132 as shown in FIG.

[0174] If the conversion to text in step S205 is not performed normally, the CPU 71 proceeds from step S206 to step S220. In this case, since the voice memo has not been converted to text, it is possible to not display the voice memo field 133 on the caption editing screen 52. However, it is possible to clearly indicate the existence of the voice memo to the user by the voice memo mark 105.

[0175] With the caption editing screen 52 displayed, the process of the CPU 71 proceeds to step S221 in Fig. 34. The CPU 71 monitors various user operations on the caption editing screen 52. That is, each operation is monitored in a loop of steps S221, S222, S223, S224, S225, and steps S226, S227, S228, and S229 in Fig. 35.

[0176] In step S221 in Fig. 34, the CPU 71 monitors the operation of screen transition by the back button 106, that is, transition to the image list screen 50. If this operation is detected, the CPU 71 performs a caption saving process in step S240 and returns to step S201 in Fig. 33. That is, the caption data displayed in the caption column 132 at that time is saved as data in the description / caption field in the IPTC metadata.

[0177] In step S222, the CPU 71 monitors an operation related to caption input. In response to an operation related to caption input, such as character input, voice input, or a template request, the CPU 71 performs input response processing in step S241.

[0178] The input response process will be described with reference to FIG. In step S260, the CPU 71 checks whether or not an operation has been performed on the template button 138. If an operation on the template button 138 has been detected, the CPU 71 calls and displays a template in step S261.

[0179] If no operation on the template button 138 is detected, the CPU 71 performs branching processing in step S262 based on whether or not the software keyboard 131 is being displayed. When the software keyboard 131 is not displayed, that is, when the caption editing screen 52 as shown in Fig. 14 is displayed on the information processing device 2, the CPU 71 checks in step S263 whether or not there is an operation to display the software keyboard 131, such as a tap operation on the caption field 132. When such an operation is detected, the CPU 71 proceeds to step S264, where it performs a process to display the software keyboard 131 on the screen, and ends the input response process. As a result, for example, the caption editing screen 52 as shown in Fig. 16 is displayed on the information processing device 2.

[0180] If a caption box selection operation is not detected in step S263, the CPU 71 ends the input response process.

[0181] If it is determined in step S262 that the software keyboard is already displayed, the CPU 71 proceeds to step S265 to determine whether or not a character input operation has been detected. When character input is detected, the CPU 71 presents normal suggested words in step S266. In presenting normal suggested words, character strings (words or sentences) frequently input to the information processing device 2 or the last input character string are presented as suggested words in the normal candidate display field 191a.

[0182] Furthermore, the CPU 71 determines in step S267 whether or not there is selected glossary data, and if there is selected glossary data, in the following step S268 determines whether or not there is any term data that matches the beginning of the selected glossary data. In the example shown in Fig. 16, for example, the term data that matches the beginning of the selected glossary data is term data in which a character string starting with the character string "enta" that has already been input by the user is set as the reading or shortcut of the term data. Of course, this term data must be term data registered in the selected glossary data. If such term data is found, the CPU 71 displays the character information of the corresponding term data, that is, the character string "entitlement-to-base", in the specific candidate display field 191b in step S269. As a result, a suggestion column 191 shown in FIG. 16 is formed.

[0183] After presenting the character information of the term data in the specific candidate display field 191b, the CPU 71 ends the input response process. Moreover, if there is no selected glossary data or no term data that matches the beginning of the input, the CPU 71 also ends the input response process.

[0184] If no character input is detected in step S265, the CPU 71 determines whether or not there is a voice input in step S270. If a voice input is detected, the CPU 71 performs a voice input response process in step S271. The voice input support process may, for example, involve acquiring input voice data and transmitting it to the text conversion engine 5. Also, converted text data is received from the text conversion engine 5 and inserted at the caret position. At this time, as described above in FIG. 31, a correction process may be performed using selected glossary data on the text data converted into text by the text conversion engine 5. This can reduce the probability of erroneous conversion.

[0185] If no voice input is detected in step S270, the CPU 71 performs a corresponding process in step S272. This corresponding process is a process that is performed based on any operation related to caption input detected in step S222. For example, a paste process corresponding to a paste operation, a caret movement process corresponding to an operation of moving the caret position, etc. In addition, a process of inserting a character string selected from the character strings presented in the suggestion field 191 described above into the caret position is also executed as a corresponding process.

[0186] Return to the explanation of Figure 34. In step S223, the CPU 71 monitors whether the user has operated the play button 135. If the CPU 71 detects that the play button 135 has been operated, the CPU 71 proceeds to step S242, where it sets the voice memo field 133 to a playback display state, such as the seek bar 160, current time 161, total playback length 162, stop button 163, and pause button 164, as shown in Fig. 17, and performs control to start audio playback.

[0187] In step S224, the CPU 71 monitors whether the user has operated the pause button 164. If the operation of the pause button 164 is detected, the CPU 71 proceeds to step S243 and performs control to pause the audio playback. Although not shown, in this case, the pause button 164 is switched to display the playback button 135.

[0188] In step S225, the CPU 71 monitors whether the user has operated the stop button 163. If the operation of the stop button 163 is detected, the CPU 71 proceeds to step S244 and performs control to stop the audio playback. In this case, the display of the voice memo field 133 is returned to the state in FIG.

[0189] The CPU 71 monitors the user's operation of the copy button 136 in step S226 of Fig. 35. If the operation of the copy button 136 is detected, the CPU 71 proceeds to step S245 and performs processing to copy the voice memo text to the clipboard. Then, in step S246, the CPU 71 displays the copy message 168 in Fig. 19 for a predetermined time or until the next user operation is detected. It should be noted that, regarding the voice memo text copied to the clipboard, if the CPU 71 subsequently detects a paste operation in step S222, the voice memo text is pasted as caption data in step S241.

[0190] In step S227, the CPU 71 monitors the user's operation of the delete button 137. If the operation of the delete button 137 is detected, the CPU 71 proceeds to step S247 and displays the confirmation dialog 61 of Fig. 18. In step S248, the CPU 71 monitors whether or not the OK button 165 has been operated, and in response to the user's operation of the OK button 165, the CPU 71 performs a deletion process related to the voice memo in step S250. On the other hand, if the CPU 71 does not detect the operation of the OK button 165 by the user, the CPU 71 proceeds to step S249 to detect whether or not the cancel button has been operated. If the user operates the cancel button 166 in the confirmation dialog 61, the CPU 71 does not execute the deletion process, and returns to monitoring of the user operation by returning from step S249 to step S221.

[0191] In step S228, the CPU 71 monitors an image enlargement operation. For example, when an image enlargement operation such as a pinch operation or a double tap on the thumbnail image 103 is performed, the individual image screen 51 in FIG. Although not shown in the flowchart, after transitioning to the individual image screen 51, a different image can be selected depending on a specified operation, the screen can return to the image list screen 50, or transition to the caption editing screen 52.

[0192] In step S229, the CPU 71 monitors the selection operation of another image. That is, it monitors the operation of the next button 107 on the caption editing screen 52. If the operation of the next button 107 is detected, the CPU 71 proceeds to step S203 in Fig. 33. In other words, assuming that the previous or next image has been newly specified, the processing of steps S203 to S209 is performed for the specified image data in the same manner as described above, and in step S220, the caption editing screen 52 for that image data is displayed.

[0193] When one image data is specified as described above, text processing and automatic captioning processing may be performed. Also, on the caption editing screen 52, it is possible to display, play, delete, copy, and paste the voice memo text into the caption data, and to input a caption manually or by voice.

[0194] <7. Example of processing when uploading> The process of uploading to the FTP server 4 is shown in Fig. 37. For example, the upload process of Fig. 37 is started when the user designates the image file PF to be uploaded and the FTP server 4 as the upload destination and issues an instruction to execute the upload.

[0195] In step S301, the CPU 71 performs a preparation process for the upload file. This process is similar to that in FIG. In step S322, the CPU 71 performs FTP connection and login processing for the FTP server 4 that is the upload destination designated by the user. Once the login is complete, the CPU 71 proceeds from step S323 to step S330 to execute the FTP upload process, that is, the image files PF and audio files AF that were set as files to be uploaded in the upload file preparation process are sequentially transmitted by FTP.

[0196] If communication with the FTP server 4 is not possible, or if communication is possible but login is not possible, the CPU 71 determines this to be an error and proceeds from step S324 to step S325 to perform a predetermined error process. For example, the user is notified of the error in the upload process. Then, the upload process ends with the error.

[0197] If the FTP upload in step S330 is completed normally, the CPU 71 proceeds from step S331 to step S333, notifies the user of the completion, and ends the upload process. It is assumed that in the uploaded image file PF, the voice memo text is reflected as caption data in the IPTC metadata by the automatic captioning function or by the user's copy / paste operation. It is also assumed that audio files AF may be uploaded together depending on the user's settings.

[0198] If an error occurs during the upload process to the FTP server 4 and the upload process cannot be completed normally, the CPU 71 proceeds from step S332 to step S334 and performs a predetermined error process. For example, the CPU 71 notifies the user of the error during the upload process. Then, the upload process ends with the error.

[0199] <8. Processing of glossary data> An example of a process executed by the information processing device 2 in a state in which the glossary list screen 58 in FIG. 8 is displayed will be described with reference to FIGS. Note that Figures 38 and 39 show a series of flowcharts divided into parts, with the connections indicated by "C6," "C7," "C8," and "C9."

[0200] After executing the process of displaying glossary list screen 58 of Fig. 8, CPU 71 executes a process of rearranging glossary data in step S400. The rearrangement process is a process of changing the arrangement of glossary data on glossary list screen 58 so as to conform to a predetermined order, and will be described in detail later.

[0201] Next, the CPU 71 determines in step S401 whether or not the glossary data automatic synchronization setting is ON. The glossary data automatic synchronization setting is a function that the user can arbitrarily set ON / OFF via the automatic synchronization setting dialog 65 in FIG.

[0202] If the glossary data automatic synchronization setting is ON, the CPU 71 executes a glossary synchronization process in step S402 and proceeds to step S403. On the other hand, if the glossary data automatic synchronization setting is OFF, the CPU 71 proceeds to step S403 without executing the process of step S402.

[0203] Here, the glossary synchronization process that is executed only when the glossary data automatic synchronization setting is on will be described with reference to FIG.

[0204] The glossary synchronization process is a process of acquiring glossary data stored in an information processing device other than the information processing device 2. In step S440, the CPU 71 attempts to connect to a synchronization target device (another information processing device) and determines whether the connection has been successful. If successful connection has not yet been confirmed, the CPU 71 determines in step S441 whether a timeout has occurred due to the passage of a predetermined time. Until the timeout occurs, the CPU 71 repeats the processes of steps S440 and S441. If it is determined that the timeout has occurred, the CPU 71 executes error processing in step S442 and ends the glossary synchronization processing. In the error processing, for example, a process of notifying the user is executed.

[0205] If it is determined in step S440 that the connection to the synchronization target device has been successful, the CPU 71 determines in step S443 whether or not there is updated glossary data in the synchronization target device.

[0206] The updated glossary data is new glossary data that has not yet been stored in the information processing device 2, or glossary data with a newer timestamp than the glossary data stored in the information processing device 2. If there is updated glossary data, the CPU 71 acquires the relevant glossary data in step S444, and then performs processing to store the data in the storage unit 79 or the like in the following step S445. This storage processing includes processing to store new glossary data, processing to overwrite and store already stored glossary data, and the like.

[0207] Note that, other than acquiring glossary data from another information processing device and storing it in the storage unit 79 of the information processing device 2, the above-mentioned process may be performed by acquiring necessary term data as appropriate while communicating with the other information processing device. That is, the other information processing device may be treated as a cloud server and the process may be performed without downloading the glossary data to the information processing device 2.

[0208] The other information processing device may be a shared server that can be used by multiple users. This allows multiple users to use glossary data created by one user by storing the glossary data in the shared server, eliminating the need for each user to create glossary data. In addition, the caption data can be edited using the same glossary data, making it possible to provide uniformity to the caption data. This ensures that the automatic allocation process of image files PF executed by the FTP server 4 can be performed and reduces allocation errors.

[0209] After completing the storage process, the CPU 71 ends the glossary synchronization process, and proceeds to step S403 in FIG. Also, if it is determined in step S443 that no updated glossary data exists, the process proceeds to step S403.

[0210] Return to the explanation of Figure 38. In step S403, the CPU 71 determines whether or not an operation for adding glossary data has been detected. This determination process is, for example, a process for detecting whether or not the glossary addition button on the glossary list screen 58 in FIG. If an operation to add glossary data is detected, the CPU 71 displays a glossary data addition screen in step S404.

[0211] On the glossary data addition screen, for example, it is possible to perform an operation such as inputting the title name of the glossary data. It is also possible to perform an operation to execute or cancel the addition of glossary data. The CPU 71 executes processing corresponding to these operations as processing corresponding to each operation in step S405 in Fig. 38. Furthermore, when the addition of glossary data is executed, processing such as storing the added glossary data in the storage unit 79 is also considered to be part of the corresponding processing. After step S405 is executed, glossary list screen 58 is displayed and CPU 71 proceeds to the process of step S403.

[0212] If no operation of adding glossary data is detected in step S403, the CPU 71 determines whether or not an operation of editing glossary data is detected in step S406. This determination process is, for example, a process of detecting whether or not an operation has been performed on the edit button 117 provided in the glossary submenu dialog 59 shown in FIG. When an editing operation of glossary data is detected, the CPU 71 displays the glossary data editing screen 60 as shown in Fig. 10 in step S407, and proceeds to step S420 in Fig. 39. Each process executed by the CPU 71 on the glossary data editing screen 60 will be described later.

[0213] If no operation of editing glossary data is detected in step S406, the CPU 71 determines in step S408 whether or not an operation of selecting glossary data is detected. The operation of selecting glossary data is an operation possible for glossary data in an unselected state, i.e., an off state, and is, for example, an operation of tapping a selection button 114 provided on glossary data in an unselected state. Alternatively, the operation may be an operation of pressing a selection button provided on glossary submenu dialog 59 shown in FIG. 9.

[0214] When a selection operation is detected, the CPU 71 performs a selection process in step S409. That is, the display mode of the selection button 114 provided on the glossary list screen 58 is changed from a mode indicating a non-selected (OFF) state to a mode indicating a selected (ON) state.

[0215] If no selection operation is detected, the CPU 71 determines in step S410 whether or not a deselection operation is detected. The deselection operation is an operation possible for glossary data in a selected state, i.e., an ON state, and may be, for example, an operation of tapping the Select button 114 provided on the glossary data in a selected state. Alternatively, the deselection operation may be an operation of pressing the Unselected button 116A, which is an operator provided in place of the Select button 116 in the glossary submenu dialog 59 shown in FIG. 9.

[0216] When a deselection operation is detected, the CPU 71 performs a deselection process in step S411. That is, the display mode of the selection button 114 provided on the glossary list screen 58 is changed from a mode indicating a selected (ON) state to a mode indicating a non-selected (OFF) state.

[0217] If no deselection operation is detected in step S410, the CPU 71 detects whether or not a manual synchronization operation has been performed in step S412. The manual synchronization operation may be a specific operation performed on the glossary list screen, or it may be an operation on an operator for performing manual synchronization provided on glossary list screen 58 (not shown in FIG. 8).

[0218] When the manual synchronization operation is detected, the CPU 71 executes the glossary synchronization process of step S402 described above.

[0219] If a manual synchronization operation is not detected, the CPU 71 detects a page back operation in step S413. If a page back operation is detected, the CPU 71 stores the glossary data updated based on the operation performed on the glossary list screen 58 in step S414, and brings the image list screen 50 into a state displayed in step S201 of Fig. 33. That is, the screen transitions to the image list screen 50.

[0220] If a page return operation is not detected, the CPU 71 returns to the process of step S403 again. In this manner, by sequentially executing the processes of steps S403, S406, S408, S410, S412, and S413, various operations by the user are detected.

[0221] Here, each process executed by the CPU 71 on the glossary data editing screen 60 (see FIG. 10) mentioned above will be described with reference to FIG.

[0222] In step S420, the CPU 71 determines whether or not an operation for adding term data has been detected. The operation for adding term data is, for example, an operation on the add term button 123 arranged on the glossary data editing screen 60 shown in FIG.

[0223] When a term data adding operation is detected, the CPU 71 displays a term data adding screen in step S421. The term data adding screen is, for example, a screen in which the input fields provided on the term data editing screen 63 shown in Fig. 12 are left blank, and specifically, the word input field 128 and the reading input field 129 are left blank.

[0224] After presenting the term data addition screen, the CPU 71 performs an editing response process in response to the editing operation by the user in step S422. The editing response process in step S422 includes, for example, a process of displaying the software keyboard 131 when the user performs a tap operation on the word input field 128 or the reading input field 129, and a process of displaying an input character string in each input field in response to an input operation from the software keyboard 131. In addition, the editing response process in step S422 also includes a process of canceling the addition of term data when the back button 127 is operated with each input field blank, and a process of storing term data when the back button 127 is operated with characters input in each input field. After executing the edit processing in step S422, the CPU 71 returns to the processing in step S420 again in response to the addition of term data or the cancellation of the addition.

[0225] If a term data adding operation is not detected, the CPU 71 determines in step S423 whether or not a term data deleting operation is detected. The term data deletion operation is, for example, an operation on the delete button 126 provided in the term submenu dialog 62 of FIG.

[0226] If a term data deletion operation is detected, the CPU 71 deletes the term data in step S424.

[0227] On the other hand, if a term data deleting operation is not detected, the CPU 71 goes to step S425 and determines whether or not a term data editing operation is detected. The term data editing operation is, for example, an operation of tapping on each term data on the glossary data editing screen 60 in FIG. 10, or an operation on the edit button 125 arranged on the term submenu dialog 62 in FIG.

[0228] If a term data editing operation is detected, the CPU 71 executes an edit handling process in step S426. The editing support process is, for example, the same process as the process in step S422.

[0229] If a term data editing operation has not been detected, the CPU 71 determines in step S427 whether or not a page return operation has been detected. The page back operation is, for example, an operation on the back button 120 arranged on the glossary data editing screen 60.

[0230] When a page back operation is detected, CPU 71 performs a process of storing the current glossary data in step S428, executes a process of displaying glossary list screen 58 in step S429, and then proceeds to step S401 in Fig. 38. Note that it is also possible to proceed to step S403 without executing the process related to the automatic synchronization setting. If the page back operation is not detected, the CPU 71 executes step S420 again. That is, the CPU 71 repeatedly executes the series of processes shown in FIG. 39 until the page back operation is detected.

[0231] Here, a modified example of the glossary synchronization process shown in step S402 in FIG. 38 will be described with reference to FIG.

[0232] In the modified glossary synchronization process, the CPU 71 repeatedly executes steps S460 and S461 until a connection to a synchronization target device is successful or a timeout occurs. These processes are similar to the processes in steps S440 and S441 in FIG.

[0233] When the connection to the device to be synchronized (hereinafter, referred to as the "target device") is successful, the CPU 71 performs processing to transmit the image capturing environment information to the target device in step S462. Here, the imaging environment information is at least imaging environment information about the image file PF received from the imaging device 1, and is information including at least one of the imaging date and time and the imaging location. The shooting environment information may be added as metadata to the image file PF by the imaging device 1 when capturing an image, or may be identified by location information or reception date and time of the information processing device 2 that receives the image file PF from the imaging device 1.

[0234] The target device that has received the image capture environment information can estimate from the image capture environment information what event the image file PF relates to. For example, if the image file PF was taken at a baseball stadium, it can identify that the event being captured is a baseball game and information about the opposing teams. Furthermore, by identifying an event, the target device is able to identify glossary data that is likely to be usable for editing caption data to be added to an image file PF.

[0235] In step S463, the information processing device 2 acquires information for identifying glossary data suitable for the event from the target device. The information for identifying the glossary data may be, for example, the glossary data itself received from the target device, or may be information such as ID (Identification) capable of identifying the glossary data so as to determine which glossary data should be enabled.

[0236] By receiving any of these pieces of information, the CPU 71 can automatically acquire and activate the glossary that the user is likely to use in the future. Here, a case where an ID capable of identifying glossary data is received will be described.

[0237] The CPU 71 determines whether or not it is necessary to update the glossary data in step S464. For example, if the latest glossary data corresponding to the received ID is stored in the storage unit 79, it determines that it is not necessary to update, and ends the glossary synchronization process shown in FIG.

[0238] On the other hand, if no glossary data corresponding to the received ID is stored or the data is not the latest data, the CPU 71 determines that the glossary data needs to be updated, and proceeds to step S265 to obtain the corresponding glossary data.

[0239] In step S466, the CPU 71 performs a storage process of the acquired glossary data, and ends the glossary synchronization process shown in FIG. 41 is automatically executed due to automatic synchronization settings, the glossary data that the user wants to use or the most suitable glossary data to use is automatically obtained simply by the user displaying the glossary list screen 58. Furthermore, even the activation of the glossary data can be performed automatically.

[0240] Finally, a specific example of the sorting process in step S400 in FIG. 38 is shown in FIG. In step S480, the CPU 71 determines whether or not rearrangement can be performed. Whether or not rearrangement can be performed can be set by, for example, a user, and information regarding the rearrangement set by the user is stored in, for example, the storage unit 79.

[0241] If reordering is off, the CPU 71 ends the reordering process.

[0242] On the other hand, if the sorting is on, the CPU 71 determines what sorting to perform in the subsequent processing. For example, in step S481, the CPU 71 determines whether or not to rearrange the glossary data in order of creation. The order of creation may be in ascending or descending order of the date and time when the glossary data was first created. Alternatively, the order may be based on the date and time when the glossary data was last updated. The determination as to whether or not to rearrange the glossary data in the order in which they were created is based on information set by the user, for example. The setting information is stored in the storage unit 79, for example.

[0243] When it is determined that the glossary data should be rearranged in the order of creation, the CPU 71 performs a process of rearranging the glossary data in the order of creation in step S482. As a result, each glossary data on the glossary list screen 58 is presented to the user in the rearranged state.

[0244] If it is determined that the glossary data has not been rearranged based on the order of creation, the CPU 71 determines in step S483 whether or not to rearrange the glossary data in order of the number of times the data has been activated. The order of the number of times of activation may be, for example, in descending order of the number of times of activation, or in descending order of the length of time that the activation has been performed.

[0245] If it is determined that the glossary data should be rearranged in order of the number of activations, the CPU 71 performs processing to rearrange the glossary data in order of the number of activations in step S484. As a result, each glossary data on the glossary list screen 58 is presented to the user in the rearranged state.

[0246] If it is determined that the order is not based on the number of times of validation, the CPU 71 determines in step S485 whether or not to rearrange the files in order of the time that has elapsed since they were invalidated. In other words, the order of elapsed time since being disabled means that the glossary data that was most recently enabled is displayed at the top. Also, glossary data that is currently enabled may be displayed at the top by regarding the elapsed time as 0.

[0247] When it is determined that the data should be rearranged in order of the elapsed time since invalidation, the CPU 71 performs a process of rearranging the data in order of the shortest elapsed time in step S486. As a result, each glossary data on the glossary list screen 58 is presented to the user in the rearranged state.

[0248] If it is determined that the order is not based on the time elapsed since invalidation, the CPU 71 ends the sorting process shown in Fig. 42. If the determination in step S483 is "No", the process in step S486 may be executed without executing the process in step S485.

[0249] In addition, the sorting conditions shown in Fig. 42 are only a part of the sorting conditions, and sorting may be performed based on other conditions. For example, among glossary data acquired from other information processing devices, the most recently acquired data may be displayed at the top.

[0250] <9. Summary and Variations> The above embodiment provides the following advantages. The information processing device 2 of the embodiment is equipped with a user interface control unit (UI control unit 31) that performs user interface processing using multiple glossary data, which is a collection of terminology data in which character information and abbreviated input information (shortcuts) are paired, to enable editing of text information as metadata to be added to an image file. That is, a plurality of glossary data can be combined and used for editing metadata. This makes it possible to create multiple pieces of subdivided glossary data and combine them to provide a highly convenient editing environment as intended by the user. Furthermore, in an environment where only one selected glossary data is available, common term data must be included in duplicate in each glossary data, but in an environment where multiple glossary data are available, common term data can be separated into a single glossary data, allowing the common term data to be deleted from the more specialized glossary data that has been subdivided. This makes it possible to downsize the glossary data, and also reduces the man-hours required to create the glossary data.

[0251] As described in the input response processing of FIG. 36, the user interface control unit (UI control unit 31) may present character information as input candidates from glossary data based on the input information entered when editing text information. That is, when the input information matches a part of the character information or a part of the abbreviated input information, the corresponding character information is presented as an input candidate. This can reduce the time required to edit text information. In addition, by appropriately selecting glossary data, even terms that are not commonly used and are difficult to present as input candidates (suggestion candidates) can be presented, further reducing the time required to edit text information. In addition, for languages ​​such as Japanese, in which the character to be inserted at the caret position is determined by converting the input character, input candidate character information is presented from glossary data, preventing erroneous conversion to homonyms and improving editing speed.

[0252] As explained in the configuration of the information processing device in FIG. 5, a glossary management unit 36 ​​for acquiring glossary data may be provided. This makes it possible, for example, to acquire glossary data created by another information processing device. Therefore, the glossary data can be used efficiently. In addition, the glossary data created once can be reused in a plurality of information processing devices, which is highly convenient.

[0253] As explained in the configuration of the information processing device in FIG. 5, glossary management unit 36 ​​may store and manage glossary data in storage unit 79. This makes it possible to use the glossary data stored in the storage unit even if the glossary data cannot be acquired from another information processing device due to a poor communication environment. Therefore, the glossary data can be used to edit text information regardless of the quality of the communication environment.

[0254] As described in the functions of the information processing device 2, the glossary management unit 36 ​​may manage the validity state of each glossary data item. This makes it possible to enable / disable each glossary data item. Therefore, by invalidating unused glossary data, it is possible to prevent unnecessary input candidates from being presented.

[0255] As described in the sorting process of Figure 42, the user interface control unit 31 may perform a process of providing an environment in which the validity state of multiple glossary data can be switched, and may also perform a process of changing the display order of the multiple glossary data displayed in the switching environment. This makes it possible to configure the glossary data so that the glossary data that is easier for the user to use is displayed higher. Therefore, the user can select appropriate glossary data and use it to edit text information.

[0256] As described in the sorting process of FIG. 42, the display order may be the order of the most frequently activated items. This will bring the most commonly used glossary data to the top of the list. Therefore, it is easy to switch the validity of frequently used glossary data, improving convenience.

[0257] As described in the sorting process of FIG. 42, the display order may be in ascending order of the time elapsed since invalidation. This will cause the most recently enabled glossary data to appear at the top of the list. Therefore, it is easy to switch the validity of frequently used glossary data, improving convenience.

[0258] As described in the glossary synchronization process of FIGS. 40 and 41, the glossary management unit 36 ​​may obtain glossary data from a server device (another information processing device, target device) via the network 6. This makes it possible to obtain glossary data from a server device or the like that is located far away and where short-distance communication is not possible. Therefore, it is possible to provide a highly convenient environment for editing text information.

[0259] As described in the process executed while glossary list screen 58 is displayed (FIG. 38), glossary management unit 36 ​​may acquire glossary data based on a synchronization setting with the server device. As a result, the glossary data stored in the server device is downloaded to the information processing device as appropriate. Therefore, it is possible to edit text information based on glossary data stored in the server device, improving convenience.

[0260] As described in the automatic synchronization setting dialog 65 (FIG. 28), automatic synchronization setting and manual synchronization setting may be provided as synchronization settings. This makes it possible to switch between automatic and manual synchronization settings depending on the situation. For example, by switching to the manual synchronization setting when the radio wave conditions are poor, it is possible to eliminate wasteful operations such as automatically executed synchronization processing timing out.

[0261] As described in the glossary synchronization process of FIG. 41, the glossary management unit 36 ​​selects glossary data to be acquired from the server device based on the position information. This allows glossary data to be acquired according to the location, such as an event venue or a baseball stadium. Therefore, the user does not need to manually select a glossary and obtain it from the server device, thereby improving convenience.

[0262] As described in the glossary synchronization process of FIG. 41, the glossary management unit 36 ​​may select glossary data to be acquired from the server device based on time information. This allows, for example, appropriate glossary data to be acquired depending on the time. In addition, by selecting the glossary data to be acquired based on both time information and location information, the event targeted by the captured image can be identified with a high probability, making it possible to smoothly edit text information using the glossary data.

[0263] As described in the glossary synchronization process of FIG. 40, the server device may be a shared server device. This allows, for example, glossary data that other users have created and stored in the server device to be used. Therefore, it is not necessary to spend time creating glossary data, and convenience can be improved. Also, by acquiring and customizing glossary data created by other users, new glossary data can be easily created in a short time.

[0264] As explained in the text conversion process of Figure 31, the user interface control unit 31 may perform processing to provide an environment in which voice data can be used to edit text information, and glossary data may be used in editing text information using voice data. Thus, when converting voice data into text information, the conversion is based on the glossary data. Therefore, it is possible to reduce the possibility of erroneous conversion when converting homonyms, etc., and to reduce the amount of correction work required after conversion. In other words, editing of text information can be performed efficiently.

[0265] As in the description of the IPTC metadata in FIG. 3, the text information may be information stored in a caption field of the IPTC metadata. This allows glossary data to be used to edit the caption field of IPTC metadata. Although it is possible to edit IPTC metadata on an imaging device, this is inefficient due to the nature of the controls on the imaging device. By contrast, editing on an information processing device can be performed to improve editing efficiency, and by using glossary data, editing can be completed in a shorter time, improving convenience.

[0266] The program of the embodiment is a program that causes, for example, a CPU, a DSP, or a device including these to execute each of the processes shown in Figs. In other words, the program of the embodiment is a program that causes an information processing device to execute user interface processing that enables editing of text information as metadata to be added to an image file, using multiple pieces of glossary data, which are a collection of term data in which character information and abbreviated input information are paired. By using such a program, the above-mentioned information processing device 2 can be realized in, for example, a mobile terminal device, a personal computer, or other devices capable of executing information processing.

[0267] A program for realizing such an information processing device 2 can be recorded in advance in a HDD serving as a recording medium built into a device such as a computer device, or in a ROM or the like in a microcomputer having a CPU. Alternatively, the software may be temporarily or permanently stored (recorded) on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto optical) disk, a DVD (Digital Versatile Disc), a Blu-ray Disc (registered trademark), a magnetic disk, a semiconductor memory, a memory card, etc. Such removable recording media may be provided as a so-called package software. Furthermore, such a program can be installed in a personal computer or the like from a removable recording medium, or can be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

[0268] Furthermore, such a program is suitable for a wide range of applications of the information processing device 2 according to the embodiment. For example, by downloading the program to a mobile terminal device such as a smartphone or tablet, a mobile phone, a personal computer, a game device, a video device, a PDA (Personal Digital Assistant), or the like, the smartphone or the like can function as the information processing device 2 of the present disclosure.

[0269] It should be noted that the effects described in this specification are merely examples and are not limiting, and other effects may also be obtained. <10. This Technology>

[0270] The present technology can also be configured as follows. (1) The present invention is provided with a user interface control unit that performs user interface processing that enables editing of text information as metadata to be added to an image file by using multiple pieces of glossary data, which are a collection of term data in which character information and abbreviated input information are paired. Information processing device. (2) The user interface control unit presents the character information as an input candidate from the glossary data based on input information input when editing the text information. The information processing device according to (1) above. (3) A glossary management unit for acquiring the glossary data is provided. An information processing device according to any one of (1) to (2) above. (4) The glossary management unit stores and manages the glossary data in a storage unit. The information processing device according to (3) above. (5) The glossary management unit manages a validity state of each of the glossary data. An information processing device according to any one of (3) to (4) above. (6) The user interface control unit includes: providing an environment for switching the validity state of the plurality of glossary data; A process for changing the display order of the plurality of glossary data items displayed in the switching environment is performed. The information processing device according to (5) above. (7) The display order is determined by the number of times the items have been activated. The information processing device according to (6) above. (8) The display order is determined by the shortest elapsed time since the invalidation. The information processing device according to (6) above. (9) The glossary management unit acquires the glossary data from a server device via a network. An information processing device according to any one of (3) to (8) above. (10) The glossary management unit acquires the glossary data based on a synchronization setting with the server device. The information processing device according to (9) above. (11) The synchronization settings include automatic synchronization and manual synchronization. The information processing device according to (10) above. (12) The glossary management unit selects the glossary data to be acquired from the server device based on location information. An information processing device according to any one of (9) to (11) above. (13) The glossary management unit selects the glossary data to be acquired from the server device based on time information. An information processing device according to any one of (9) to (12) above. (14) The server device is a shared server device. An information processing device according to any one of (9) to (13) above. (15) the user interface control unit performs processing to provide an environment in which voice data can be used to edit the text information; The glossary data is used in editing the text information using the voice data. An information processing device according to any one of (1) to (14) above. (16) The text information is stored in the caption field of the IPTC metadata. An information processing device according to any one of (1) to (15) above. (17) A user interface process that enables editing of text information as metadata to be added to an image file by using multiple pieces of glossary data, which are a collection of term data in which character information and abbreviated input information are paired. An information processing method executed by an information processing device. (18) A user interface process that enables editing of text information as metadata to be added to an image file by using multiple pieces of glossary data, which are a collection of term data in which character information and abbreviated input information are paired. A program to be executed by an information processing device. [Explanation of symbols]

[0271] 1. Imaging device 2. Information processing equipment 4. FTP Server 6 Network 31 UI control section 36 Glossary Management Department 58 Glossary list screen 63 Terminology data editing screen 71 CPU 79 Memory section PF Image File

Claims

1. a user interface control unit that performs user interface processing to enable editing of text information as metadata to be added to an image file, using multiple pieces of glossary data, which are a collection of term data in which character information and abbreviated input information are paired; a glossary management unit that acquires the glossary data, The glossary management unit manages a validity state of each of the glossary data by setting validity information for each of the stored glossary data. Information processing device.

2. The user interface control unit presents the character information as an input candidate from the glossary data based on input information input when editing the text information. The information processing device according to claim 1 .

3. The glossary management unit stores and manages the glossary data in a storage unit. The information processing device according to claim 1 .

4. The user interface control unit includes: providing an environment for switching the validity state of the plurality of glossary data; A process for changing the display order of the plurality of glossary data items displayed in the switching environment is performed. The information processing device according to claim 1 .

5. The display order is determined by the number of times the items have been activated. The information processing device according to claim 4.

6. The display order is determined by the shortest elapsed time since the invalidation. The information processing device according to claim 4.

7. The glossary management unit acquires the glossary data from a server device via a network. The information processing device according to claim 1 .

8. The glossary management unit acquires the glossary data based on a synchronization setting with the server device. The information processing device according to claim 7.

9. The synchronization settings include automatic synchronization and manual synchronization. The information processing device according to claim 8.

10. The glossary management unit selects the glossary data to be acquired from the server device based on location information. The information processing device according to claim 7.

11. The glossary management unit selects the glossary data to be acquired from the server device based on time information. The information processing device according to claim 7.

12. The server device is a shared server device. The information processing device according to claim 7.

13. the user interface control unit performs processing to provide an environment in which voice data can be used to edit the text information; The glossary data is used in editing the text information using the voice data. The information processing device according to claim 1 .

14. The text information is stored in the caption field of the IPTC metadata. The information processing device according to claim 1 .

15. A user interface process that enables editing of text information as metadata to be added to an image file by using a plurality of glossary data, which is a collection of term data in which character information and abbreviated input information are paired; obtaining the glossary data; A process of managing a validity state of each of the glossary data by setting validity information for each of the glossary data stored. An information processing method executed by an information processing device.

16. A user interface process that enables editing of text information as metadata to be added to an image file by using a plurality of glossary data, which is a collection of term data in which character information and abbreviated input information are paired; obtaining the glossary data; A process of managing a validity state of each of the glossary data by setting validity information for each of the glossary data stored. A program to be executed by an information processing device.

Images