Information processor, information processing terminal, information processing method and information processing program

Abstract

To provide an information processor, an information processing terminal, an information processing method and an information processing program with higher convenience.SOLUTION: An information processor includes: a reception part for receiving voice data transmitted from a first terminal or a second terminal; a text conversion part for converting the voice data which the reception part receives into text data; and a transmission part for transmitting the text data which the conversion part converts to the second terminal or the first terminal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing terminal, an information processing method, and an information processing program that can be used in a system that transmits and receives audio data. [Background technology]

[0002] GPS devices capable of transmitting and receiving voice data have been proposed for use in monitoring children. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Retable 2020 / 202449 Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional GPS terminals only provide users with location information and voice information, and there is room for improvement in terms of convenience.

[0005] The present invention has been made in consideration of the above-mentioned problems, and has an object to provide a more convenient information processing device, information processing terminal, information processing method, and information processing program. [Means for solving the problem]

[0006] In order to solve the above problem, the information processing device of the present invention comprises a receiving unit that receives voice data transmitted from a first terminal or a second terminal, a text conversion unit that converts the voice data received by the receiving unit into text data, and a transmitting unit that transmits the text data converted by the conversion unit to the second terminal or the first terminal. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a more convenient information processing device, information processing terminal, information processing method, and information processing program. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the layout of an information processing system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a configuration of an information processing server (information processing device) according to the embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of a configuration of an information processing server according to the embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of the configuration of a first terminal (information processing terminal) according to the embodiment. [Figure 5] FIG. 2 is a diagram illustrating an example of a configuration of a first terminal according to the embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of the configuration of a second terminal (information processing terminal) according to the embodiment. [Figure 7] FIG. 2 is a diagram illustrating an example of a configuration of a second terminal according to the embodiment. [Figure 8] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first terminal according to the embodiment. [Figure 9] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first terminal according to the embodiment. [Figure 10] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first terminal according to the embodiment. [Figure 11] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first terminal according to the embodiment. [Figure 12] 10 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 13] 10 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 14] 10 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 15]10 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 16] 10 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 17] 10 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 18] FIG. 10 is a diagram showing an example of a screen displayed on a display device of a first terminal according to a modified example of the embodiment. [Figure 19] FIG. 10 is a diagram showing an example of a screen displayed on a display device of a first terminal according to a modified example of the embodiment. [Figure 20] FIG. 10 is a diagram showing an example of a screen displayed on a display device of a first terminal according to a modified example of the embodiment. [Figure 21] FIG. 10 is a diagram showing an example of a screen displayed on a display device of a first terminal according to a modified example of the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] [Embodiment] An information processing system 1 according to an embodiment will be described below with reference to the drawings. The information processing system 1 according to the embodiment is a so-called monitoring system. The location of the second terminal 4 is determined from data uploaded to a server 2 at predetermined intervals, such as every 1.5 minutes, from a second terminal 4 carried by a person being watched over (e.g., a child) and usable while being carried around. The determined location is then notified from the server 2 to a first terminal 3 carried or used by a person being watched over (e.g., a family member or relative, such as a parent or grandparent). In addition, in the information processing system 1 according to the embodiment, the first terminal 3 and the second terminal 4 are equipped with a microphone, a speaker, etc., and are configured to be able to send and receive voice messages (hereinafter also referred to as "audio") to each other. That is, the system is configured to enable the exchange of voice messages between the watcher and the person being watched over. The first terminal 3 is equipped with a display device and is configured to convert voice to text and display it on the display device. In the following description, the watcher will also be referred to as the "first user." The person being watched over will also be referred to as the "second user."

[0010] 1, the information processing system 1 includes a server 2 (information processing device) and one or more first terminals 3 (information processing terminals) and second terminals 4 (information processing terminals) connected to the server 2 via a network 5. In the example shown in FIG. 1, the information processing system 1 is configured to include one each of the server 2, the first terminal 3, and the second terminal 4, but the number of servers 2, the first terminals 3, and the second terminals 4 included in the information processing system 1 is arbitrary.

[0011] (Server 2) 2 and 3 are configuration diagrams of the server 2. Fig. 2 shows the main hardware configuration of the server 2, and the server 2 includes a communication IF 200A, a storage device 200B (storage unit), a CPU 200C, etc. Although not shown in Fig. 2, the server 2 may also include an input device (for example, a mouse, a keyboard, a touch panel, etc.) and a display device (CRT (Cathode Ray Tube), a liquid crystal display, an organic EL display, etc.).

[0012] The communication IF 200A is an interface for communicating with other devices (for example, the first terminal 3, the second terminal 4, etc.).

[0013] The storage device 200B is, for example, a hard disk drive (HDD) or a semiconductor storage device (solid state drive (SSD)). Various data and information processing programs are stored in the storage device 200B. Note that some or all of the various data stored in the storage device 200B may be stored in an external storage device such as a universal serial bus (USB) memory or an external HDD, or in a storage device of another information processing device connected via the network 5. In this case, the server 2 refers to or acquires the various data stored in the external storage device or the storage device of the other information processing device.

[0014] The storage device 200B stores account information of the first terminal 3, such as the identification number (terminal ID) of the first terminal 3, the name, contact information (email address, telephone number), and the identification number (terminal ID) of the second terminal 4 owned by the second user (e.g., one's child). The storage device 200B also stores account information of the second terminal 4, such as the terminal ID of the second terminal 4, the name, and the terminal ID of the first terminal 3 owned by the first user (for example, a family member such as one's parents or grandparents). Furthermore, the storage device 200B stores various data (including metadata added to the data) transmitted and received by the first terminal 3 and the second terminal 4 as a log in association with the terminal ID together with date and time data. Note that the various data may also be stored as a log in association with the account ID together with date and time data. Here, the various data include, for example, the following data: (1) Data for identifying the location (e.g., location information transmitted from the second terminal 4) (2) Audio data (including audio data converted from text data) (3) Text data (including converted audio data) The various data described above also include metadata such as acquisition date and time (which may be recording date and time or conversion date and time), transmission date and time, reception date and time, the terminal ID of the first or second terminal that sent the data, and the terminal ID of the first or second terminal that received the data. Data for specifying a location is also called location information.

[0015] The CPU 200C controls the server 2 according to this embodiment, and includes a ROM, a RAM, and the like (not shown).

[0016] Fig. 3 is a functional block diagram of server 2. As shown in Fig. 3, server 2 includes functions such as a receiving unit 201, a transmitting unit 202, a storage device control unit 203 (association unit), a text conversion unit 204, a voice conversion unit 205, a file format conversion unit 206, a removal unit 207, a volume adjustment unit 208, and an extraction unit 209. The functions shown in Fig. 3 are realized by CPU 200C executing an information processing program stored in storage device 200B.

[0017] The receiving unit 201 receives data (including metadata) transmitted from the first terminal 3 and the second terminal 4. The data received by the receiving unit 201 includes, for example, data for specifying a location, audio data, text data, etc. Note that the data described above is an example, and the receiving unit 201 does not prevent the receiving unit 201 from receiving other data.

[0018] The transmitting unit 202 transmits data (including metadata) to the first terminal 3 and the second terminal 4. The data transmitted by the transmitting unit 202 includes, for example, data for specifying a location, audio data, text data, etc. Note that the data described above is an example, and the transmitting unit 202 may transmit other data.

[0019] The storage device control unit 203 stores data (including metadata) transmitted and received by the first terminal 3 and the second terminal 4 in the storage device 200B in association with the terminal IDs of the terminals that transmitted and received the data. The storage device control unit 203 also stores various types of data in the storage device 200B in association with the terminal IDs.

[0020] The text conversion unit 204 converts the voice data received by the receiving unit 201 into text data. This makes it possible to check the message in text format in situations where it is not desirable to play back voice data, such as on public transportation such as trains and buses, or in public facilities such as libraries, providing high convenience.

[0021] The voice conversion unit 205 converts the text data received by the receiving unit 201 into voice data. This provides high convenience by allowing users to check messages by voice in situations where it is not desirable to view text data, such as while driving a vehicle (including a bicycle), walking, running, exercising, cooking, etc. Furthermore, it provides high convenience by allowing users to check messages by voice even when the second terminal 4 does not have a display device or the display device cannot display text.

[0022] The file format conversion unit 206 converts the file format of the audio data. For example, the file format conversion unit 206 converts the file format of the audio data to match the storage capacity of the storage device and the speaker of the second terminal 4. For example, the file format conversion unit 206 compresses the file to reduce the data volume. This reduces the data volume when transmitting audio data to the second terminal 4, thereby reducing communication charges. It also reduces the storage capacity of the storage device of the second terminal 4, thereby reducing the cost of the second terminal 4. Furthermore, the storage device 200B may be configured to store data associating the type of the second terminal 4 with a terminal ID and data associating the file format with the type, and the file format conversion unit 206 may identify the type of the second terminal 4 from the terminal ID and convert the audio data to the file format associated with the identified type. In addition, the file format conversion unit 206 may convert the file format of the audio data to match the storage capacity of the storage device and the speaker of the first terminal 3. This reduces the data volume when transmitting audio data to the first terminal 3, thereby reducing communication charges. It is also possible to reduce the storage capacity of the storage device included in the first terminal 3. Note that the storage device 200B may be configured to store data associating the type of the first terminal 3 with the terminal ID and data associating the file format with the type, and the file format conversion unit 206 may identify the type of the first terminal 3 from the terminal ID and convert the audio data into the file format associated with the identified type.

[0023] The removal unit 207 removes or reduces data outside the audible range, outside the voice band, or in a band that becomes noise from the voice data, or processes the voice data to emphasize only the voice band. This reduces the amount of data when transmitting voice data to the second terminal 4, and makes it possible to reduce communication charges. Note that the removal unit 207 may also remove or reduce data outside the audible range, outside the voice band, or in a band that becomes noise from the voice data to be transmitted to the second terminal 4, or process the voice data to emphasize only the voice band. This reduces the amount of data when transmitting voice data to the second terminal 4, and makes it possible to reduce communication charges.

[0024] The volume adjustment unit 208 adjusts the playback volume when audio data is played back on the second terminal 4. This allows audio data to be played back in accordance with the grade of an audio output device, such as a speaker, provided in the second terminal 4, thereby suppressing distortion and the like. Note that the storage device 200B may be configured to store data associating the type of the second terminal 4 with a terminal ID and data associating the playback volume with the type, and the volume adjustment unit 208 may identify the type of the second terminal 4 from the terminal ID and adjust the volume of the audio data to the playback volume associated with the identified type. Note that the volume adjustment unit 208 may adjust the playback volume when audio data is played back on the first terminal 3. This allows audio data to be played back in accordance with the grade of an audio output device, such as a speaker, provided in the first terminal 3. In addition, the storage device 200B may be configured to store data associating the type of the first terminal 3 with the terminal ID, and data associating the playback volume with the type, and the volume adjustment unit 208 may be configured to identify the type of the first terminal 3 from the terminal ID and adjust the volume of the audio data to the playback volume associated with this identified type.

[0025] The extraction unit 209 extracts data from the storage device 200B based on the sorting conditions. For example, the extraction unit 209 extracts data specified by the sorting conditions. Furthermore, the extraction unit 209 extracts data associated with the history of the location information (via the terminal ID), such as audio data.

[0026] (Terminal 1 3) The first terminal 3 is a terminal owned by the first user, such as a smartphone installed with application software that causes the first terminal 3 to function as a terminal equipped with the functions described in this embodiment. The first user can communicate with a second user (e.g., their child) using voice or text by sending and receiving voice data and text data to and from a registered second terminal 4 using the first terminal 3. Figure 4 shows the main hardware configuration of the first terminal 3, which includes a communication IF 300A, a storage device 300B, an input device 300C, a display device 300D, a CPU 300E, a microphone 300F, and a speaker 300G.

[0027] The communication IF 300A is an interface for communicating with other devices (in this embodiment, the server 2).

[0028] The storage device 300B is, for example, a hard disk drive (HDD) or a semiconductor storage device (solid state drive (SSD)). The storage device 300B stores a terminal ID, an information processing program (application software), and the like. The terminal ID is a number for identifying the first terminal 3. By assigning a terminal ID to data transmitted from the first terminal 3, the server 2 can determine which first terminal 3 transmitted the received data. The terminal ID may be an Internet Protocol (IP) address, a Media Access Control (MAC) address, or the like, or may be assigned to the first terminal 3 by the server 2. The storage device 300B may also store data transmitted and received between the first terminal 3 and the second terminal 4. For example, the storage device 300B may store transmitted and received data (for example, voice data or text data) in association with each other.

[0029] The input device 300C is, for example, an input device such as a keyboard, a mouse, or a touch panel, but may be any other device or equipment that allows input. It may also be a voice input device.

[0030] The display device 300D is, for example, a liquid crystal display, a plasma display, an organic EL display, or the like, but may be any other device or equipment (for example, a CRT: Cathode Ray Tube) as long as it is capable of displaying.

[0031] The CPU 300E controls the first terminal 3 according to this embodiment, and includes a ROM and a RAM (not shown).

[0032] The microphone 300F is an acoustic device that converts sound into an electrical signal. The user of the first terminal 3 can input voice using the microphone 300F. The input voice is transmitted to the server 2 by a transmitting unit 302, which will be described later.

[0033] The speaker 300G is an acoustic device that converts an electrical signal into sound. The speaker 300G plays back, for example, audio data transmitted from the second terminal 4 via the server 2 and stored in the storage device 300B.

[0034] As with the second terminal 4 described below, the first terminal 3 may be provided with a position sensor that identifies its current location based on signals from GNSS satellites, and the current location identified by the position sensor may be output. As long as the location of the first terminal 3 can be identified, the current location may be output by a method other than a position sensor. Possible methods other than a position sensor include, for example, using wireless access point information, using mobile network tower information, or using an acceleration sensor and a magnetic sensor to determine the amount of movement and direction of travel of the first terminal 3. Of course, methods other than those exemplified above may also be used.

[0035] 5 shows a functional block diagram of first terminal 3, which has functions such as receiving unit 301, transmitting unit 302, storage device control unit 303, input receiving unit 304 (receiving unit), display device control unit 305 (display control unit), and audio output control unit 306. The functions shown in FIG. 5 are realized by CPU 300E executing an information processing program stored in storage device 300B.

[0036] The receiving unit 301 receives data transmitted from the server 2, for example.

[0037] The transmitting unit 302 transmits data to the server 2 in response to an input operation received by the input receiving unit 304, for example.

[0038] The storage device control unit 303 controls the storage device 300B. For example, the storage device control unit 303 stores data transmitted and received by the first terminal 3 and the second terminal 4 in the storage device 300B in association with the terminal IDs that transmitted and received the data. The storage device control unit 303 also stores, for example, transmitted and received voice data and text data in the storage device 300B.

[0039] The input receiving unit 304 receives an input operation from the input device 300C. The input receiving unit 304 receives, for example, an input of a message.

[0040] The display device control unit 305 controls the display device 300D and displays on the display device 300D data received by the receiving unit 301. The display device control unit 305 functions as, for example, a notification control unit, and has a push notification function that, when the receiving unit 301 receives audio data, causes the display device 300D to display that the audio data has been received.

[0041] The audio output control unit 306 controls the speaker 300G. The speaker 300G outputs audio under the control of the audio output control unit 306. The audio output control unit 406 functions as, for example, a notification control unit, and causes the receiving unit 301 to play back at least a part of the audio data, thereby notifying the user that the audio data has been received. Note that the audio output control unit 406 may also notify the user that audio has been received by generating a sound in a predetermined pattern when the receiving unit 301 receives audio data.

[0042] (2nd Terminal 4) The second terminal 4 is a terminal used by a second user of the information processing system 1. The second user can use the second terminal 4 to exchange voice data and text data with the registered first terminal 3, thereby communicating with the first user (e.g., their family) by voice. Fig. 6 shows the main hardware configuration of the second terminal 4, which includes a communication IF 400A, a storage device 400B, an input device 400C, a display device 400D, a CPU 400E, a microphone 400F, a speaker 400G, a position sensor 400H, etc.

[0043] The communication IF 400A is an interface for communicating with other devices (in this embodiment, the server 2).

[0044] The storage device 400B is, for example, a hard disk drive (HDD) or a semiconductor storage device (solid state drive (SSD)). The storage device 400B stores a terminal ID, an information processing program, voice data transmitted from the first terminal 3, and the like. The terminal ID is a number for identifying the second terminal 4. By assigning a terminal ID to data transmitted from the second terminal 4, the server 2 can determine from which second terminal 4 the received data was transmitted. Note that the terminal ID may be an IP (Internet Protocol) address, a MAC (Media Access Control) address, or the like, or may be assigned to the second terminal 4 by the server 2. Furthermore, the storage device 400B may store transmitted and received data (for example, audio data).

[0045] The input device 400C is, for example, an input device such as an operation button, but may be any other device or equipment capable of inputting, such as a keyboard, a mouse, or a touch panel. It may also be an audio input device. The second user can operate the input device 400C to input audio and transmit it to the server 2, or play audio data transmitted from the server 2.

[0046] The display device 400D is, for example, an LED, and notifies that a voice has been received by lighting up or blinking in a predetermined pattern.

[0047] The CPU 400E controls the second terminal 4 according to this embodiment, and includes a ROM and a RAM (not shown).

[0048] The microphone 400F is an acoustic device that converts sound into an electrical signal. The user of the second terminal 4 can input voice using the microphone 400F. The input voice is transmitted to the server 2 by a transmitting unit 402, which will be described later.

[0049] The speaker 400G is an acoustic device that converts an electrical signal into sound. The speaker 400G plays back, for example, audio data transmitted from the first terminal 3 via the server 2 and stored in the storage device 400B. The speaker 400G also notifies the reception of audio by generating a sound in a predetermined pattern.

[0050] The position sensor 400H identifies the current location based on signals from GNSS satellites. The position sensor 400H outputs the identified current location. Note that the current location may be output by a method other than the position sensor 400H, as long as the location of the second terminal 4 can be identified. Possible methods other than the position sensor 400H include, for example, using wireless access point information, using mobile network tower information, and using an acceleration sensor and a magnetic sensor to determine the amount of movement and direction of travel of the second terminal 4. Of course, methods other than those exemplified above may also be used.

[0051] 7 shows a functional block diagram of the second terminal 4, which has functions such as a receiving unit 401, a transmitting unit 402, a storage device control unit 403, an input accepting unit 404, a display device control unit 405 (display control unit), and an audio output control unit 406. The functions shown in FIG. 7 are realized by the CPU 400E executing an information processing program stored in the storage device 400B.

[0052] The receiving unit 401 receives, for example, data transmitted from the server 2, such as audio data.

[0053] The transmitting unit 402 transmits data, such as voice data, to the server 2 in response to an input operation received by the input receiving unit 304, for example.

[0054] The storage device control unit 403 controls the storage device 400B. For example, the storage device control unit 403 controls the storage device 400B to write and read data. For example, the storage device control unit 403 stores the data received by the receiving unit 401 in the storage device 400B.

[0055] The input receiving unit 404 receives an input operation from the input device 400C. The input receiving unit 404 receives, for example, an operation to play back audio data stored in the storage device 400B.

[0056] Display device control unit 405 controls display device 400D. Display device control unit 405 functions as, for example, a notification control unit, and when receiving unit 401 receives audio data, causes display device 400D (LED) to light up or blink in a predetermined pattern or the like.

[0057] The audio output control unit 406 controls the speaker 400G. The speaker 400G outputs audio under the control of the audio output control unit 406. The audio output control unit 406 functions as, for example, a notification control unit, and when the receiving unit 401 receives audio data, it generates a sound in a predetermined pattern to notify that the audio has been received. Note that the audio output control unit 406 may also cause the receiving unit 401 to play back at least a part of the audio data, thereby notifying that the audio data has been received.

[0058] (display screen) 8 to 11 are diagrams showing an example of screen G1 displayed on display device 300D of first terminal 3. An example of screen G1 displayed on display device 300D of first terminal 3 will be described below with reference to Figs. 8 to 11. Note that the same components as those described with reference to Figs. 1 to 7 are assigned the same reference numerals, and duplicated description will be omitted.

[0059] (Screen description of Figure 8) As shown in FIG. 8, the display device 300D displays text data, which is obtained by converting the voice data transmitted and received between the first terminal 3 and the second terminal 4 into text, in chronological order on a voice data file basis (hereinafter also referred to as timeline display).

[0060] In the example shown in FIG. 8, the name 11 (or handle name) of the second user is displayed at the top of the screen G1. On the left side of the screen G1, text data 12B converted from voice data (voice file of the second user) transmitted from the second terminal 4 is displayed together with a transmission date and time 12D (using timestamp information) and an icon 12A. When a play button 12C is selected, voice data (voice file) corresponding to the displayed text data 12B is played, allowing the user to listen to the voice. On the right side of the screen G1, text data 13A converted from voice data (voice file of the first user) transmitted from the first terminal 3 is displayed together with a transmission date and time 13C (using timestamp information). Each piece of text data transmitted from the first terminal 3 is accompanied by a status 13D (e.g., whether or not the voice data was played on the second terminal 4). When a play button 13B is selected, voice data (voice file) corresponding to the displayed text data 13A is played, allowing the user to listen to the voice.

[0061] 8, the text data converted from the audio data is displayed in chronological order for each audio data file, but the text data 12B converted from the audio data may not be displayed. In this case, for example, the playback time of the audio data may be displayed instead of the text data 12B, but this is not necessarily a limitation. In addition, in the example shown in Figure 8, all characters converted from the voice data are displayed on the display screen, but it is not necessary to display all characters; for example, the first several characters (e.g., 10 characters) may be displayed.

[0062] (Screen description of Figure 9) Screen G2 shown in FIG. 9 is a screen to which the user transitions when icon 15 described with reference to FIG. 8 is selected (tap operation). As shown in FIG. 9, when icon 15 is selected in FIG. 8, a display frame 16 for sending a message to the second terminal 4 appears, rising from the bottom of screen G2. The first user can record audio and send it to the second terminal 4 by operating input device 300C, such as a touch panel, to select microphone icon 16A displayed in display frame 16 on screen G2. Note that when microphone icon 16A is selected, the display form of microphone icon 16A (e.g., icon color) changes to indicate that recording has started. When the first user finishes speaking the message (e.g., "I'm coming to pick you up now") and reselects microphone icon 16A, the display form of microphone icon 16A (e.g., icon color) returns to its original state, indicating that recording has ended. In addition, below the microphone icon 16A, multiple messages 16B are displayed, such as messages 16B preset in the storage device 300B, messages 16B entered by the first user, and messages 16B downloaded from the server 2. The first user can select one of the multiple displayed messages 16B by operating the input device 300C such as a touch panel, and send the selected message 16B to the second terminal 4.

[0063] Furthermore, it is preferable that the messages 16B displayed on the screen G2 of FIG. 9 be displayed in an order according to the frequency of message use by the first user or a setting made by the first user. For example, when messages are displayed according to frequency of use, it is preferable that the messages are displayed in descending order of frequency of use. Furthermore, the messages 16B displayed on the screen G2 of FIG. 9 may be displayed in an order according to a setting made by the first user. In this case, as will be described later with reference to FIG. 10, the first user may manually rearrange and set the display order of the messages 16B by operating the input device 300C. Furthermore, it is also possible to set the messages 16B to be displayed in descending order of frequency of use by the preset messages 16B, or to set the messages 16B entered by the first user to be displayed in descending order of frequency of use by the first user. Note that when displaying messages in descending order of frequency of use, it is preferable to calculate the frequency of message use taking into account variations in the spelling of the messages (e.g., similarities between messages).

[0064] (Screen description of Figure 10) As already mentioned, the message input by the first user includes a voice message recorded by the first user using the microphone 300F and a character message input by the first user as text by operating the input device 300C. Here, the voice message is transcribed (converted into text) and displayed as the title of the audio file. FIG. 10 shows an example of screen G3 on which a voice message is transcribed (converted to text) and displayed as the title of the voice file. As shown in FIG. 10, screen G3 displays the transcribed (converted to text) voice message as title 16B. The first terminal 3 also accesses the server 2 to inquire about the first user's purchase information in the stamp store (described below). If a purchase history exists, the voice stamp and its title (described below) are also displayed on screen G3. The voice stamp title may be displayed differently from the message entered by the first user (for example, by changing the font or adding a symbol such as a star before the title). The first user can select the voice stamp store 17A on screen G3 using an input device 300C, such as a touch panel, to transition to a stamp store screen (not shown), where the stamp store appears and allows the first user to purchase or download a voice stamp (voice file) different from the voice message entered by the first user for free. For example, when a user goes through the process of purchasing an audio stamp on the stamp store screen, server 2 records the first user's purchase information, and the user can use the audio file stored on server 2 that corresponds to the purchased audio stamp (for example, an audio file of a message recorded by a voice actor, actor, idol, etc., or an audio file of a message generated by a voice synthesis engine such as Vocaloid (registered trademark)). Furthermore, the first user can change the display order of the titles 16B by operating the input device 300C such as a touch panel to select (long press or tap) a swap button 17B located to the left of the titles 16B. Furthermore, the first user can operate the input device 300C, such as a touch panel, to select (long press or tap) the edit button 17C located to the right of the title 16B to edit the volume, playback speed, pitch, playback start time, playback end time, etc., of the audio file that is the source of the title 16B. However, if the audio file is an audio stamp, the edit button 17C can also be hidden. In addition, the first user can play (listen to) the audio file that is the source of title 16B by operating input device 300C, such as a touch panel, and selecting (long press or tap operation, etc.) play button 17D located to the right of title 16B. In addition, the first user can re-record the audio file that is the source of title 16B by operating input device 300C, such as a touch panel, and selecting (by long pressing or tapping, for example) record button 17E located to the right of title 16B. The audio file titles 16B may be set to be displayed in descending order of frequency of use. When displaying the audio files in descending order of frequency of use, it is preferable to calculate the frequency of use of the messages taking into consideration variations in the way messages are written (for example, similarities between messages).

[0065] (Screen description of Figure 11) As shown in FIG. 11 , in this embodiment, the display device 300D of the first terminal 3 can display the history of the location P of the second terminal 4 superimposed on a map. The current time T and the user name U of the second terminal 4 are displayed at the top of the display screen 300D. A calendar C and a slider S are displayed at the bottom of the display screen 300D. The first user can click the calendar C to select a date to display the history of the location P of the second terminal 4 for the selected date. The first user can also zoom in or out of the map by moving the slider S left or right. If data, such as audio data, exists associated with the location P, a speech bubble F is displayed at the corresponding location P, indicating the existence of associated data (e.g., audio data). In this embodiment, the status of the associated data (e.g., whether or not it has been confirmed) is also displayed. For example, if the associated data is audio data, the status is marked "read" if the audio data has been played on the first terminal 3. This provides a high level of convenience, as it allows the user to check not only the location history but also the type of information associated with each location.

[0066] The second terminal 4 may be provided with a display device such as a liquid crystal display, a plasma display, or an organic EL display, and configured to be able to display the screens exemplified in Figures 8 to 11 on the first terminal 3. In this case, the relationship between the first terminal 3 and the second terminal 4 is reversed in the screens exemplified in Figures 8 to 11.

[0067] (Information Processing) 12 to 17 are flowcharts showing an example of information processing of the information processing system 1. Hereinafter, the information processing of the information processing system 1 will be described with reference to Fig. 12 to 17. Note that the same components as those described with reference to Fig. 1 to Fig. 11 are assigned the same reference numerals, and redundant description will be omitted.

[0068] (Location information transmission process) 12 is a flowchart showing an example of the position information transmission process of the information processing system 1. Hereinafter, an example of the position information transmission process of the information processing system 1 will be described with reference to FIG.

[0069] (Step S101) The transmitting unit 402 of the second terminal 4 determines whether a predetermined interval (for example, every 1.5 minutes) has arrived. If the predetermined interval has arrived (YES), the server 2 executes the process of step S102. If the predetermined interval has not arrived (NO), the server 2 ends the process.

[0070] (Step S102) The transmitter 402 of the second terminal 4 transmits the location information output from the location sensor 400H to the server 2. The data transmitted from the second terminal 4 is provided with data such as the terminal ID of the second terminal 4, timestamps (transmission date and time, positioning date and time of the location information), etc.

[0071] (Step S103) The receiving unit 201 of the server 2 receives the location information transmitted from the second terminal 4.

[0072] (Step S104) The storage device control unit 203 of the server 2 stores the location information (including metadata) transmitted and received by the second terminal 4 in the storage device 200B in association with the terminal ID of the terminal that transmitted and received the data.

[0073] (Message sending process 1) Fig. 13 is a flowchart showing an example of message transmission processing 1 in the information processing system 1. Hereinafter, an example of message transmission processing 1 in the information processing system 1 will be described with reference to Fig. 13. Note that Fig. 13 describes a case where a message is transmitted from the first terminal 3 to the second terminal 4.

[0074] (Step S201) The first user operates the input device 400C of the first terminal 3 to input a message by voice or text.

[0075] (Step S202) When voice is input, it is converted into an electric signal by microphone 400F, converted into digital data by an A / D converter (not shown), and then transmitted as voice data from transmission unit 302 to server 2. When text is input, it is transmitted as text data from transmission unit 302 to server 2. Note that the data transmitted from first terminal 3 is provided with data such as the terminal ID of first terminal 3 and a timestamp.

[0076] (Step S203) The receiving unit 201 of the server 2 receives the data transmitted from the first terminal 3. The voice conversion unit 205 of the server 2 determines whether the receiving unit 201 has received voice data. If voice data has been received (YES), the server 2 executes the process of step S205. If voice data has not been received (NO), the server 2 executes the process of step S204.

[0077] (Step S204) The speech conversion unit 205 of the server 2 converts the received text data into speech data. When converting the received text data into speech, a language conversion unit (not shown) can convert the original language into another language to create speech data, or speech data that can reproduce all speeches converted into the original language and one or more other languages. In this case, the first terminal 3 is set in advance.

[0078] (Step S205) When the storage device control unit 203 of the server 2 receives voice data, it stores the voice data transmitted by the first terminal 3 in the storage device 200B in association with the terminal ID that transmitted and received the data. When the storage device control unit 203 receives text data, it stores the text data transmitted by the first terminal 3 and the voice data converted from this text data in association with the terminal ID that transmitted and received the data in the storage device 200B.

[0079] (Step S206) The server 2 executes the voice data conversion process, the details of which will be described later with reference to FIG.

[0080] (Step S207) The transmitting unit 202 of the server 2 refers to the storage device 200B, identifies the terminal ID of the second terminal 4 associated with the terminal ID assigned to the voice data received by the receiving unit 201, and transmits the voice data transmitted from the first terminal 3 or the voice data converted by the voice conversion unit 205 to the identified second terminal 4.

[0081] (Step S208) The receiving unit 401 of the second terminal 4 receives the voice data transmitted from the server 2. The second terminal 4 notifies that the message has been received. For example, the display device control unit 405 may control the display device 400D to notify that the message has been received by, for example, lighting an LED or making a sound, or the voice output control unit 406 may control the speaker 400G to output a sound or voice to notify that the message has been received.

[0082] (Message sending process 2) Fig. 14 is a flowchart showing an example of the message transmission process 2 of the information processing system 1. Hereinafter, an example of the message transmission process 2 of the information processing system 1 will be described with reference to Fig. 14. Note that Fig. 14 describes a case where a message is transmitted from the second terminal 4 to the first terminal 3.

[0083] (Step S301) The second user inputs voice by operating the input device 400C of the second terminal 4. The input voice is converted into an electrical signal by the microphone 400F.

[0084] (Step S302) The transmitting unit 402 of the second terminal 4 transmits the input voice data to the server 2. Note that the data transmitted from the second terminal 4 is provided with data such as the terminal ID of the second terminal 4 and a timestamp.

[0085] (Step S303) The receiving unit 201 of the server 2 receives the voice data transmitted from the second terminal 4 .

[0086] (Step S304) The text conversion unit 204 of the server 2 converts the received voice data into text data. When converting the received voice data into text data, a language conversion unit (not shown) can convert the original language into another language to create text data, or text data that can simultaneously display all of the text in the original language and one or more other languages. In this case, the first terminal 3 is set up in advance.

[0087] (Step S305) The storage device control unit 203 of the server 2 stores the voice data transmitted by the second terminal 4 and the text data converted by the text conversion unit 204 in the storage device 200B in association with the terminal IDs that transmitted and received the data.

[0088] (Step S306) The transmitting unit 202 of the server 2 refers to the storage device 200B, identifies the terminal ID of the first terminal 3 associated with the terminal ID assigned to the voice data received by the receiving unit 201, and transmits the voice data transmitted from the second terminal 4 and the text data converted by the text conversion unit 204 to the identified first terminal 3.

[0089] (Step S307) The receiving unit 301 of the first terminal 3 receives the voice data and text data transmitted from the server 2.

[0090] (Step S308) The receiving unit 301 of the first terminal 3 receives the voice data and text data transmitted from the server 2. The first terminal 3 notifies that the message has been received. For example, the display device control unit 305 may control the display device 300D to notify that the message has been received by, for example, a PUSH notification, or the audio output control unit 306 may control the speaker 300G to output sound or voice to notify that the message has been received.

[0091] (audio data conversion processing) 15 is a flowchart showing an example of the voice data conversion process of the information processing system 1. Hereinafter, an example of the voice data conversion process of the information processing system 1 will be described with reference to FIG.

[0092] (Step S401) The removal unit 207 of the server 2 removes or reduces data outside the audible range, outside the voice band, or in a band that becomes noise from the voice data received by the receiving unit 201, or processes the voice data to emphasize only the voice band.

[0093] (Step S402) The volume adjustment unit 208 of the server 2 adjusts the playback volume when the audio data is played back on the second terminal 4.

[0094] (Step S403) The file format conversion unit 206 of the server 2 converts the file format of the audio data.

[0095] Note that the steps of the audio data conversion process described with reference to Figure 15 do not necessarily have to be processed in the order of steps S401 to S403, and they may be processed in a different order, or one or more of steps S401 to S403 may be processed in any order.

[0096] As described above, when transmitting voice data from the second terminal 4 to the first terminal 3, the voice data conversion process described with reference to FIG. 15 may be executed.

[0097] (TL display processing) 16 is a flowchart showing an example of the TL display process of the information processing system 1. Hereinafter, an example of the TL display process of the information processing system 1 will be described with reference to FIG.

[0098] (Step S501) The first user operates input device 300C of first terminal 3 to input sorting conditions for the data to be displayed. Input receiving unit 304 of first terminal 3 receives the input sorting conditions, and transmission unit 302 transmits the sorting conditions received by input receiving unit 304 to server 2. Receiving unit 201 of server 2 receives the sorting conditions transmitted from first terminal 3.

[0099] (Step S502) The extraction unit 209 of the server 2 extracts data from the storage device 200B based on the sorting conditions. For example, the extraction unit 209 extracts data specified by the sorting conditions (for example, location information history and voice data).

[0100] (Step S503) The transmitting unit 202 of the server 2 refers to the storage device 200B, identifies the terminal ID of the first terminal 3 associated with the terminal ID assigned to the data received by the receiving unit 201, and transmits the data extracted by the extracting unit 209 to the identified first terminal 3. The receiving unit 301 of the first terminal 3 receives the data transmitted from the server 2. The display device control unit 305 of the first terminal 3 causes the data received by the receiving unit 301 to be displayed on the display device 300D.

[0101] As described above, the second terminal 4 may be provided with a display device such as a liquid crystal display, a plasma display, or an organic EL display, and may execute the TL display process described with reference to FIG.

[0102] (Map display processing) 17 is a flowchart showing an example of map display processing in the information processing system 1. Hereinafter, an example of map display processing in the information processing system 1 will be described with reference to FIG.

[0103] (Step S601) The first user operates the input device 300C of the first terminal 3 to instruct a map display. The input receiving unit 304 of the first terminal 3 receives the instruction to display the map. The transmitting unit 302 of the first terminal 3 transmits the instruction to display the map to the server 2. The receiving unit 201 of the server 2 receives the instruction to display the map transmitted from the first terminal 3.

[0104] (Step S602) The extraction unit 209 of the server 2 refers to the storage device 200B, identifies the terminal ID of the second terminal 4 associated with the terminal ID assigned to the map display instruction, and extracts the history of the location information of the identified second terminal 4.

[0105] (Step S603) Furthermore, the extraction unit 209 of the server 2 extracts data associated with the history of the location information (via the terminal ID), such as audio data.

[0106] (Step S604) The transmitting unit 202 of the server 2 refers to the storage device 200B, identifies the terminal ID of the first terminal 3 associated with the terminal ID assigned to the data received by the receiving unit 201, and transmits to the identified first terminal 3 the history of location information extracted by the extracting unit 209 and data associated with the history of location information, for example, audio data.

[0107] (Step S605) The receiving unit 301 of the first terminal 3 receives the history of the location information transmitted from the server 2 and data associated with the history of the location information.

[0108] (Step S606) The display device control unit 305 of the first terminal 3 causes the display device 300D to display the history of the location information received by the receiving unit 301 on a map (see, for example, FIG. 11). The display device control unit 305 of the first terminal 3 also causes the display device 300D to display the presence of data associated with the history in or near the history of the location information displayed on the map.

[0109] In the map display process illustrated in FIG. 17, the server 2 transmits the history of the extracted location information and the voice data associated with this history of location information (via the terminal ID) to the first terminal 3. Alternatively, the server 2 may transmit the history of the extracted location information and data (e.g., flag information) indicating that there is voice data associated with this history of location information (via the terminal ID) to the first terminal 3, and when the user instructs playback of the voice data, the instructed voice data is downloaded from the server 2 and played.

[0110] As described above, the second terminal 4 may be provided with a display device such as a liquid crystal display, a plasma display, or an organic EL display, and may execute the map display process described with reference to FIG.

[0111] According to the information processing system 1 of this embodiment, voice data can be converted into text data and transmitted or received, or text data can be converted into voice data and transmitted or received. This enables communication between the first user and the second user (or both users) in a variety of situations, including users who have difficulty inputting text or voice (for example, children or elderly people who have difficulty operating complex terminals, or users with impaired speech), terminals that have difficulty inputting text or voice (for example, small devices that make it difficult to attach a keyboard, or devices that make it difficult to attach a display due to cost or other constraints), situations where text input is difficult because the user's hands are full, or situations where voice recording and playback are difficult in public spaces, etc.

[0112] [Modification of the embodiment] In the above embodiment, the display device 400D of the second terminal 4 may be configured to be able to display text using an LED. Alternatively, the display device 400D of the second terminal 4 may be configured to be able to display text by using a liquid crystal panel or an organic EL panel. With this configuration, it is possible to convert voice data transmitted from the first terminal 3 or the server 2 into text data and check the text as well. It is also possible to check text data transmitted from the first terminal 3 or the server 2.

[0113] In the above embodiment, some or all of the functions of the server 2 shown in Fig. 3 may be included in at least one of the first terminal 3 and the second terminal 4. For example, of the functions of the server 2 shown in Fig. 3, at least one of the first terminal 3 and the second terminal 4 may be included in at least one of the storage device control unit 203 (association unit), text conversion unit 204, speech conversion unit 205, file format conversion unit 206, removal unit 207, and volume adjustment unit 208. In this case, at least one of the first terminal 3 and the second terminal 4 may acquire or refer to information stored in storage device 200B, or information stored in storage device 200B may be stored in at least one of storage device 300B and storage device 400B. In addition, in the above embodiment, the second terminal 4 may have at least one of the functions that the first terminal 3 has, or the first terminal 3 may have at least one of the functions that the second terminal 4 has.

[0114] Furthermore, the screen G1 described with reference to Fig. 8 may be changed to a screen G4 shown in Fig. 18. The screen G4 shown in Fig. 18 is provided with an input box 18A for inputting a text message and a microphone icon 18B for inputting a voice message, and is configured so that the first user can select whether to input a message as text or voice. In addition, in the input text message, characters that do not have a sound (pronunciation) (such as symbols) or combinations of characters (such as surrounding characters that have a sound with the aforementioned symbols) can be used to change the sound source (tone of the voice or tone of an instrument) or to specify the volume, pitch, etc. in detail.

[0115] Moreover, a screen G5 shown in FIG. 19 is a screen to which the user transitions after inputting a voice message or a text message. 19, the first user can preview and check the input voice message or text message by operating input device 300C such as a touch panel to select icon 19A on screen G5. In addition, the first user can re-input the voice message or text message by operating input device 300C such as a touch panel to select icon 19B on screen G5. The first user can also set a notification pattern to be used when notifying the second user terminal 4 that it has received a message from the first user terminal 3. In the example shown in Fig. 19, the first user can select a notification pattern from "Ringtone ON" 20A, "Ringtone OFF" 20B, and "Ring this sound as a ringtone" 20C. Note that in the example shown in Fig. 19, the first user can select from three notification patterns, but the notification patterns are not limited to the example shown in Fig. 19. Screen G5 also allows the user to specify the tone of voice and emotion to be used when playing back a voice message. When the first user selects a tone of voice from tone of voice options 21 and an emotion from emotion options 22, the voice message is played back in the selected tone of voice and emotion on the second terminal 4 of the recipient of the voice message. The expression of tone of voice and emotion can be achieved by using AI machine learning to learn human voices and synthesize voices.

[0116] 20 and 21 are diagrams illustrating an example in which the display device 300D receives audio data or text data by the push notification function. As shown in FIG. 20, a push notification may be sent only with the fact that a message has been received and the name of the user who sent the message, or as shown in FIG. 21, a push notification may be sent with the content of the received message (if the message is long, for example, if it is longer than a predetermined number of characters, only the first predetermined number of characters of the message content may be displayed, or a summary of the content may be displayed) and the name of the user who sent the message. In the example shown in FIG. 21, the playback method of the message for which a push notification has been sent (such as "play hands-free," "play by holding to ear," or "open app") and a response to the message (selecting and sending a pre-registered message (such as a preset message or a message registered by the user)) can be performed without opening the app, which is very convenient.

[0117] (Processing when new audio is received before listening to the audio received on the second terminal 4) After the second terminal 4 receives the audio data transmitted from the server 2, new audio data may be transmitted from the server 2 before the audio data is played back on the second terminal 4. In this case, the second terminal 4 may execute any of the processes exemplified below as (1) to (3) to store the audio data. Note that the following processes are executed by the second terminal 4 due to the limited storage capacity of the storage device 400B of the second terminal 4. (1) When new audio data is received, the audio data received before that is deleted from the storage device 400B. (2) Audio data is stored in an audio data buffer (e.g., a specified area provided in the storage device 400B) that can store any number of data or any storage capacity of data, and when the audio data buffer is about to overflow, old data is erased using the FIFO (first in first out) method. (3) The voice data is stored in a voice data buffer (for example, a predetermined area provided in the storage device 400B) that can store any number of data or any storage capacity of data, and when the voice data buffer is about to overflow, buffer full information (information indicating that no more voice data can be stored in the second terminal 4) is sent to the first terminal 3 via the server 2, and a message is displayed on the first terminal 3 indicating that a message cannot be sent. Furthermore, when an operation to play back audio data is performed on the second terminal 4, the second terminal 4 plays back the audio data in the buffer in the order in which it was stored or in the order of the most recent audio data, but may thereafter erase the audio data in the audio data buffer, or may erase all audio data other than the most recently received audio data, or may always perform the process (2) above without erasing the data. These settings can be changed from the first terminal 3.

[0118] (talk group) In the above embodiment and modified example, a pair of one first terminal 3 and one second terminal 4 has been described, but multiple first terminals 3 and / or multiple second terminals 4 can also be used to form a single talkgroup. Talkgroups are managed by the server 2 using a unique ID (talkgroup ID), and the identification numbers (terminal IDs) of all first terminals 3 and second terminals 4 belonging to the same talkgroup are linked. Each terminal can be assigned a name that is easy for users belonging to the talkgroup to understand, and in this case, the terminal ID and terminal name are also linked. Messages can be sent simultaneously between devices in the same talk group, but messages can also be sent to specific devices. For example, when sending a message from the first device 3, the user can select one or more devices to which the message should be sent on the text or voice message sending screen and send the message. When sending a voice message from the second device 4, the user can select the device by saying the name of the device to which the message should be sent during the voice message, or by pressing a button operated to send a voice message to the second device 4 any number of times within a given time. The second device 4 then asks, "Who would you like to send this to?" over the speaker 400G. The second user then voice-selects the name(s) of one or more devices to which the message should be sent. After confirming the names of the devices to which the message should be sent, the message to be sent to the second user is accepted and sent to the desired devices within the same talk group via the server 2.

[0119] Furthermore, the above-described embodiments and modifications are merely examples of specific embodiments of the present invention, and the technical scope of the present invention should not be construed as being limited thereby. In other words, the present invention can be embodied in various forms without departing from the gist or main characteristics thereof. [Explanation of symbols]

[0120] 1. Information Processing Systems 2. Server (information processing device) 200A communication interface 200B storage device 200C CPU 201 Receiving unit 202 Transmission Unit 203 Storage device control unit (association unit) 204 Text Conversion Unit 205 Voice conversion unit 206 File Format Conversion Section 207 Removal section 208 Volume control section 209 Extraction part 3. First terminal (information processing terminal) 300A communication IF 300B storage device 300C input device 300D display device 300E CPU 300F Microphone 300G speaker 301 Receiving unit 302 Transmission Unit 303 Storage device control unit 304 Input reception unit (reception unit) 305 Display device control unit (display control unit) 306 Audio output control unit 4. Terminal 2 400A communication interface 400B storage device 400C input device 400D display device (LED) 400E CPU 400F Microphone 400G speaker 400H Position Sensor 401 Receiving unit 402 Transmission Unit 403 Storage device control unit 404 Input acceptance section 405 Display device control unit (display control unit) 406 Audio output control unit 5. Network

Claims

1. a receiving unit that receives voice data transmitted from the first terminal or the second terminal; a text conversion unit that converts the voice data received by the receiving unit into text data; a transmitting unit that transmits the text data converted by the converting unit to the second terminal or the first terminal; An information processing device comprising:

2. a receiving unit that receives text data transmitted from the first terminal or the second terminal; a voice conversion unit that converts the text data received by the receiving unit into voice data; a transmitting unit that transmits the voice data converted by the converting unit to the second terminal or the first terminal; An information processing device comprising:

3. an association unit that associates the voice data with information for identifying a position of the first terminal or the second terminal, The receiving unit receiving information for identifying a location transmitted from the first terminal or the second terminal; The association unit Associating the voice data received by the receiving unit with information for identifying the position; The transmission unit transmitting the voice data and information for specifying the location associated with the voice data to the second terminal or the first terminal; 2. The information processing apparatus according to claim 1, wherein:

4. an association unit that associates the text data with information for identifying the location of the first terminal or the second terminal; The receiving unit receiving information for identifying a location transmitted from the first terminal or the second terminal; The association unit Associating the text data received by the receiving unit with information for identifying the location; The transmission unit transmitting the text data and information for specifying the location associated with the text data to the second terminal or the first terminal; 3. The information processing apparatus according to claim 2, wherein:

5. The association unit associating the voice data with information for specifying the location of the first terminal or the second terminal based on the information for specifying the location, one or more of the positioning date and time, the transmission date and time, and the reception date and time of the information for specifying the location, and one or more of the recording date and time, the transmission date and time, and the reception date and time of the voice data; 4. The information processing apparatus according to claim 3,

6. a format conversion unit that converts the file format of the audio data; 2. The information processing apparatus according to claim 1, further comprising:

7. a removal unit that removes or reduces data of the audio data that is outside the audible range, outside the audio band, or in a band that becomes noise, or that emphasizes only the audio band; The transmission unit The removal unit removes or reduces data outside the audible range, outside the voice band, or in a band that becomes noise, or transmits audio data in which only the voice band is emphasized to the second terminal or the first terminal.

2. The information processing apparatus according to claim 1, wherein:

8. a volume adjustment unit that adjusts the playback volume of the audio data that the transmission unit transmits to the second terminal or the first terminal; 2. The information processing apparatus according to claim 1, further comprising:

9. a receiving unit that receives audio data; a text conversion unit that converts the voice data received by the receiving unit into text data; an output unit that outputs the text data converted by the conversion unit; An information processing terminal comprising:

10. a receiving unit that receives text data; a voice conversion unit that converts the text data received by the receiving unit into voice data; an output unit that outputs the audio data converted by the conversion unit; An information processing terminal comprising:

11. a reception unit that receives input of voice data; a text conversion unit that converts the voice data received by the reception unit into text data; a transmission unit that transmits the text data converted by the conversion unit; An information processing terminal comprising:

12. a reception unit that receives input of text data; a voice conversion unit that converts the text data received by the reception unit into voice data; a transmitting unit that transmits the audio data converted by the converting unit; An information processing terminal comprising:

13. an association unit that associates the voice data with information for identifying a position, The receiving unit receiving information for identifying the location; The association unit associating the voice data received by the receiving unit with information for identifying the position; 10. The information processing terminal according to claim 9.

14. an association unit that associates the text data with information for specifying a position, The receiving unit receiving information for identifying the location; The association unit associating the text data received by the receiving unit with information for identifying the location; 11. The information processing terminal according to claim 10.

15. a volume adjustment unit that adjusts the playback volume of the audio data transmitted by the transmission unit; 12. The information processing terminal according to claim 11, further comprising:

16. a notification control unit that, when the receiving unit receives the voice data or the text data, notifies the user that the voice data or the text data has been received; 11. The information processing terminal according to claim 9, further comprising:

17. The notification control unit Reproducing at least a part of the voice data or the text data to notify the user that the voice data or the text data has been received.

17. The information processing terminal according to claim 16.

18. The association unit associates the voice data with information for specifying the location of another information processing terminal that transmitted the voice data, based on the information for specifying the location, one or more of the positioning date and time, the transmission date and time, and the reception date and time of the information for specifying the location, and one or more of the recording date and time, the transmission date and time, and the reception date and time of the voice data; 14. The information processing terminal according to claim 13.

19. a format conversion unit that converts the file format of the audio data; 10. The information processing terminal according to claim 9, further comprising:

20. a removal unit that removes or reduces data outside the audible range, outside the audio band, or in a band that becomes noise from the audio data, or that emphasizes only the audio band; The transmission unit The removal unit removes or reduces data outside the audible range or outside the voice band, or transmits the voice data in which only the voice band is emphasized to another information processing terminal.

12. The information processing terminal according to claim 11.

21. a volume adjustment unit that adjusts the playback volume of the audio data that the transmission unit transmits to other information processing terminals; 12. The information processing terminal according to claim 11, further comprising:

22. a receiving unit that receives voice data and text data converted from the voice data; a display control unit that displays the presence of the voice data received by the receiving unit in association with at least a part of the text data; An information processing terminal comprising:

23. a receiving unit that receives information for identifying the location of the other information processing terminal and voice data or text data converted from the voice data; a display control unit that displays information for identifying the location of the other information processing terminal received by the receiving unit in association with the presence of the voice data or the text data; An information processing terminal comprising:

24. The display control unit displaying, on a map, information for specifying the location of the other information processing terminal received by the receiving unit and the presence of the voice data or the text data in association with each other; 23. The information processing terminal according to claim 22.

25. The display control unit Displaying one or more pieces of audio data or text data; The information processing terminal a receiving unit that receives designation of the displayed voice data or text data; a transmitting unit that transmits the voice data or the text data designated by the receiving unit; 24. The information processing terminal according to claim 23, further comprising:

26. The information processing terminal a terminal for outputting information for identifying the location of the information processing terminal at predetermined intervals and monitoring the behavior of a user who holds the information processing terminal; 13. The information processing terminal according to claim 9, wherein:

27. a receiving unit receiving voice data transmitted from the first terminal or the second terminal; a step of converting the voice data received by the receiving unit into text data by a text conversion unit; a transmitting unit transmitting the text data converted by the converting unit to the second terminal or the first terminal; An information processing method comprising:

28. Computer, a receiving unit that receives voice data transmitted from the first terminal or the second terminal; a text conversion unit that converts the voice data received by the receiving unit into text data; a transmission unit that transmits the text data converted by the conversion unit to the second terminal or the first terminal; An information processing program characterized by causing the program to function as:

Images