Information processing apparatus, information processing terminal, information processing method, information processing program

Abstract

To provide a more convenient information processing apparatus, information processing terminal, information processing method, and information processing program. 【Solution means】An information processing apparatus according to the present invention includes a receiving unit that receives voice data transmitted from a first terminal or a second terminal, a text conversion unit that converts the voice data received by the receiving unit into text data, and a transmitting unit that transmits the text data converted by the conversion unit to the second terminal or the first terminal.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing terminal, an information processing method, and an information processing program that can be used in a system for transmitting and receiving voice data.

Background Art

[0002] Conventionally, a GPS terminal capable of exchanging voice data has been proposed for the purpose of monitoring children.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, conventional GPS terminals simply present position information, voice information, etc. to the user, and there is room for improvement in convenience.

[0005] The present invention has been made in view of the above problems, and an object thereof is to provide a more convenient information processing apparatus, information processing terminal, information processing method, and information processing program.

Means for Solving the Problems

[0006] To solve the above problems, an information processing apparatus according to the present invention includes a receiving unit that receives voice data transmitted from a first terminal or a second terminal, a text conversion unit that converts the voice data received by the receiving unit into text data, and a transmitting unit that transmits the text data converted by the conversion unit to the second terminal or the first terminal.

Effects of the Invention

[0007] According to the present invention, it is possible to provide a more convenient information processing apparatus, information processing terminal, information processing method, and information processing program.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Mode for Carrying Out the Invention

[0009] [Embodiment] Hereinafter, the information processing system 1 according to the embodiment will be described with reference to the drawings. The information processing system 1 according to the embodiment is a so-called monitoring system. From a second terminal 4 that can be used while being carried by a person under guardianship (for example, a child), the position of the second terminal 4 is determined from data uploaded to the server 2 at a predetermined interval such as every 1.5 minutes, and the determined position is notified from the server 2 to a first terminal 3 carried or used by a guardian (for example, a family member or relative such as a parent or grandparent). Further, in the information processing system 1 according to the present embodiment, the first terminal 3 and the second terminal 4 are provided with microphones, speakers, etc., and are configured to be able to transmit and receive voice messages (hereinafter also referred to as voices) to and from each other. That is, it is configured to be able to exchange messages by voice between the guardian and the person under guardianship. Further, the first terminal 3 is provided with a display device and is configured to be able to convert voice into text and display it on the display device. In the following description, the guardian is also referred to as the first user. Also, the person under guardianship is also referred to as the second user.

[0010] As shown in FIG. 1, the information processing system 1 includes a server 2 (information processing device), and one or more first terminals 3 (information processing terminals) and second terminals 4 (information processing terminals) connected to the server 2 via a network 5. In the example shown in FIG. 1, the information processing system 1 is configured to include one server 2, one first terminal 3, and one second terminal 4 each, but the number of servers 2, first terminals 3, and second terminals 4 included in the information processing system 1 is arbitrary respectively.

[0011] (Server 2) FIGS. 2 and 3 are block diagrams of the server 2. FIG. 2 shows the main hardware configuration of the server 2, and the server 2 includes a communication IF 200A, a storage device 200B (storage unit), a CPU 200C, etc. Although not shown in FIG. 2, the server 2 may be provided with an input device (for example, a mouse, a keyboard, a touch panel, etc.) and a display device (CRT (Cathode Ray Tube), a liquid crystal display, an organic EL display, etc.).

[0012] The communication IF 200A is an interface for communicating with other devices (e.g., the first terminal 3, the second terminal 4, etc.).

[0013] The storage device 200B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD (Solid State Drive)). Various data and information processing programs are stored in the storage device 200B. Note that part or all of the various data stored in the storage device 200B may be stored in an external storage device such as a USB (Universal Serial Bus) memory or an external HDD, or in the storage device of another information processing device connected via the network 5. In this case, the server 2 refers to or acquires the various data stored in the external storage device or the storage device of another information processing device.

[0014] The storage device 200B stores the account information of the first terminal 3, for example, the identification number (terminal ID) of the first terminal 3, name, contact information (email address, phone number), and the identification number (terminal ID) of the second terminal 4 held by the second user (e.g., one's own child). Also, the storage device 200B stores the account information of the second terminal 4, for example, the terminal ID of the second terminal 4, name, and the terminal ID of the first terminal 3 held by the first user (e.g., family members such as one's own parents or grandparents). Also, the storage device 200B stores various data (including metadata added to the data) transmitted and received by the first terminal 3 and the second terminal 4 as a log, associated with the terminal ID together with the date and time data. Note that the various data may be stored as a log, associated with the account ID together with the date and time data. Here, the above various data includes, for example, the following data. (1) Data for specifying a location (e.g., location information transmitted from the second terminal 4, etc.) (2) Audio data (including audio data converted from text data) (3) Text data (including that converted from audio data) In addition, the above various types of data include metadata such as the acquisition date and time (which may be the recording date and time or the conversion date and time), the transmission date and time, the reception date and time, the terminal ID of the first terminal or the second terminal that transmitted the data, and the terminal ID of the first terminal or the second terminal that received the data. Data for specifying a position is also referred to as position information.

[0015] The CPU 200C controls the server 2 according to this embodiment and includes a ROM, a RAM, etc. (not shown).

[0016] FIG. 3 is a functional block diagram of the server 2. As shown in FIG. 3, the server 2 includes functions such as a reception unit 201, a transmission unit 202, a storage device control unit 203 (association unit), a text conversion unit 204, an audio conversion unit 205, a file format conversion unit 206, a removal unit 207, a volume adjustment unit 208, and an extraction unit 209. The functions shown in FIG. 3 are realized by the CPU 200C executing an information processing program stored in the storage device 200B.

[0017] The reception unit 201 receives data (including metadata) transmitted from the first terminal 3 and the second terminal 4. The data received by the reception unit 201 includes, for example, data for specifying a position, audio data, text data, etc. The data described above is an example and does not prevent the reception unit 201 from receiving other data.

[0018] The transmission unit 202 transmits data (including metadata) to the first terminal 3 and the second terminal 4. The data transmitted by the transmission unit 202 includes, for example, data for specifying a position, audio data, text data, etc. The data described above is an example and does not prevent the transmission unit 202 from transmitting other data.

[0019] The storage device control unit 203 stores the data (including metadata) transmitted and received by the first terminal 3 and the second terminal 4 in the storage device 200B in association with the terminal ID of the terminal that transmitted and received the data. In addition, the storage device control unit 203 stores various types of data in the storage device 200B in association with the terminal ID.

[0020] The text conversion unit 204 converts the voice data received by the reception unit 201 into text data. Thereby, it is possible to check the message in text in a situation where it is not preferable to play the voice data, for example, inside public transportation such as trains and buses, inside public facilities such as libraries, etc., and the convenience is high.

[0021] The voice conversion unit 205 converts the text data received by the reception unit 201 into voice data. Thereby, it is possible to check the message by voice in a situation where it is not preferable to visually recognize the text data, for example, during driving of a vehicle (including a bicycle), walking, running, other than during exercise, cooking, etc., and the convenience is high. Also, even when the second terminal 4 does not include a display device or the display device cannot display text, it is possible to check the message by voice and the convenience is high.

[0022] The file format conversion unit 206 converts the file format of the voice data. For example, the file format conversion unit 206 converts the file format of the voice data according to the storage capacity of the storage device or the speaker included in the second terminal 4. For example, the file format conversion unit 206 compresses the file so that the amount of data is reduced. As a result, the amount of data when transmitting the voice data to the second terminal 4 can be reduced, and the communication fee can be reduced. In addition, the storage capacity of the storage device included in the second terminal 4 can be reduced, and the cost of the second terminal 4 can be reduced. Further, the storage device 200B stores data associating the type of the second terminal 4 with the terminal ID, and data associating the file format with the type. The file format conversion unit 206 may be configured to identify the type of the second terminal 4 from the terminal ID and convert the voice data into the file format associated with the identified type. In addition, the file format conversion unit 206 may convert the file format of the voice data according to the storage capacity of the storage device or the speaker included in the first terminal 3. As a result, the amount of data when transmitting the voice data to the first terminal 3 can be reduced, and the communication fee can be reduced. In addition, the storage capacity of the storage device included in the first terminal 3 can be reduced. Note that the storage device 200B stores data associating the type of the first terminal 3 with the terminal ID, and data associating the file format with the type. The file format conversion unit 206 may be configured to identify the type of the first terminal 3 from the terminal ID and convert the voice data into the file format associated with the identified type.

[0023] The removing unit 207 processes the audio data to remove or reduce data in a band outside the audible range, outside the voice band, or that becomes noise in the audio data, or to emphasize only the voice band. Thereby, the data volume when transmitting the audio data to the second terminal 4 can be reduced, and the communication fee can be reduced. Note that the removing unit 207 may process the audio data to remove or reduce data in a band outside the audible range, outside the voice band, or that becomes noise in the audio data to be transmitted to the second terminal 4, or to emphasize only the voice band. Thereby, the data volume when transmitting the audio data to the second terminal 4 can be reduced, and the communication fee can be reduced.

[0024] The volume adjustment unit 208 adjusts the playback volume when the audio data is played back on the second terminal 4. Thereby, the audio data can be played back according to the grade of the audio output device such as the speaker provided in the second terminal 4, and voice breakage or the like can be suppressed. Note that the storage device 200B stores data associating the type of the second terminal 4 with the terminal ID, and data associating the playback volume with the type. The volume adjustment unit 208 may be configured to specify the type of the second terminal 4 from the terminal ID and adjust the volume of the audio data to the playback volume associated with the specified type. Note that the volume adjustment unit 208 may adjust the playback volume when the audio data is played back on the first terminal 3. Thereby, the audio data can be played back according to the grade of the audio output device such as the speaker provided in the first terminal 3. Note that the storage device 200B stores data associating the type of the first terminal 3 with the terminal ID, and data associating the playback volume with the type. The volume adjustment unit 208 may be configured to specify the type of the first terminal 3 from the terminal ID and adjust the volume of the audio data to the playback volume associated with the specified type.

[0025] The extraction unit 209 extracts data from the storage device 200B based on the sorting condition. For example, the extraction unit 209 extracts the data specified by the sorting condition. In addition, the extraction unit 209 extracts data associated with the history of the position information (via the terminal ID), for example, audio data.

[0026] (The first terminal 3) The first terminal 3 is a terminal owned by the first user. For example, the first terminal 3 is a smartphone or the like installed with application software for functioning as a terminal equipped with each function shown in this embodiment. The first user can communicate with the second user (for example, their own child) by voice and text by transmitting and receiving voice data and text data to and from the second terminal 4 registered using the first terminal 3. FIG. 4 shows the main hardware configuration of the first terminal 3, and includes a communication IF 300A, a storage device 300B, an input device 300C, a display device 300D, a CPU 300E, a microphone 300F, a speaker 300G, and the like.

[0027] The communication IF 300A is an interface for communicating with other devices (in this embodiment, the server 2).

[0028] The storage device 300B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD (Solid State Drive)). The storage device 300B stores a terminal ID, an information processing program (application software), and the like. The terminal ID is a number for identifying the first terminal 3. By attaching the terminal ID to the data transmitted from the first terminal 3, the server 2 can determine from which first terminal 3 the received data was transmitted. Note that the terminal ID may use an IP (Internet Protocol) address, a MAC (Media Access Control) address, or the like, or may be assigned to the first terminal 3 by the server 2. In addition, the storage device 300B may store data transmitted and received between the first terminal 3 and the second terminal 4. The storage device 300B may store, for example, transmitted and received data (for example, voice data and text data) in association with each other.

[0029] The input device 300C is an input device such as a keyboard, a mouse, or a touch panel, but may be other devices or apparatuses as long as input is possible. It may also be a voice input device.

[0030] The display device 300D is, for example, a liquid crystal display, a plasma display, an organic EL display, etc., but may be other devices or apparatuses (e.g., CRT: Cathode Ray Tube) as long as display is possible.

[0031] The CPU 300E controls the first terminal 3 according to the present embodiment and includes a ROM and a RAM (not shown).

[0032] The microphone 300F is an acoustic device that converts sound into an electrical signal. A user of the first terminal 3 can input voice using the microphone 300F. The input voice is transmitted to the server 2 by a transmission unit 302 described later.

[0033] The speaker 300G is an acoustic device that converts an electrical signal into sound. The speaker 300G reproduces voice data transmitted from the second terminal 4 via the server 2 and stored in the storage device 300B, for example.

[0034] Note that, similar to the second terminal 4 described later, the first terminal 3 may be provided with a position sensor that specifies the current position based on a signal from a GNSS satellite, and outputs the current position specified by the position sensor. Note that it is sufficient if the position of the first terminal 3 can be specified, and the current position may be output by a method other than the position sensor. Examples of methods other than the position sensor include using wireless access point information, using mobile network tower information, and using an acceleration sensor and a magnetic sensor to utilize the movement amount and the traveling direction of the first terminal 3. Of course, methods other than those exemplified may also be used.

[0035] FIG. 5 shows a functional block diagram of the first terminal 3. The first terminal 3 has functions such as a receiving unit 301, a transmitting unit 302, a storage device control unit 303, an input receiving unit 304 (receiving unit), a display device control unit 305 (display control unit), and an audio output control unit 306. The functions shown in FIG. 5 are realized by the CPU 300E executing an information processing program stored in the storage device 300B.

[0036] The receiving unit 301 receives, for example, data transmitted from the server 2.

[0037] The transmitting unit 302 transmits data to the server 2, for example, in response to an input operation received by the input receiving unit 304.

[0038] The storage device control unit 303 controls the storage device 300B. The storage device control unit 303 stores, for example, data transmitted and received by the first terminal 3 and the second terminal 4 in the storage device 300B in association with the terminal ID from which the data was transmitted and received. Also, the storage device control unit 303 stores, for example, transmitted and received audio data and text data in the storage device 300B.

[0039] The input receiving unit 304 receives an input operation from the input device 300C. The input receiving unit 304 receives, for example, the input of a message.

[0040] The display device control unit 305 controls the display device 300D and displays data received by the receiving unit 301 on the display device 300D. The display device control unit 305 functions as a notification control unit, for example, and has a PUSH notification function that causes the display device 300D to display that audio data has been received when the receiving unit 301 receives audio data.

[0041] The voice output control unit 306 controls the speaker 300G. The speaker 300G outputs voice based on the control of the voice output control unit 306. The voice output control unit 406 functions as, for example, a notification control unit, and notifies that voice data has been received by causing at least a part of the voice data to be reproduced by the receiving unit 301. Note that the voice output control unit 406 may notify that voice has been received by generating a sound in a predetermined pattern when the receiving unit 301 receives voice data.

[0042] (Second terminal 4) The second terminal 4 is a terminal used by the second user of the present information processing system 1. The second user can communicate with the first user (for example, their family) by voice by transmitting and receiving voice data and text data to and from the first terminal 3 registered using the second terminal 4. FIG. 6 shows the main hardware configuration of the second terminal 4. The second terminal 4 includes a communication IF 400A, a storage device 400B, an input device 400C, a display device 400D, a CPU 400E, a microphone 400F, a speaker 400G, a position sensor 400H, and the like.

[0043] The communication IF 400A is an interface for communicating with other devices (in this embodiment, the server 2).

[0044] The storage device 400B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD (Solid State Drive)). The storage device 400B stores a terminal ID, an information processing program, voice data transmitted from the first terminal 3, and the like. The terminal ID is a number for identifying the second terminal 4. By attaching the terminal ID to the data transmitted from the second terminal 4, the server 2 can determine from which second terminal 4 the received data was transmitted. Note that the terminal ID may use an IP (Internet Protocol) address, a MAC (Media Access Control) address, or the like, or may be assigned by the server 2 to the second terminal 4. Further, the storage device 400B may store the transmitted and received data (e.g., audio data).

[0045] The input device 400C is an input device such as an operation button, for example. However, as long as input is possible, it may be other devices or apparatuses, such as a keyboard, a mouse, a touch panel, etc. Further, it may be a voice input device. The second user can operate the input device 400C to input voice and transmit it to the server 2, or play back the voice data transmitted from the server 2.

[0046] The display device 400D is, for example, an LED. The display device 400D notifies that voice has been received by lighting or flashing in a predetermined pattern.

[0047] The CPU 400E controls the second terminal 4 according to the present embodiment and includes a ROM and a RAM (not shown).

[0048] The microphone 400F is an acoustic device that converts sound into an electrical signal. The user of the second terminal 4 can input voice using the microphone 400F. The input voice is transmitted to the server 2 by a transmission unit 402 described later.

[0049] The speaker 400G is an acoustic device that converts an electrical signal into sound. The speaker 400G plays back the voice data transmitted from the first terminal 3 via the server 2 and stored in the storage device 400B, for example. Further, the speaker 400G notifies that voice has been received by generating sound in a predetermined pattern.

[0050] The position sensor 400H identifies the current position based on signals from GNSS satellites. Further, the position sensor 400H outputs the identified current position. Note that as long as the position of the second terminal 4 can be identified, the current position may be output by a method other than the position sensor 400H. As methods other than the position sensor 400H, for example, using wireless access point information, using mobile network tower information, using an acceleration sensor and a magnetic sensor to utilize the movement amount and the traveling direction of the second terminal 4, etc. can be considered. Of course, methods other than those exemplified may also be used.

[0051] FIG. 7 shows a functional block diagram of the second terminal 4. The second terminal 4 has functions such as a receiving unit 401, a transmitting unit 402, a storage device control unit 403, an input reception unit 404, a display device control unit 405 (display control unit), and an audio output control unit 406. Note that the functions shown in FIG. 7 are realized by the CPU 400E executing an information processing program stored in the storage device 400B.

[0052] The receiving unit 401 receives, for example, data transmitted from the server 2, such as audio data.

[0053] The transmitting unit 402 transmits, for example, data, such as audio data, to the server 2 in response to an input operation received by the input reception unit 304.

[0054] The storage device control unit 403 controls the storage device 400B. The storage device control unit 403 controls, for example, the storage device 400B to write and read data. The storage device control unit 403 stores, for example, the data received by the receiving unit 401 in the storage device 400B.

[0055] The input reception unit 404 receives an input operation from the input device 400C. The input reception unit 404 receives, for example, a reproduction operation of audio data stored in the storage device 400B.

[0056] The display device control unit 405 controls the display device 400D. For example, the display device control unit 405 functions as a notification control unit. When the receiving unit 401 receives voice data, the display device 400D (LED) is turned on or blinked in a predetermined pattern.

[0057] The voice output control unit 406 controls the speaker 400G. The speaker 400G outputs voice based on the control of the voice output control unit 406. For example, the voice output control unit 406 functions as a notification control unit. When the receiving unit 401 receives voice data, it notifies the reception of the voice data by generating a sound in a predetermined pattern. Note that the voice output control unit 406 may notify the reception of the voice data by reproducing at least a part of the voice data by the receiving unit 401.

[0058] (Display screen) FIGS. 8 to 11 are diagrams showing an example of the screen G1 displayed on the display device 300D of the first terminal 3. Hereinafter, an example of the screen G1 displayed on the display device 300D of the first terminal 3 will be described with reference to FIGS. 8 to 11. Note that the same components as those described with reference to FIGS. 1 to 7 are denoted by the same reference numerals and redundant descriptions are omitted.

[0059] (Explanation of the screen in FIG. 8) As shown in FIG. 8, text data obtained by converting voice data transmitted and received between the first terminal 3 and the second terminal 4 into characters is displayed in chronological order in units of voice data files on the display device 300D (hereinafter, also referred to as timeline display).

[0060] In the example shown in FIG. 8, the name 11 of the second user (which may be a handle name) is displayed at the upper part of the screen G1. Also, on the left side of the screen G1, the text data 12B obtained by converting the voice data (voice file of the second user) transmitted from the second terminal 4, the date and time 12D when it was transmitted (using the timestamp information), and the icon 12A are displayed together. Also, when the play button 12C is selected, the voice data (voice file) corresponding to the displayed text data 12B is played and the voice can be listened to. On the right side of the screen G1, the text data 13A obtained by converting the voice data (voice file of the first user) transmitted from the first terminal 3 and the date and time 13C when it was transmitted (using the timestamp information) are displayed together. Also, for each text data transmitted from the first terminal 3, a status 13D (for example, whether the voice data was played on the second terminal 4 or not) is also noted. Also, when the play button 13B is selected, the voice data (voice file) corresponding to the displayed text data 13A is played and the voice can be listened to.

[0061] Note that in the example shown in FIG. 8, the text data obtained by converting the voice data is displayed in chronological order in file units of the voice data, but a configuration may be adopted in which the text data 12B obtained by converting the voice data is not displayed. In this case, for example, the playback time of the voice data may be displayed instead of the text data 12B, but it is not necessarily limited to this example. Also, in the example shown in FIG. 8, all the characters obtained by converting the voice data are displayed on the display screen, but it is not necessarily necessary to display all the characters. For example, the first several characters (for example, 10 characters) may be displayed.

[0062] (Description of the screen in FIG. 9) The screen G2 shown in FIG. 9 is a screen that transitions when the icon 15 described with reference to FIG. 8 is selected (tapped). As shown in FIG. 9, when the icon 15 is selected in FIG. 8, a display frame 16 for sending a message to the second terminal 4 appears so as to rise from the lower side of the screen G2. The first user can operate an input device 300C such as a touch panel to select the microphone icon 16A displayed within the display frame 16 of the screen G2, thereby recording a voice and sending it to the second terminal 4. When the microphone icon 16A is selected, the display form of the microphone icon 16A (for example, the color of the icon) changes, indicating that recording has started. When the first user finishes speaking a message (for example, "I'm coming to pick you up now") and reselects the microphone icon 16A again, the display form of the microphone icon 16A (for example, the color of the icon) returns to its original state, indicating that recording has ended. Also, a plurality of messages 16B preset in the storage device 300B, messages 16B input by the first user, messages 16B downloaded from the server 2, etc. are displayed below the microphone icon 16A. The first user can operate an input device 300C such as a touch panel to select any one of the plurality of displayed messages 16B, and thereby send the selected message 16B to the second terminal 4.

[0063] In addition, the message 16B displayed on the screen G2 of FIG. 9 is preferably displayed in the order according to the message usage frequency by the first user or the settings by the first user. For example, when displayed according to the usage frequency, it is preferable that the messages are displayed in descending order of usage frequency. Also, the message 16B displayed on the screen G2 of FIG. 9 may be displayed in the order according to the settings by the first user. In this case, similar to the description in FIG. 10 to be described later, the first user may be able to operate the input device 300C to manually rearrange and set the display order of the messages 16B. Also, it may be set such that the preset messages 16B are displayed in descending order of usage frequency, or it may be set such that the messages 16B input by the first user are displayed in descending order of usage frequency. When displaying in descending order of usage frequency, it is preferable to calculate the usage frequency of the messages in consideration of the variation in the message notation (for example, the similarity of the messages).

[0064] (Description of the screen in FIG. 10) Note that the messages input by the first user include the voice messages blown in by the first user using the microphone 300F as described above, and the text messages input by the first user by operating the input device 300C in text. Here, the voice messages are transcribed (textualized) and displayed as the titles of the voice files. FIG. 10 shows an example of a screen G3 in which a voice message is transcribed (textualized) and displayed as the title of a voice file. As illustrated in FIG. 10, on the screen G3, the message of the voice file obtained by transcribing (textualizing) the voice message is displayed as a title 16B. Also, the first terminal 3 accesses the server 2, queries the purchase information of the first user in a stamp store described later, and if there is a purchase history, the voice stamp and the title of the voice stamp described later are also displayed on the screen G3. Note that the title of the voice stamp may be displayed in a different manner (for example, changing the font or adding a symbol such as a star mark before the title) from the message input by the first user. By operating an input device 300C such as a touch panel, the first user selects the voice stamp store 17A on the screen G3, thereby transitioning to a stamp store screen (not shown) or causing the stamp store to appear, and the first user can purchase or download for free a voice stamp (voice file) different from the voice message input by the first user. For example, when performing a purchase procedure for a voice stamp on the stamp store screen, the server 2 records the purchase information of the first user and can use the voice file corresponding to the purchased voice stamp (for example, a voice file of a message dubbed by a voice actor, an actor, an idol, etc., or a voice file of a message by a voice synthesis engine such as Vocaloid (registered trademark)) stored in the server 2. Also, the first user can change the display order of the title 16B by operating an input device 300C such as a touch panel to select (long-press or tap operation, etc.) a swap button 17B arranged on the left side of the title 16B. Also, the first user can edit the volume level, playback speed, pitch, playback start time, playback end time, etc. of the voice file that is the source of the title 16B by operating an input device 300C such as a touch panel to select (long-press or tap operation, etc.) an edit button 17C arranged on the right side of the title 16B. However, when the voice file is a voice stamp, the edit button 17C may not be displayed. Also, the first user can play (preview) the audio file that is the source of title 16B by operating an input device 300C such as a touch panel to select (long-press or tap, etc.) the play button 17D arranged on the right side of title 16B. Also, the first user can re-record the audio file that is the source of title 16B by operating an input device 300C such as a touch panel to select (long-press or tap, etc.) the recording button 17E arranged on the right side of title 16B. Note that the title 16B of the audio file may be set to be displayed in the order of decreasing usage frequency. When displaying in the order of decreasing usage frequency, it is preferable to calculate the usage frequency of the message in consideration of variations in the message notation (e.g., message similarity, etc.).

[0065] (Description of the screen in FIG. 11) As shown in FIG. 11, in this embodiment, on the display device 300D of the first terminal 3, the history of the position P of the second terminal 4 can be superimposed on a map and displayed. Also, the current time T and the user name U of the second terminal 4 are displayed at the upper part of the display screen 300D. Further, a calendar C and a slider S are displayed at the lower part of the display screen 300D. The first user can display the history of the position P of the second terminal 4 on the selected date by clicking on the calendar C to select a date. Also, the first user can enlarge or reduce the display of the map by moving the slider S to the left or right. Note that if there is data associated with the position P, for example, audio data, a balloon F is displayed at the corresponding position P, indicating that there is associated data (e.g., audio data). Also, in this embodiment, the status of the associated data (such as whether it has been confirmed or not) is shown. For example, if the associated data is audio data, it becomes "read" if the audio data has been played on the first terminal 3. In this way, not only the history of positions but also what information is associated with which position can be confirmed, which is highly convenient.

[0066] Note that the second terminal 4 may be provided with a display device such as a liquid crystal display, a plasma display, an organic EL display, etc., and configured to be able to display the screens illustrated in FIGS. 8 to 11 on the first terminal 3. In this case, the relationship between the first terminal 3 and the second terminal 4 is reversed in the screens illustrated in FIGS. 8 to 11.

[0067] (Information Processing) FIGS. 12 to 17 are flowcharts showing an example of the information processing of the information processing system 1. Hereinafter, with reference to FIGS. 12 to 17, the information processing of the information processing system 1 will be described. Note that the same components as those described with reference to FIGS. 1 to 11 are denoted by the same reference numerals and redundant descriptions are omitted.

[0068] (Position Information Transmission Processing) FIG. 12 is a flowchart showing an example of the position information transmission processing of the information processing system 1. Hereinafter, with reference to FIG. 12, an example of the position information transmission processing of the information processing system 1 will be described.

[0069] (Step S101) The transmission unit 402 of the second terminal 4 determines whether a predetermined interval (for example, every 1.5 minutes) has elapsed. If the predetermined interval has elapsed (YES), the server 2 executes the process of step S102. If the predetermined interval has not elapsed (NO), the server 2 ends the process.

[0070] (Step S102) The transmission unit 402 of the second terminal 4 transmits the position information output from the position sensor 400H to the server 2. Note that data such as the terminal ID of the second terminal 4 and a timestamp (transmission date and time, positioning date and time of the position information) are attached to the data transmitted from the second terminal 4.

[0071] (Step S103) The reception unit 201 of the server 2 receives the position information transmitted from the second terminal 4.

[0072] (Step S104) The storage device control unit 203 of server 2 stores the location information (including metadata) transmitted and received by the second terminal 4 in the storage device 200B in association with the terminal ID of the terminal that transmitted and received the data.

[0073] (Message transmission process 1) FIG. 13 is a flowchart showing an example of the message transmission process 1 of the information processing system 1. Hereinafter, an example of the message transmission process 1 of the information processing system 1 will be described with reference to FIG. 13. Note that FIG. 13 describes the case of transmitting a message from the first terminal 3 to the second terminal 4.

[0074] (Step S201) The first user operates the input device 400C of the first terminal 3 to input a message in voice or text.

[0075] (Step S202) When voice is input, it is converted into an electrical signal by the microphone 400F, converted into digital data by an A / D converter (not shown), and then transmitted from the transmission unit 302 to the server 2 as voice data. When text is input, it is transmitted from the transmission unit 302 to the server 2 as text data. Note that the data transmitted from the first terminal 3 is provided with data such as the terminal ID and timestamp of the first terminal 3.

[0076] (Step S203) The receiving unit 201 of server 2 receives the data transmitted from the first terminal 3. The voice conversion unit 205 of server 2 determines whether the receiving unit 201 has received voice data. If voice data is received (YES), server 2 executes the process of step S205. If voice data has not been received (NO), server 2 executes the process of step S204.

[0077] (Step S204) The voice conversion unit 205 of server 2 converts the received text data into voice data. When converting the received text data into voice, it is also possible to convert the original language into another language by a language conversion unit (not shown) and generate voice data that can play all voices converted from the original language to one or more other languages. In that case, it should be set in advance by the first terminal 3.

[0078] (Step S205) When the storage device control unit 203 of server 2 receives voice data, it stores the voice data transmitted by the first terminal 3 in the storage device 200B in association with the terminal ID of the terminal that sent and received the data. Also, when the storage device control unit 203 receives text data, it stores the text data transmitted by the first terminal 3 and the voice data converted from this text data in the storage device 200B in association with the terminal ID of the terminal that sent and received the data.

[0079] (Step S206) Server 2 executes voice data conversion processing. The details of the voice data conversion processing will be described later with reference to FIG. 15.

[0080] (Step S207) The transmission unit 202 of server 2 refers to the storage device 200B, identifies the terminal ID of the second terminal 4 associated with the terminal ID given to the voice data received by the reception unit 201, and transmits the voice data transmitted from the first terminal 3 or the voice data converted by the voice conversion unit 205 to the identified second terminal 4.

[0081] (Step S208) The reception unit 401 of the second terminal 4 receives the voice data transmitted from server 2. The second terminal 4 notifies that a message has been received. This notification may be, for example, that the display device control unit 405 controls the display device 400D to notify that a message has been received by, for example, lighting an LED or making a sound, or that the voice output control unit 406 controls the speaker 400G to output a sound or voice to notify that a message has been received.

[0082] (Message transmission process 2) FIG. 14 is a flowchart showing an example of the message transmission process 2 of the information processing system 1. Hereinafter, an example of the message transmission process 2 of the information processing system 1 will be described with reference to FIG. 14. Note that FIG. 14 illustrates the case where a message is transmitted from the second terminal 4 to the first terminal 3.

[0083] (Step S301) The second user operates the input device 400C of the second terminal 4 to input voice. The input voice is converted into an electrical signal by the microphone 400F.

[0084] (Step S302) The transmission unit 402 of the second terminal 4 transmits the input voice data to the server 2. Note that data such as the terminal ID and timestamp of the second terminal 4 are attached to the data transmitted from the second terminal 4.

[0085] (Step S303) The reception unit 201 of the server 2 receives the voice data transmitted from the second terminal 4.

[0086] (Step S304) The text conversion unit 204 of the server 2 converts the received voice data into text data. Note that when converting the received voice data into text data, text data obtained by changing the original language to another language by a language conversion unit (not shown), or text data that can simultaneously display all the texts changed from the original language to one or more other languages can also be used. In that case, it should be set in advance by the first terminal 3.

[0087] (Step S305) The storage device control unit 203 of the server 2 stores the voice data transmitted by the second terminal 4 and the text data converted by the text conversion unit 204 in the storage device 200B in association with the terminal ID from which the data was transmitted and received.

[0088] (Step S306) The transmission unit 202 of the server 2 refers to the storage device 200B, identifies the terminal ID of the first terminal 3 associated with the terminal ID assigned to the voice data received by the reception unit 201, and transmits the voice data transmitted from the second terminal 4 and the text data converted by the text conversion unit 204 to the identified first terminal 3.

[0089] (Step S307) The reception unit 301 of the first terminal 3 receives the voice data and text data transmitted from the server 2.

[0090] (Step S308) The reception unit 301 of the first terminal 3 receives the voice data and text data transmitted from the server 2. The first terminal 3 notifies that a message has been received. This notification may be, for example, that the display device control unit 305 controls the display device 300D to notify that a message has been received by, for example, a PUSH notification, or that the voice output control unit 306 controls the speaker 300G to output a sound or voice to notify that a message has been received.

[0091] (Voice data conversion process) FIG. 15 is a flowchart showing an example of the voice data conversion process of the information processing system 1. Hereinafter, an example of the voice data conversion process of the information processing system 1 will be described with reference to FIG. 15.

[0092] (Step S401) The removal unit 207 of the server 2 processes the voice data by removing or reducing the data in the frequency band outside the audible range, outside the voice band, or the noise in the voice data received by the reception unit 201, or emphasizing only the voice band.

[0093] (Step S402) The volume adjustment unit 208 of the server 2 adjusts the playback volume when the voice data is played back on the second terminal 4.

[0094] (Step S403) The file format conversion unit 206 of the server 2 converts the file format of the voice data.

[0095] Note that each step of the voice data conversion process described with reference to FIG. 15 does not necessarily need to be processed in the order of steps S401 to S403. The order may be changed, or any one or more of steps S401 to S403 may be processed in an arbitrary order.

[0096] Note that, as described above, when transmitting voice data from the second terminal 4 to the first terminal 3, the voice data conversion process described with reference to FIG. 15 may be executed.

[0097] (TL display process) FIG. 16 is a flowchart showing an example of the TL display process of the information processing system 1. Hereinafter, an example of the TL display process of the information processing system 1 will be described with reference to FIG. 16.

[0098] (Step S501) The first user operates the input device 300C of the first terminal 3 to input the sorting condition of the data to be displayed. The input reception unit 304 of the first terminal 3 receives the input sorting condition, and the transmission unit 302 transmits the sorting condition received by the input reception unit 304 to the server 2. The reception unit 201 of the server 2 receives the sorting condition transmitted from the first terminal 3.

[0099] (Step S502) The extraction unit 209 of the server 2 extracts data from the storage device 200B based on the sorting condition. For example, the extraction unit 209 extracts the data specified by the sorting condition (for example, the history of position information and voice data, etc.).

[0100] (Step S503) The transmission unit 202 of the server 2 refers to the storage device 200B, identifies the terminal ID of the first terminal 3 associated with the terminal ID assigned to the data received by the reception unit 201, and transmits the data extracted by the extraction unit 209 to the identified first terminal 3. The reception unit 301 of the first terminal 3 receives the data transmitted from the server 2. The display device control unit 305 of the first terminal 3 causes the display device 300D to display the data received by the reception unit 301.

[0101] Note that, as described above, the second terminal 4 may be provided with a display device such as a liquid crystal display, a plasma display, an organic EL display, etc., and may execute the TL display process described with reference to FIG. 16.

[0102] (Map display process) FIG. 17 is a flowchart showing an example of the map display process of the information processing system 1. Hereinafter, with reference to FIG. 17, an example of the map display process of the information processing system 1 will be described.

[0103] (Step S601) The first user operates the input device 300C of the first terminal 3 to instruct map display. The input reception unit 304 of the first terminal 3 receives the instruction for map display. The transmission unit 302 of the first terminal 3 transmits the instruction for map display to the server 2. The reception unit 201 of the server 2 receives the instruction for map display transmitted from the first terminal 3.

[0104] (Step S602) The extraction unit 209 of the server 2 refers to the storage device 200B, identifies the terminal ID of the second terminal 4 associated with the terminal ID assigned to the instruction for map display, and extracts the history of the position information of the identified second terminal 4.

[0105] (Step S603) In addition, the extraction unit 209 of the server 2 extracts data associated (via the terminal ID) with the history of the position information, for example, voice data.

[0106] (Step S604) The transmission unit 202 of the server 2 refers to the storage device 200B, identifies the terminal ID of the first terminal 3 associated with the terminal ID assigned to the data received by the reception unit 201, and transmits to the identified first terminal 3 the history of the location information extracted by the extraction unit 209 and the data associated with the history of the location information, for example, audio data.

[0107] (Step S605) The reception unit 301 of the first terminal 3 receives the history of the location information transmitted from the server 2 and the data associated with the history of the location information.

[0108] (Step S606) The display device control unit 305 of the first terminal 3 causes the display device 300D to display the history of the location information received by the reception unit 301 on a map (see, for example, FIG. 11). Further, the display device control unit 305 of the first terminal 3 causes the display device 300D to display the presence of data associated with the history on or near the location information displayed on the map.

[0109] In the map display process illustrated in FIG. 17, the server 2 transmits the extracted history of the location information and the audio data associated with the history of the location information (via the terminal ID) to the first terminal 3. However, the server 2 may transmit to the first terminal 3 the data indicating the existence of the extracted history of the location information and the audio data associated with the history of the location information (via the terminal ID) (for example, flag information, etc.), and when the user instructs the reproduction of the audio data, the instructed audio data is downloaded from the server 2 and reproduced.

[0110] As described above, the second terminal 4 may be provided with a display device such as a liquid crystal display, a plasma display, an organic EL display, etc., and execute the map display process described with reference to FIG. 17.

[0111] According to the information processing system 1 according to this embodiment, it is possible to convert voice data into text data and transmit or receive it, or to convert text data into voice data and transmit or receive it. Therefore, either one (or both) of the first user and the second user can be a user who has difficulty in text input or voice input (for example, a child or an elderly person who has difficulty in complex operations of a terminal, a user who has a voice function disorder, etc.), a terminal that has difficulty in text input or voice input (for example, a small device that is difficult to attach a keyboard, or a case where it is difficult to attach a display, etc. due to cost constraints), a scene where text input is difficult because the hands are occupied, or a scene where voice recording or playback is difficult in a public space, etc. In various attributes of users, terminals, and scenes, communication between the two (the first user and the second user) becomes possible.

[0112] [Modification Example of Embodiment] In addition, in the above embodiment, the LED provided in the display device 400D of the second terminal 4 may be configured to be able to display text. Also, a liquid crystal panel or an organic EL panel may be adopted as the display device 400D of the second terminal 4 and configured to be able to display text. By configuring in this way, it is possible to convert the voice data transmitted from the first terminal 3 or the server 2 into text data and confirm it in text. Also, it is possible to confirm the text data transmitted from the first terminal 3 or the server 2.

[0113] In the above embodiment, at least one of the first terminal 3 and the second terminal 4 may have some or all of the functions of the server 2 shown in FIG. 3. For example, at least one or more of the functions of the storage device control unit 203 (association unit), text conversion unit 204, voice conversion unit 205, file format conversion unit 206, removal unit 207, and volume adjustment unit 208 of the server 2 shown in FIG. 3 may be provided in at least one of the first terminal 3 and the second terminal 4. In this case, at least one of the first terminal 3 and the second terminal 4 may acquire or refer to the information stored in the storage device 200B, or the information stored in the storage device 200B may be stored in at least one of the storage devices 300B and 400B. In the above embodiment, at least one or more of the functions of the first terminal 3 may be provided in the second terminal 4, or at least one or more of the functions of the second terminal 4 may be provided in the first terminal 3.

[0114] Also, the screen G1 described with reference to FIG. 8 may be the screen G4 shown in FIG. 18. In the screen G4 shown in FIG. 18, an input frame 18A for inputting a text message and a microphone icon 18B for inputting a voice message are provided, and the first user can select whether to input a message in text or voice. In the input text message, it is also possible to change the sound source (voice timbre or musical instrument timbre), or specify the volume, pitch, etc. in detail using characters without sound (e.g., symbols) or combinations thereof (e.g., surrounding a character with sound with the aforementioned symbols).

[0115] Also, the screen G5 shown in FIG. 19 is a screen that transitions after an audio message or a text message is input. As shown in FIG. 19, the first user can audition and confirm a voice message or a text message input by operating an input device 300C such as a touch panel to select the icon 19A on the screen G5. Also, the first user can re-enter a voice message or a text message by operating an input device 300C such as a touch panel to select the icon 19B on the screen G5. In addition, the first user can set a notification pattern when the second user terminal 4 notifies that it has received a message from the first user terminal 3. In the example shown in FIG. 19, the first user can select a notification pattern from "Incoming call sound ON" 20A, "Incoming call sound OFF" 20B, and "Play this voice as the incoming call sound" 20C. Note that in the example shown in FIG. 19, the notification pattern is selected from three, but the notification pattern is not limited to the example shown in FIG. 19. Also, on the screen G5, it is also possible to specify the tone color and emotion when playing a voice message. When the first user selects a tone color from the tone color options 21 and an emotion from the emotion options 22, the voice message is played on the second terminal 4 of the other party who sent the voice message with the selected tone color and emotion. Note that the expression of tone color and emotion can be realized by training a human voice by machine learning of AI and performing voice synthesis.

[0116] FIGS. 20 and 21 are diagrams illustrating that voice data or text data has been received by the display device 300D by the PUSH notification function. As shown in FIG. 20, only the fact that a message has been received and the user name of the user who sent the message may be PUSH-notified. Alternatively, as shown in FIG. 21, the content of the received message (when the message is long, for example, when it has more than a predetermined number of characters, only the first predetermined number of characters of the message content may be displayed, or a summary of the content may be displayed) and the user name of the user who sent the message may be PUSH-notified. Note that in the example shown in FIG. 21, the playback method of the PUSH-notified message ("play hands-free", "play by holding to the ear", "open the app", etc.) and the response to the message (selecting and sending a pre-registered message (such as a preset message or a message registered by the user), etc.) can be executed without opening the app, which is highly convenient.

[0117] (Processing when a new voice is received before listening to the voice received by the second terminal 4) After the second terminal 4 receives the voice data transmitted from the server 2, new voice data may be transmitted from the server 2 before the second terminal 4 plays back the voice data. In that case, regarding the retention of the voice data, the second terminal 4 executes any one of the processes exemplified in the following (1) to (3), for example. The following processes are executed by the second terminal 4 due to the small storage capacity of the storage device 400B of the second terminal 4. (1) When new voice data is received, the previously received voice data is deleted from the storage device 400B. (2) The voice data is stored in a voice data buffer (for example, a predetermined area provided in the storage device 400B) that can store an arbitrary number of data or data of a storage capacity, and when the voice data buffer is about to overflow, the old data is deleted in a FIFO (first in first out) manner. (3) Store the voice data in a voice data buffer (for example, a predetermined area provided in the storage device 400B) that can store data of any number or storage capacity. When the voice data buffer is about to overflow, send buffer full information (information indicating that the second terminal 4 cannot store any more voice data) to the first terminal 3 through the server 2, and display a message on the first terminal 3 indicating that message sending is not possible. Also, when a voice data playback operation is performed on the second terminal 4, the second terminal 4 plays back the voice data stored in the buffer in the order in which it was stored or in the order of new voice data. After that, the voice data on the voice data buffer may be deleted, or voice data other than the last received voice data may be deleted, or the process of (2) above may always be performed without deletion. Note that these settings can be changed and set from the first terminal 3.

[0118] (Talk group) In the above embodiment and modification example, each of the first terminal 3 and the second terminal 4 has been described in pairs of one. However, a plurality of the first terminal 3 or / and the second terminal 4 can be used to form a single talk group. The talk group is managed by a unique ID (talk group ID) in the server 2, and further associates the identification numbers (terminal IDs) of all the first terminals 3 and the second terminals 4 belonging to the same talk group. Note that each terminal can also be set with a name so that it is easy for the users belonging to the talk group to understand. In that case, the terminal ID and the name of the terminal are also associated. Among the terminals within the same talk group, messages can be sent simultaneously, or messages can be sent to specific terminals only. For example, when sending from the first terminal 3, it can be done by selecting one or more terminals to which the message is to be sent on the text or voice message sending screen and then sending. Also, when sending a voice message from the second terminal 4, it can be done by saying the name of the terminal to which the message is to be sent during the voice message, or by pressing the button for operating to send the voice message to the second terminal 4 any number of times at any time to select the terminal to be sent, or by pressing the button for operating to send the voice message to the second terminal 4 any number of times at any time to prompt "Who do you want to send to?" from the speaker 400G of the second terminal 4. After one or more names of the terminals to be sent are input by voice from the second user, after confirming the name of the terminal of the recipient to be sent to the second user, the message to be sent to the second user is received and can be sent to the target terminal within the same talk group via the server 2.

[0119] In addition, the above embodiments and modified examples are merely examples of the implementation of the present invention, and the technical scope of the present invention should not be construed in a limited manner by these. That is, the present invention can be implemented in various forms without departing from its gist or its main features.

Explanation of Reference Numerals

[0120] 1 Information processing system 2 Server (information processing device) 200A Communication IF 200B Storage device 200C CPU 201 Receiver 202 Transmitter 203 Storage device control unit (association unit) 204 Text conversion unit 205 Voice conversion unit 206 File format conversion unit 207 Removal unit 208 Volume adjustment section 209 Extraction section 3 First terminal (information processing terminal) 300A Communication IF 300B Memory device 300C Input device 300D Display device 300E CPU 300F Microphone 300G Speaker 301 Receiver 302 Transmitter 303 Memory device control section 304 Input reception section (reception section) 305 Display device control section (display control section) 306 Audio output control section 4 Second terminal 400A Communication IF 400B Memory device 400C Input device 400D Display device (LED) 400E CPU 400F Microphone 400G Speaker 400H Position sensor 401 Receiver 402 Transmitter 403 Memory device control section 404 Input reception section 405 Display device control section (display control section) 406 Audio output control section 5 Network

Claims

1. An information processing device that communicates with a first terminal and a second terminal whose location information is monitored by the first terminal, converting at least a portion of first voice data obtained from the first terminal and transmitted to the second terminal into a first text; converting at least a portion of second voice data obtained from the second terminal and transmitted to the first terminal into second text; displaying the first text and the second text on the first terminal; An information processing method for performing the above.

2. The information processing method according to claim 1 , wherein the displaying includes displaying an object for reproducing the first voice data and an object for reproducing the second voice data.

3. The information processing device, obtaining a third text from the first terminal; converting the third text into third audio data; transmitting the third voice data to the second terminal; The information processing method according to claim 1 , further comprising the steps of:

4. The information processing device, receiving, from the first terminal, a setting of a ringtone for the first audio data or the third audio data in the second terminal before transmitting the first audio data or the third audio data; The information processing method according to claim 3 , further comprising the steps of:

5. The information processing method according to claim 1 , wherein the displaying includes displaying an object indicating whether the first audio data has been reproduced by the second terminal.

6. The information processing device, Obtaining location information from the second terminal; displaying a movement history of the second terminal based on the location information; displaying location information based on the transmission and / or reception of the first voice data and / or the second voice data together with the movement history; The information processing method according to claim 1 , further comprising the steps of:

7. The information processing device, displaying, based on position information or time information at which the first voice data is reproduced, position information based on the reproduction of the first voice data together with the movement history; The information processing method according to claim 6 , further comprising the steps of:

8. The information processing device, Obtaining location information from the second terminal; displaying a movement history of the second terminal based on the location information; If voice data is associated with any of the locations included in the movement history, displaying the presence of the voice data; and The information processing method according to claim 1 , further comprising the steps of:

9. 3. An information processing method according to claim 1 or 2, wherein the first terminal is for a watcher and the second terminal is carried by a person being watched (excluding a case where the second terminal is a smartphone).

10. An information processing device that communicates with a first terminal and a second terminal whose location information is monitored by the first terminal, a first means for converting at least a portion of first voice data acquired from the first terminal and transmitted to the second terminal into a first text; second means for converting at least a portion of second voice data acquired from the second terminal and transmitted to the first terminal into second text; a third means for displaying the first text and the second text on the first terminal; An information processing device comprising:

11. An information processing device that communicates with a first terminal and a second terminal whose location information is monitored by the first terminal, converting at least a portion of first voice data obtained from the first terminal and transmitted to the second terminal into a first text; converting at least a portion of second voice data obtained from the second terminal and transmitted to the first terminal into second text; displaying the first text and the second text on the first terminal; A program that executes the following.

12. A first terminal that monitors the location information of a second terminal, accepting an input of first voice data to be transmitted to the second terminal; obtaining a first text obtained by converting at least a portion of the first voice data into text; acquiring second voice data transmitted from the second terminal; obtaining second text obtained by converting at least a portion of the second voice data into text; displaying both the first text and the second text; A program that executes the following.

13. 13. The program according to claim 12, wherein the displaying includes displaying an object for reproducing the first audio data and an object for reproducing the second audio data.

14. The first terminal, accepting input of a third text; displaying an object for reproducing third voice data, the third voice data being transmitted to the second terminal and obtained by converting the third text into voice data; The program according to claim 12 or 13, further comprising:

15. A first terminal that monitors location information of a second terminal, accepting an input of first voice data to be transmitted to the second terminal; obtaining a first text obtained by converting at least a portion of the first voice data into text; acquiring second voice data transmitted from the second terminal; obtaining second text obtained by converting at least a portion of the second voice data into text; displaying both the first text and the second text; An information processing method for performing the above.

16. A first terminal that monitors location information of a second terminal, a first means for receiving input of first voice data to be transmitted to the second terminal; A second means for acquiring a first text obtained by converting at least a part of the first voice data into text; a third means for acquiring second voice data transmitted from the second terminal; a fourth means for acquiring a second text obtained by converting at least a part of the second voice data into text; a fifth means for displaying both the first text and the second text; An information processing device having the above configuration.

Images