Information processor, information processing terminal, information processing method and information processing program

Abstract

To provide an information processor, an information processing terminal, an information processing method and an information processing program with higher convenience.SOLUTION: An information processor includes: a reception part for receiving voice data transmitted from a first terminal or a second terminal; a text conversion part for converting the voice data which the reception part receives into text data; and a transmission part for transmitting the text data which the conversion part converts to the second terminal or the first terminal.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing terminal, an information processing method, and an information processing program that can be used in a system that transmits and receives audio data. [Background technology]

[0002] GPS devices capable of transmitting voice data have been proposed for some time for the purpose of monitoring children. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Retable 2020 / 202449 Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional GPS terminals simply present location information and voice information to users, and there is room for improvement in terms of convenience.

[0005] The present invention has been made in consideration of the above-mentioned problems, and has an object to provide a more convenient information processing device, an information processing terminal, an information processing method, and an information processing program. [Means for solving the problem]

[0006] In order to solve the above problems, the information processing device of the present invention includes a receiving unit that receives voice data transmitted from a first terminal or a second terminal, a text conversion unit that converts the voice data received by the receiving unit into text data, and a transmitting unit that transmits the text data converted by the conversion unit to the second terminal or the first terminal. Effect of the Invention

[0007] According to the present invention, it is possible to provide a more convenient information processing device, an information processing terminal, an information processing method, and an information processing program. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a layout of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a configuration of an information processing server (information processing device) according to the embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a configuration of an information processing server according to the embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a configuration of a first terminal (information processing terminal) according to an embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of a configuration of a first terminal according to an embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of a configuration of a second terminal (information processing terminal) according to the embodiment. [Figure 7] FIG. 2 is a diagram illustrating an example of a configuration of a second terminal according to the embodiment. [Figure 8] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first terminal according to the embodiment. [Figure 9] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first terminal according to the embodiment. [Figure 10] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first terminal according to the embodiment. [Figure 11] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first terminal according to the embodiment. [Figure 12] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 13] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 14] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 15]4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 16] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 17] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 18] FIG. 11 is a diagram showing an example of a screen displayed on a display device of a first terminal according to a modified example of the embodiment. [Figure 19] FIG. 11 is a diagram showing an example of a screen displayed on a display device of a first terminal according to a modified example of the embodiment. [Figure 20] FIG. 11 is a diagram showing an example of a screen displayed on a display device of a first terminal according to a modified example of the embodiment. [Figure 21] FIG. 11 is a diagram showing an example of a screen displayed on a display device of a first terminal according to a modified example of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] [Embodiment] An information processing system 1 according to an embodiment will be described below with reference to the drawings. The information processing system 1 according to the embodiment is a so-called monitoring system, in which the location of the second terminal 4 is determined from data uploaded to the server 2 at a predetermined interval, such as every 1.5 minutes, from the second terminal 4 carried by the person being watched over (for example, a child) and usable while being carried, and the determined location is notified from the server 2 to the first terminal 3 carried or used by the person being watched over (for example, a family member or relative such as a parent or grandparent). In addition, in the information processing system 1 according to the embodiment, the first terminal 3 and the second terminal 4 are provided with a microphone, a speaker, etc., and are configured to be able to send and receive voice messages (hereinafter also referred to as voice) to each other. In other words, the information processing system 1 according to the embodiment is configured to be able to exchange messages by voice between the person being watched over and the person being watched over. In addition, the first terminal 3 is provided with a display device, and is configured to convert voice into text and display it on the display device. In the following description, the person being watched over is also referred to as the first user. In addition, the person being watched over is also referred to as the second user.

[0010] 1, an information processing system 1 includes a server 2 (information processing device) and one or more first terminals 3 (information processing terminals) and second terminals 4 (information processing terminals) connected to the server 2 via a network 5. In the example shown in FIG 1, the information processing system 1 is configured to include one each of the server 2, the first terminal 3, and the second terminal 4, but the number of each of the servers 2, the first terminals 3, and the second terminals 4 included in the information processing system 1 is arbitrary.

[0011] (Server 2) 2 and 3 are configuration diagrams of the server 2. Fig. 2 shows the main hardware configuration of the server 2, and the server 2 includes a communication IF 200A, a storage device 200B (storage unit), a CPU 200C, etc. Although not shown in Fig. 2, the server 2 may also include an input device (e.g., a mouse, a keyboard, a touch panel, etc.) and a display device (CRT (Cathode Ray Tube), a liquid crystal display, an organic EL display, etc.).

[0012] The communication IF 200A is an interface for communicating with other devices (eg, the first terminal 3, the second terminal 4, etc.).

[0013] The storage device 200B is, for example, a hard disk drive (HDD) or a semiconductor storage device (solid state drive (SSD)). Various data and information processing programs are stored in the storage device 200B. Some or all of the various data stored in the storage device 200B may be stored in an external storage device such as a universal serial bus (USB) memory or an external HDD, or in a storage device of another information processing device connected via the network 5. In this case, the server 2 refers to or acquires the various data stored in the external storage device or the storage device of the other information processing device.

[0014] The memory device 200B stores account information of the first terminal 3, such as the identification number (terminal ID) of the first terminal 3, the name, contact information (email address, telephone number), and the identification number (terminal ID) of the second terminal 4 owned by a second user (e.g., one's child). The storage device 200B also stores account information of the second terminal 4, such as the terminal ID of the second terminal 4, the name, and the terminal ID of the first terminal 3 owned by the first user (e.g., a family member such as one's parents or grandparents). In addition, the storage device 200B stores various data (including metadata added to the data) transmitted and received by the first terminal 3 and the second terminal 4 as a log together with date and time data in association with the terminal ID. The various data may be stored as a log together with date and time data in association with the account ID. Here, the various data mentioned above includes, for example, the following data: (1) Data for identifying a location (e.g., location information transmitted from the second terminal 4) (2) Audio data (including audio data converted from text data) (3) Text data (including converted voice data) The various data mentioned above also include metadata such as acquisition date and time (which may be recording date and time, conversion date and time), transmission date and time, reception date and time, the terminal ID of the first or second terminal that transmitted the data, and the terminal ID of the first or second terminal that received the data. Data for identifying a location is also called location information.

[0015] The CPU 200C controls the server 2 according to this embodiment, and includes a ROM and a RAM (not shown).

[0016] Fig. 3 is a functional block diagram of the server 2. As shown in Fig. 3, the server 2 includes functions such as a receiving unit 201, a transmitting unit 202, a storage device control unit 203 (association unit), a text conversion unit 204, a voice conversion unit 205, a file format conversion unit 206, a removal unit 207, a volume adjustment unit 208, and an extraction unit 209. The functions shown in Fig. 3 are realized by the CPU 200C executing an information processing program stored in the storage device 200B.

[0017] The receiving unit 201 receives data (including metadata) transmitted from the first terminal 3 and the second terminal 4. The data received by the receiving unit 201 includes, for example, data for identifying a position, voice data, text data, etc. Note that the data described above is merely an example, and does not prevent the receiving unit 201 from receiving other data.

[0018] The transmitting unit 202 transmits data (including metadata) to the first terminal 3 and the second terminal 4. The data transmitted by the transmitting unit 202 includes, for example, data for identifying a position, voice data, text data, etc. Note that the data described above is merely an example, and does not prevent the transmitting unit 202 from transmitting other data.

[0019] The storage device control unit 203 stores data (including metadata) transmitted and received by the first terminal 3 and the second terminal 4 in the storage device 200B in association with the terminal IDs of the terminals that transmitted and received the data. The storage device control unit 203 also stores various types of data in the storage device 200B in association with the terminal IDs.

[0020] The text conversion unit 204 converts the voice data received by the receiving unit 201 into text data. This makes it convenient to check messages in text format in situations where it is not desirable to play back voice data, such as in public transportation such as trains and buses, or in public facilities such as libraries.

[0021] The voice conversion unit 205 converts the text data received by the receiving unit 201 into voice data. This makes it highly convenient to check messages by voice in situations where it is not desirable to visually check text data, such as while driving a vehicle (including a bicycle), walking, running, exercising, cooking, etc. Also, even when the second terminal 4 does not have a display device or the display device cannot display text, it is highly convenient to check messages by voice.

[0022] The file format conversion unit 206 converts the file format of the voice data. For example, the file format conversion unit 206 converts the file format of the voice data to match the storage capacity and speaker of the storage device included in the second terminal 4. For example, the file format conversion unit 206 compresses the file so as to reduce the amount of data. This reduces the amount of data when transmitting voice data to the second terminal 4, and reduces the communication fee. In addition, the storage capacity of the storage device included in the second terminal 4 can be reduced, and the cost of the second terminal 4 can be reduced. Furthermore, the storage device 200B may store data in which the type of the second terminal 4 is associated with the terminal ID, and data in which the file format and the type are associated, and the file format conversion unit 206 may be configured to identify the type of the second terminal 4 from the terminal ID and convert the voice data into the file format associated with the identified type. In addition, the file format conversion unit 206 may convert the file format of the voice data to match the storage capacity and speaker of the storage device included in the first terminal 3. This reduces the amount of data when transmitting voice data to the first terminal 3, and reduces the communication fee. It is also possible to reduce the storage capacity of the storage device included in the first terminal 3. Note that the storage device 200B may be configured to store data in which the type of the first terminal 3 is associated with the terminal ID and data in which the file format is associated with the type, and the file format conversion unit 206 may identify the type of the first terminal 3 from the terminal ID and convert the voice data into the file format associated with the identified type.

[0023] The removal unit 207 removes or reduces data outside the audible range, outside the voice band, or in a band that becomes noise from the voice data, or processes the voice data so as to emphasize only the voice band. This allows the amount of data to be reduced when transmitting voice data to the second terminal 4, and communication charges can be reduced. The removal unit 207 may remove or reduce data outside the audible range, outside the voice band, or in a band that becomes noise from the voice data to be transmitted to the second terminal 4, or may process the voice data so as to emphasize only the voice band. This allows the amount of data to be reduced when transmitting voice data to the second terminal 4, and communication charges can be reduced.

[0024] The volume adjustment unit 208 adjusts the playback volume when the audio data is played back on the second terminal 4. This allows the audio data to be played back in accordance with the grade of an audio output device such as a speaker provided in the second terminal 4, and suppresses distortion of the sound. Note that the storage device 200B may be configured to store data in which the type of the second terminal 4 is associated with a terminal ID and data in which the playback volume is associated with the type, and the volume adjustment unit 208 may specify the type of the second terminal 4 from the terminal ID and adjust the volume of the audio data to the playback volume associated with the specified type. Note that the volume adjustment unit 208 may adjust the playback volume when the audio data is played back on the first terminal 3. This allows the audio data to be played back in accordance with the grade of an audio output device such as a speaker provided in the first terminal 3. In addition, the memory device 200B may be configured to store data correlating the type of the first terminal 3 with the terminal ID, and data correlating the playback volume with the type, and the volume adjustment unit 208 may be configured to identify the type of the first terminal 3 from the terminal ID, and adjust the volume of the audio data to the playback volume associated with this identified type.

[0025] The extraction unit 209 extracts data from the storage device 200B based on the sorting conditions. For example, the extraction unit 209 extracts data specified by the sorting conditions. Furthermore, the extraction unit 209 extracts data associated with the history of the position information (via the terminal ID), for example, audio data.

[0026] (1st Terminal 3) The first terminal 3 is a terminal possessed by the first user, and is, for example, a smartphone on which application software is installed to cause the first terminal 3 to function as a terminal having each function shown in this embodiment. The first user can exchange voice and text with the second user (for example, his / her child) by transmitting and receiving voice data and text data to and from the second terminal 4 registered using the first terminal 3. FIG. 4 shows the main hardware configuration of the first terminal 3, and includes a communication IF 300A, a storage device 300B, an input device 300C, a display device 300D, a CPU 300E, a microphone 300F, and a speaker 300G.

[0027] The communication IF 300A is an interface for communicating with another device (the server 2 in this embodiment).

[0028] The storage device 300B is, for example, a hard disk drive (HDD) or a semiconductor storage device (solid state drive (SSD)). A terminal ID, an information processing program (application software), etc. are stored in the storage device 300B. The terminal ID is a number for identifying the first terminal 3. By assigning the terminal ID to data transmitted from the first terminal 3, the server 2 can determine which first terminal 3 sent the received data. Note that the terminal ID may be an Internet Protocol (IP) address, a Media Access Control (MAC) address, etc., or may be assigned to the first terminal 3 by the server 2. The storage device 300B may also store data transmitted and received between the first terminal 3 and the second terminal 4. For example, the storage device 300B may store transmitted and received data (for example, voice data or text data) in association with each other.

[0029] The input device 300C is, for example, an input device such as a keyboard, a mouse, or a touch panel, but may be any other device or equipment that allows input. Also, it may be a voice input device.

[0030] The display device 300D is, for example, a liquid crystal display, a plasma display, an organic EL display, or the like, but may be any other device or equipment (for example, a CRT: Cathode Ray Tube) as long as it is capable of displaying.

[0031] The CPU 300E controls the first terminal 3 according to this embodiment, and includes a ROM and a RAM (not shown).

[0032] The microphone 300F is an acoustic device that converts sound into an electrical signal. The user of the first terminal 3 can input voice using the microphone 300F. The input voice is transmitted to the server 2 by a transmission unit 302, which will be described later.

[0033] The speaker 300G is an audio device that converts an electrical signal into sound. The speaker 300G reproduces, for example, audio data transmitted from the second terminal 4 via the server 2 and stored in the storage device 300B.

[0034] As with the second terminal 4 described below, a position sensor may be provided to identify the current position based on a signal from a GNSS satellite, and the current position identified by the position sensor may be output. As long as the position of the first terminal 3 can be identified, the current position may be output by a method other than a position sensor. Examples of methods other than a position sensor include the use of wireless access point information, the use of mobile network tower information, and the use of an acceleration sensor and a magnetic sensor to identify the amount of movement and direction of travel of the first terminal 3. Of course, methods other than those exemplified may also be used.

[0035] 5 shows a functional block diagram of first terminal 3, and first terminal 3 has functions such as receiving unit 301, transmitting unit 302, storage device control unit 303, input receiving unit 304 (receiving unit), display device control unit 305 (display control unit), and audio output control unit 306. Note that the functions shown in FIG. 5 are realized by CPU 300E executing an information processing program stored in storage device 300B.

[0036] The receiving unit 301 receives data transmitted from the server 2, for example.

[0037] The transmitting unit 302 transmits data to the server 2 in response to an input operation accepted by the input accepting unit 304, for example.

[0038] The storage device control unit 303 controls the storage device 300B. For example, the storage device control unit 303 stores data transmitted and received by the first terminal 3 and the second terminal 4 in the storage device 300B in association with the terminal IDs that transmitted and received the data. In addition, the storage device control unit 303 stores, for example, transmitted and received voice data and text data in the storage device 300B.

[0039] The input receiving unit 304 receives an input operation from the input device 300C. The input receiving unit 304 receives, for example, an input of a message.

[0040] The display device control unit 305 controls the display device 300D and displays on the display device 300D the data received by the receiving unit 301. The display device control unit 305 functions as, for example, a notification control unit, and has a push notification function that, when the receiving unit 301 receives audio data, causes the display device 300D to display that the audio data has been received.

[0041] The audio output control unit 306 controls the speaker 300G. The speaker 300G outputs audio under the control of the audio output control unit 306. The audio output control unit 406 functions as, for example, a notification control unit, and notifies the reception of the audio data by causing the receiving unit 301 to play back at least a part of the audio data. Note that when the receiving unit 301 receives the audio data, the audio output control unit 406 may notify the reception of the audio by generating a sound in a predetermined pattern.

[0042] (2nd Terminal 4) The second terminal 4 is a terminal used by a second user of the information processing system 1. The second user can communicate with the first user (e.g., his / her family) by voice by using the second terminal 4 to transmit and receive voice data and text data to and from the registered first terminal 3. Fig. 6 shows the main hardware configuration of the second terminal 4, and the second terminal 4 includes a communication IF 400A, a storage device 400B, an input device 400C, a display device 400D, a CPU 400E, a microphone 400F, a speaker 400G, a position sensor 400H, and the like.

[0043] The communication IF 400A is an interface for communicating with other devices (the server 2 in this embodiment).

[0044] The storage device 400B is, for example, a hard disk drive (HDD) or a semiconductor storage device (solid state drive (SSD)). The storage device 400B stores a terminal ID, an information processing program, voice data transmitted from the first terminal 3, and the like. The terminal ID is a number for identifying the second terminal 4. By assigning the terminal ID to data transmitted from the second terminal 4, the server 2 can determine which second terminal 4 sent the received data. Note that the terminal ID may be an Internet Protocol (IP) address, a Media Access Control (MAC) address, or the like, or may be assigned to the second terminal 4 by the server 2. Furthermore, the storage device 400B may also store transmitted and received data (eg, audio data).

[0045] The input device 400C is, for example, an input device such as an operation button, but may be other devices or equipment such as a keyboard, a mouse, or a touch panel as long as it is capable of inputting. It may also be a voice input device. The second user can operate the input device 400C to input voice and transmit it to the server 2, or play back voice data transmitted from the server 2.

[0046] The display device 400D is, for example, an LED, and notifies the user that a voice has been received by lighting up or blinking in a predetermined pattern.

[0047] The CPU 400E controls the second terminal 4 according to this embodiment, and includes a ROM and a RAM (not shown).

[0048] The microphone 400F is an acoustic device that converts sound into an electrical signal. The user of the second terminal 4 can input voice using the microphone 400F. The input voice is transmitted to the server 2 by a transmission unit 402, which will be described later.

[0049] The speaker 400G is an audio device that converts an electric signal into sound. The speaker 400G plays back, for example, audio data transmitted from the first terminal 3 via the server 2 and stored in the storage device 400B. The speaker 400G also notifies the reception of audio by generating a sound in a predetermined pattern.

[0050] The position sensor 400H identifies the current location based on a signal from a GNSS satellite. The position sensor 400H outputs the identified current location. Note that the current location may be output by a method other than the position sensor 400H as long as the location of the second terminal 4 can be identified. Possible methods other than the position sensor 400H include, for example, using wireless access point information, using mobile network tower information, and using an acceleration sensor and a magnetic sensor to use the amount of movement and direction of travel of the second terminal 4. Note that, of course, methods other than those exemplified may also be used.

[0051] 7 shows a functional block diagram of the second terminal 4, which has functions such as a receiving unit 401, a transmitting unit 402, a storage device control unit 403, an input accepting unit 404, a display device control unit 405 (display control unit), and an audio output control unit 406. The functions shown in FIG. 7 are realized by the CPU 400E executing an information processing program stored in the storage device 400B.

[0052] The receiving unit 401 receives, for example, data transmitted from the server 2, such as voice data.

[0053] The transmitting unit 402 transmits data, such as voice data, to the server 2 in response to an input operation received by the input receiving unit 304, for example.

[0054] The storage device control unit 403 controls the storage device 400B. For example, the storage device control unit 403 controls the storage device 400B to write and read data. For example, the storage device control unit 403 stores data received by the receiving unit 401 in the storage device 400B.

[0055] The input receiving unit 404 receives an input operation from the input device 400C. The input receiving unit 404 receives, for example, an operation to play back audio data stored in the storage device 400B.

[0056] The display device control unit 405 controls the display device 400D. The display device control unit 405 functions as, for example, a notification control unit, and when the receiving unit 401 receives audio data, causes the display device 400D (LED) to light up or blink in a predetermined pattern or the like.

[0057] The audio output control unit 406 controls the speaker 400G. The speaker 400G outputs audio under the control of the audio output control unit 406. The audio output control unit 406 functions as, for example, a notification control unit, and when the receiving unit 401 receives audio data, it generates a sound in a predetermined pattern to notify that the audio has been received. Note that the audio output control unit 406 may cause the receiving unit 401 to play back at least a part of the audio data, thereby notifying that the audio data has been received.

[0058] (display screen) Figures 8 to 11 are diagrams showing an example of a screen G1 displayed on the display device 300D of the first terminal 3. Hereinafter, an example of the screen G1 displayed on the display device 300D of the first terminal 3 will be described with reference to Figures 8 to 11. Note that the same components as those described with reference to Figures 1 to 7 are denoted by the same reference numerals, and duplicated descriptions will be omitted.

[0059] (Screen description of Fig. 8) As shown in FIG. 8, the display device 300D displays text data, which is obtained by converting voice data transmitted and received between the first terminal 3 and the second terminal 4 into text, in chronological order on a voice data file basis (hereinafter also referred to as a timeline display).

[0060] In the example shown in FIG. 8, the name 11 (or handle name) of the second user is displayed at the top of the screen G1. In addition, on the left side of the screen G1, text data 12B obtained by converting the voice data (voice file of the second user) transmitted from the second terminal 4 is displayed together with the transmission date and time 12D (using time stamp information) and the icon 12A. In addition, when the play button 12C is selected, the voice data (voice file) corresponding to the displayed text data 12B is played back, and the voice can be listened to. In addition, on the right side of the screen G1, text data 13A obtained by converting the voice data (voice file of the first user) transmitted from the first terminal 3 is displayed together with the transmission date and time 13C (using time stamp information). In addition, a status 13D (for example, whether the voice data was played back on the second terminal 4, etc.) is written alongside each piece of text data transmitted from the first terminal 3. In addition, when the play button 13B is selected, the voice data (voice file) corresponding to the displayed text data 13A is played back, and the voice can be listened to.

[0061] 8, the text data converted from the voice data is displayed in chronological order for each file of the voice data, but the text data 12B converted from the voice data may not be displayed. In this case, for example, the playback time of the voice data may be displayed instead of the text data 12B, but this is not necessarily limited to this example. In addition, in the example shown in FIG. 8, all characters converted from the voice data are displayed on the display screen, but it is not necessary to display all characters. For example, only the first several characters (e.g., 10 characters) may be displayed.

[0062] (Screen description of Fig. 9) The screen G2 shown in FIG. 9 is a screen to which the screen transitions when the icon 15 described with reference to FIG. 8 is selected (tap operation). As shown in FIG. 9, when the icon 15 is selected in FIG. 8, a display frame 16 for sending a message to the second terminal 4 appears from the bottom of the screen G2 in a manner that it rises up. The first user can record a voice and send it to the second terminal 4 by operating the input device 300C such as a touch panel to select the microphone icon 16A displayed in the display frame 16 of the screen G2. When the microphone icon 16A is selected, the display form (e.g., the color of the icon) of the microphone icon 16A changes to indicate that recording has started. When the first user finishes speaking a message (e.g., "I'm coming to pick you up now") and reselects the microphone icon 16A again, the display form (e.g., the color of the icon) of the microphone icon 16A returns to the original state, indicating that recording has ended. In addition, multiple messages 16B are displayed below the microphone icon 16A, such as messages 16B preset in the storage device 300B, messages 16B input by the first user, and messages 16B downloaded from the server 2. The first user can select one of the multiple displayed messages 16B by operating an input device 300C such as a touch panel, and send the selected message 16B to the second terminal 4.

[0063] Moreover, it is preferable that the messages 16B displayed on the screen G2 of FIG. 9 are displayed in an order according to the frequency of message use by the first user or a setting by the first user. For example, when the messages are displayed according to the frequency of use, it is preferable that the messages are displayed in the order of high frequency of use. Moreover, the messages 16B displayed on the screen G2 of FIG. 9 may be displayed in an order according to a setting by the first user. In this case, as will be described later with reference to FIG. 10, the first user may operate the input device 300C to manually rearrange and set the display order of the messages 16B. Moreover, it is also possible to set the preset messages 16B to be displayed in the order of high frequency of use, or to set the messages 16B input by the first user to be displayed in the order of high frequency of use. When displaying the messages in the order of high frequency of use, it is preferable to calculate the frequency of use of the messages taking into consideration variations in the notation of the messages (for example, similarity of the messages).

[0064] (Screen description of Fig. 10) As already described, the message input by the first user includes a voice message recorded by the first user using the microphone 300F and a character message input by the first user by operating the input device 300C. Here, the voice message is transcribed (converted into text) and displayed as the title of the voice file. FIG. 10 is an example of a screen G3 in which a voice message is transcribed (converted into text) and displayed as the title of a voice file. As illustrated in FIG. 10, the screen G3 displays the message of the voice file in which the voice message is transcribed (converted into text) as a title 16B. The first terminal 3 also accesses the server 2, inquires about the purchase information of the first user in the stamp store described later, and if there is a purchase history, displays the voice stamp and the title of the voice stamp described later on the screen G3. The title of the voice stamp may be displayed differently from the message input by the first user (for example, by changing the font or adding a symbol such as a star before the title). The first user can select the voice stamp store 17A on the screen G3 by operating the input device 300C such as a touch panel to transition to a stamp store screen (not shown) or the stamp store appears, and can purchase or download a voice stamp (voice file) different from the voice message input by the first user for free. For example, when the first user performs a procedure to purchase an audio stamp on the stamp store screen, server 2 records the purchase information of the first user and the user can use an audio file stored on server 2 that corresponds to the purchased audio stamp (for example, an audio file of a message recorded by a voice actor, actor, idol, etc., or an audio file of a message generated by a voice synthesis engine such as Vocaloid (registered trademark), etc.). Furthermore, the first user can change the display order of the titles 16B by operating the input device 300C such as a touch panel to select (long press or tap) a change button 17B arranged to the left of the titles 16B. Furthermore, the first user can operate the input device 300C such as a touch panel to select (long press or tap) the edit button 17C arranged to the right of the title 16B to edit the audio file that is the source of the title 16B, such as changing the volume, changing the playback speed, changing the pitch, the playback start time, the playback end time, etc. However, if the audio file is an audio stamp, it is also possible not to display the edit button 17C. In addition, the first user can play (listen to) the audio file that is the source of title 16B by operating input device 300C, such as a touch panel, to select (long press or tap, for example) play button 17D located to the right of title 16B. In addition, the first user can re-record the audio file that is the source of the title 16B by operating the input device 300C, such as a touch panel, to select (by long pressing or tapping, for example) the recording button 17E located to the right of the title 16B. The titles 16B of the audio files may be set to be displayed in order of frequency of use. When displaying the titles 16B in order of frequency of use, it is preferable to calculate the frequency of use of the messages taking into consideration variations in the notation of the messages (for example, similarities between the messages).

[0065] (Screen description of Fig. 11) As shown in FIG. 11, in this embodiment, the display device 300D of the first terminal 3 can display the history of the position P of the second terminal 4 superimposed on a map. In addition, the current time T and the user name U of the second terminal 4 are displayed in the upper part of the display screen 300D. In addition, a calendar C and a slider S are displayed in the lower part of the display screen 300D. The first user can display the history of the position P of the second terminal 4 on the selected date by clicking the calendar C to select a date. In addition, the first user can zoom in or zoom out the map by moving the slider S to the left or right. Note that if data, for example, voice data, is associated with the position P, a speech bubble F is displayed at the corresponding position P to indicate that associated data (for example, voice data) exists. In addition, in this embodiment, the status of the associated data (whether or not it has been confirmed) is displayed. For example, if the associated data is voice data, if the voice data has been played on the first terminal 3, it becomes "read". In this way, it is highly convenient because it is possible to confirm not only the position history but also what information is associated at what position.

[0066] The second terminal 4 may be provided with a display device such as a liquid crystal display, a plasma display, or an organic EL display, and configured to be able to display the screens exemplified in Figures 8 to 11 on the first terminal 3. In this case, the relationship between the first terminal 3 and the second terminal 4 is reversed in terms of the screens exemplified in Figures 8 to 11.

[0067] (Information Processing) Figures 12 to 17 are flowcharts showing an example of information processing by the information processing system 1. Below, the information processing by the information processing system 1 will be described with reference to Figures 12 to 17. Note that the same components as those described with reference to Figures 1 to 11 are given the same reference numerals and duplicated descriptions will be omitted.

[0068] (Location information transmission process) 12 is a flowchart showing an example of the position information transmission process of the information processing system 1. Hereinafter, an example of the position information transmission process of the information processing system 1 will be described with reference to FIG.

[0069] (Step S101) The transmitting unit 402 of the second terminal 4 judges whether or not a predetermined interval (for example, every 1.5 minutes) has arrived. If the predetermined interval has arrived (YES), the server 2 executes the process of step S102. If the predetermined interval has not arrived (NO), the server 2 ends the process.

[0070] (Step S102) The transmitting unit 402 of the second terminal 4 transmits the location information output from the location sensor 400H to the server 2. Note that the data transmitted from the second terminal 4 includes data such as the terminal ID of the second terminal 4 and a timestamp (transmission date and time, positioning date and time of the location information).

[0071] (Step S103) The receiving unit 201 of the server 2 receives the location information transmitted from the second terminal 4 .

[0072] (Step S104) The storage device control unit 203 of the server 2 stores the location information (including metadata) transmitted and received by the second terminal 4 in the storage device 200B in association with the terminal ID of the terminal that transmitted and received the data.

[0073] (Message sending process 1) Fig. 13 is a flowchart showing an example of the message transmission process 1 of the information processing system 1. Hereinafter, an example of the message transmission process 1 of the information processing system 1 will be described with reference to Fig. 13. Note that Fig. 13 describes a case where a message is transmitted from the first terminal 3 to the second terminal 4.

[0074] (Step S201) The first user operates the input device 400C of the first terminal 3 to input a message by voice or text.

[0075] (Step S202) When voice is input, it is converted into an electric signal by microphone 400F, converted into digital data by an A / D converter (not shown), and then transmitted as voice data from transmission unit 302 to server 2. When text is input, it is transmitted as text data from transmission unit 302 to server 2. Note that the data transmitted from first terminal 3 is provided with data such as the terminal ID of first terminal 3 and a timestamp.

[0076] (Step S203) The receiving unit 201 of the server 2 receives the data transmitted from the first terminal 3. The voice conversion unit 205 of the server 2 determines whether the receiving unit 201 has received voice data or not. If voice data has been received (YES), the server 2 executes the process of step S205. If voice data has not been received (NO), the server 2 executes the process of step S204.

[0077] (Step S204) The speech conversion unit 205 of the server 2 converts the received text data into speech data. When converting the received text data into speech, it is also possible to convert the original language into another language by a language conversion unit (not shown), or to convert all speech into the original language and one or more other languages, and to create speech data that can be played back. In this case, the first terminal 3 is set in advance.

[0078] (Step S205) When the storage device control unit 203 of the server 2 receives voice data, it stores the voice data transmitted by the first terminal 3 in the storage device 200B in association with the terminal ID that transmitted and received the data. When the storage device control unit 203 receives text data, it stores the text data transmitted by the first terminal 3 and the voice data converted from this text data in the storage device 200B in association with the terminal ID that transmitted and received the data.

[0079] (Step S206) The server 2 executes the voice data conversion process, the details of which will be described later with reference to FIG.

[0080] (Step S207) The transmitting unit 202 of the server 2 refers to the memory device 200B, identifies the terminal ID of the second terminal 4 associated with the terminal ID assigned to the voice data received by the receiving unit 201, and transmits the voice data transmitted from the first terminal 3 or the voice data converted by the voice conversion unit 205 to the identified second terminal 4.

[0081] (Step S208) The receiving unit 401 of the second terminal 4 receives the voice data transmitted from the server 2. The second terminal 4 notifies the reception of the message. For example, the display device control unit 405 may control the display device 400D to notify the reception of the message by, for example, lighting an LED or making a sound, or the audio output control unit 406 may control the speaker 400G to output a sound or voice to notify the reception of the message.

[0082] (Message sending process 2) Fig. 14 is a flowchart showing an example of the message transmission process 2 of the information processing system 1. Hereinafter, an example of the message transmission process 2 of the information processing system 1 will be described with reference to Fig. 14. Note that Fig. 14 describes a case where a message is transmitted from the second terminal 4 to the first terminal 3.

[0083] (Step S301) The second user inputs voice by operating the input device 400C of the second terminal 4. The input voice is converted into an electrical signal by the microphone 400F.

[0084] (Step S302) The transmitting unit 402 of the second terminal 4 transmits the input voice data to the server 2. Note that the data transmitted from the second terminal 4 is provided with data such as the terminal ID of the second terminal 4 and a time stamp.

[0085] (Step S303) The receiving unit 201 of the server 2 receives the voice data transmitted from the second terminal 4 .

[0086] (Step S304) The text conversion unit 204 of the server 2 converts the received voice data into text data. When converting the received voice data into text data, it is also possible to convert the voice data into text data by converting the original language into another language by a language conversion unit (not shown), or to convert the voice data into text data that can simultaneously display all texts in the original language and one or more other languages. In this case, the first terminal 3 is set in advance.

[0087] (Step S305) The storage device control unit 203 of the server 2 stores the voice data transmitted by the second terminal 4 and the text data converted by the text conversion unit 204 in the storage device 200B in association with the terminal ID that transmitted and received the data.

[0088] (Step S306) The transmitting unit 202 of the server 2 refers to the memory device 200B, identifies the terminal ID of the first terminal 3 associated with the terminal ID assigned to the voice data received by the receiving unit 201, and transmits the voice data transmitted from the second terminal 4 and the text data converted by the text conversion unit 204 to the identified first terminal 3.

[0089] (Step S307) The receiving unit 301 of the first terminal 3 receives the voice data and text data transmitted from the server 2.

[0090] (Step S308) The receiving unit 301 of the first terminal 3 receives the voice data and text data transmitted from the server 2. The first terminal 3 notifies the user that a message has been received. For example, the display device control unit 305 may control the display device 300D to notify the user that a message has been received by, for example, a PUSH notification, or the audio output control unit 306 may control the speaker 300G to output sound or voice to notify the user that a message has been received.

[0091] (Audio data conversion processing) 15 is a flowchart showing an example of the voice data conversion process of the information processing system 1. Hereinafter, an example of the voice data conversion process of the information processing system 1 will be described with reference to FIG.

[0092] (Step S401) The removal unit 207 of the server 2 removes or reduces data outside the audible range, outside the voice band, or in a band that becomes noise from the voice data received by the receiving unit 201, or processes the voice data to emphasize only the voice band.

[0093] (Step S402) The volume adjustment unit 208 of the server 2 adjusts the playback volume when the audio data is played back on the second terminal 4 .

[0094] (Step S403) The file format conversion unit 206 of the server 2 converts the file format of the audio data.

[0095] It should be noted that the steps of the audio data conversion process described with reference to FIG. 15 do not necessarily have to be processed in the order of steps S401 to S403, but may be processed in a different order, and one or more of steps S401 to S403 may be processed in any order.

[0096] As described above, when transmitting voice data from the second terminal 4 to the first terminal 3, the voice data conversion process described with reference to FIG. 15 may be executed.

[0097] (TL display processing) 16 is a flowchart showing an example of a TL display process of the information processing system 1. Hereinafter, an example of a TL display process of the information processing system 1 will be described with reference to FIG.

[0098] (Step S501) The first user inputs sorting conditions for the data to be displayed by operating the input device 300C of the first terminal 3. The input receiving unit 304 of the first terminal 3 receives the input sorting conditions, and the transmission unit 302 transmits the sorting conditions received by the input receiving unit 304 to the server 2. The reception unit 201 of the server 2 receives the sorting conditions transmitted from the first terminal 3.

[0099] (Step S502) The extraction unit 209 of the server 2 extracts data from the storage device 200B based on the sorting conditions. For example, the extraction unit 209 extracts data specified by the sorting conditions (for example, location information history and voice data, etc.).

[0100] (Step S503) The transmitting unit 202 of the server 2 refers to the storage device 200B, identifies the terminal ID of the first terminal 3 associated with the terminal ID assigned to the data received by the receiving unit 201, and transmits the data extracted by the extracting unit 209 to the identified first terminal 3. The receiving unit 301 of the first terminal 3 receives the data transmitted from the server 2. The display device control unit 305 of the first terminal 3 causes the data received by the receiving unit 301 to be displayed on the display device 300D.

[0101] As described above, the second terminal 4 may be provided with a display device such as a liquid crystal display, a plasma display, or an organic EL display, and may execute the TL display process described with reference to FIG.

[0102] (Map display processing) 17 is a flowchart showing an example of a map display process of the information processing system 1. Hereinafter, an example of the map display process of the information processing system 1 will be described with reference to FIG.

[0103] (Step S601) The first user operates the input device 300C of the first terminal 3 to instruct the map display. The input receiving unit 304 of the first terminal 3 receives the instruction to display the map. The transmitting unit 302 of the first terminal 3 transmits the instruction to display the map to the server 2. The receiving unit 201 of the server 2 receives the instruction to display the map transmitted from the first terminal 3.

[0104] (Step S602) The extraction unit 209 of the server 2 refers to the storage device 200B, identifies the terminal ID of the second terminal 4 associated with the terminal ID attached to the instruction to display the map, and extracts the history of the location information of the identified second terminal 4.

[0105] (Step S603) Furthermore, the extraction unit 209 of the server 2 extracts data associated with the history of the location information (via the terminal ID), for example, audio data.

[0106] (Step S604) The transmitting unit 202 of the server 2 refers to the storage device 200B, identifies the terminal ID of the first terminal 3 associated with the terminal ID assigned to the data received by the receiving unit 201, and transmits to the identified first terminal 3 the history of the location information extracted by the extraction unit 209 and data associated with the history of the location information, for example, voice data.

[0107] (Step S605) The receiving unit 301 of the first terminal 3 receives the history of the location information transmitted from the server 2 and data associated with the history of the location information.

[0108] (Step S606) The display device control unit 305 of the first terminal 3 causes the display device 300D to display the history of the location information received by the receiving unit 301 on a map (see, for example, FIG. 11). In addition, the display device control unit 305 of the first terminal 3 causes the display device 300D to display the presence of data associated with the history in or near the history of the location information displayed on the map.

[0109] In the map display process illustrated in FIG. 17, the server 2 transmits the history of the extracted location information and the voice data associated with this location information history (via the terminal ID) to the first terminal 3. Alternatively, the server 2 may transmit the history of the extracted location information and data (e.g., flag information) indicating that there is voice data associated with this location information history (via the terminal ID) to the first terminal 3, and when the user instructs playback of the voice data, the instructed voice data is downloaded from the server 2 and played.

[0110] As described above, the second terminal 4 may be provided with a display device such as a liquid crystal display, a plasma display, or an organic EL display, and may execute the map display process described with reference to FIG.

[0111] According to the information processing system 1 of the present embodiment, voice data can be converted into text data and transmitted or received, or text data can be converted into voice data and transmitted or received. Therefore, communication between the first user and the second user (the first user and the second user) is possible in various types of users, terminals, and scenes, such as a user who has difficulty in inputting text or voice (for example, a child or an elderly person who has difficulty in complex operations of a terminal, or a user who has a speech impediment), a terminal where text input or voice input is difficult (for example, a small device where it is difficult to attach a keyboard, or a case where it is difficult to attach a display due to constraints such as cost), a scene where text input is difficult because the hands are full, or a scene where recording or playback of voice is difficult in a public space, etc.

[0112] [Modifications of the embodiment] In the above embodiment, the display device 400D of the second terminal 4 may be configured to display text using an LED. Alternatively, a liquid crystal panel or an organic EL panel may be adopted as the display device 400D of the second terminal 4 to display text. With this configuration, the voice data transmitted from the first terminal 3 or the server 2 can be converted into text data and the text can be confirmed. Also, the text data transmitted from the first terminal 3 or the server 2 can be confirmed.

[0113] In the above embodiment, at least one of the first terminal 3 and the second terminal 4 may have some or all of the functions of the server 2 shown in Fig. 3. For example, at least one of the first terminal 3 and the second terminal 4 may have at least one of the functions of the storage device control unit 203 (association unit), the text conversion unit 204, the voice conversion unit 205, the file format conversion unit 206, the removal unit 207, and the volume adjustment unit 208 among the functions of the server 2 shown in Fig. 3. In this case, at least one of the first terminal 3 and the second terminal 4 may acquire or refer to the information stored in the storage device 200B, or the information stored in the storage device 200B may be stored in at least one of the storage device 300B and the storage device 400B. In addition, in the above embodiment, the second terminal 4 may have at least one of the functions possessed by the first terminal 3, or the first terminal 3 may have at least one of the functions possessed by the second terminal 4.

[0114] Moreover, the screen G1 described with reference to Fig. 8 may be a screen G4 shown in Fig. 18. The screen G4 shown in Fig. 18 is provided with an input frame 18A for inputting a text message and a microphone icon 18B for inputting a voice message, and is configured so that the first user can select whether to input a message by text or by voice. In addition, in the input text message, characters that do not have a sound (pronunciation) (such as symbols) or combinations of such characters (for example, surrounding characters that have a sound with the aforementioned symbols) can be used to change the sound source (tone of the voice or tone of an instrument) or to specify the volume, pitch, etc. in detail.

[0115] Moreover, a screen G5 shown in FIG. 19 is a screen to which the user transitions after inputting a voice message or a text message. 19, the first user can preview and check the input voice message or text message by operating the input device 300C such as a touch panel to select an icon 19A on the screen G5. The first user can also re-input the voice message or text message by operating the input device 300C such as a touch panel to select an icon 19B on the screen G5. Furthermore, the first user can set a notification pattern for when the second user terminal 4 is notified that it has received a message from the first user terminal 3. In the example shown in Fig. 19, the first user can select a notification pattern from "Ringtone ON" 20A, "Ringtone OFF" 20B, and "Ring this sound as a ringtone" 20C. Note that, although the notification pattern is selected from three in the example shown in Fig. 19, the notification pattern is not limited to the example shown in Fig. 19. Screen G5 also allows the user to specify the tone of voice and emotion to be used when playing back a voice message. When the first user selects a tone of voice from tone of voice options 21 and an emotion from emotion options 22, the voice message is played back in the selected tone of voice and emotion on the second terminal 4 of the other party to whom the voice message was sent. The expression of tone of voice and emotion can be realized by learning human voices using AI machine learning or the like and performing voice synthesis.

[0116] 20 and 21 are diagrams illustrating an example in which the display device 300D receives audio data or text data by the push notification function. As shown in FIG. 20, a push notification may be sent only to the fact that a message has been received and the name of the user who sent the message, or as shown in FIG. 21, a push notification may be sent to the content of the received message (if the message is long, for example, if it is longer than a predetermined number of characters, only the first predetermined number of characters of the message content may be displayed, or a summary of the content may be displayed) and the name of the user who sent the message. In the example shown in FIG. 21, the method of playing the message notified by push (such as "play hands-free," "play by holding to ear," or "open app") and responding to the message (selecting and sending a pre-registered message (such as a preset message or a message registered by the user)) can be performed without opening the app, which is very convenient.

[0117] (Processing when new voice is received before listening to the voice received at the second terminal 4) After the second terminal 4 receives the voice data transmitted from the server 2, new voice data may be transmitted from the server 2 before the voice data is played back on the second terminal 4. In this case, the second terminal 4 executes, for example, any of the processes exemplified below in (1) to (3) to store the voice data. Note that the following processes are executed by the second terminal 4 due to the small storage capacity of the storage device 400B of the second terminal 4. (1) When new voice data is received, the previously received voice data is deleted from the storage device 400B. (2) The audio data is stored in an audio data buffer (e.g., a specified area provided in the memory device 400B) that can store any number of pieces of data or any storage capacity, and when the audio data buffer is about to overflow, old data is erased using the FIFO (first in first out) method. (3) The voice data is stored in a voice data buffer (e.g., a specified area provided in memory device 400B) that can store any number of data items or any storage capacity. When the voice data buffer is about to overflow, buffer full information (information indicating that no more voice data can be stored in second terminal 4) is sent to first terminal 3 via server 2, and a message is displayed on first terminal 3 indicating that a message cannot be sent. Furthermore, when an operation to play back audio data is performed on the second terminal 4, the second terminal 4 plays back the audio data in the buffer in the order in which it was stored or in the order of the most recent audio data. Thereafter, the second terminal 4 may erase the audio data in the audio data buffer, or may erase all audio data other than the most recently received audio data, or may not erase the data and always perform the above process (2). These settings can be changed from the first terminal 3.

[0118] (Talk Group) In the above embodiment and modified example, the first terminal 3 and the second terminal 4 are described as a pair, but it is also possible to have multiple first terminals 3 and / or multiple second terminals 4 and make them into one talk group. Talk groups are managed by the server 2 using a unique ID (talk group ID), and furthermore, the identification numbers (terminal IDs) of all first terminals 3 and second terminals 4 belonging to the same talk group are linked. Note that each terminal can be set with a name that is easy for users belonging to the talk group to understand, and in that case, the terminal ID and the terminal name are also linked. A message can be sent simultaneously between terminals in the same talk group, but a message can also be sent only to a specific terminal. For example, when sending from the first terminal 3, a message can be sent by selecting one or more terminals to which a message is to be sent on a text or voice message sending screen and sending the message. When sending a voice message from the second terminal 4, the name of the terminal to which the message is to be sent can be said during the voice message, or a button operated to send a voice message to the second terminal 4 can be pressed any number of times during a given time to select the terminal to which the message is to be sent, or a button operated to send a voice message can be pressed any number of times during a given time to select the terminal to which the message is to be sent, and the speaker 400G of the second terminal 4 can be used to ask "Who would you like to send to?". When the second user inputs the name of one or more terminals to which the message is to be sent by voice, the name of the terminal to which the message is to be sent can be confirmed for the second user, and the message to be sent to the second user can be accepted and sent to the desired terminal in the same talk group via the server 2.

[0119] In addition, the above-mentioned embodiment and modifications are merely examples of the embodiment of the present invention, and the technical scope of the present invention should not be interpreted as being limited thereby. In other words, the present invention can be embodied in various forms without departing from the gist or main characteristics thereof. [Explanation of symbols]

[0120] 1. Information Processing Systems 2. Server (information processing device) 200A Communication IF 200B storage device 200C CPU 201 Receiving unit 202 Transmitter 203 Storage device control unit (association unit) 204 Text conversion section 205 Voice conversion unit 206 File Format Conversion Section 207 Removal section 208 Volume control section 209 Extraction part 3. First terminal (information processing terminal) 300A communication IF 300B storage device 300C Input Device 300D display device 300E CPU 300F Microphone 300G Speaker 301 Receiving unit 302 Transmitter 303 Storage device control unit 304 Input reception unit (reception unit) 305 Display device control unit (display control unit) 306 Audio output control unit 4. Terminal 2 400A Communication IF 400B storage device 400C Input Device 400D display device (LED) 400E CPU 400F Microphone 400G Speaker 400H Position Sensor 401 Receiving unit 402 Transmitter 403 Storage device control unit 404 Input reception section 405 Display device control unit (display control unit) 406 Audio output control unit 5. Network

Claims

1. A receiving unit that receives voice data transmitted from the first terminal or the second terminal; a text conversion unit that converts the voice data received by the receiving unit into text data; a transmission unit that transmits the text data converted by the conversion unit to the second terminal or the first terminal; An information processing device comprising:

2. A receiving unit that receives text data transmitted from the first terminal or the second terminal; a voice conversion unit that converts the text data received by the receiving unit into voice data; a transmission unit that transmits the voice data converted by the conversion unit to the second terminal or the first terminal; An information processing device comprising:

3. an association unit that associates the voice data with information for identifying a position of the first terminal or the second terminal, The receiving unit is receiving information for identifying a location transmitted from the first terminal or the second terminal; The association unit is Associating the voice data received by the receiving unit with information for identifying the position; The transmission unit is Transmitting the voice data and information for identifying the location associated with the voice data to the second terminal or the first terminal; 2. The information processing apparatus according to claim 1,

4. an association unit that associates the text data with information for identifying a location of the first terminal or the second terminal; The receiving unit is receiving information for identifying a location transmitted from the first terminal or the second terminal; The association unit is Associating the text data received by the receiving unit with information for identifying the location; The transmission unit is Transmitting the text data and information for identifying the location associated with the text data to the second terminal or the first terminal; 3. The information processing apparatus according to claim 2.

5. The association unit is associating information for identifying a location of the first terminal or the second terminal with the voice data based on the information for identifying the location, one or more of a positioning date and time, a transmission date and time, and a reception date and time of the information for identifying the location, and one or more of a recording date and time, a transmission date and time, and a reception date and time of the voice data; 4. The information processing apparatus according to claim 3.

6. a format conversion unit that converts the file format of the audio data; The information processing apparatus according to claim 1 , further comprising:

7. a removal unit that removes or reduces data of the audio data that is outside an audible range, outside an audio band, or in a band that becomes noise, or that emphasizes only the audio band; The transmission unit is The removal unit removes or reduces data outside the audible range, outside the voice band, or in a band that becomes noise, or transmits voice data in which only the voice band is emphasized to the second terminal or the first terminal.

2. The information processing apparatus according to claim 1,

8. a volume adjustment unit that adjusts a playback volume of the audio data that the transmission unit transmits to the second terminal or the first terminal; The information processing apparatus according to claim 1 , further comprising:

9. A receiving unit for receiving voice data; a text conversion unit that converts the voice data received by the receiving unit into text data; an output unit that outputs the text data converted by the conversion unit; An information processing terminal comprising:

10. A receiving unit for receiving text data; a voice conversion unit that converts the text data received by the receiving unit into voice data; an output unit that outputs the audio data converted by the conversion unit; An information processing terminal comprising:

11. A reception unit that receives input of voice data; a text conversion unit that converts the voice data received by the reception unit into text data; a transmission unit that transmits the text data converted by the conversion unit; An information processing terminal comprising:

12. A reception unit that receives input of text data; a voice conversion unit that converts the text data received by the reception unit into voice data; a transmission unit that transmits the voice data converted by the conversion unit; An information processing terminal comprising:

13. an association unit that associates the voice data with information for identifying a position, The receiving unit is receiving information for identifying the location; The association unit is Associating the voice data received by the receiving unit with information for identifying the position; 10. The information processing terminal according to claim 9.

14. an association unit that associates the text data with information for identifying a position, The receiving unit is receiving information for identifying the location; The association unit is Associating the text data received by the receiving unit with information for identifying the location.

11. The information processing terminal according to claim 10.

15. a volume adjustment unit that adjusts the playback volume of the audio data transmitted by the transmission unit; 12. The information processing terminal according to claim 11, further comprising:

16. a notification control unit that notifies a user that the voice data or the text data has been received when the receiving unit receives the voice data or the text data; 11. The information processing terminal according to claim 9, further comprising:

17. The notification control unit is by playing back at least a part of the voice data or the text data, a notification that the voice data or the text data has been received is given.

17. The information processing terminal according to claim 16,

18. The association unit is associating the voice data with information for identifying the location of another information processing terminal that transmitted the voice data, based on the information for identifying the location, one or more of the positioning date and time, the transmission date and time, and the reception date and time of the information for identifying the location, and one or more of the recording date and time, the transmission date and time, and the reception date and time of the voice data; 14. The information processing terminal according to claim 13.

19. a format conversion unit that converts the file format of the audio data; 10. The information processing terminal according to claim 9, further comprising:

20. a removal unit that removes or reduces data of the audio data that is outside an audible range, outside an audio band, or in a band that becomes noise, or that emphasizes only the audio band; The transmission unit is The removal unit removes or reduces data outside the audible range or outside the voice band, or transmits the voice data in which only the voice band is emphasized to another information processing terminal.

12. The information processing terminal according to claim 11.

21. a volume adjustment unit that adjusts the playback volume of the audio data that the transmission unit transmits to another information processing terminal; 12. The information processing terminal according to claim 11, further comprising:

22. a receiving unit that receives voice data and text data converted from the voice data; a display control unit that displays the presence of the voice data received by the receiving unit in association with at least a portion of the text data; An information processing terminal comprising:

23. a receiving unit for receiving information for identifying the location of the other information processing terminal and voice data or text data obtained by converting the voice data; a display control unit that displays information for identifying the position of the other information processing terminal received by the receiving unit and the presence of the voice data or the text data in association with each other; An information processing terminal comprising:

24. The display control unit is displaying on a map the information for identifying the position of the other information processing terminal received by the receiving unit and the presence of the voice data or the text data in association with each other; 23. The information processing terminal according to claim 22.

25. The display control unit is Displaying one or more pieces of audio data or text data; The information processing terminal includes: a reception unit that receives designation of the displayed voice data or text data; a transmission unit that transmits the voice data or the text data designated by the reception unit; 24. The information processing terminal according to claim 23, further comprising:

26. The information processing terminal includes: a terminal for outputting information for identifying the location of the information processing terminal at predetermined intervals and monitoring the behavior of a person holding the information processing terminal; 13. The information processing terminal according to claim 9, wherein

27. A step of receiving voice data transmitted from a first terminal or a second terminal by a receiving unit; A text conversion unit converts the voice data received by the receiving unit into text data; A transmitting unit transmitting the text data converted by the converting unit to the second terminal or the first terminal; 13. An information processing method comprising:

28. Computer, a receiving unit that receives voice data transmitted from the first terminal or the second terminal; a text conversion unit that converts the voice data received by the receiving unit into text data; a transmission unit that transmits the text data converted by the conversion unit to the second terminal or the first terminal; An information processing program characterized by causing the program to function as follows.

Images