Information processing device, information processing terminal, information processing method, information processing program

Abstract

More convenient information processing device, information processing terminal, information processing method, and information processing program Provide grams. [Solution] The information processing device according to the present invention receives audio data transmitted from the first terminal or the second terminal. A receiving unit that receives audio data, and the receiving unit that converts the received audio data into text data. A text conversion unit converts the text data converted by the conversion unit to the second terminal or the front It comprises a transmitting unit that transmits to the first terminal.

Description

Technical Field

[0001] The present invention relates to an information processing device, an information processing terminal, an information processing method, and an information processing program that can be used in a system for transmitting and receiving voice data.

Background Art

[0002] Conventionally, a GPS terminal capable of exchanging voice data has been proposed for use in monitoring children.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, conventional GPS terminals simply present position information, voice information, etc. to the user, and there is room for improvement in convenience.

[0005] The present invention has been made in view of the above problems, and an object thereof is to provide an information processing device, an information processing terminal, an information processing method, and an information processing program with higher convenience.

Means for Solving the Problems

[0006] To solve the above problems, an information processing device according to the present invention includes a receiving unit that receives voice data transmitted from a first terminal or a second terminal, a text conversion unit that converts the voice data received by the receiving unit into text data, and a transmission unit that transmits the text data converted by the conversion unit to the second terminal or the first terminal. ​[Effects of the Invention]

[0007] According to the present invention, a more convenient information processing device, information processing terminal, information processing method, and information We can provide a report processing program. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an example of the arrangement of an information processing system according to the embodiment. [Figure 2] This figure shows an example of the configuration of an information processing server (information processing device) according to the embodiment. [Figure 3] This figure shows an example of the configuration of an information processing server according to the embodiment. [Figure 4] This figure shows an example of the configuration of the first terminal (information processing terminal) according to the embodiment. [Figure 5] This figure shows an example of the configuration of the first terminal according to the embodiment. [Figure 6] This figure shows an example of the configuration of a second terminal (information processing terminal) according to the embodiment. [Figure 7] This figure shows an example of the configuration of the second terminal according to the embodiment. [Figure 8] This figure shows an example of a screen displayed on the display device of the first terminal according to this embodiment. [Figure 9] This figure shows an example of a screen displayed on the display device of the first terminal according to this embodiment. [Figure 10] This figure shows an example of a screen displayed on the display device of the first terminal according to this embodiment. [Figure 11] This figure shows an example of a screen displayed on the display device of the first terminal according to this embodiment. [Figure 12] This flowchart shows an example of processing performed by the information processing system according to the embodiment. [Figure 13] This flowchart shows an example of processing performed by the information processing system according to the embodiment. [Figure 14]It is a flowchart showing an example of processing by the information processing system according to the embodiment. [Figure 15] It is a flowchart showing an example of processing by the information processing system according to the embodiment. [Figure 16] It is a flowchart showing an example of processing by the information processing system according to the embodiment. [Figure 17] It is a flowchart showing an example of processing by the information processing system according to the embodiment. [Figure 18] It is a diagram showing an example of a screen displayed on the display device of the first terminal according to a modification of the embodiment. [Figure 19] It is a diagram showing an example of a screen displayed on the display device of the first terminal according to a modification of the embodiment. [Figure 20] It is a diagram showing an example of a screen displayed on the display device of the first terminal according to a modification of the embodiment. [Figure 21] It is a diagram showing an example of a screen displayed on the display device of the first terminal according to a modification of the embodiment.

Mode for Carrying Out the Invention

[0009] [Embodiment] Hereinafter, the information processing system 1 according to the embodiment will be described with reference to the drawings. The information processing system 1 according to the embodiment is a so-called monitoring system, and from the second terminal 4 that can be carried and used by the person being monitored (for example, a child), the position of the second terminal 4 is determined from the data uploaded to the server 2 at a predetermined interval such as every 1.5 minutes, and the determined position is sent from the server 2 to the first terminal 3 carried or used by the person watching (for example, family members or relatives such as parents and grandparents). Also, in the information processing system 1 according to the present embodiment, microphones are provided in the first terminal 3 and the second terminal 4. It is equipped with a speaker and other features, and can send and receive voice messages (hereinafter also referred to as voice) to each other. It is configured to allow for voice communication between the caregiver and the person being cared for. It is configured to allow message exchange. It is equipped with a display device and is configured to convert speech to text and display it on the display device. It is done. In the following explanation, the observer will also be referred to as the first user. The protector is also called the second user.

[0010] As shown in Figure 1, the information processing system 1 consists of a server 2 (information processing device) and the server 2 One or more first terminals 3 (information processing terminals) and second terminals connected via network 5 It includes 4 (information processing terminal). In the example shown in Figure 1, the information processing system 1 is server 2, The system is configured to have one first terminal 3 and one second terminal 4, but the information processing system The number of servers 2, first terminals 3, and second terminals 4 provided by 1 is arbitrary.

[0011] (Server 2) Figures 2 and 3 are configuration diagrams of Server 2. Figure 2 shows the main hardware configuration of Server 2. Server 2 consists of a communication IF200A, a storage device 200B (storage unit), and a CPU 200C. It is equipped with the following. Although not shown in Figure 2, Server 2 is an input device (for example, mouse (Keyboards, keyboards, touch panels, etc.) and display devices (CRT (Cathode Ray Tube), LCDs) It may also be equipped with a display, such as an OLED display.

[0012] The communication IF200A communicates with other devices (for example, terminal 3, terminal 4, etc.) It is the interface.

[0013] Storage device 200B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD). It is a Solid State Drive. The storage device 200B contains various data and information processing programs. This is stored. Furthermore, some or all of the various data stored in memory device 200B are, USB (Universal Serial Bus) external storage devices such as memory sticks and external HDDs, and network connections The data may be stored in the memory of another information processing device connected via 5. In this case, -ver 2 refers to various data stored in external storage devices or other information processing devices. It will be acquired.

[0014] The storage device 200B contains account information for the first terminal 3, for example, the identification number of the first terminal 3. (Device ID), Name, Contact Information (Email Address, Phone Number), Second User (e.g., myself) The identification number (terminal ID) of the second terminal 4, which is owned by the child of the person in question, is stored there. Furthermore, the storage device 200B contains account information for the second terminal 4, for example, the terminal information for the second terminal 4. Last ID, name, first device owned by the first user (for example, a family member such as your parent or grandparent) Terminal ID 3 is stored. Furthermore, the storage device 200B contains various data transmitted and received by the first terminal 3 and the second terminal 4. The data (including metadata attached to the data) corresponds to the terminal ID along with the date and time data as a log. It is attached and stored in the account. Furthermore, this various data is logged along with the date and time data. It may be stored in association with an ID. Here, the various types of data mentioned above include, for example, the following data. (1) Data for determining location (for example, location information transmitted from the second terminal 4) (2) Audio data (including audio data converted from text data) (3) Text data (including converted audio data) Furthermore, the above various data include the acquisition date and time (which can also be the recording date and time or the conversion date and time), the transmission date and time, Date and time of receipt, terminal ID of the first or second terminal that sent the message, and the first or second terminal that received the message. This includes metadata such as the device ID. Location information refers to data used to determine a location. It is also called a report.

[0015] The CPU200C controls the server 2 according to this embodiment, and includes ROM and RAM (not shown). It is equipped with the following features.

[0016] Figure 3 is a functional block diagram of Server 2. As shown in Figure 3, Server 2 is a receiving unit 2 01, Transmission unit 202, Storage device control unit 203 (association unit), Text conversion unit 204, Voice Conversion unit 205, file format conversion unit 206, removal unit 207, volume adjustment unit 208, extraction unit 2 It has functions such as 09. Note that the functions shown in Figure 3 are performed by the CPU 200C on the storage device 200 This is achieved by executing the information processing program stored in B.

[0017] The receiving unit 201 receives data (including metadata) transmitted from the first terminal 3 and the second terminal 4. The receiver 201 receives data, for example, data for determining location. This includes audio data, text data, etc. Note that the data mentioned above is just an example. This does not interfere with the receiving unit 201 receiving other data.

[0018] The transmission unit 202 transmits data (including metadata) to the first terminal 3 and the second terminal 4. The data transmitted by the transmitter 202 includes, for example, data for determining location, and voice data. This includes text data, etc. Note that the data described above is just an example, and the transmission unit 2 This does not prevent 02 from transmitting other data.

[0019] The storage device control unit 203 processes the data (metadata) transmitted and received by the first terminal 3 and the second terminal 4. (including) are stored in storage device 200B, associated with the terminal ID of the terminal that sent and received the data. Furthermore, the storage device control unit 203 associates various data with the terminal ID and stores them in the storage device 2 Store in 00B.

[0020] The text conversion unit 204 converts the audio data received by the receiving unit 201 into text data. This allows for playback of audio data in situations where it is undesirable, such as on trains or buses. Text messages can be confirmed in public transportation, public facilities such as libraries, etc. It can be recognized and is highly convenient.

[0021] The voice conversion unit 205 converts the text data received by the receiving unit 201 into voice data. This makes it undesirable to view text data in situations such as when using a vehicle (bicycle). Voice messages can be received while driving (including in a car), walking, running, exercising, cooking, etc. It is convenient because it allows you to check the sage. Also, the second terminal 4 does not have a display device. Even if the display device cannot show text, you can still confirm the message by voice. It is highly convenient because it allows for this.

[0022] The file format conversion unit 206 converts the file format of the audio data. The exchange unit 206, for example, converts audio data to the storage capacity of the storage device equipped in the second terminal 4 or to the speaker. The file format is converted accordingly. The file format conversion unit 206, for example, if the amount of data... The files are compressed to reduce their size. This allows the audio data to be sent to the second terminal 4. This reduces the amount of data used when transmitting, thereby lowering communication costs. This reduces the storage capacity of the memory device equipped in terminal 4, thereby lowering the cost of terminal 4. Furthermore, the type of the second terminal 4 is associated with the terminal ID in the storage device 200B. It stores data, as well as data that associates file formats and types, and performs file format conversion. Unit 206 identifies the type of the second terminal 4 from the terminal ID and associates it with this identified type. It may also be configured to convert audio data to a specific file format. The exchange unit 206 adjusts the audio data to match the storage capacity of the storage device and speaker of the first terminal 3. You may also convert the file format. This will allow you to send audio data to the first terminal 3. This can reduce the amount of data used and thus lower communication charges. Furthermore, the first terminal 3 is equipped with The storage capacity of the storage device can be reduced. Data that associates the type with the terminal ID, and data that associates the file format with the type. The file format conversion unit 206 stores this information and identifies the type of the first terminal 3 from the terminal ID. Even if you configure it to convert audio data to a file format associated with the specified type good.

[0023] The removal unit 207 removes from the audio data any bands that are outside the audible range, outside the audio band, or are noise. Audio data is processed to remove or reduce data, or to emphasize only the audio bandwidth. This reduces the amount of data transmitted to the second terminal 4. This can reduce communication charges. The removal unit 207 removes the voice data transmitted to the second terminal 4. Remove or reduce data in the audible range, outside the speech band, or in the noise band of the data. Alternatively, the audio data may be processed to emphasize only the audio frequency band. This reduces the amount of data transmitted to the second terminal 4, thereby lowering communication charges. It is possible.

[0024] The volume adjustment unit 208 adjusts the playback volume when audio data is played back on the second terminal 4. This allows the audio output device, such as the speaker, of the second terminal 4 to be matched to the grade of the audio output device. It can play back data and suppress sound distortion, etc. The storage device is 200B. This includes data that associates the type of the second terminal 4 with the terminal ID, and data that associates the playback volume with the type. The volume control unit 208 stores the digit data and identifies the type of the second terminal 4 from the terminal ID. The system is configured to adjust the volume of the audio data to the playback volume associated with this identified type. It is also possible to do so. The volume adjustment unit 208 controls the playback sound when audio data is played back on the first terminal 3. The amount may be adjusted. This will allow the audio output device such as the speaker equipped in the first terminal 3 to be controlled. Audio data can be played back according to the RAID. Furthermore, the first Data that associates the type of terminal 3 with the terminal ID, and data that associates the playback volume with the terminal type. The volume control unit 208 stores the terminal ID and identifies the type of the first terminal 3 from this identification. The system may be configured to adjust the volume of the audio data to the playback volume associated with the specified type. .

[0025] The extraction unit 209 extracts data from the storage device 200B based on sorting conditions. Then, the extraction unit 209 extracts the data specified by the sorting conditions. Furthermore, the extraction unit 209 extracts data associated with the location information history (via the terminal ID). For example, extract audio data.

[0026] (Terminal 1, 3) The first terminal 3 is a terminal owned by the first user, for example, the first terminal 3 in this embodiment Application software to enable the terminal to function with each of the indicated functions This includes a smartphone with the software installed. The first user registers using the first device 3. By sending and receiving voice data and text data with the second terminal 4, the second user (for example, It is possible to communicate with your child (using voice and text). Figure 4 shows the first terminal 3. This shows the main hardware configuration, including communication IF300A, storage device 300B, and input device 300. C, Display device 300D, CPU 300E, Microphone 300F, Speaker 300G It is equipped with such features.

[0027] The communication IF300A is an interface for communicating with other devices (in this embodiment, server 2). - It's the face.

[0028] The storage device 300B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD). It is a Solid State Drive. The storage device 300B contains the terminal ID and information processing programs. Application software and other data are stored. The terminal ID identifies the first terminal 3. This is the number for that purpose. By assigning the terminal ID to the data sent from the first terminal 3, the server 2 can determine which first terminal 3 the received data was sent from. Yes. Note that the terminal ID is the IP (Internet Protocol) address, MAC (Media Access) address. You may also use a Control address, and Server 2 will assign it to the first terminal 3. You can do that. Furthermore, the storage device 300B records the data transmitted and received between the first terminal 3 and the second terminal 4. It may be stored. The storage device 300B may contain, for example, transmitted and received data (for example, voice). Data (including text data) may be stored in a corresponding manner.

[0029] The input device 300C is, for example, an input device such as a keyboard, mouse, or touch panel. However, other devices or equipment may be used as long as they can be used for input. Also, voice input devices are also acceptable. That's fine.

[0030] Display device 300D is, for example, a liquid crystal display, a plasma display, or an organic EL display. While displays are an option, other devices or equipment (e.g., CRT: Cathode) can display the image if possible. (Ray Tube) is also acceptable.

[0031] The CPU300E controls the first terminal 3 according to this embodiment, and includes a ROM and RA (not shown). It has M.

[0032] Microphone 300F is an audio device that converts sound into electrical signals. The system can input audio using the Microphone 300F. The voice is transmitted to server 2 by the transmission unit 302, which will be described later.

[0033] The Speaker 300G is an audio device that converts electrical signals into sound. For example, For example, the audio data transmitted from the second terminal 4 via server 2 and stored in storage device 300B Play the data.

[0034] Similar to the second terminal 4 described later, the current location is determined based on signals from GNSS satellites. The system may be equipped with a position sensor that outputs the current position identified by the position sensor. Furthermore, if the location of the first terminal 3 can be determined, the current location will be output by a method other than the location sensor. Alternatively, one method other than a position sensor could be wireless access. Use of point information, use of mobile network tower information, acceleration sensors and magnetic sensors One possible approach is to utilize the movement amount and direction of the first terminal 3 using the "S" function. (Examples are provided below.) Of course, other methods are also acceptable.

[0035] Figure 5 shows a functional block diagram of the first terminal 3, which consists of a receiving unit 301 and a transmitting unit. Signal unit 302, storage device control unit 303, input receiving unit 304 (receiving unit), display device control unit 30 It has functions such as 5 (display control unit) and audio output control unit 306. The functions shown in Figure 5 The CPU 300E then executes the information processing program stored in the memory device 300B. This will be achieved.

[0036] The receiving unit 301 receives data transmitted from, for example, the server 2.

[0037] The transmission unit 302 transmits data in response to input operations received by the input reception unit 304, for example. Send to -ver2.

[0038] The storage device control unit 303 controls the storage device 300B. For example, the data sent and received by the first terminal 3 and the second terminal 4, etc., are sent and received by terminal I, which sent and received the data. It is associated with D and stored in the storage device 300B. Furthermore, the storage device control unit 303, for example, The transmitted and received audio and text data are stored in the storage device 300B.

[0039] The input receiving unit 304 receives input operations from the input device 300C. 4, for example, accepts message input.

[0040] The display control unit 305 controls the display device 300D and the data received by the receiving unit 301. The information is displayed on the display device 300D. The display device control unit 305 is, for example, a notification control unit. It functions as follows: when the receiving unit 301 receives audio data, the display device 300D receives the audio data. It has a push notification function that displays a message indicating that the action has been taken.

[0041] The audio output control unit 306 controls the speaker 300G. The speaker 300G outputs audio The audio output control unit 406 outputs audio based on the control of the force control unit 306. The audio output control unit 406, for example, reports It functions as a control unit and causes the receiver 301 to play back at least a portion of the audio data. The audio output control unit 406 notifies that audio data has been received. When audio data is received in step 1, a sound is generated in a predetermined pattern to indicate that the audio has been received. You may also want to set up a notification system.

[0042] (Terminal 2, 4) Terminal 4 is a terminal used by the second user of this information processing system 1. This allows the second terminal 4 to send and receive voice and text data with the first terminal 3 which has been registered. This allows you to communicate with the first user (for example, your family) via voice. Figure 6 shows the main hardware configuration of the second terminal 4, which is a communication IF400A , storage device 400B, input device 400C, display device 400D, CPU 400E, micro It is equipped with a phone 400F, speaker 400G, position sensor 400H, etc.

[0043] The communication IF400A is an interface for communicating with other devices (in this embodiment, server 2). - It's the face.

[0044] Storage device 400B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD). It is a Solid State Drive. The storage device 400B contains the terminal ID and information processing programs. Voice data and other information transmitted from the first terminal 3 are stored. The terminal ID identifies the second terminal 4. This is the number used for that purpose. By adding the terminal ID to the data transmitted from the second terminal 4, -ver 2 determines which second terminal 4 the received data was sent from. This is possible. Note that the terminal ID is determined by the IP (Internet Protocol) address and MAC (Media Acc). You may also use an address such as a ess Control address, which Server 2 assigns to the second terminal 4. You may do so. Furthermore, the storage device 400B stores the transmitted and received data (for example, audio data). It's okay to be there.

[0045] The input device 400C is, for example, an input device such as an operation button, but is capable of input. If so, other devices or equipment, such as a keyboard, mouse, or touch panel, may also be used. It may also be an audio input device. The second user operates the input device 400C to input sound This involves inputting voice data and sending it to server 2, or playing back audio data sent from server 2. It is possible.

[0046] The display device 400D is, for example, an LED. The display device 400D lights up in a predetermined pattern. The device will indicate that it has received audio by illuminating or flashing.

[0047] The CPU400E controls the second terminal 4 according to this embodiment, and includes a ROM and RA (not shown). It has M.

[0048] The microphone 400F is an audio device that converts sound into electrical signals. The system can input audio using the Microphone 400F. The voice is transmitted to server 2 by the transmission unit 402, which will be described later.

[0049] The Speaker 400G is an audio device that converts electrical signals into sound. For example, For example, the audio data transmitted from the first terminal 3 via server 2 and stored in storage device 400B The audio is played back. Additionally, the speaker 400G generates sound in predetermined patterns to produce audio. It will notify that it has received the message.

[0050] The position sensor 400H determines its current location based on signals from GNSS satellites. The position sensor 400H outputs the identified current location. The location of the second terminal 4 is also identified. If possible, it would be good to output the current position using a method other than the 400H position sensor. Other methods besides the 400H position sensor include, for example, wireless access point information. The use of mobile network tower information, and the use of acceleration sensors and magnetic sensors Possible methods include utilizing the movement amount and direction of travel of the two terminals (4). Note that other methods may also be considered. But that's perfectly fine, of course.

[0051] Figure 7 shows a functional block diagram of the second terminal 4, which consists of a receiving unit 401 and a transmitting unit. Signal unit 402, storage device control unit 403, input reception unit 404, display device control unit 405 (display control It has functions such as the audio output control unit 406. The functions shown in Figure 7 are CPU 4 00E is achieved by executing the information processing program stored in memory device 400B. It will be done.

[0052] The receiving unit 401 receives data transmitted from, for example, server 2, such as voice data. ru.

[0053] The transmission unit 402 transmits data, for example, in response to an input operation received by the input reception unit 304. For example, the audio data will be sent to server 2.

[0054] The storage device control unit 403 controls the storage device 400B. For example, it controls the memory device 400B to write and read data. For example, 403 stores the data received by the receiving unit 401 in the storage device 400B.

[0055] The input receiving unit 404 receives input operations from the input device 400C. For example, unit 4 accepts a playback command for audio data stored in the memory device 400B.

[0056] The display device control unit 405 controls the display device 400D. For example, it functions as a notification control unit, and when it receives audio data at the receiving unit 401, the display device 400 LED D is turned on or blinked in a predetermined pattern.

[0057] The audio output control unit 406 controls the speaker 400G. The speaker 400G outputs audio The audio output control unit 406 outputs sound based on the control of the force control unit 406. The audio output control unit 406, for example, reports It functions as a control unit and, upon receiving audio data at the receiving unit 401, generates sound in a predetermined pattern. This notifies that audio has been received. The audio output control unit 406 is connected to the receiving unit 4 By playing at least a portion of the audio data in step 01, the system will notify that the audio data has been received. It would be good to let them know.

[0058] (display screen) Figures 8 to 11 show examples of screen G1 displayed on the display device 300D of the first terminal 3. Therefore, please refer to Figures 8 to 11 below to see the image displayed on the display device 300D of the first terminal 3. An example of surface G1 will be described. Note that this configuration is the same as the one described with reference to Figures 1 to 7. The same symbol is used to omit redundant explanations.

[0059] (Screen description of Figure 8) As shown in Figure 8, the display device 300D transmits and receives data between the first terminal 3 and the second terminal 4. The text data, which is a conversion of the audio data into text, is arranged chronologically for each audio file. It is displayed (hereinafter also referred to as the timeline display).

[0060] In the example shown in Figure 8, the name of the second user 11 (or handle name) is displayed at the top of screen G1. ) is displayed. Also, on the left side of screen G1, the audio data (from the second terminal 4) sent from the second terminal 4 is displayed. The date and time 12D (time) on which the text data 12B converted from the audio files of two users was sent It uses the information from Im Stamp and is displayed along with icon 12A. Also, the play button Selecting 12C displays the audio data corresponding to the text data 12B (audio file). The audio (L) is played and you can hear the sound. Also, on the right side of screen G1, the message sent from terminal 3 is displayed. Text data 13A, which is a converted version of the transmitted audio data (the first user's audio file), is sent. It is displayed along with the date and time of transmission (using timestamp information). Each text data sent from terminal 3 has status 13D (for example, voice on terminal 4). Whether or not the data has been played is also displayed. Additionally, it is displayed when the play button 13B is selected. The audio data (audio file) corresponding to the text data 13A is played and the audio is heard. It is possible.

[0061] In the example shown in Figure 8, the text data converted from the audio data is the file of the audio data. Although displayed in chronological order by unit, the text data 12B converted from the audio data is displayed. The configuration may not be shown. In this case, for example, instead of text data 12B The playback time of the audio data may be displayed, but this is not necessarily the only example. stomach. Furthermore, in the example shown in Figure 8, all the characters converted from the audio data are displayed on the screen. However, it is not always necessary to display all characters; for example, the first few characters (for example, You can also choose to display 10 characters.

[0062] (Screen description in Figure 9) Screen G2 shown in Figure 9 is created by selecting (tapping) icon 15, as explained in Figure 8. This is the screen that you will transition to. As shown in Figure 9, when you select icon 15 in Figure 8, A display frame 16 for sending a message to the second terminal 4 will rise up from the bottom of screen G2. It appears in this way. The first user operates the input device 300C such as a touch panel to access screen G2 By selecting the microphone icon 16A displayed within the display frame 16, you can record audio and create a second audio track. It can be sent to terminal 4. Note that selecting microphone icon 16A will result in the microphone icon The display of unit 16A (for example, the color of the icon) changes to indicate that recording has started. The first user finishes speaking their message (for example, "I'll come pick you up now"), and then When you re-select microphone icon 16A, the display format of microphone icon 16A (for example, icon The color of the indicator returns to its original state, indicating that recording has finished. Also, below the microphone icon 16A, there is a message that was pre-set in the storage device 300B. Sage 16B, Message 16B entered by the first user, downloaded from Server 2 Multiple messages such as message 16B are displayed, and the first user uses an input device 300 such as a touch panel. By operating C and selecting one of the multiple messages 16B displayed, this selection The message 16B can be sent to the second terminal 4.

[0063] Furthermore, message 16B displayed on screen G2 in Figure 9 is a message from the first user. It is preferable that the items be displayed in an order that corresponds to their frequency of use or settings made by the first user. For example, When messages are displayed based on usage frequency, it is preferable that they be displayed in order of frequency of use. It seems so. Also, the message 16B displayed on screen G2 in Figure 9 is a setting by the first user. The items may be displayed in a corresponding order. In this case, the same applies as explained in Figure 10 below. Similarly, the first user operates the input device 300C to manually rearrange the display order of message 16B. It may be possible to make it possible to change the settings. Also, the preset message 16B can be used. It is also possible to set it to display in order of frequency, and the message 16B entered by the first user is You can also set it to display in order of frequency of use. In addition, the message's advantages are taken into consideration, taking into account variations in message notation (for example, similarity of messages). It is preferable to calculate the frequency of use.

[0064] (Screen description of Figure 10) Furthermore, as already mentioned, the message entered by the first user contains micro The voice message recorded using Phone 300F and the first user input device 300C This includes text messages entered by operating the system. Here, voice messages The word "ji" is transcribed (converted to text) and displayed as the title of the audio file. Figure 10 shows the title of the audio file after the audio message has been transcribed (converted to text). This is an example of screen G3 displayed. As illustrated in Figure 10, screen G3 displays voice messages The audio file containing the transcript (text) of the message is titled 16B. It will be displayed. Also, terminal 3 will access server 2 and the stamp store described later will be The purchase information of one user is checked, and if a purchase history exists, the voice stamp and voice (described below) are displayed. The stamp title will also be displayed on screen G3. Note that the title of the voice stamp will be displayed to the first user. The message displayed may differ from the one entered (for example, the font may be changed, or a star may appear before the title). Any symbol may be added (or otherwise). The first user is an input device such as a touch panel 300C By operating the controls and selecting the voice stamp store 17A on screen G3, you can access the stamps not shown in the diagram. The screen transitions to the stamp store, and the stamp store appears, displaying the voice message entered by the first user. You can purchase or download different voice stamps (voice files) for free. Yes. For example, when you proceed with purchasing a voice stamp on the stamp store screen, server 2 will 1. Records the purchase information of one user and stores it on server 2, corresponding to the purchased voice stamp. Audio files (for example, audio recordings of messages made by voice actors, actors, idols, etc.) Voice files, voices of messages produced by speech synthesis engines such as Vocaloid (registered trademark) (Files, etc.) can be used. Furthermore, the first user operates the input device 300C, such as a touch panel, to access title 16B. By selecting the swap button 17B located on the left side (by long-pressing or tapping), you can change the timing. The display order of Tor16B can be changed. Furthermore, the first user operates the input device 300C, such as a touch panel, to access title 16B. By selecting the edit button 17C located to the right (by long-pressing or tapping), Regarding the audio file that forms the basis of Title 16B, you can change the volume, playback speed, and pitch. Furthermore, the playback start time, playback end time, etc. can be edited. However, if the audio file is not sound If it's a voice stamp, you can also hide the edit button 17C. Furthermore, the first user operates the input device 300C, such as a touch panel, to the right of title 16B. Select the play button 17D located on the side (by long-pressing or tapping). You can play (listen to) the original audio file for Ru16B. Furthermore, the first user operates the input device 300C, such as a touch panel, to access title 16B. By selecting the recording button 17E located on the right side (by long-pressing or tapping), you can start recording. It is possible to re-record the original audio files for Tor16B. Also, the audio file titles 16B can be set to be displayed in order of frequency of use. Good. However, when displaying messages in order of frequency of use, variations in message formatting (for example, message It is preferable to calculate the frequency of message usage by considering factors such as the similarity of the messages.

[0065] (Screen description of Figure 11) As shown in Figure 11, in this embodiment, the display device 300D of the first terminal 3 is connected to the second terminal 4 The history of location P can be overlaid on the map and displayed. Also, the display screen 300D At the top, the current time T and the username U of the second terminal 4 are displayed. Furthermore, display screen 300 At the bottom of D, Calendar C and Slider S are displayed. The first user is the calendar By clicking C and selecting a date, the location history of the second terminal 4 P for the selected date can be viewed. This can be displayed. Also, the first user can move slider S to the left or right. This allows you to zoom in or out on the map. Note that it is associated with location P. If data exists, for example, audio data, a speech bubble F will be displayed at the corresponding position P. This indicates that associated data (e.g., audio data) exists. The implementation form shows the status of the associated data (whether it has been verified or not). For example, if the associated data is audio data, the audio data will be sent to the first terminal 3. If it has been played, it will be marked as "read". In this way, not only the location history, but also the location It's highly convenient because you can see what kind of information is associated with the data.

[0066] Furthermore, the second terminal 4 may have, for example, an LCD display, a plasma display, or an OLED display. Equipped with a display device such as a screen, it can display the screens exemplified in Figures 8 to 11 on the first terminal 3. It may be configured as follows. In this case, the relationship between the first terminal 3 and the second terminal 4 is illustrated in Figures 8 to 11. The opposite occurs on the screen.

[0067] (Information processing) Figures 12 to 17 show flowcharts illustrating an example of information processing in Information Processing System 1. The information processing of Information Processing System 1 will be explained below with reference to Figures 12 to 17. Note that components identical to those described with reference to Figures 1 to 11 are denoted by the same reference numerals to avoid duplication. I will omit the explanation.

[0068] (Location information transmission process) Figure 12 is a flowchart showing an example of the location information transmission process of the information processing system 1. The following describes an example of the location information transmission process of the information processing system 1, with reference to Figure 12. do.

[0069] (Step S101) The transmission unit 402 of the second terminal 4 determines if a predetermined interval (for example, every 1.5 minutes) has occurred. Determine whether it is true or false. If the predetermined interval is reached (YES), Server 2 proceeds to step S1. Execute process 02. If the specified interval has not been reached (NO), Server 2 will process End of explanation.

[0070] (Step S102) The transmission unit 402 of the second terminal 4 transmits the position information output from the position sensor 400H to the server 2 It will be sent to [destination]. Note that the data sent from the second terminal 4 will include the terminal ID of the second terminal 4 and the [type]. Data such as the stamp (sending date and time, location information positioning date and time) is attached.

[0071] (Step S103) The receiving unit 201 of server 2 receives location information transmitted from the second terminal 4.

[0072] (Step S104) The storage control unit 203 of server 2 processes the location information (metadata) transmitted and received by the second terminal 4. (including) are stored in storage device 200B, associated with the terminal ID of the terminal that sent and received the data. .

[0073] (Message sending process 1) Figure 13 is a flowchart showing an example of message transmission process 1 of information processing system 1. Yes. Below, please refer to Figure 13 for an example of message transmission processing 1 of the information processing system 1. Let me explain. Figure 13 shows the case when sending a message from the first terminal 3 to the second terminal 4. I will explain this.

[0074] (Step S201) The first user operates the input device 400C of the first terminal 3 to send a message via voice or text. Enter the character.

[0075] (Step S202) When audio is input, it is converted into an electrical signal by microphone 400F (not shown). After being converted to digital data by the A / D converter, it is transmitted as audio data from the transmission unit 302. It is sent to Server 2. Also, if text is entered, it is sent as text data. It is sent from 302 to server 2. Note that the data sent from the first terminal 3 includes the first terminal The terminal ID and timestamp data are attached to the last three entries.

[0076] (Step S203) The receiving unit 201 of server 2 receives data transmitted from the first terminal 3. The voice conversion unit 205 determines whether the receiving unit 201 has received voice data. If a message is received (YES), Server 2 executes the process in step S205. If no data has been received (NO), server 2 executes the process in step S204.

[0077] (Step S204) The voice conversion unit 205 of server 2 converts the received text data into voice data. Oh, when receiving text data and converting it to speech, a language conversion unit (not shown) converts the original text data to speech. Audio data with the language changed to another language, or the original language changed to one or more other languages. It is also possible to create audio data that allows all sounds to be played back. This should be configured in advance using terminal 3.

[0078] (Step S205) When the storage control unit 203 of server 2 receives audio data, it will receive a message from the first terminal 3. The audio data is stored in the storage device 200B, associated with the terminal IDs that sent and received the data. Furthermore, when the storage device control unit 203 receives text data, the first terminal 3 transmits... The text data and the audio data obtained by converting this text data are sent and received. The terminal ID is associated with the device and stored in storage device 200B.

[0079] (Step S206) Server 2 performs the audio data conversion process. Details of the audio data conversion process are shown in the diagram. See section 15 below for further details.

[0080] (Step S207) The transmitting unit 202 of server 2 refers to the storage device 200B, and the receiving unit 201 receives the audio. The terminal ID of the second terminal 4, which is associated with the terminal ID assigned to the data, was identified. Audio data transmitted from the first terminal 3 to the second terminal 4, or audio converted by the audio conversion unit 205. Tap the data.

[0081] (Step S208) The receiving unit 401 of the second terminal 4 receives the voice data transmitted from the server 2. The end 4 notifies that a message has been received. This notification is, for example, from the display device control unit 4. 05 controls the display device 400D and receives messages, for example, by lighting up an LED or making a sound. The system may notify that this has happened, or the audio output control unit 406 may control the speaker 400G to produce sound or audio. The system may also notify the user that a message has been received by outputting a voice signal.

[0082] (Message sending process 2) Figure 14 is a flowchart showing an example of the message transmission process 2 of the information processing system 1. Yes. Below, please refer to Figure 14 for an example of the message transmission process 2 of the information processing system 1. Let me explain. Figure 14 shows the case when sending a message from the second terminal 4 to the first terminal 3. I will explain this.

[0083] (Step S301) The second user inputs voice by operating the input device 400C of the second terminal 4. The audio signal is converted into an electrical signal by the microphone 400F.

[0084] (Step S302) The transmission unit 402 of the second terminal 4 transmits the input voice data to the server 2. The data transmitted from terminal 4 includes the terminal ID of terminal 4, a timestamp, and other data. The "Ta" designation is attached.

[0085] (Step S303) The receiving unit 201 of server 2 receives the voice data transmitted from the second terminal 4.

[0086] (Step S304) The text conversion unit 204 of server 2 converts the received audio data into text data. Furthermore, when converting the received audio data into text data, a language conversion unit (not shown) is used. Therefore, text data in which the original language has been changed to another language, or the original language and one or more other languages Text data that can display all the text changed to the language simultaneously It is also possible to do so. In that case, the settings must be configured in advance using the first terminal 3.

[0087] (Step S305) The storage device control unit 203 of server 2 processes the audio data and text transmitted by the second terminal 4. The conversion unit 204 stores the converted text data in association with the terminal IDs that sent and received the data. Store in device 200B.

[0088] (Step S306) The transmitting unit 202 of server 2 refers to the storage device 200B, and the receiving unit 201 receives the audio. The terminal ID of the first terminal 3, which is associated with the terminal ID assigned to the data, was identified. The audio data transmitted from the second terminal 4 to the first terminal 3 and converted by the text conversion unit 204 Send text data.

[0089] (Step S307) The receiving unit 301 of the first terminal 3 receives voice data and text data transmitted from the server 2. Receive.

[0090] (Step S308) The receiving unit 301 of the first terminal 3 receives voice data and text data transmitted from the server 2. The first terminal 3 receives the message. The first terminal 3 notifies that it has received the message. This notification is, for example, The display device control unit 305 controls the display device 300D, for example, by sending a push notification. The system may also notify that a message has been received, or the audio output control unit 306 may output to speaker 300. You may also use G to output sound or voice to indicate that a message has been received.

[0091] (Audio data conversion processing) Figure 15 is a flowchart showing an example of the audio data conversion process of the information processing system 1. The following is an example of the audio data conversion process of Information Processing System 1, referring to Figure 15. explain.

[0092] (Step S401) The removal unit 207 of server 2 removes audio data received by the receiving unit 201 that is outside the audible range or To remove or reduce data outside the audio band or in the noise band, or to focus only on the audio band. The audio data is processed to enhance certain aspects.

[0093] (Step S402) The volume control unit 208 of server 2 controls the playback volume when audio data is played back on the second terminal 4. Adjust.

[0094] (Step S403) The file format conversion unit 206 of server 2 converts the file format of the audio data.

[0095] Note that each step of the audio data conversion process described with reference to Figure 15 is not necessarily a step. It is not necessary to process steps S401 to S403 in that order; the order can be changed. One or more of steps S401 to S403 are processed in any order. That's fine.

[0096] Furthermore, as mentioned above, when transmitting voice data from the second terminal 4 to the first terminal 3, Figure 1 You may also perform the audio data conversion process described in section 5.

[0097] (TL display processing) Figure 16 is a flowchart showing an example of the TL display process in Information Processing System 1. Below, with reference to Figure 16, an example of the TL display process of the information processing system 1 will be explained.

[0098] (Step S501) The first user operates the input device 300C of the first terminal 3 to sort the data they want to display. Enter the conditions. The input receiving unit 304 of the first terminal 3 receives the entered sorting conditions, The transmission unit 302 sends the sorting conditions received by the input reception unit 304 to the server 2. The receiving unit 201 of unit 2 receives the sorting conditions transmitted from the first terminal 3.

[0099] (Step S502) The extraction unit 209 of server 2 extracts data from the storage device 200B based on sorting conditions. For example, the extraction unit 209 extracts data specified by the sorting conditions (e.g., location information). Extract history and audio data, etc.

[0100] (Step S503) The transmitting unit 202 of server 2 refers to the storage device 200B, and the receiving unit 201 receives the data Identify the terminal ID of the first terminal 3 that is associated with the terminal ID assigned to the terminal, and identify the first terminal 3 The extraction unit 209 transmits the extracted data to terminal 3 to terminal 1 terminal 3. The receiving unit 3 of terminal 1 terminal 3 01 receives data transmitted from server 2. Display device control unit 305 of the first terminal 3 The receiving unit 301 displays the received data on the display device 300D.

[0101] As mentioned above, the second terminal 4 may have, for example, an LCD display, a plasma display Ray, equipped with a display device such as an organic EL display, and TL display as described with reference to Figure 16. You may also choose to execute the process.

[0102] (Map display processing) Figure 17 is a flowchart showing an example of the map display process of Information Processing System 1. Below, with reference to Figure 17, an example of the map display processing of the information processing system 1 will be explained.

[0103] (Step S601) The first user operates the input device 300C of the first terminal 3 to instruct the map display. The input receiving unit 304 of terminal 3 receives instructions for map display. The transmission unit 302 of terminal 3 The command to display the map is sent to server 2. The receiving unit 201 of server 2 receives from the first terminal 3. Receive instructions for displaying the transmitted map.

[0104] (Step S602) The extraction unit 209 of server 2 refers to the storage device 200B and assigns instructions for map display. Identify the terminal ID of the second terminal 4 that is associated with the terminal ID, and then determine the location of the identified second terminal 4. Extract the history of the report.

[0105] (Step S603) Furthermore, the extraction unit 209 of server 2 associates the location information history (via the terminal ID) Extract the collected data, for example, audio data.

[0106] (Step S604) The transmitting unit 202 of server 2 refers to the storage device 200B, and the receiving unit 201 receives the data Identify the terminal ID of the first terminal 3 that is associated with the terminal ID assigned to the terminal, and identify the first terminal 3 The terminal 3 receives the history of location information extracted by the extraction unit 209 and the information associated with the history of location information. Send data, such as audio data.

[0107] (Step S605) The receiving unit 301 of the first terminal 3 receives the history of location information transmitted from the server 2 and the location information Receive data associated with the history.

[0108] (Step S606) The display device control unit 305 of the first terminal 3 maps the history of location information received by the receiving unit 301. The display device 300D above will display the information (see, for example, Figure 11). The location control unit 305 associates location information displayed on the map with history or nearby locations. The presence of the data is displayed on the display device 300D.

[0109] In the map display process illustrated in Figure 17, Server 2 uses the extracted location information history and The audio data associated with this location history (via the terminal ID) is sent to the first terminal 3. It is being transmitted, but the extracted location information history and this location information history (via terminal ID) ) Data indicating the existence of associated audio data (e.g., flag information) and The command is sent to the first terminal 3, and when the user instructs the playback of the audio data, the instructed audio data is played. Alternatively, the system could be configured to download and play content from server 2.

[0110] As mentioned above, the second terminal 4 may have, for example, an LCD display, a plasma display The map display, which includes a display device such as an organic EL display, is described with reference to Figure 17. You may also choose to execute the process.

[0111] According to the information processing system 1 of this embodiment, audio data is converted into text data. Sending or receiving text data, or converting text data to audio data and then sending or receiving it. This is possible. Therefore, one of the first user and the second user (or both) can use text. Users who have difficulty with inputting text or voice input (for example, children or elderly people who have difficulty with complex terminal operations) (For example, a person, a user with speech impairment, etc., or a device that makes text input or voice input difficult) For example, due to constraints such as the difficulty of attaching a keyboard to small devices or the cost, If it is difficult to turn on a display, etc., or if your hands are occupied and you have difficulty typing text. This includes situations where recording or playing back audio is difficult, such as in private settings or public spaces, and is suitable for users with various attributes. Communication between the two parties (first user and second user) in the terminal and scene. This becomes possible.

[0112] [Modified examples of embodiments] In the above embodiment, the LEDs of the display device 400D of the second terminal 4 are used to display text. The display device 400D of the second terminal 4 may be configured to display a liquid crystal panel. Alternatively, an OLED panel may be used and configured to display text. This converts the audio data transmitted from the first terminal 3 and server 2 into text data. It can also be confirmed via KIST. In addition, text sent from the first terminal 3 and server 2. You can also check the data.

[0113] In the above embodiment, some or all of the functions of the server 2 shown in Figure 3 are defined as the first At least one of terminal 3 and the second terminal 4 may have it. For example, as shown in Figure 3. Among the functions of Server 2 are the storage device control unit 203 (association unit) and the text conversion unit 204. The audio conversion unit 205, the file format conversion unit 206, the removal unit 207, and the volume adjustment unit 208 are all small At least one of the first terminal 3 and the second terminal 4 may have one or more functions. In this case, at least one of the first terminal 3 and the second terminal 4 may acquire or refer to the Information stored in the storage device 200B, or the Information stored in the storage device 200B may be stored in at least one of the storage devices 300B and 400B. Further, in the above embodiment, at least one of the functions of the first terminal 3 may be possessed by the second terminal 4, or at least one of the functions of the second terminal 4 may be possessed by the first terminal 3.

[0114] Also, the screen G1 described with reference to FIG. 8 may be the screen G4 shown in FIG. 18. In the screen G4 shown in FIG. 18, an input frame 18A for inputting a text message and a microphone icon 18B for inputting a voice message are provided, and the first user can select whether to input a message in either text or voice. In the input text message, characters without sound (e.g., symbols, etc.) or combinations thereof (e.g., surrounding a character with sound with the aforementioned symbols, etc.) can be used to change the sound source (the tone color of the voice or the tone color of the musical instrument), or to finely specify the volume, pitch, etc.

[0115] Also, the screen G5 shown in FIG. 19 is a screen that transitions after inputting a voice message or a text message. As shown in FIG. 19, the first user operates an input device 300C such as a touch panel to select the icon 19A on the screen G5, thereby inputting the voice message or the text message. ​​​​​​​​​​​​​It can be confirmed by auditioning the voice. Also, the first user can re-enter the voice message or text message by operating the input device 3 such as a touch panel 00C to select the icon 19B on the screen G5. In addition, the first user can set the notification pattern when the second user terminal 4 notifies that it has received a message from the first user terminal 3. In the example shown in FIG. 19, the first user can select the notification pattern from "Incoming call sound ON" 20A, "Incoming call sound OFF" 20B, and "Ring with this voice as the incoming call sound" 20C. Note that in the example shown in FIG. 19, the notification pattern is selected from three, but the notification pattern is not limited to the example shown in FIG. 19. Also, on the screen G5, it is also possible to specify the voice color and emotion when playing the voice message. When the first user selects the voice color from the voice color options 21 and selects the emotion from the emotion options 22, the voice message is played on the second terminal 4 of the other party who sent the voice message with the selected voice color and emotion. Note that the expression of the voice color and emotion can be realized by learning the human voice by machine learning of AI and performing voice synthesis.

[0116] FIGS. 20 and 21 are diagrams illustrating that voice data or text data has been received by the display device 300D by the PUSH notification function. As shown in FIG. 20, it may be possible to perform only a PUSH notification of the fact that a message has been received and the name of the user who sent the message. Or, as shown in FIG. 21, the content of the received message (when the message is long, for example, when there are more than a predetermined number of characters, only the first predetermined number of characters of the message content may be displayed, or a summary of the content may be displayed) and ​​​​​​​​​​​​Alternatively, you can configure push notifications to include the username of the user who sent the message. Note that Figure 21 shows... The example shows how to play a push notification message ("Play hands-free", "Listen to audio"). (For example, "Press to play," "Open app," etc.) and responding to messages (pre-registered messages) Select a message (such as a preset message or a user-registered message) It's highly convenient because you can perform actions like sending messages without opening the app.

[0117] (Processing when new audio is received before the audio received on the second terminal 4 is heard) After receiving the audio data transmitted from server 2 at terminal 4, terminal 4 receives the audio data Before the audio is played, new audio data may be sent from server 2. In that case, the audio Regarding the retention of voice data, the second terminal 4 is, for example, as illustrated in (1) to (3) below. Execute one of the following processes. Note that the following processes require a storage capacity of the storage device 400B of the second terminal 4. Due to its limited capacity, this process is executed on the second terminal 4. (1) When new audio data is received, the previously received audio data is stored in the storage device 40 Erase starting from 0B. (2) Audio data buffer capable of storing any number of data or storage capacity (for example) The audio data is stored in a predetermined area provided in the storage device 400B, and the audio data buffer When the storage is about to overflow, the oldest data is deleted using the FIFO (first in first out) method. ru. (3) Audio data buffer capable of storing any number of data or storage capacity (for example) The audio data is stored in a predetermined area provided in the storage device 400B, and the audio data buffer When it is about to overflow, a buffer full notification is sent to the first terminal 3 via server 2 (second terminal) It sends information to terminal 4 indicating that it can no longer store any more audio data, and terminal 1 3. Display a message indicating that message sending is not possible. Furthermore, when the second terminal 4 performs an operation to play audio data, the second terminal 4 will process the audio data in the buffer. The audio data is played back in the order it was stored or in the order of the newest audio data, but after that the audio data is played back You can delete the audio data on the fa, or delete all audio data except the last one received. Alternatively, you may always perform the process described in (2) above without deleting the data. These settings can be changed from the first terminal 3.

[0118] (Talk group) In the above embodiments and modifications, the first terminal 3 and the second terminal 4 were described as a pair. However, by using multiple first terminal 3 and / or second terminal 4, and combining them into a single talk group... It can also be a group. A talk group has a unique ID on server 2 (talk group). Managed by (P-ID), and furthermore, all first terminal 3 and second terminal belonging to the same talk group. The last four identification numbers (device IDs) are linked. Each device belongs to a chat group. You can also set a name that is easy for users to understand, and in that case, the terminal ID and terminal The final name is also linked. Furthermore, messages can be sent simultaneously between devices within the same chat group. However, it is also possible to send messages only to specific devices. For example, sending from the first device 3. If you wish to send a message, please select the device you wish to send the message from on the text or voice message sending screen. This can be done by selecting one or more items and sending them. Additionally, a voice message can be sent from the second terminal 4. If you want to send a message, you should say the name of the device you want to send the message to during the voice message, or the second To send a voice message to the terminal 4, press the button to be operated for any number of times during any period of time to select the terminal to be sent, or press the button to be operated for sending the voice message for any number of times during any period of time so that the speaker 40G of the second terminal 4 prompts "To whom do you want to send?" Then, when the name of one or more terminals to be sent is input by voice from the second user, after confirming the name of the destination terminal to be sent to the second user, receive the message to be sent to the second user and send it to the target terminal within the same talk group via the server 2 or the like. In addition, each of the above-described embodiments and modified examples is merely an example of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner by these. That is, the present invention can be implemented in various forms without departing from the gist or main features thereof .

[0119]

Explanation of Signs

[0120] 1 Information processing system 2 Server (information processing device) 200A Communication IF 200B Storage device 200C CPU 201 Receiver 202 Transmitter 203 Storage device control unit (association unit) 204 Text conversion unit 205 Voice conversion unit 206 File format conversion unit 207 Removal unit 208 Volume adjustment unit 209 Extraction unit 3 First terminal (information processing terminal) 300A Communication IF 300B storage device 300C Input Device 300D display device 300E CPU 300F Microphone 300G Speaker 301 Receiver 302 Transmitter 303 Storage Unit 304 Input Reception Department (Reception Department) 305 Display device control unit (display control unit) 306 Audio Output Control Unit 4. Second Terminal 400A Communication IF 400B storage device 400C Input Device 400D display device (LED) 400E CPU 400F Microphone 400G Speaker 400H Position Sensor 401 Receiver 402 Transmitter 403 Storage Unit 404 Input Reception Section 405 Display device control unit (display control unit) 406 Audio Output Control Unit 5 Network

Claims

1. A receiving unit that receives audio data transmitted from the first terminal or the second terminal, The receiving unit converts the audio data received by the receiving unit into text data, The conversion unit transmits the converted text data to the second terminal or the first terminal. The transmitting unit, An information processing device characterized by comprising:

2. A receiving unit that receives text data transmitted from the first terminal or the second terminal, The receiving unit includes a speech conversion unit that converts the received text data into speech data, The conversion unit transmits the converted audio data to the second terminal or the first terminal. Department and, An information processing device characterized by comprising:

3. The aforementioned audio data and information for identifying the location of the first terminal or the second terminal are related It is equipped with a connecting attachment part, The receiving unit is Receiving information for identifying the location transmitted from the first terminal or the second terminal, The aforementioned related attachment part is, The receiving unit associates the audio data it receives with the information for identifying the location. 、 The aforementioned transmitting unit The audio data and the information for identifying the location associated with the audio data. The following is transmitted to the second terminal or the first terminal: The information processing apparatus according to feature 1.

4. The text data and information for identifying the location of the first terminal or the second terminal. It includes an association part that associates, The receiving unit is Receiving information for identifying the location transmitted from the first terminal or the second terminal, The aforementioned related attachment part is, The receiving unit associates the text data it receives with the information for identifying the location. Attach, The aforementioned transmitting unit To identify the text data and the position associated with the text data The information is transmitted to the second terminal or the first terminal. The information processing apparatus according to feature 2.

5. The aforementioned related attachment part is, Information for identifying the aforementioned location, the date and time the location information was measured, and the date of transmission. The time and reception date and time, or one or more of the above, and the recording date and time, transmission date and time, and reception date and time of the audio data. Based on one or more of the above, the position of the first terminal or the second terminal is added to the audio data. To associate information in order to identify The information processing apparatus according to claim 3.

6. A format conversion unit that converts the file format of the aforementioned audio data, The information processing apparatus according to claim 1, characterized by comprising:

7. Of the aforementioned audio data, remove data that is outside the audible range, outside the audio band, or in the frequency band that constitutes noise. It includes a removal unit that eliminates or reduces, or emphasizes only the audio band. The aforementioned transmitting unit The aforementioned removal unit removes data from outside the audible range, outside the audio band, or from the band that would otherwise be considered noise. Audio data with the audio bandwidth removed or reduced, or with only the audio bandwidth emphasized, is sent to the second terminal or the front To be sent to terminal 1, The information processing apparatus according to feature 1.

8. The transmitting unit adjusts the playback volume of the audio data transmitted to the second terminal or the first terminal. Adjustable volume control section, The information processing apparatus according to claim 1, characterized by comprising:

9. A receiving unit that receives audio data, The receiving unit converts the audio data received by the receiving unit into text data, The conversion unit outputs the text data converted by the conversion unit, An information processing terminal characterized by being equipped with the following features.

10. A receiving unit that receives text data, The receiving unit includes a speech conversion unit that converts the received text data into speech data, The conversion unit outputs the audio data converted by the conversion unit, An information processing terminal characterized by being equipped with the following features.

11. A reception desk that accepts voice data input, A text conversion unit that converts the voice data received by the reception unit into text data. 、 A transmission unit that transmits the text data converted by the conversion unit, An information processing terminal characterized by being equipped with the following features.

12. A reception unit that accepts text data input, The aforementioned reception unit converts the text data received by the reception unit into audio data, A transmission unit that transmits the audio data converted by the conversion unit, An information processing terminal characterized by being equipped with the following features.

13. The system includes an association unit that associates the aforementioned audio data with information for determining location, The receiving unit is Information for identifying the aforementioned location is received, The aforementioned related attachment part is, The receiving unit associates the audio data it receives with the information for identifying the location. ru, The information processing terminal according to feature 9.

14. The system includes an association unit that associates the aforementioned text data with information for identifying a location, The receiving unit is Information for identifying the aforementioned location is received, The aforementioned related attachment part is, The receiving unit associates the text data it receives with the information for identifying the location. wear, The information processing terminal according to feature 10.

15. A volume adjustment unit adjusts the playback volume of the audio data transmitted by the transmission unit. The information processing terminal according to claim 11, characterized by comprising the above.

16. When the receiving unit receives the audio data or the text data, the audio data or The notification control unit causes the system to notify that the text data has been received. The information processing terminal according to claim 9 or 10, characterized by comprising:

17. The notification control unit, By playing back at least a portion of the aforementioned audio data or text data, the sound To notify that voice data or the aforementioned text data has been received. The information processing terminal according to feature 16.

18. The aforementioned related attachment part is, Information for identifying the aforementioned location, the date and time the location information was measured, and the date of transmission. The time and reception date and time, or one or more of the above, and the recording date and time, transmission date and time, and reception date and time of the audio data. Based on one or more of the above, other information processing that transmits the audio data to the audio data Associate information to pinpoint the location of the data terminal. The information processing terminal according to feature 13.

19. A format conversion unit that converts the file format of the aforementioned audio data, The information processing terminal according to claim 9, characterized by comprising:

20. Remove data from the aforementioned audio data that is outside the audible range, outside the audio band, or in the frequency range that contains noise. Alternatively, it may include a reduction or removal unit that emphasizes only the audio band. The aforementioned transmitting unit The removal unit removes or reduces data outside the audible range or the audio band. Furthermore, it transmits audio data with only the audio bandwidth emphasized to other information processing terminals. The information processing terminal according to feature 11.

21. The volume control adjusts the playback volume of the audio data transmitted by the transmitting unit to other information processing terminals. Orthopedics, The information processing terminal according to claim 11, characterized by comprising the above.

22. A receiving unit that receives audio data and text data obtained by converting the audio data, The existence of the audio data received by the receiving unit and at least the text data A display control unit that displays parts of it in association with each other, An information processing terminal characterized by being equipped with the following features.

23. Information for identifying the location of other information processing terminals, and audio data or modified audio data. A receiving unit that receives the converted text data, Information for identifying the location of the other information processing terminal received by the receiving unit, A display control unit that displays the presence of recorded audio data or the text data in association with it, An information processing terminal characterized by being equipped with the following features.

24. The display control unit, Information for identifying the location of the other information processing terminal received by the receiving unit, The presence of the recorded audio data or the text data is displayed on the map in association with it. The information processing terminal according to feature 22.

25. The display control unit, Display one or more audio or text data, The aforementioned information processing terminal is A receiving unit that receives the specification of the displayed audio data or the text data, The reception unit transmits the voice data or text data that has been received as a designation. The transmitting unit, The information processing terminal according to claim 23, characterized by comprising:

26. The aforementioned information processing terminal is Information for identifying the location of the information processing terminal is output at predetermined intervals to maintain the location of the information processing terminal. A terminal for monitoring the actions of the person holding it. The information processing terminal according to any one of claims 9 to 12, characterized in that it is the same as the one described above.

27. The receiving unit receives audio data transmitted from the first terminal or the second terminal, The text conversion unit converts the audio data received by the receiving unit into text data. The process, The transmission unit transmits the text data converted by the conversion unit to the second terminal or the first terminal. The process of sending to, An information processing method characterized by having the following features.

28. Computers, A receiving unit that receives voice data transmitted from the first terminal or the second terminal. A text conversion unit converts the audio data received by the receiving unit into text data. The conversion unit transmits the converted text data to the second terminal or the first terminal. Transmitter, An information processing program characterized by functioning as such.

Images