Information processing device, information processing terminal, information processing method, and information processing program

Abstract

To provide an information processing device, information processing terminal, information processing method, and information processing program with higher convenience.SOLUTION: An information processing device according to the present invention comprises: a receiving unit that receives voice data transmitted from a first terminal or a second terminal; a text conversion unit that converts the voice data received by the receiving unit into text data; and a transmitting unit that transmits the text data converted by the conversion unit to the second terminal or the first terminal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device and an information processing terminal that can be used in a system for transmitting and receiving audio data. , an information processing method, and an information processing program. [Background technology]

[0002] GPS devices capable of transmitting and receiving voice data have been proposed for use in monitoring children. do. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Retable 2020 / 202449 Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional GPS devices simply provide users with location information and voice information. However, there is room for improvement in terms of convenience.

[0005] The present invention has been made in consideration of the above-mentioned problems, and provides a more convenient information processing device and information An object of the present invention is to provide an information processing terminal, an information processing method, and an information processing program. [Means for solving the problem]

[0006] In order to solve the above problem, an information processing device according to the present invention is provided. a receiving unit for receiving voice data transmitted by the receiving unit, and converting the voice data received by the receiving unit into text data; a text conversion unit that converts the text data converted by the conversion unit into and a transmitting unit that transmits to a second terminal or the first terminal. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a more convenient information processing device, information processing terminal, information processing method, and information An information processing program can be provided. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the layout of an information processing system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a configuration of an information processing server (information processing device) according to the embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of a configuration of an information processing server according to the embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of the configuration of a first terminal (information processing terminal) according to the embodiment. [Figure 5] FIG. 2 is a diagram illustrating an example of a configuration of a first terminal according to the embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of the configuration of a second terminal (information processing terminal) according to the embodiment. [Figure 7] FIG. 2 is a diagram illustrating an example of a configuration of a second terminal according to the embodiment. [Figure 8] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first terminal according to the embodiment. [Figure 9] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first terminal according to the embodiment. [Figure 10] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first terminal according to the embodiment. [Figure 11] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first terminal according to the embodiment. [Figure 12] 10 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 13] 10 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 14]10 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 15] 10 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 16] 10 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 17] 10 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 18] FIG. 10 is a diagram showing an example of a screen displayed on a display device of a first terminal according to a modified example of the embodiment. [Figure 19] FIG. 10 is a diagram showing an example of a screen displayed on a display device of a first terminal according to a modified example of the embodiment. [Figure 20] FIG. 10 is a diagram showing an example of a screen displayed on a display device of a first terminal according to a modified example of the embodiment. [Figure 21] FIG. 10 is a diagram showing an example of a screen displayed on a display device of a first terminal according to a modified example of the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] [Embodiment] An information processing system 1 according to an embodiment will be described below with reference to the drawings. The information processing system 1 according to the embodiment is a so-called monitoring system. From a portable second terminal 4 carried by a user (e.g., a child), Data uploaded to Server 2 at a predetermined interval, for example, every 1.5 minutes. The location of the second terminal 4 is determined from the location information, and the determined location is sent from the server 2 to the watcher (for example, the parent The information is notified to the first terminal 3 carried or used by the person (family member or relative, such as a parent or grandparent). In the information processing system 1 according to this embodiment, the first terminal 3 and the second terminal 4 each have a microphone. , and speakers, and can send and receive voice messages (hereinafter also referred to as voice) In other words, the system is configured so that the watcher and the person being watched can communicate by voice. The first terminal 3 is configured to be able to exchange messages by is equipped with a display device and is configured to convert speech into text and display it on the display device. In the following description, the watcher is also referred to as the first user. The guardian is also called the second user.

[0010] As shown in FIG. 1, the information processing system 1 includes a server 2 (information processing device) and One or more first terminals 3 (information processing terminals) and second terminals 4 connected to the network 5 In the example shown in FIG. 1, the information processing system 1 includes a server 2, The information processing system is configured to include one first terminal 3 and one second terminal 4. The number of servers 2, first terminals 3, and second terminals 4 included in the system 1 is arbitrary.

[0011] (Server 2) 2 and 3 are diagrams showing the configuration of the server 2. FIG. 2 shows the main hardware configuration of the server 2. The server 2 includes a communication IF 200A, a storage device 200B (storage unit), a CPU 200C, Although not shown in FIG. 2, the server 2 may include an input device (e.g., a mouse). display devices (CRT (Cathode Ray Tube), LCD display, etc.) The display may be a display, an organic EL display, or the like.

[0012] The communication IF 200A is used for communication with other devices (for example, the first terminal 3, the second terminal 4, etc.). It is an interface for

[0013] The storage device 200B is, for example, a hard disk drive (HDD) or a semiconductor storage device (SSD ( The storage device 200B is a solid state drive (SDD). Various data and information processing programs are stored in the storage device 200B. In addition, a part or all of the various data stored in the storage device 200B is stored in the External storage devices such as USB (Universal Serial Bus) memory and external HDDs, and network The data may be stored in a storage device of another information processing device connected via the network 5. The server 2 refers to or processes various data stored in an external storage device or in a storage device of another information processing device. is obtained.

[0014] The storage device 200B stores account information of the first terminal 3, for example, the identification number of the first terminal 3. (Device ID), name, contact information (email address, phone number), second user (e.g., yourself) The identification number (terminal ID) of the second terminal 4 carried by the person (the child) or the like is stored. The storage device 200B also stores account information of the second terminal 4, for example, The first user's ID, name, and the first device owned by the first user (for example, your parents, grandparents, or other family members) The device ID of 3 is stored. In addition, the storage device 200B stores various data ( (including metadata attached to the data) corresponds to the device ID along with the date and time data as a log. The various data are stored as logs along with the date and time. It may be stored in association with the ID. Here, the various data include, for example, the following data: (1) Data for identifying the location (e.g., location information transmitted from the second terminal 4) (2) Audio data (including audio data converted from text data) (3) Text data (including converted audio data) In addition, the above various data include the acquisition date and time (recording date and time, conversion date and time may also be used), transmission date and time, Date and time of receipt, the device ID of the first or second device that sent the message, and the device ID of the first or second device that received the message It includes metadata such as device ID. Location information is also used to identify a location. It is also called news.

[0015] The CPU 200C controls the server 2 according to this embodiment, and stores ROM and RAM (not shown). Equipped with:

[0016] 3 is a functional block diagram of the server 2. As shown in FIG. 3, the server 2 includes a receiving unit 2 01, transmission unit 202, storage device control unit 203 (association unit), text conversion unit 204, voice Conversion unit 205, file format conversion unit 206, removal unit 207, volume adjustment unit 208, extraction unit 2 3. The functions shown in FIG. 3 are implemented by the CPU 200C. This is realized by executing the information processing program stored in B.

[0017] The receiving unit 201 receives data (including metadata) transmitted from the first terminal 3 and the second terminal 4. The data received by the receiving unit 201 includes, for example, data for specifying a position. This includes data, voice data, text data, etc. The data listed above is just an example. This does not prevent the receiving unit 201 from receiving other data.

[0018] The transmitting unit 202 transmits data (including metadata) to the first terminal 3 and the second terminal 4. The data transmitted by the transmitting unit 202 includes, for example, data for identifying a position, audio data, etc. The data described above is an example, and the data transmitted by the transmitting unit 2 This does not prevent the 02 from transmitting other data.

[0019] The storage device control unit 203 controls the data (metadata) transmitted and received by the first terminal 3 and the second terminal 4. (including the above) is stored in the storage device 200B in association with the terminal ID of the terminal that transmitted and received the data. In addition, the storage device control unit 203 stores various data in the storage device 2 in association with the terminal ID. Store it in 00B.

[0020] The text conversion unit 204 converts the voice data received by the receiving unit 201 into text data. This allows for situations where it is not desirable to play audio data, such as on a train or bus. You can send messages by text message on public transport such as public transport, libraries, etc. It is highly convenient because it can be recognized.

[0021] The voice conversion unit 205 converts the text data received by the receiving unit 201 into voice data. This makes it possible to view text data in situations where it is not desirable, such as when driving a vehicle (bicycle) You can receive voice messages while driving (including a car), walking, running, exercising, cooking, etc. In addition, the second terminal 4 does not have a display device. Even if the display device cannot display text, you can hear the message aloud. This makes it highly convenient.

[0022] The file format conversion unit 206 converts the file format of the audio data. The conversion unit 206 converts the audio data into a format suitable for the storage capacity of the storage device of the second terminal 4 and the speaker. The file format conversion unit 206 converts the file format according to the amount of data, for example. This allows the audio data to be sent to the second terminal 4 in a timely manner. This reduces the amount of data transmitted and reduces communication charges. The storage capacity of the storage device provided in the second terminal 4 can be reduced, thereby reducing the cost of the second terminal 4. Furthermore, the type of the second terminal 4 is associated with the terminal ID in the storage device 200B. The data and the data associating the file format with the type are stored, and the file format is converted. The unit 206 identifies the type of the second terminal 4 from the terminal ID and In addition, the file format conversion may be configured to convert the audio data into a file format. The conversion unit 206 converts the audio data to match the storage capacity of the storage device and the speaker of the first terminal 3. This allows the file format to be converted easily when transmitting voice data to the first terminal 3. The amount of data can be reduced, and communication charges can be reduced. It is possible to reduce the storage capacity of the storage device to be used. Data that associates the type of file with the device ID, and data that associates the file format with the type The file format conversion unit 206 identifies the type of the first terminal 3 from the terminal ID, and Even if it is configured to convert audio data into a file format corresponding to a specific type, good.

[0023] The removal unit 207 removes audio data that is outside the audible range, outside the audio band, or in a band that becomes noise. Process audio data to remove or reduce data, or to emphasize only the voice band This makes it possible to reduce the amount of data when transmitting voice data to the second terminal 4. The removal unit 207 can reduce the communication charges for the voice data to be transmitted to the second terminal 4. Remove or reduce data that is outside the audible range, outside the voice band, or in a band that becomes noise. Alternatively, the audio data may be processed so as to emphasize only the audio band. The amount of data transmitted to the second terminal 4 can be reduced, thereby reducing communication charges. It is possible.

[0024] The volume adjustment unit 208 adjusts the playback volume when the audio data is played back on the second terminal 4. This allows audio to be output in accordance with the grade of an audio output device such as a speaker provided in the second terminal 4. The data can be reproduced and distortion of the sound can be suppressed. data in which the type of the second terminal 4 is associated with the terminal ID, and data in which the playback volume is associated with the type The volume adjustment unit 208 identifies the type of the second terminal 4 from the terminal ID, The volume of the audio data is adjusted to the playback volume associated with the specified type. The volume adjustment unit 208 may adjust the playback volume when the audio data is played back on the first terminal 3. This allows the first terminal 3 to output a sound from a speaker or other audio output device. The audio data can be reproduced in accordance with the speed. Data associating the type of terminal 3 with the terminal ID, and data associating the playback volume with the type The volume adjustment unit 208 identifies the type of the first terminal 3 from the terminal ID, and The volume of the audio data may be adjusted to the playback volume associated with the selected type. .

[0025] The extraction unit 209 extracts data from the storage device 200B based on the sorting conditions. For example, the extraction unit 209 extracts the data specified by the sorting conditions. The extraction unit 209 also extracts data associated with the history of location information (via the terminal ID). , for example, extracting audio data.

[0026] (Terminal 1 3) The first terminal 3 is a terminal possessed by the first user. For example, in this embodiment, the first terminal 3 is Install the application software to function as a terminal with the functions shown. The first user is a smartphone or the like that has the application installed. By transmitting and receiving voice data and text data to and from the second terminal 4, the second user (for example, You can communicate with your child (or your child) via voice or text. The main hardware configuration is shown as follows: communication IF 300A, storage device 300B, input device 300 C, a display device 300D, a CPU 300E, a microphone 300F, a speaker 300G, etc. etc.

[0027] The communication IF 300A is an interface for communicating with other devices (in this embodiment, the server 2). -face.

[0028] The storage device 300B is, for example, a hard disk drive (HDD) or a semiconductor storage device (SSD ( The storage device 300B is a solid state drive (SD). The storage device 300B stores a terminal ID and an information processing program ( The terminal ID identifies the first terminal 3. By adding a terminal ID to the data sent from the first terminal 3, the server The first terminal 2 can determine from which first terminal 3 the received data was sent. The terminal ID is a combination of the IP (Internet Protocol) address, MAC (Media Access Control) The server 2 may use a control address or the like to assign to the first terminal 3. It can also be set to The storage device 300B also stores data transmitted and received between the first terminal 3 and the second terminal 4. The storage device 300B may store, for example, transmitted and received data (for example, voice data or text data) may be stored in association with each other.

[0029] The input device 300C is, for example, an input device such as a keyboard, a mouse, or a touch panel. However, other devices or equipment may be used as long as they are capable of inputting voice. It is also possible.

[0030] The display device 300D may be, for example, a liquid crystal display, a plasma display, or an organic EL display. However, other devices or equipment (e.g., CRT: Cathode ray tube) can also be used if they are capable of displaying images. Ray Tube).

[0031] The CPU 300E controls the first terminal 3 according to this embodiment, and stores information about the ROM and RA (not shown). Equipped with M.

[0032] The microphone 300F is an acoustic device that converts sound into an electrical signal. The user can input voice using the microphone 300F. The voice is transmitted to the server 2 by a transmitting unit 302, which will be described later.

[0033] The speaker 300G is an acoustic device that converts electrical signals into sound. For example, the voice data transmitted from the second terminal 4 via the server 2 and stored in the storage device 300B is Play the data.

[0034] In addition, similar to the second terminal 4 described later, the current position is determined based on signals from GNSS satellites. The present position may be output by a position sensor that outputs the current position determined by the position sensor. It is sufficient to identify the location of the first terminal 3, and the current location may be output by a method other than a location sensor. As a method other than the location sensor, for example, wireless access Use of point information, use of mobile network tower information, acceleration sensor and magnetic sensor It is conceivable to use the amount of movement and direction of travel of the first terminal 3 by using the sensor. Of course, other methods are also acceptable.

[0035] FIG. 5 shows a functional block diagram of the first terminal 3. The first terminal 3 includes a receiving unit 301, a transmitting unit 302, and a a reception unit 302, a storage device control unit 303, an input reception unit 304 (reception unit), a display device control unit 30 5 (display control unit), audio output control unit 306, etc. The functions shown in FIG. The CPU 300E executes the information processing program stored in the storage device 300B. This is achieved by:

[0036] The receiving unit 301 receives data transmitted from the server 2, for example.

[0037] The transmission unit 302 transmits data in response to an input operation received by the input receiving unit 304, for example. Send to Server 2.

[0038] The storage device control unit 303 controls the storage device 300B. For example, data transmitted and received by the first terminal 3 and the second terminal 4 is recorded in the terminal I that transmitted and received the data. D and stored in the storage device 300B. The transmitted and received voice data and text data are stored in the storage device 300B.

[0039] The input receiving unit 304 receives an input operation from the input device 300C. 4, for example, accepts message input.

[0040] The display device control unit 305 controls the display device 300D and receives the data from the receiving unit 301. The display device control unit 305 is configured as, for example, a notification control unit. When the receiving unit 301 receives audio data, the audio data is displayed on the display device 300D. It has a push notification function that displays that a message has been sent.

[0041] The audio output control unit 306 controls the speaker 300G. The voice output control unit 406 outputs voice based on the control of the force control unit 306. The receiver 301 functions as a signal processing unit, and causes the receiver 301 to play back at least a part of the audio data. The audio output control unit 406 notifies the reception unit 30 that the audio data has been received. When voice data is received in 1, a sound is generated in a predetermined pattern to indicate that voice data has been received. It may be configured to notify the user.

[0042] (2nd Terminal 4) The second terminal 4 is a terminal used by a second user of the information processing system 1. The second terminal 4 is used to send and receive voice data and text data to and from the registered first terminal 3. By doing so, the user can communicate with the first user (e.g., his / her family) by voice. FIG. 6 shows the main hardware configuration of the second terminal 4. The second terminal 4 includes a communication IF 400A. , storage device 400B, input device 400C, display device 400D, CPU 400E, It is equipped with a phone 400F, a speaker 400G, a position sensor 400H, etc.

[0043] The communication IF 400A is an interface for communicating with other devices (in this embodiment, the server 2). -face.

[0044] The storage device 400B is, for example, a hard disk drive (HDD) or a semiconductor storage device (SSD ( The storage device 400B is a solid state drive (SD). The storage device 400B stores a terminal ID, an information processing program, The voice data transmitted from the first terminal 3 is stored. The terminal ID identifies the second terminal 4. By adding a terminal ID to the data sent from the second terminal 4, The server 2 determines from which second terminal 4 the received data was sent. The terminal ID is a combination of the IP (Internet Protocol) address, MAC (Media Access Control) The address assigned by the server 2 to the second terminal 4 may be a TLS address. This may be done. In addition, the storage device 400B stores transmitted and received data (for example, audio data). It's fine.

[0045] The input device 400C is an input device such as an operation button, but is capable of inputting If necessary, other devices or equipment, such as a keyboard, mouse, touch panel, etc. Alternatively, the input device may be a voice input device. The second user operates the input device 400C to input a voice. Input voice and send it to Server 2, and play back the voice data sent from Server 2 can be done.

[0046] The display device 400D is, for example, an LED. The display device 400D lights up in a predetermined pattern. The device will light up or flash to indicate that it has received audio.

[0047] The CPU 400E controls the second terminal 4 according to this embodiment, and stores data in a ROM and RA (not shown). Equipped with M.

[0048] The microphone 400F is an acoustic device that converts sound into an electrical signal. The user can input voice using the microphone 400F. The voice is transmitted to the server 2 by a transmitting unit 402, which will be described later.

[0049] The Speaker 400G is an acoustic device that converts electrical signals into sound. For example, the voice data transmitted from the first terminal 3 via the server 2 and stored in the storage device 400B is The speaker 400G also generates sounds in a specific pattern to reproduce audio. It notifies that it has received the

[0050] The position sensor 400H identifies the current position based on signals from GNSS satellites. The position sensor 400H outputs the identified current position. If possible, the current position may be output by a method other than the position sensor 400H. As a method other than the location sensor 400H, for example, wireless access point information Use of mobile network tower information, acceleration sensors and magnetic sensors 2. It is possible to use the amount of movement and direction of the terminal 4. But of course, that's okay.

[0051] FIG. 7 shows a functional block diagram of the second terminal 4. The second terminal 4 includes a receiving unit 401, a transmitting unit 402, and a a reception unit 402, a storage device control unit 403, an input reception unit 404, a display device control unit 405 (display control 7. The functions shown in FIG. 7 are implemented by the CPU 4. 00E executes the information processing program stored in the storage device 400B. will be done.

[0052] The receiving unit 401 receives data, such as audio data, transmitted from the server 2. do.

[0053] The transmission unit 402 transmits data, e.g., For example, the audio data is transmitted to the server 2.

[0054] The storage device control unit 403 controls the storage device 400B. For example, it controls the storage device 400B to write and read data. 403, for example, stores the data received by the receiving unit 401 in the storage device 400B.

[0055] The input receiving unit 404 receives an input operation from the input device 400C. 4, for example, accepts a playback operation of audio data stored in the storage device 400B.

[0056] The display device control unit 405 controls the display device 400D. For example, when the receiver 401 receives audio data, the display device 400 D (LED) lights up or blinks in a specified pattern.

[0057] The audio output control unit 406 controls the speaker 400G. The sound output control unit 406 outputs sound based on the control of the force control unit 406. For example, the sound output control unit 406 It functions as a sound control unit, and when the receiving unit 401 receives voice data, it generates a sound with a predetermined pattern. The audio output control unit 406 notifies the reception of the audio by causing the receiving unit 4 01, by playing at least a portion of the audio data, the fact that the audio data has been received is reported. It may be configured to notify the user.

[0058] (display screen) 8 to 11 are diagrams showing an example of a screen G1 displayed on the display device 300D of the first terminal 3. Hereinafter, with reference to FIGS. 8 to 11, the image displayed on the display device 300D of the first terminal 3 will be described. An example of the surface G1 will be described. Note that the same configuration as that described with reference to FIGS. The same reference numerals are used to denote the same components, and redundant explanations will be omitted.

[0059] (Screen description of Figure 8) As shown in FIG. 8, the display device 300D displays the information transmitted and received between the first terminal 3 and the second terminal 4. The text data converted from the audio data is then sorted by audio data file in chronological order. (hereinafter also referred to as timeline display).

[0060] In the example shown in FIG. 8, the name 11 of the second user (which may be a handle name) is displayed at the top of the screen G1. ) is displayed. On the left side of the screen G1, the voice data (the The date and time 12D (time stamp) when the text data 12B converted from the user's voice file is sent It is displayed with the play button (using the time stamp information) and icon 12A. When 12C is selected, the audio data (audio file) corresponding to the displayed text data 12B is The message is played back and you can listen to the audio. Also, on the right side of the screen G1, you can see the audio sent from the first terminal 3. The text data 13A converted from the received voice data (voice file of the first user) is sent. The date and time of transmission 13C (using timestamp information) is also displayed. Each text data sent from the terminal 3 includes a status 13D (e.g., a voice message sent from the second terminal 4). Also, when the playback button 13B is selected, The audio data (audio file) corresponding to the text data 13A is played back and the user can listen to the audio. It can be done.

[0061] In the example shown in FIG. 8, the text data converted from the voice data is stored in the voice data file. The text data is displayed in chronological order in units of 12B. In this case, for example, instead of the text data 12B, The playback time of the audio data may be displayed, but this is not necessarily limited to this example. stomach. In the example shown in Figure 8, all characters converted from voice data are displayed on the display screen. However, it is not necessary to display all the characters. For example, the first several characters (e.g., It is also possible to display the character (up to 10 characters).

[0062] (Screen description of Figure 9) The screen G2 shown in FIG. 9 is displayed when the icon 15 described with reference to FIG. 8 is selected (tap operation). As shown in Figure 9, when icon 15 is selected in Figure 8, A display frame 16 for sending a message to the second terminal 4 appears from the bottom of the screen G2. The first user operates the input device 300C such as a touch panel to display the screen G2 By selecting the microphone icon 16A displayed in the display frame 16, you can record audio and It can be transmitted to the terminal 4. If you select the microphone icon 16A, The display of the 16A (e.g., the color of the icon) will change to indicate that recording has started. The first user finishes speaking a message (e.g., "I'll come pick you up now") and then When the microphone icon 16A is selected again, the display form of the microphone icon 16A (for example, The indicator light will return to its original color, indicating that recording has finished. Also, below the microphone icon 16A, a message preset in the storage device 300B is displayed. Message 16B, entered by user 1, downloaded from server 2 A plurality of messages such as message 16B are displayed, and the first user can input the message by using the input device 300 such as a touch panel. By operating C to select one of the multiple messages 16B displayed, The message 16B can be transmitted to the second terminal 4.

[0063] Also, the message 16B displayed on the screen G2 of FIG. 9 is a message from the first user. It is preferable to display them in an order according to the frequency of use or the setting made by the first user. For example, When messages are displayed according to frequency of use, it is preferable to display them in order of frequency of use. Furthermore, the message 16B displayed on the screen G2 of FIG. 9 indicates the setting by the first user. In this case, the images may be displayed in the same order as described later with reference to FIG. Similarly, the first user operates the input device 300C to manually rearrange the display order of the messages 16B. It may be possible to change the message to be set. The messages may be displayed in descending order of frequency, and the message 16B input by the first user may be It may be set to display in order of frequency of use. In this case, the message usage is calculated by taking into account variations in the message notation (e.g., similarity of the message). It is preferable to calculate the frequency of use.

[0064] (Screen description of Figure 10) As mentioned above, the message entered by the first user is The first user inputs a voice message using the phone 300F and the second user inputs a voice message using the input device 300C. and text messages entered by operating the The message will be transcribed (converted to text) and displayed as the title of the audio file. Figure 10 shows the audio file title after transcribing the audio message (into text). As shown in FIG. 10, the screen G3 displays a voice message. The message in the audio file transcribed (converted to text) is titled 16B. The first terminal 3 also accesses the server 2 and displays the first stamp in the stamp store, which will be described later. 1. Check the user's purchase information, and if there is a purchase history, the voice stamp and voice The title of the stamp is also displayed on screen G3. The title of the voice stamp is also displayed on screen G3. The message you entered may appear differently (for example, with a different font or a star before the title). The first user may input any symbol (e.g., add any symbol). By operating the [ ] key and selecting the voice stamp store 17A on the screen G3, you can The first user will be transferred to the Sticker Store screen and the Sticker Store will appear. You can purchase or download free audio stamps (audio files) that are different from the above. For example, when you purchase a voice stamp on the stamp store screen, Server 2 Records the purchase information of 1 user and corresponds to the purchased voice stamp stored in server 2 Audio files (e.g., voice actors, actors, idols, etc.) Voice files, voice messages generated by voice synthesis engines such as Vocaloid (registered trademark) files, etc.) can be used. The first user also operates the input device 300C such as a touch panel to select the title 16B. By selecting the swap button 17B located on the left side (by long pressing or tapping), You can change the display order of the Tor 16B. The first user operates the input device 300C such as a touch panel to input the title 16B. By selecting the edit button 17C located to the right of the The original audio file for Title 16B can be adjusted to change the volume, playback speed, and pitch. You can change the playback time, start time, and end time. If it is a voice stamp, you can also choose not to display the edit button 17C. The first user also operates the input device 300C such as a touch panel to right-click the title 16B. By selecting (long press or tap) the play button 17D located on the side, you can play the title. You can play (listen to) the audio file that is the source of Rule 16B. The first user also operates the input device 300C such as a touch panel to select the title 16B. By selecting the recording button 17E located on the right side (by long pressing or tapping), you can record You can re-record the original audio file for Tor 16B. The audio file title 16B is also set to be displayed in order of frequency of use. In addition, when displaying the most frequently used messages, the message display may be inconsistent (for example, It is preferable to calculate the frequency of message usage by taking into consideration the similarity of messages, etc.

[0065] (Screen description of Figure 11) As shown in FIG. 11, in this embodiment, the display device 300D of the first terminal 3 is The history of the position P can be displayed superimposed on the map. The current time T and the user name U of the second terminal 4 are displayed at the top. A calendar C and a slider S are displayed below D. The first user can Click C to select a date, and the location P of the second device 4 for the selected date will be displayed. The first user can move the slider S to the left or right. The map can be enlarged or reduced in size by If there is data, for example, audio data, a speech bubble F is displayed at the corresponding position P. , it indicates that associated data (e.g., audio data) exists. In an embodiment, the status of the associated data (e.g., whether it has been verified) is indicated. For example, if the associated data is voice data, the voice data is transmitted to the first terminal 3. If it has already been played, it will be marked as "read". In this way, not only the location history but also the location It is highly convenient because you can check what information is associated.

[0066] The second terminal 4 may be, for example, a liquid crystal display, a plasma display, an organic EL display, or the like. The first terminal 3 is provided with a display device such as a display, and the screens shown in Figs. 8 to 11 can be displayed on the first terminal 3. In this case, the relationship between the first terminal 3 and the second terminal 4 may be configured as shown in FIGS. The opposite is true on the screen.

[0067] (Information Processing) 12 to 17 are flowcharts showing an example of information processing by the information processing system 1. The information processing of the information processing system 1 will be described below with reference to FIGS. The same components as those described with reference to FIGS. 1 to 11 are designated by the same reference numerals and will not be repeated. The explanation will be omitted.

[0068] (Location information transmission process) FIG. 12 is a flowchart illustrating an example of the location information transmission process of the information processing system 1. An example of the location information transmission process of the information processing system 1 will be described below with reference to FIG. do.

[0069] (Step S101) The transmitting unit 402 of the second terminal 4 checks whether a predetermined interval (for example, every 1.5 minutes) has elapsed. If the predetermined interval has come (YES), the server 2 performs step S1 If the predetermined interval has not elapsed (NO), the server 2 executes the process 02. End the process.

[0070] (Step S102) The transmitting unit 402 of the second terminal 4 transmits the position information output from the position sensor 400H to the server 2. The data transmitted from the second terminal 4 includes the terminal ID of the second terminal 4, It is accompanied by data such as a timestamp (date and time of sending, date and time of location information measurement).

[0071] (Step S103) The receiving unit 201 of the server 2 receives the location information transmitted from the second terminal 4.

[0072] (Step S104) The storage device control unit 203 of the server 2 receives and transmits the location information (metadata) transmitted by the second terminal 4. (including the ID of the terminal that transmitted or received the data) is stored in the storage device 200B in association with the terminal ID of the terminal that transmitted or received the data. .

[0073] (Message sending process 1) FIG. 13 is a flowchart showing an example of a message transmission process 1 of the information processing system 1. An example of the message transmission process 1 of the information processing system 1 will be described below with reference to FIG. In FIG. 13, a case where a message is sent from the first terminal 3 to the second terminal 4 is explained. This article explains:

[0074] (Step S201) The first user operates the input device 400C of the first terminal 3 to send a message by voice or text. Enter the message.

[0075] (Step S202) When a voice is input, it is converted into an electric signal by the microphone 400F, and After being converted into digital data by an A / D converter, the data is transmitted from the transmitting unit 302 as audio data. When text is input, it is sent to the server 2 as text data. 302 to the server 2. The data transmitted from the first terminal 3 includes the The last three data such as device ID and timestamp are added.

[0076] (Step S203) The receiving unit 201 of the server 2 receives the data transmitted from the first terminal 3. The voice conversion unit 205 determines whether the receiving unit 201 has received voice data. If the data is received (YES), the server 2 executes the process of step S205. If the data has not been received (NO), the server 2 executes the process of step S204.

[0077] (Step S204) The speech conversion unit 205 of the server 2 converts the received text data into speech data. When the received text data is converted into voice, the original Audio data in which the language has been changed to another language, or in which the original language has been changed to one or more different languages It is also possible to make the audio data so that all sounds can be played. This is set in advance using the first terminal 3.

[0078] (Step S205) When the server 2 receives the voice data, the storage device control unit 203 The received voice data is stored in the storage device 200B in association with the terminal ID that transmitted and received the data. In addition, when the storage device control unit 203 receives text data, it The text data and the voice data converted from this text data are transmitted and received. The information is stored in the storage device 200B in association with the terminal ID.

[0079] (Step S206) The server 2 executes the voice data conversion process. The details of the voice data conversion process are shown in FIG. 15, which will be discussed later.

[0080] (Step S207) The transmitting unit 202 of the server 2 refers to the storage device 200B and receives the voice data received by the receiving unit 201. The terminal ID of the second terminal 4 associated with the terminal ID assigned to the data is identified, and the identified terminal ID is Voice data transmitted from the first terminal 3 to the second terminal 4 or voice converted by the voice conversion unit 205 Send data.

[0081] (Step S208) The receiving unit 401 of the second terminal 4 receives the voice data transmitted from the server 2. The terminal 4 notifies the user that the message has been received. This notification is made, for example, by the display device control unit 4 05 controls the display device 400D to receive messages, for example, by lighting up an LED or making a sound. Alternatively, the audio output control unit 406 may control the speaker 400G to output a sound or The reception of the message may be notified by outputting a voice.

[0082] (Message sending process 2) FIG. 14 is a flowchart showing an example of the message transmission process 2 of the information processing system 1. An example of the message transmission process 2 of the information processing system 1 will be described below with reference to FIG. 14, the case where a message is sent from the second terminal 4 to the first terminal 3 will be described. This article explains:

[0083] (Step S301) The second user operates the input device 400C of the second terminal 4 to input voice. The sound is converted into an electrical signal by the microphone 400F.

[0084] (Step S302) The transmitting unit 402 of the second terminal 4 transmits the input voice data to the server 2. The data sent from the second terminal 4 includes the terminal ID of the second terminal 4, a timestamp, and other data. The data is given.

[0085] (Step S303) The receiving unit 201 of the server 2 receives the voice data transmitted from the second terminal 4 .

[0086] (Step S304) The text conversion unit 204 of the server 2 converts the received voice data into text data. When the received voice data is converted into text data, a language conversion unit (not shown) Therefore, text data that has been converted from the original language into another language, or data that has been converted from the original language into one or more different languages, Text data that allows you to simultaneously display all texts in different languages. In this case, the setting is made in advance by the first terminal 3.

[0087] (Step S305) The storage device control unit 203 of the server 2 converts the voice data and text data sent by the second terminal 4 into The text data converted by the conversion unit 204 is stored in association with the terminal ID that transmitted and received the data. Stored in device 200B.

[0088] (Step S306) The transmitting unit 202 of the server 2 refers to the storage device 200B and receives the voice data received by the receiving unit 201. The terminal ID of the first terminal 3 associated with the terminal ID assigned to the data is identified, and the identified terminal ID is The voice data transmitted from the second terminal 4 to the first terminal 3 and the text converted by the text converter 204 are Send text data.

[0089] (Step S307) The receiving unit 301 of the first terminal 3 receives the voice data and text data transmitted from the server 2. Receive.

[0090] (Step S308) The receiving unit 301 of the first terminal 3 receives the voice data and text data transmitted from the server 2. The first terminal 3 then notifies the reception of the message. This notification is made, for example, by The display device control unit 305 controls the display device 300D, for example, by a PUSH notification. The message may be received, or the audio output control unit 306 may output a message to the speaker 300. The reception of the message may be notified by controlling G to output a sound or voice.

[0091] (audio data conversion processing) FIG. 15 is a flowchart showing an example of the voice data conversion process of the information processing system 1. An example of the audio data conversion process of the information processing system 1 will be described below with reference to FIG. explain.

[0092] (Step S401) The removal unit 207 of the server 2 removes audio data received by the receiving unit 201 that is outside the audible range or Remove or reduce data outside the voice band or in the noise band, or select only the voice band The audio data is processed to emphasize the sound.

[0093] (Step S402) The volume adjustment unit 208 of the server 2 adjusts the playback volume when the audio data is played back on the second terminal 4. Adjust.

[0094] (Step S403) The file format conversion unit 206 of the server 2 converts the file format of the audio data.

[0095] Note that the steps of the audio data conversion process described with reference to FIG. 15 are not necessarily steps. It is not necessary to process steps S401 to S403 in this order, and the order may be changed. One or more of steps S401 to S403 may be processed in any order. That's fine.

[0096] As described above, when transmitting voice data from the second terminal 4 to the first terminal 3, 5. The audio data conversion process described above may be executed.

[0097] (TL display processing) FIG. 16 is a flowchart showing an example of the TL display process of the information processing system 1. An example of the TL display process of the information processing system 1 will be described below with reference to FIG.

[0098] (Step S501) The first user operates the input device 300C of the first terminal 3 to sort the data to be displayed. The input receiving unit 304 of the first terminal 3 receives the input sorting conditions, The transmission unit 302 transmits the sorting conditions received by the input reception unit 304 to the server 2. The receiving unit 201 of the second terminal receives the sorting conditions transmitted from the first terminal 3 .

[0099] (Step S502) The extraction unit 209 of the server 2 extracts data from the storage device 200B based on the sorting conditions. For example, the extraction unit 209 extracts data specified by the sorting conditions (for example, the history of location information). Extract data (such as history and audio data).

[0100] (Step S503) The transmitting unit 202 of the server 2 refers to the storage device 200B and receives the data received by the receiving unit 201. The terminal ID of the first terminal 3 associated with the terminal ID assigned to the data is identified, and the identified first terminal ID is The data extracted by the extraction unit 209 to the first terminal 3 is transmitted to the receiving unit 3 of the first terminal 3. 01 receives the data transmitted from the server 2. The display device control unit 305 of the first terminal 3 causes the data received by the receiving unit 301 to be displayed on the display device 300D.

[0101] As described above, the second terminal 4 may be equipped with a liquid crystal display, a plasma display, or the like. The TL display described with reference to FIG. 16 is provided with a display device such as a raster image display (TL display) or an organic EL display. The processing may be executed.

[0102] (Map display processing) FIG. 17 is a flowchart showing an example of a map display process of the information processing system 1. An example of map display processing by the information processing system 1 will be described below with reference to FIG.

[0103] (Step S601) The first user operates the input device 300C of the first terminal 3 to instruct map display. The input receiving unit 304 of the first terminal 3 receives an instruction to display a map. The server 2 then transmits a map display instruction to the server 2. The receiving unit 201 of the server 2 receives the map information sent from the first terminal 3. The transmitted map display instruction is received.

[0104] (Step S602) The extraction unit 209 of the server 2 refers to the storage device 200B and extracts the The terminal ID of the second terminal 4 associated with the terminal ID is identified, and the location information of the identified second terminal 4 is Extract the report history.

[0105] (Step S603) The extraction unit 209 of the server 2 also extracts the location information associated with the history of the location information (via the terminal ID). The collected data, for example, audio data, is extracted.

[0106] (Step S604) The transmitting unit 202 of the server 2 refers to the storage device 200B and receives the data received by the receiving unit 201. The terminal ID of the first terminal 3 associated with the terminal ID assigned to the data is identified, and the identified first terminal ID is The terminal 3 receives the history of the location information extracted by the extraction unit 209 and the information associated with the history of the location information. The data, for example, audio data, is transmitted.

[0107] (Step S605) The receiving unit 301 of the first terminal 3 receives the history of the location information transmitted from the server 2 and the location information Receive data associated with the history of

[0108] (Step S606) The display device control unit 305 of the first terminal 3 displays the history of the location information received by the receiving unit 301 on a map. The display device 300D displays the message (see, for example, FIG. 11). The location control unit 305 determines whether the location information displayed on the map is related to the history or is located in the vicinity of the history. The presence of the collected data is displayed on the display device 300D.

[0109] In the map display process illustrated in FIG. 17, the server 2 stores the history of the extracted location information and The voice data associated with this location information history (via the terminal ID) is sent to the first terminal 3. The extracted location information history and this location information history (via the device ID) ) Data indicating the existence of associated audio data (e.g., flag information) to the first terminal 3, and when the user instructs playback of the audio data, the instructed audio data is It may also be configured to be downloaded from the server 2 and played back.

[0110] As described above, the second terminal 4 may be equipped with a liquid crystal display, a plasma display, or the like. The map display device described with reference to FIG. 17 is provided with a display device such as a raster image display (RAD) or an organic EL display. The processing may be executed.

[0111] According to the information processing system 1 of this embodiment, voice data is converted into text data. or converting text data into voice data and sending or receiving it. Therefore, one of the first user and the second user (or both) can Users who have difficulty with keyboard or voice input (for example, children or elderly people who have difficulty with complex device operations) people with speech impairments, devices that make it difficult to input text or voice (e.g. For example, it is difficult to attach a keyboard to a small device or due to cost or other constraints. When it is difficult to attach a display, or when your hands are full, it is difficult to input text. It is suitable for users with various attributes, such as in crowded scenes or public spaces where recording and playback of audio is difficult. Communication between two users (first and second users) at a terminal and in a scene This becomes possible.

[0112] [Modification of the embodiment] In the above embodiment, the text is displayed by the LED provided on the display device 400D of the second terminal 4. The display device 400D of the second terminal 4 may be configured to be able to display the image. Alternatively, an organic EL panel may be used to display text. By doing so, the voice data transmitted from the first terminal 3 or the server 2 is converted into text data and the text is The text sent from the first terminal 3 or the server 2 can also be checked. You can also check the data.

[0113] In the above embodiment, some or all of the functions of the server 2 shown in FIG. At least one of the terminal 3 and the second terminal 4 may have the same. For example, the Among the functions of the server 2, the storage device control unit 203 (association unit), the text conversion unit 204 , a voice conversion unit 205, a file format conversion unit 206, a removal unit 207, and a volume adjustment unit 208. At least one of the first terminal 3 and the second terminal 4 has at least one function. In this case, the information stored in the storage device 200B may be transmitted to the first terminal 3 and the second terminal 4. At least one of the terminals 4 may acquire or refer to the data, or the data may be stored in the storage device 200B. The information is stored in at least one of the storage device 300B and the storage device 400B. Good too. In the above embodiment, at least one of the functions of the first terminal 3 is provided to the second terminal 4. Alternatively, at least one of the functions of the second terminal 4 may be provided to the first terminal. 3 may have the same.

[0114] Moreover, the screen G1 described with reference to FIG. 8 may be replaced with the screen G4 shown in FIG. The screen G4 shown in FIG. 1 has an input box 18A for inputting a text message and an input box 18B for inputting a voice message. A microphone icon 18B is provided for inputting a message, and the first user can input a text message. The user can select whether to input a message by voice or by touch. In the input text message, characters that do not have sounds (pronunciations) (for example, symbols) or their combinations (for example, surrounding a character with a sound with the aforementioned symbols, etc.) You can also change the tone of the voice (voice quality and instrument tone), and specify the volume, pitch, etc. in detail. do.

[0115] Also, screen G5 shown in FIG. 19 is displayed after inputting a voice message or a text message. This is the screen that transitions to. As shown in FIG. 19, the first user operates the input device 300C such as a touch panel to input a picture. Select icon 19A on screen G5 to play the voice or text message you entered. The first user can preview and check the message. By operating 00C and selecting icon 19B on screen G5, you can send a voice message or text message. You can re-enter the text message. In addition, the first user is notified that the second user terminal 4 has received a message from the first user terminal 3. In the example shown in FIG. 19, the first user The user can select "Ringtone ON" 20A, "Ringtone OFF" 20B, or "Play this sound as a ringtone" In the example shown in FIG. 19, the notification pattern can be selected from the notification pattern 20C. The button can be selected from three options, but the notification pattern is not limited to the example shown in FIG. Also, on the G5 screen, you can specify the tone of voice and emotion when playing back a voice message. The first user selects a tone of voice from tone of voice options 21 and an emotion from emotion options 22. When you select this, the voice tone and feeling selected will be displayed on the second terminal 4 of the other party who sent the voice message. The voice message is played back with emotion. The tone of voice and emotional expression are determined by AI machine learning. This can be achieved by learning human voices and synthesizing them.

[0116] 20 and 21 show a display device 300D that displays voice data or text data using the PUSH notification function. FIG. 10 is a diagram illustrating an example of store data being received. As shown in Figure 20, the message will be sent to you with the username of the person who sent it. Alternatively, as shown in FIG. 21, the received message may be notified by push notification. If the message is long, for example, if it contains more than a certain number of characters, You can display only the first few characters, or you can display a summary of the content. The name of the user who sent the message may be notified by push notification. In the example shown, the playback method of the PUSH notification message ("Play hands-free", "Play in ear") is selected. "Hit the button to play," "Open the app," etc.) and respond to messages (pre-registered messages). Select a message (preset message, user-defined message, etc.) It is very convenient as you can perform tasks such as sending emails without opening the app.

[0117] (Processing when new audio is received before listening to the audio received on the second terminal 4) After the voice data transmitted from the server 2 is received by the second terminal 4, the voice data is In some cases, new audio data may be sent from Server 2 before the audio data is played. Regarding the storage of voice data, the second terminal 4 may use, for example, any of the following (1) to (3): The following process is performed when the storage capacity of the storage device 400B of the second terminal 4 is This is a process executed by the second terminal 4 due to the small number of users. (1) When new voice data is received, the previously received voice data is stored in the storage device 40. Erase from 0B. (2) A voice data buffer that can store any number of data or any storage capacity (e.g. , a predetermined area provided in the storage device 400B) and stores the audio data in an audio data buffer. When the memory is about to overflow, the oldest data is deleted using the FIFO (first in first out) method. do. (3) A voice data buffer that can store any number of data or any storage capacity (e.g. , a predetermined area provided in the storage device 400B) and stores the audio data in an audio data buffer. When the buffer is about to overflow, the buffer full information is sent to the first terminal 3 via the server 2 (the second terminal 4) to the first terminal (information indicating that no more voice data can be stored), 3. A message will be displayed on the screen indicating that the message cannot be sent. When the second terminal 4 is operated to play back audio data, the second terminal 4 plays back the audio data in the buffer. The audio data is played in the order in which it was stored or in the order of the newest audio data. You can erase all voice data in the buffer, or you can erase all voice data except the last one received. Alternatively, the process (2) above may be always performed without erasing the data. These settings can be changed from the first terminal 3.

[0118] (talk group) In the above embodiment and modified example, the first terminal 3 and the second terminal 4 are paired. However, if you have multiple first terminals 3 and / or multiple second terminals 4, you can connect them to one talk group. The talk group can also be a unique ID (talk group ID) in Server 2. The talk group ID is used to manage all the first and second terminals that belong to the same talk group. The last four identification numbers (device IDs) are linked. Each device has a number of devices that belong to a talk group. You can also set a name that is easy for users to understand, and in that case, enter the device ID and The last name is also linked. Messages can be sent simultaneously between devices in the same talk group. However, it is also possible to send a message only to a specific terminal. For example, To send a text or voice message, select the device you want to send the message from on the Send Text or Voice Message screen. Alternatively, the second terminal 4 may send a voice message. If you want to send a message, say the name of the device you want to send the message to during the voice message, or Press any button to send a voice message to terminal 4 at any time. By pressing the number of times, you can select the device to send to and operate the The speaker 4 of the second terminal 4 can be operated by pressing the button for operating the speaker 4 any number of times within any time. 00G asks "Who would you like to send to?" and the second user selects one or more When the name of the device to which you want to send is entered by voice, the name of the device to which you want to send to the second user is After checking the terminal name, the message to be sent to the second user is accepted and sent via server 2. You can send it to the desired device in the same talk group.

[0119] In addition, the above-described embodiments and modifications are merely examples of the present invention. These are merely examples and should not be construed to limit the scope of the present invention. That is, the present invention does not deviate from its gist or main characteristics. It can be implemented in a variety of ways. [Explanation of symbols]

[0120] 1. Information Processing Systems 2. Server (information processing device) 200A communication interface 200B storage device 200C CPU 201 Receiving unit 202 Transmission Unit 203 Storage device control unit (association unit) 204 Text Conversion Unit 205 Voice conversion unit 206 File Format Conversion Section 207 Removal section 208 Volume control section 209 Extraction part 3. First terminal (information processing terminal) 300A communication IF 300B storage device 300C input device 300D display device 300E CPU 300F Microphone 300G speaker 301 Receiving unit 302 Transmission Unit 303 Storage device control unit 304 Input reception unit (reception unit) 305 Display device control unit (display control unit) 306 Audio output control unit 4. Terminal 2 400A communication interface 400B storage device 400C input device 400D display device (LED) 400E CPU 400F Microphone 400G speaker 400H Position Sensor 401 Receiving unit 402 Transmission Unit 403 Storage device control unit 404 Input acceptance section 405 Display device control unit (display control unit) 406 Audio output control unit 5. Network

Claims

1. An information processing device that communicates with a first watcher terminal, a second watcher terminal, a first watched person terminal carried by a first watched person, and a second watched person terminal carried by a second watched person, a first means for receiving destination information indicating whether the first voice data acquired from the first watcher terminal should be (1) transmitted to the second watcher terminal without being transmitted to the first watched person terminal, (2) transmitted to the first watched person terminal without being transmitted to the second watched person terminal, or (3) transmitted to both the first watched person terminal and the second watched person terminal, and transmitting the first voice data to a destination according to the received destination information; a second means for receiving destination information indicating whether the second voice data acquired from the second watcher terminal should be (1) transmitted to the second watcher terminal without being transmitted to the first watched person terminal, (2) transmitted to the first watched person terminal without being transmitted to the second watched person terminal, or (3) transmitted to both the first watched person terminal and the second watched person terminal, and transmitting the second voice data to a destination according to the received destination information; a third means for transmitting third voice data acquired from the first watched person terminal to the first watching person terminal and / or the second watching person terminal; An information processing device comprising: a fourth means for transmitting fourth audio data acquired from the second watched person terminal to the first watching person terminal and / or the second watching person terminal.

2. The information processing device according to claim 1 , wherein the location information of the first watched person terminal and the location information of the second watched person terminal are monitored by the first watcher terminal and the second watcher terminal.

3. seventh means for acquiring text data obtained by converting at least a part of at least one of the first voice data, the second voice data, and the third voice data into text; The information processing device according to claim 1 , further comprising: an eighth means for displaying the text data on the first watcher terminal and / or the second watcher terminal.

4. The information processing device according to claim 1 , wherein the first means also transmits the first voice data to the second watcher terminal.

5. The third means generates the third audio data as follows: Send the data to the second watcher terminal without sending it to the first watcher terminal, or Send it to the first watcher terminal without sending it to the second watcher terminal, or The information processing device according to claim 1 , further comprising: receiving destination information indicating whether to transmit to the first watcher terminal and the second watcher terminal.

6. a ninth means for receiving text data input to the first watcher terminal; The information processing device according to claim 1 , further comprising: a tenth means for transmitting voice data converted based on the text data to the first watched person terminal.

7. an eleventh means for acquiring location information from the first watched person terminal; The information processing device of claim 1, further comprising: a 12th means for displaying the location information of the first watched person terminal on the first watcher terminal and / or the second watcher terminal based on the location information.

8. an eleventh means for acquiring location information from the first watched person terminal and the second watched person terminal; The information processing device of claim 1, further comprising: a 12th means for displaying the location information of the terminal for the first watched person and the location information of the terminal for the second watched person on the terminal for the first watcher and / or the terminal for the second watcher based on the location information.

9. An information processing device as described in claim 1, further comprising a 13th means for displaying location information based on the transmission and / or reception of at least one of the first voice data, the second voice data, and the third voice data on the first watcher terminal and the second watcher terminal.

10. An information processing device according to claim 1 (excluding the case where the first person-to-be-watched terminal is a smartphone and the second person-to-be-watched terminal is a smartphone).

11. An information processing device that communicates with a first watcher terminal, a second watcher terminal, a first watched person terminal carried by the first watched person, and a second watched person terminal carried by the second watched person, receiving destination information indicating whether the first voice data acquired from the first watcher terminal is to be sent to the second watched-over terminal without being sent to the first watched-over person terminal, (2) to the first watched-over person terminal without being sent to the second watched-over person terminal, or (3) to both the first watched-over person terminal and the second watched-over person terminal; transmitting the first voice data to a destination corresponding to the received destination information; receiving destination information indicating whether the second voice data acquired from the second watching person terminal is to be sent to the second watched person terminal without being sent to the first watched person terminal, (2) to the first watched person terminal without being sent to the second watched person terminal, or (3) to both the first watched person terminal and the second watched person terminal; transmitting the second voice data to a destination corresponding to the received destination information; Transmitting the third voice data acquired from the first watched person terminal to the first watching person terminal and / or the second watching person terminal; An information processing method, comprising transmitting fourth audio data acquired from the second watched-over person terminal to the first watching-over terminal and / or the second watching-over terminal.

12. an information processing device that communicates with a first watching person terminal, a second watching person terminal, a first watched person terminal carried by the first watched person, and a second watched person terminal carried by the second watched person; a first means for receiving destination information indicating whether the first voice data acquired from the first watcher terminal is to be transmitted to the second watched-person terminal without being transmitted to the first watched-person terminal, (2) to the first watched-person terminal without being transmitted to the second watched-person terminal, or (3) to both the first watched-person terminal and the second watched-person terminal, and transmitting the first voice data to a destination according to the received destination information; a second means for receiving destination information indicating whether the second voice data acquired from the second person's terminal is to be transmitted to the second person's terminal without being transmitted to the first person's terminal, (2) to the first person's terminal without being transmitted to the second person's terminal, or (3) to both the first person's terminal and the second person's terminal, and transmitting the second voice data to a destination according to the received destination information; a third means for transmitting third voice data acquired from the first watched person terminal to the first watching person terminal and / or the second watching person terminal; and An information processing program that functions as a fourth means for transmitting fourth audio data acquired from the second monitored person terminal to the first monitored person terminal and / or the second monitored person terminal.

Images