Information processing terminal, information processing method, and information processing program

Abstract

To provide an information processing terminal, an information processing method, and an information processing program that provide a high convenience in posting.SOLUTION: In an information processing system including a server and one or more first user terminals and second user terminals which are connected to a server via a network, a CPU of each first user terminal 3 includes: a first acquisition unit 306 that obtains first specification information for specifying voice data to be posted, from among one or more pieces of voice data; a posting unit 307 that posts the voice data specified by the first specification information obtained by the first acquisition unit; and a generation unit 308 that generates reproduction data to be reproduced in combination of the voice data specified by the first specification information obtained by the first acquisition unit and at least either image data or moving image data. The posting unit posts the reproduction data generated by the generation unit.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an information processing terminal capable of posting data, an information processing method, and an information processing program. [Background technology]

[0002] SNS (Social Networking Services) have become widespread, and as content has become richer, it has become possible to post not only text data, but also image data, video data, audio data, and the like.

[0003] For example, Patent Document 1 describes an information processing system in which, when posting audio data to an SNS, a call between users is recorded and the recorded call data is posted on the SNS, thereby enabling a third user who is not participating in the call to listen to the contents of the call between the users. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6455848 Summary of the Invention [Problem to be solved by the invention]

[0005] However, conventional information processing systems still have room for improvement in terms of convenience in posting data.

[0006] The present invention has been made in consideration of the above-mentioned problems, and has an object to provide an information processing terminal, an information processing method, and an information processing program that enable highly convenient data posting. [Means for solving the problem]

[0007] In order to solve the above problems, the information processing terminal of the present invention includes a first acquisition unit that acquires first designation information that designates audio data to be posted from one or more audio data, and a posting unit that posts the audio data designated by the first designation information acquired by the first acquisition unit. Effect of the Invention

[0008] According to the present invention, it is possible to provide an information processing terminal, an information processing method, and an information processing program that enable highly convenient posting. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of a layout of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a configuration of an information processing server according to the embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a configuration of an information processing device server according to the embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a configuration of a first user terminal according to the embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of a configuration of a first user terminal according to the embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of a configuration of a second user terminal according to the embodiment. [Figure 7] FIG. 2 is a diagram illustrating an example of a configuration of a second user terminal according to the embodiment. [Figure 8] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first user terminal according to the embodiment. [Figure 9] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 10] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 11] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 12] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 13] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] [Embodiment] An information processing system 1 according to an embodiment will be described below with reference to the drawings. The information processing system 1 according to the embodiment is a so-called monitoring system, in which the location of the second user terminal 4 is determined from information uploaded to the server 2 at regular intervals, such as every 1.5 minutes, from the second user terminal 4 carried by the person being watched over (for example, a child) and usable while being carried, and the determined location is notified from the server 2 to the first user terminal 3 carried or used by the person being watched over (for example, a family member such as a parent or grandparent). In addition, in the information processing system 1 according to the embodiment, the first user terminal 3 and the second user terminal 4 are provided with a microphone and a speaker, and are configured to be able to send and receive voice messages (hereinafter also referred to as voice) to each other. That is, the system is configured to be able to exchange messages by voice between the watcher and the person being watched over. In addition, the system is configured to be able to allow the watcher to select any message from a conversation with the person being watched over and post it on an SNS or the like. In the following description, the watcher is also referred to as the first user. The person being watched over is also referred to as the second user.

[0011] As shown in FIG. 1, the information processing system 1 includes a server 2 and one or more first user terminals 3 and second user terminals 4 connected to the server 2 via a network 5. The first user terminal 3 is configured to be able to post data such as voice data, character data, image data, video data (note that in the following description, at least one of image data and video data is also referred to as image data, etc.), location data, and time data on an external SNS server (not shown) via the network 5. In the example shown in FIG. 1, the information processing system 1 includes one each of the server 2, the first user terminal 3, and the second user terminal 4, but the number of the servers 2, the first user terminals 3, and the second user terminals 4 included in the information processing system 1 is arbitrary.

[0012] (Server 2) 2 and 3 are configuration diagrams of the server 2. Fig. 2 shows the main hardware configuration of the server 2, and the server 2 includes a communication IF 200A, a storage device 200B, a CPU 200C, etc. Although not shown in Fig. 2, the server 2 may also include an input device (e.g., a mouse, a keyboard, a touch panel, etc.) and a display device (CRT (Cathode Ray Tube), a liquid crystal display, an organic EL display, etc.).

[0013] The communication IF 200A is an interface for communicating with other devices (eg, the first user terminal 3, the second user terminal 4, etc.).

[0014] The storage device 200B is, for example, a hard disk drive (HDD) or a semiconductor storage device (solid state drive (SSD)). Various data and information processing programs are stored in the storage device 200B. Some or all of the various data stored in the storage device 200B may be stored in an external storage device such as a universal serial bus (USB) memory or an external HDD, or in a storage device of another information processing device connected via the network 5. In this case, the server 2 refers to or acquires the various data stored in the external storage device or the storage device of the other information processing device.

[0015] The storage device 200B stores account information of the first user terminal 3, such as the identification number, name, contact information (email address, phone number) of the first user terminal 3, and the identification number of the second user terminal 4 owned by the second user (e.g., one's child). The storage device 200B also stores account information of the second user terminal 4, such as the identification number, name, and identification number of the first user terminal 3 owned by the first user (e.g., family members such as one's parents or grandparents). The storage device 200B also stores logs including data transmitted and received by the first user terminal 3 and the second user terminal 4 in association with the accounts.

[0016] The CPU 200C controls the server 2 according to this embodiment, and includes a ROM and a RAM (not shown).

[0017] Fig. 3 is a functional block diagram of the server 2. As shown in Fig. 3, the server 2 includes functions such as a receiving unit 201, a transmitting unit 202, and a storage device control unit 203. The functions shown in Fig. 3 are realized by the CPU 200C executing an information processing program stored in the storage device 200B.

[0018] The receiving unit 201 receives data, such as voice data, transmitted from the first user terminal 3 or the second user terminal 4.

[0019] The transmission unit 202 transmits data received from the first user terminal 3, for example, voice data, to the second user terminal 4. The transmission unit 202 also transmits data received from the second user terminal 4, for example, voice data, to the first user terminal 3.

[0020] The storage device control unit 203 stores the data transmitted and received by the first user terminal 3 and the second user terminal 4 in the storage device 200B in association with the identification number of the account or user terminal that transmitted and received the data.

[0021] (First user terminal 3) The first user terminal 3 is a terminal owned by the first user, and is, for example, a smartphone installed with application software for making the first user terminal 3 function as a terminal having each function shown in this embodiment. The first user can exchange voice data with the second user (for example, his / her child) using the first user terminal 3 to transmit and receive voice data to and from the second user terminal 4 registered therein. FIG. 4 shows the main hardware configuration of the first user terminal 3, and includes a communication IF 300A, a storage device 300B, an input device 300C, a display device 300D, a CPU 300E, a microphone 300F, and a speaker 300G.

[0022] The communication IF 300A is an interface for communicating with another device (the server 2 in this embodiment).

[0023] The storage device 300B is, for example, a hard disk drive (HDD) or a semiconductor storage device (solid state drive (SSD)). The storage device 300B stores a terminal identification number, an information processing program (application software), a dictionary in which words and phrases that are prohibited from being posted are registered, and the like. The storage device 300B also stores data transmitted and received between the first user terminal 3 and the second user terminal 4. For example, the storage device 300B stores voice data transmitted and received between the first user terminal 3 and the second user terminal 4 and character data obtained by converting the voice data into characters in association with each other. The terminal identification number is a number for identifying the first user terminal 3. By assigning the terminal identification number to data transmitted from the first user terminal 3, the server 2 can determine which first user terminal 3 has transmitted the received data. The terminal identification number may be an IP (Internet Protocol) address, a MAC (Media Access Control) address, or the like, or may be assigned to the first user terminal 3 by the server 2.

[0024] The input device 300C is, for example, an input device such as a keyboard, a mouse, or a touch panel, but may be any other device or equipment that allows input. Also, it may be a voice input device.

[0025] The display device 300D is, for example, a liquid crystal display, a plasma display, an organic EL display, or the like, but may be any other device or equipment (for example, a CRT: Cathode Ray Tube) as long as it is capable of displaying.

[0026] The CPU 300E controls the first user terminal 3 according to this embodiment, and includes a ROM and a RAM (not shown).

[0027] The microphone 300F is an acoustic device that converts sound into an electrical signal. The user of the first user terminal 3 can input voice using the microphone 300F. The input voice is transmitted to the server 2 by a transmission unit 302, which will be described later.

[0028] The speaker 300G is an audio device that converts an electric signal into sound. The speaker 300G reproduces, for example, audio data transmitted from the second user terminal 4 via the server 2 and stored in the storage device 300B.

[0029] 5 shows a functional block diagram of the first user terminal 3, and the first user terminal 3 has functions such as a receiving unit 301, a transmitting unit 302, a storage device control unit 303, an input receiving unit 304 (receiving unit), a display device control unit 305, an acquiring unit 306 (first to third acquiring units), a posting unit 307, a generating unit 308, a converting unit 309, a recognizing unit 310, a notifying unit 311, and a registering unit 312. The functions shown in FIG. 5 are realized by CPU 300E executing an information processing program stored in storage device 300B.

[0030] The receiving unit 301 receives data transmitted from the server 2, for example.

[0031] The transmitting unit 302 transmits data to the server 2 in response to an input operation accepted by the input accepting unit 304, for example.

[0032] The storage device control unit 303 controls the storage device 300B. For example, the storage device control unit 303 stores data transmitted and received by the first user terminal 3 and the second user terminal 4 in the storage device 300B in association with the identification number of the account or user terminal that transmitted and received the data. In addition, the storage device control unit 303 stores, for example, voice data transmitted and received between the first user terminal 3 and the second user terminal 4 in association with character data obtained by converting the voice data into characters in the storage device 300B.

[0033] The input receiving unit 304 receives an input operation from the input device 300C. For example, the input receiving unit 304 receives a selection notified by the notification unit 311 as to whether or not to post the voice data.

[0034] Display device control unit 305 controls display device 300D, and displays data received by receiving unit 301, etc., on display device 300D.

[0035] The acquiring unit 306 acquires first designation information that designates the voice data to be posted from one or more pieces of voice data accepted by the input accepting unit 304. Here, the acquiring unit 306 may acquire information that designates character data in units of two or more sentences or in units of voice data. Furthermore, the acquiring unit 306 may acquire the first designation information based on character data converted by the converting unit 309. Furthermore, the acquiring unit 306 acquires second designation information that designates image data, etc. (at least one of image data and video data) to be posted. Here, the image data, etc. may be image data, etc. automatically designated by the generating unit 308 of the first user terminal 3, or may be image data, etc. designated by the user accepted by the input accepting unit 304.

[0036] The posting unit 307 posts the audio data designated by the first designation information acquired by the acquisition unit 306 to an SNS or the like. The posting unit 307 also posts the playback data generated by the generation unit 308 to an SNS or the like. The posting unit 307 may also post character data to an SNS or the like together with the audio data designated for posting. The character data is data obtained by converting the audio data designated for posting into characters. The posting unit 307 may also post information about the speaker of the audio data to an SNS or the like together with the audio data designated for posting. The posting unit 307 may also refer to a dictionary in which words prohibited from being posted are registered, and restrict posting of audio data including the words registered in the dictionary to an SNS or the like. The posting unit 307 posts the audio data notified by the notification unit 311 to an SNS or the like based on the selection of whether or not to post accepted by the input acceptance unit 304. Here, posting refers to a process of uploading data to be posted to a platform such as an SNS or a website where the posted data can be viewed or downloaded by a third party's terminal, and making it possible for the third party's terminal to view or download the data. The platform in question not only exchanges data between terminals of an unspecified number of recipients, but also includes those that function as a two-way communication tool, such as data exchange between the terminals of a specific number of recipients or a single person. The process of uploading data to be viewed or downloaded by a single recipient on the communication tool also constitutes posting. The form of posting for the recipient's terminal to view or download data is not limited to the case where the poster uploads the data itself, as already mentioned, but also includes alternative forms of sending information for downloading data, such as a URL link, created by the poster's terminal or a server that has received data to be downloaded from the poster's terminal, to the recipient's terminal. By selecting the URL link, the recipient's terminal can download the data associated with the URL link.

[0037] The generating unit 308 generates playback data to be played back by combining the voice data specified by the first specification information acquired by the acquiring unit 306 with image data, etc. As described above, the image data, etc. may be image data, etc. automatically acquired by the generating unit 308 of the first user terminal 3, or image data, etc. designated by the user. Note that the playback data may be configured to present the speaker (recognized by the recognizing unit 310) of the voice data being played back and character data of the voice data converted by the converting unit 309 in accordance with the playback of the voice data.

[0038] The conversion unit 309 converts the voice data acquired by the acquisition unit 306 into character data.

[0039] The recognition unit 310 recognizes the speaker of the voice data. Here, the speaker of the voice data may be recognized from an identification number assigned to the voice data, or may be recognized by analyzing the voice data to extract features and comparing them with the features of the voice of a speaker registered in advance.

[0040] The notification unit 311 notifies the reception of a voice. This notification is performed, for example, by a push notification by application software (for example, a notification sound or a display on the display device 300D). The notification unit 311 also notifies the presence of voice data including a word or phrase registered in the dictionary. The content of the notification by the notification unit 311 is displayed on the display device 300D by the display device control unit 305. The content of the notification by the notification unit 311 may also be notified as a voice from the speaker 300G.

[0041] Registration unit 312 registers (stores) in a dictionary the words acquired by acquisition unit 306. Registration unit 312 also registers (stores) in the dictionary the words acquired by acquisition unit 306 as words to be excluded from words prohibited from posting (words that can be posted). The words registered in the dictionary by registration unit 312 are stored in storage device 200B by storage device control unit 303.

[0042] (Second user terminal 4) The second user terminal 4 is a terminal used by a second user of the information processing system 1. The second user can communicate with the first user (e.g., his / her family) by voice by transmitting and receiving voice data to and from the registered first user terminal 3 using the second user terminal 4. Fig. 6 shows the main hardware configuration of the second user terminal 4, and the second user terminal 4 includes a communication IF 400A, a storage device 400B, an input device 400C, a display device 400D, a CPU 400E, a microphone 400F, a speaker 400G, a GPS sensor 400H, etc.

[0043] The communication IF 400A is an interface for communicating with other devices (the server 2 in this embodiment).

[0044] The storage device 400B is, for example, a hard disk drive (HDD) or a semiconductor storage device (solid state drive (SSD)). The storage device 400B stores a terminal identification number, an information processing program, voice data transmitted from the first user terminal 3, and the like. The terminal identification number is a number for identifying the second user terminal 4. By assigning the terminal identification number to data transmitted from the second user terminal 4, the server 2 can determine which second user terminal 4 transmitted the received data. Note that the terminal identification number may be an Internet Protocol (IP) address, a Media Access Control (MAC) address, or the like, or may be assigned to the second user terminal 4 by the server 2.

[0045] The input device 400C is, for example, an input device such as a keyboard, a mouse, or a touch panel, but may be another device or equipment as long as it is capable of inputting. It may also be a voice input device. The second user can operate the input device 400C to input voice and transmit it to the first user terminal 3, or to play back voice data transmitted from the first user terminal 3.

[0046] The display device 400D is, for example, an LED, and notifies the user that a voice has been received by lighting up or blinking in a predetermined pattern.

[0047] The CPU 400E controls the second user terminal 4 according to this embodiment, and includes a ROM and a RAM (not shown).

[0048] The microphone 400F is an acoustic device that converts sound into an electrical signal. The user of the second user terminal 4 can input voice using the microphone 400F. The input voice is transmitted to the server 2 by a transmission unit 402, which will be described later.

[0049] The speaker 400G is an audio device that converts an electric signal into sound. For example, the speaker 400G reproduces audio data transmitted from the first user terminal 3 via the server 2 and stored in the storage device 400B. The speaker 400G also notifies the reception of audio by generating a sound in a predetermined pattern.

[0050] The GPS sensor 400H receives signals from GPS satellites that include data such as the time data of the atomic clocks installed on the satellites and the satellite's astronomical ephemeris (orbit), and calculates the distance from the satellite based on the difference between the transmission time and reception time of the received signal to determine the current position. The GPS sensor 400H also outputs the determined current position.

[0051] 7 shows a functional block diagram of the second user terminal 4, and the second user terminal 4 has functions such as a receiving unit 401, a transmitting unit 402, a storage device control unit 403, an input accepting unit 404, and a display device control unit 405. The functions shown in FIG. 7 are realized by the CPU 400E executing an information processing program stored in the storage device 400B.

[0052] The receiving unit 401 receives, for example, data transmitted from the server 2, such as voice data.

[0053] The transmitting unit 402 transmits data, such as voice data, to the server 2 in response to an input operation received by the input receiving unit 304, for example.

[0054] The storage device control unit 403 controls the storage device 400B. For example, the storage device control unit 403 controls the storage device 400B to write and read data. For example, the storage device control unit 403 stores data received by the receiving unit 401 in the storage device 400B.

[0055] The input receiving unit 404 receives an input operation from the input device 400C. The input receiving unit 404 receives, for example, an operation to play back audio data stored in the storage device 400B.

[0056] Display device control unit 405 controls display device 400D. For example, when receiving unit 401 receives audio data, display device control unit 405 causes display device 400D (LED) to light up or blink in a predetermined pattern or the like.

[0057] (display screen) Fig. 8 is a diagram showing an example of a screen G1 displayed on the display device 300D of the first user terminal 3. Hereinafter, an example of the screen G1 displayed on the display device 300D of the first user terminal 3 will be described with reference to Fig. 8. Note that the same components as those described with reference to Figs. 1 to 7 are denoted by the same reference numerals, and duplicated descriptions will be omitted.

[0058] As shown in FIG. 8, the display device 300D displays text data converted from audio data transmitted and received between the first user terminal 3 and the second user terminal 4 in chronological order on an audio data file basis (hereinafter, also referred to as timeline display).

[0059] In the example shown in FIG. 8, the name 11 (or handle name) of the second user is displayed at the top of the screen G1. In addition, on the left side of the screen G1, character data 12B obtained by converting voice data (voice file of the second user) transmitted from the second user terminal 4 is displayed together with a transmission time 12D (using time stamp information) and an icon 12A. In addition, when the play button 12C is selected, voice data (voice file) corresponding to the displayed character data 12B is played back, and the voice can be listened to. In addition, on the right side of the screen G1, character data 13A obtained by converting voice data (voice file of the first user) transmitted from the first user terminal 3 is displayed together with a transmission time 13C (using time stamp information). In addition, a status 13D (for example, whether or not the voice data was played back on the second user terminal 4) is displayed alongside each character data transmitted from the first user terminal 3. In addition, when the play button 13B is selected, voice data (voice file) corresponding to the displayed character data 13A is played back, and the voice can be listened to.

[0060] When posting audio data to an SNS or the like, the first user operates the input device 300C such as a touch panel to specify character data converted from the audio data to be posted, thereby specifying the audio data to be posted to the SNS or the like. When the first user operates the input device 300C such as a touch panel to specify character data converted from the audio data to be posted, the audio data before conversion is posted to the SNS or the like by the posting unit 307. The audio data may be specified for each audio data file, or multiple audio data files may be specified collectively. When specifying collectively, the first audio data may be configured to specify the first audio data including intermediate audio data to the last audio data by specifying the first audio data and the last audio data in the timeline shown in FIG. 8.

[0061] 8, the character data converted from the voice data is displayed in chronological order for each file of the voice data, but the character data 12B converted from the voice data may not be displayed. In this case, for example, the playback time of the voice data may be displayed instead of the character data 12B, but this is not necessarily limited to this example.

[0062] (Information Processing) Figures 9 to 13 are flowcharts showing an example of information processing by the information processing system 1. Hereinafter, the information processing by the information processing system 1 will be described with reference to Figures 9 to 13. Note that the same components as those described with reference to Figures 1 to 8 are denoted by the same reference numerals, and duplicated descriptions will be omitted.

[0063] (Call processing) Fig. 9 is a flowchart showing an example of call processing in the information processing system 1. Hereinafter, an example of call processing in the information processing system 1 will be described with reference to Fig. 9. Note that Fig. 9 describes a case where voice data is transmitted from the second user terminal 4 to the first user terminal 3.

[0064] (Step S101) The second user operates the input device 400C of the second user terminal 4 to input speech.

[0065] (Step S102) The input voice is converted into an electric signal by the microphone 400F and then transmitted as voice data from the transmitting unit 402 to the server 2. Note that the data transmitted from the second user terminal 4 is provided with data such as the identification number of the second user terminal 4 and a time stamp.

[0066] (Step S103) The receiving unit 201 of the server 2 receives the voice data transmitted from the second user terminal 4 .

[0067] (Step S104) The storage device control unit 203 stores the voice data transmitted by the second user terminal 4 in the storage device 200B in association with the identification number of the account or user terminal that transmitted or received the data.

[0068] (Step S105) The transmitting unit 202 of the server 2 refers to the memory device 200B, identifies the identification number of the first user terminal 3 associated with the identification number assigned to the voice data received by the receiving unit 201, and transmits the voice data transmitted from the second user terminal 4 to the identified first user terminal 3.

[0069] (Step S106) The receiving unit 301 of the first user terminal 3 receives the voice data transmitted from the server 2 .

[0070] (Step S107) The conversion unit 309 of the first user terminal 3 converts the voice data received by the receiving unit 301 into character data.

[0071] (Step S108) The storage device control unit 303 of the first user terminal 3 associates the voice data received from the second user terminal 4 with character data obtained by converting the voice data into characters, and stores them in the storage device 300B.

[0072] (Step S109) The notification unit 311 of the first user terminal 3 notifies that the voice has been received.

[0073] (Call processing) Fig. 10 is a flowchart showing an example of call processing in the information processing system 1. Hereinafter, an example of call processing in the information processing system 1 will be described with reference to Fig. 10. Note that Fig. 10 describes a case where voice data is transmitted from the first user terminal 3 to the second user terminal 4.

[0074] (Step S201) The first user inputs voice by operating the input device 300C of the first user terminal 3. The input voice is converted into an electrical signal by the microphone 400F.

[0075] (Step S202) The conversion unit 309 of the first user terminal 3 converts the input voice data into character data.

[0076] (Step S203) The storage device control unit 303 of the first user terminal 3 associates the input voice data with character data obtained by converting the voice data into characters, and stores them in the storage device 300B.

[0077] (Step S204) The transmitting unit 302 of the first user terminal 3 transmits the input voice data to the server 2. Note that the data transmitted from the first user terminal 3 is provided with data such as the identification number of the first user terminal 3 and a time stamp.

[0078] (Step S205) The receiving unit 201 of the server 2 receives the voice data transmitted from the first user terminal 3 .

[0079] (Step S206) The storage device control unit 203 stores the voice data transmitted by the first user terminal 3 in the storage device 200B in association with the identification number of the account or user terminal that transmitted or received the data.

[0080] (Step S207) The transmitting unit 202 of the server 2 refers to the memory device 200B, identifies the identification number of the second user terminal 4 associated with the identification number assigned to the voice data received by the receiving unit 201, and transmits the voice data transmitted from the first user terminal 3 to the identified second user terminal 4.

[0081] (Step S208) The receiving unit 401 of the second user terminal 4 receives the voice data transmitted from the server 2.

[0082] (Step S209) The LED of the second user terminal 4 notifies the reception of the voice by lighting up the LED or by making a sound.

[0083] (Posting process) 11 is a flowchart showing an example of posting processing in the information processing system 1. Hereinafter, an example of posting processing in the information processing system 1 will be described with reference to FIG.

[0084] (Step S301) The first user operates the input device 300C of the first user terminal 3 to specify the voice data to be posted to an SNS or the like. This voice data specification may be performed for each voice data file, or multiple voice data files may be specified collectively or by selection. The acquisition unit 306 of the first user terminal 3 acquires first specification information that specifies the voice data to be posted from one or more voice data accepted by the input acceptance unit 304. In this embodiment, by specifying character data, corresponding audio data is posted to an SNS or the like, but the configuration may also be such that the audio data to be posted to an SNS or the like is specified by directly specifying the audio data (an audio data file).

[0085] (Step S302) The notification unit 311 of the first user terminal 3 refers to the dictionary and determines whether or not the voice data specified by the first specification information contains a forbidden phrase. The notification unit 311 may determine whether or not the voice data contains a forbidden phrase by analyzing the voice data, or may determine whether or not the voice data contains a forbidden phrase based on the character data converted by the conversion unit 309. If the voice data contains a forbidden phrase (YES), the first user terminal 3 executes the process of step S303. If the voice data does not contain a forbidden phrase (NO), the first user terminal 3 executes the process of step S305.

[0086] (Step S303) The notification unit 311 notifies the user of the presence of audio data that includes a word or phrase registered in the dictionary. The content of the notification by the notification unit 311 is displayed on the display device 300D by the display device control unit 305. The content of the notification by the notification unit 311 may be notified as a sound from the speaker 300G.

[0087] (Step S304) The input receiving unit 304 receives a selection of whether or not to post the voice data notified by the notification unit 311. If a selection of whether or not to post is received (YES), the first user terminal 3 executes the process of step S305. If a selection of whether or not to post is received (NO), the first user terminal 3 ends the process (the first user starts again by specifying the voice data in step S301, or ends the posting itself).

[0088] (Step S305) The recognition unit 310 of the first user terminal 3 recognizes the speaker of the selected voice data. Here, the speaker of the voice data may be recognized from an identification number assigned to the voice data, or may be recognized by analyzing the voice data to extract features and comparing them with the features of the voice of a speaker registered in advance.

[0089] (Step S306) The first user operates the input device 300C of the first user terminal 3 as necessary to specify image data, etc. to be posted to an SNS or the like. If the input reception unit 304 receives the specification of image data, etc. (YES), the acquisition unit 306 of the first user terminal 3 acquires second specification information specifying the image data, etc., and the first user terminal 3 executes the process of step S307. As described above, the image data, etc. may be automatically specified by the generation unit 308 of the first user terminal 3. If the input reception unit 304 does not receive the specification of image data, etc. (NO), the first user terminal 3 executes the process of step S308. The first user may post only the voice data without going through the process of specifying the image data, etc. in this step S306.

[0090] (Step S307) The generating unit 308 of the first user terminal 3 generates playback data to be played back by combining the audio data specified in the first specification information acquired by the acquiring unit 306 with image data, etc. As described above, the image data, etc. may be image data, etc. automatically acquired by the generating unit 308 of the first user terminal 3, or may be image data, etc. specified by the user.

[0091] (Step S308) If image data or the like is not specified (NO in step S306), the posting unit 307 of the first user terminal 3 posts the audio data specified in the first specification information acquired by the acquisition unit 306 to an SNS or the like. If image data or the like is specified (YES in step S306), the posting unit 307 posts the playback data generated by the generation unit 308 to an SNS or the like.

[0092] 1, when posting voice data to an SNS or the like, character data converted from the voice data may be posted together. When posting voice data to an SNS or the like, characters, sentences, hashtags, URLs, etc. that are unrelated to the character data converted from the voice data input by the first user using the input device 300C may be posted together.

[0093] (Registration process) 12 is a flowchart showing an example of the registration process of the information processing system 1. Hereinafter, an example of the registration process of the information processing system 1 will be described with reference to FIG.

[0094] (Step S401) The first user inputs a phrase that is to be prohibited from being posted by operating the input device 300C of the first user terminal 3. The acquisition unit 306 of the first user terminal 3 acquires the phrase accepted by the input acceptance unit 304.

[0095] (Step S402) The registration unit 312 of the first user terminal 3 registers (stores) the word acquired by the acquisition unit 306 in a dictionary as a word that is prohibited from being posted. The word registered in the dictionary by the registration unit 312 is stored in the storage device 200B by the storage device control unit 303.

[0096] In the above registration process described with reference to Fig. 12, the first user operates the input device 300C of the first user terminal 3 to input the words and phrases that are prohibited from being posted, but the first user does not necessarily have to input them. For example, the first user terminal 3 may automatically determine words and phrases that are prohibited from being posted and register them in the dictionary as words and phrases that are prohibited from being posted, or may be configured to recommend them to the first user as words and phrases that are prohibited from being posted. In this case, for example, the first user terminal 3 may be configured to learn words and phrases that are prohibited from being posted that were previously registered by the first user, and automatically determine words and phrases that are prohibited from being posted based on the learning result.

[0097] (Exclusion processing) 13 is a flowchart showing an example of the exclusion process of the information processing system 1. Hereinafter, an example of the exclusion process of the information processing system 1 will be described with reference to FIG.

[0098] (Step S501) The first user inputs a phrase to be excluded from phrases prohibited from being posted, by operating the input device 300C of the first user terminal 3. The acquisition unit 306 of the first user terminal 3 acquires the phrase accepted by the input acceptance unit 304.

[0099] (Step S502) The registration unit 312 of the first user terminal 3 registers (stores) the word acquired by the acquisition unit 306 in a dictionary as a word to be excluded from words prohibited from posting (word that can be posted). The word registered in the dictionary by the registration unit 312 is stored in the storage device 200B by the storage device control unit 303.

[0100] As described above, the first user terminal 3 (information processing terminal) of the embodiment includes an acquisition unit 306 that acquires first designation information that designates the audio data to be posted from one or more audio data, and a posting unit 307 that posts the audio data designated by the first designation information acquired by the acquisition unit 306. This is highly convenient as you can specify audio data and post it to social media, etc.

[0101] Moreover, the first user terminal 3 according to the embodiment includes a generating unit 308 that generates playback data to be played by combining the audio data designated by the first designation information acquired by the acquiring unit 306 with image data or the like. Then, the posting unit 307 posts the playback data generated by the generating unit 308. In this way, audio data and image data, etc. can be combined to generate playback data and posted to SNS, etc., improving convenience.

[0102] In addition, the first user terminal 3 of the embodiment is equipped with an acquisition unit 306 that acquires second designation information that designates image data, etc. to be posted, and the generation unit 308 generates playback data to be played by combining the audio data specified in the first designation information acquired by the acquisition unit 306 and the image data, etc. specified in the second designation information acquired by the acquisition unit 306. In this way, image data and the like can be specified to generate playback data, improving convenience.

[0103] In addition, the first user terminal 3 according to the embodiment includes a conversion unit 309 that converts the voice data acquired by the acquisition unit 306 into character data, and the acquisition unit 306 acquires the first specification information based on the character data converted by the conversion unit 309. In this way, the user can select the voice data to post on a social networking site or the like by looking at the text data converted from the voice data, so that the user can understand at a glance what content to post, improving convenience.

[0104] Moreover, the acquisition unit 306 of the first user terminal 3 according to the embodiment acquires information specifying character data on a sentence-by-sentence basis or on a voice data-by-voice data basis. In this way, the voice data to be posted to an SNS or the like can be specified on a sentence-by-sentence or voice data-by-voice data basis, improving convenience.

[0105] Moreover, the acquisition unit 306 of the first user terminal 3 according to the embodiment acquires information specifying character data in units of two or more sentences or in units of voice data. In this way, multiple pieces of audio data to be posted to SNS etc. can be specified at once, improving convenience.

[0106] Moreover, the posting unit 307 of the first user terminal 3 according to the embodiment posts the character data to an SNS or the like together with the voice data designated for posting. In this way, not only voice data but also text data can be posted, improving convenience.

[0107] The character data is character data converted from voice data designated for posting to an SNS or the like. In this way, the text data converted from the voice data can be posted on social networking sites, etc., improving convenience.

[0108] Moreover, the first user terminal 3 according to the embodiment includes a recognition unit 310 that recognizes the speaker of the voice data, and the posting unit 307 posts information about the speaker of the voice data together with the voice data designated for posting. This makes it possible to show who is talking on social media, etc., improving convenience.

[0109] Furthermore, the posting unit 307 of the first user terminal 3 according to the embodiment refers to a dictionary in which words and phrases that are prohibited from being posted are registered, and restricts the posting of voice data that includes words and phrases registered in the dictionary. In this way, convenience is improved by prohibiting the posting of voice data containing pre-registered words (e.g., words that can identify personal information, such as school names, place names, and names) to SNS and the like.

[0110] Moreover, the first user terminal 3 according to the embodiment includes a notification unit 311 that notifies the user of the presence of voice data that includes a word or phrase registered in the dictionary. In this way, the presence of voice data containing preregistered words (for example, words that can identify personal information, such as a school name, a place name, or a person's name) is notified, thereby improving convenience.

[0111] Moreover, the first user terminal 3 according to the embodiment includes a reception unit 304 that receives a selection of whether or not to post the voice data notified by the notification unit 311. Then, the posting unit 307 posts the voice data notified by the notification unit 311 based on the selection of whether or not to post accepted by the acceptance unit 304. In this way, when there is voice data that includes a word registered in the dictionary, the user can choose whether or not to post the data on a social networking site, etc., thereby improving convenience.

[0112] Moreover, the first user terminal 3 according to the embodiment includes an acquisition unit 306 that acquires a phrase that is prohibited from being posted, and a registration unit 312 that registers the phrase acquired by the acquisition unit 306 in a dictionary. In this way, it is possible to register words that are prohibited from being posted on social media, etc., thereby improving convenience.

[0113] [Modification of the embodiment] In the above embodiment, the server 2 may have at least some of the functions of the first user terminal 3 shown in Fig. 5. For example, the server 2 may have some or all of the functions of the first user terminal 3 shown in Fig. 5, such as the acquisition unit 306 (first to third acquisition units), the generation unit 308, the conversion unit 309, the recognition unit 310, the notification unit 311, and the registration unit 312. In this case, for example, the server 2 executes the processes of steps S301 to S307 described with reference to Fig. 11, and the posting unit 307 of the first user terminal 3 posts the audio data and the playback data to an SNS or the like. Also, at least one of the processes of steps S401 to S402 and steps S501 to S502 described with reference to Figs. 12 and 13 is executed.

[0114] In addition, the above-mentioned embodiment and modifications are merely examples of the embodiment of the present invention, and the technical scope of the present invention should not be interpreted as being limited thereby. In other words, the present invention can be embodied in various forms without departing from the gist or main characteristics thereof. [Explanation of symbols]

[0115] 1. Information Processing Systems 2. Server (information processing device) 200A Communication IF 200B storage device 200C CPU 201 Receiving unit 202 Transmitter 203 Storage device control unit 3. First user terminal (information processing terminal) 300A communication IF 300B storage device 300C Input Device 300D display device 300E CPU 300F Microphone 300G Speaker 301 Receiving unit 302 Transmitter 303 Storage device control unit 304 Input reception unit (reception unit) 305 Display device control unit 306 Acquisition Department (1st ~ 3rd Acquisition Department) 307 Posting Department 308 Generation part 309 Conversion Unit 310 Recognition part 311 Information Department 312 Registration Department 4. Second user terminal 400A Communication IF 400B storage device 400C Input Device 400D display device (LED) 400E CPU 400F Microphone 400G Speaker 400H GPS Sensor 401 Receiving unit 402 Transmitter 403 Storage device control unit 404 Input reception section 405 Display device control unit 5. Network

Claims

1. An information processing device, providing a service in which a first information processing terminal and a second information processing terminal can transmit and receive voice messages to each other and the first information processing terminal monitors location information of the second information processing terminal; acquiring first voice data transmitted from the second information processing terminal to the first information processing terminal; receiving, from the first information processing terminal, designation of the first voice data or first character data obtained by converting the first voice data into character data; outputting the first voice data or the first character data for posting to another service provided by an information processing device different from the information processing device; An information processing method for performing the above.

2. The information processing method according to claim 1 , wherein the outputting includes posting the first voice data or the first character data to the other service.

3. In the information processing device, acquiring first voice data transmitted from the information processing terminal of the second user to the information processing terminal of the first user; converting the first voice data into first character data; receiving designation of the first voice data or the first character data from an information processing terminal of the first user; outputting the first voice data or the first character data; A program that executes the following.

4. An information processing device having one or more processors, The processor, acquiring first voice data transmitted from the information processing terminal of the second user to the information processing terminal of the first user; converting the first voice data into first character data; receiving designation of the first voice data or the first character data from an information processing terminal of the first user; outputting the first voice data or the first character data; An information processing device that executes the above.

5. A first information processing terminal that is capable of transmitting and receiving voice messages to and from a second information processing terminal and that uses a service that is capable of monitoring location information of the second information processing device, acquiring first voice data transmitted from the second information processing terminal or first character data obtained by converting the first voice data into character data; displaying the first voice data or the first character data on the first information processing terminal in a visually recognizable manner; accepting designation of the first voice data or the first character data in response to an operation by a user of the first information processing terminal; outputting the first voice data or the first character data for posting to a service different from the service; A program that executes the following.

6. The program according to claim 5, wherein the displaying includes displaying the first voice data or the first character data together with second voice data which is voice data different from the first voice data or second character data in which the second voice data is converted into character data.

7. 7. The program according to claim 6, wherein the second voice data is voice data transmitted from the first information processing terminal to the second information processing terminal.

8. 8. The program according to claim 6, wherein the displaying includes displaying a character string indicating a playback status of the second audio data near an object indicating the second audio data.

9. 9. The program according to claim 8, wherein the character string indicating the status includes a character string indicating that the second audio data has been reproduced when the second audio data has been reproduced on the second information processing terminal.

10. 10. The program according to claim 6, wherein the displaying includes displaying a playback object for playing back the first audio data or the second audio data.

11. 11. The program according to claim 10, further comprising: reproducing audio data associated with the reproduction object in response to the reproduction object being selected.

12. A first information processing terminal that is capable of mutually transmitting and receiving voice messages with a second information processing terminal and that uses a service that is capable of monitoring location information of the second information processing device, acquiring first voice data transmitted from the second information processing terminal or first character data obtained by converting the first voice data into character data; displaying the first voice data or the first character data on the first information processing terminal in a visually recognizable manner; accepting designation of the first voice data or the first character data in response to an operation by a user of the first information processing terminal; outputting the first voice data or the first character data for posting to a service different from the service; An information processing method for performing the above.

13. A first information processing terminal having one or more processors, The processor, The first information processing terminal is capable of transmitting and receiving voice messages to and from a second information processing terminal and using a service capable of monitoring location information of the second information processing device. acquiring first voice data transmitted from the second information processing terminal or first character data obtained by converting the first voice data into character data; displaying the first voice data or the first character data on the first information processing terminal in a visually recognizable manner; accepting designation of the first voice data or the first character data in response to an operation by a user of the first information processing terminal; outputting the first voice data or the first character data for posting to a service different from the service; An information processing terminal that executes the above.

Images