Information processing terminal, information processing apparatus, information processing method, information processing program

Abstract

To provide a highly convenient information processing terminal, information processing apparatus, information processing method, and information processing program. 【Solution means】In an information processing system including a server, and one or more first user terminals and second user terminals connected to the server via a network, an information processing terminal (second user terminal) includes: a receiving unit that receives data and a setting instruction for setting a notification pattern for notifying reception of the data from a different terminal (first user terminal); a notification unit that notifies that the receiving unit has received the data; and a setting unit that sets the notification pattern of the notification unit based on the setting instruction.

Description

Technical Field

[0001] The present invention relates to an information processing terminal, an information processing apparatus, an information processing method, and an information processing program capable of voice data communication.

Background Art

[0002] When a child grows to a certain size, for example, becomes a primary school student and often acts alone, a guardian with a child worries about the child's actions, such as whether the child has arrived at school or a cram school safely without encountering an accident and has returned home.

[0003] Therefore, as a mechanism for dealing with the above problems, for example, a service that enables confirmation of the position information of a child by using the GPS function installed in a portable information terminal such as a smartphone is provided (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, there is still room for improvement in convenience in the conventional information processing system.

[0006] The present invention has been made in view of the above problems, and an object thereof is to provide an information processing terminal, an information processing apparatus, an information processing method, and an information processing program with high convenience.

Means for Solving the Problems

[0007] To solve the above problems, an information processing terminal according to the present invention receives data and a setting instruction for setting a notification pattern when notifying that the data has been received from a different terminal. a receiving unit that receives a setting instruction for setting a notification pattern when notifying that the data has been received from a different terminal; a notification unit that notifies that the receiving unit has received the data; and a setting unit that sets the notification pattern of the notification unit based on the setting instruction.

Advantages of the Invention

[0008] According to the present invention, it is possible to provide a highly convenient information processing terminal, information processing apparatus, information processing method, and information processing program.

Brief Description of the Drawings

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Mode for Carrying Out the Invention

[0010] [Embodiment] Hereinafter, an information processing system 1 according to an embodiment will be described with reference to the drawings. The information processing system 1 according to the embodiment is a so-called monitoring system, and from a second user terminal 4 carried by a person under guardianship (for example, a child), for example, every 1.5 minutes, etc. The position of the second user terminal 4 is determined from the information uploaded to the server 2 at a predetermined interval, and the determined position is from the server 2 to the guardian (for example, a family member such as a parent or grandparent). It is notified to the first user terminal 3 carried or used by. Also, in the information processing system 1 according to the present embodiment, The first user terminal 3 and the second user terminal 4 are provided with microphones and speakers, and are configured to be able to transmit and receive voice messages (hereinafter, also referred to as voice messages) to and from each other. In the following description, the guardian is also referred to as the first user. Also, the person under guardianship is also referred to as the second user. In the information processing system 1, the first user terminal 3 and the second user terminal 4 are provided with microphones and speakers, and are configured to be able to transmit and receive voice messages (hereinafter, also referred to as voice messages) to and from each other. In the information processing system 1, the first user terminal 3 and the second user terminal 4 are provided with microphones and speakers, and are configured to be able to transmit and receive voice messages (hereinafter, also referred to as voice messages) to and from each other. In the following description, the guardian is also referred to as the first user. Also, the person under guardianship is also referred to as the second user. In the following description, the guardian is also referred to as the first user. Also, the person under guardianship is also referred to as the second user.

[0011] As shown in FIG. 1, the information processing system 1 includes a server 2 and a network 5 connecting the server 2. It includes one or more first user terminals 3 and second user terminals 4 connected via it. As shown in FIG. 1 In the example shown, the information processing system 1 is configured to include one server 2, one first user terminal 3, and one second user terminal 4 respectively. However, the number of the server 2, the first user terminal 3, and the second user terminal 4 included in the information processing system 1 is arbitrary respectively.

[0012] (Server 2) FIG. 2 and FIG. 3 are block diagrams of the server 2. FIG. 2 shows the main hardware configuration of the server 2, and the server 2 includes a communication IF200A, a storage device 200B, a CPU200C, etc. Although not shown in FIG. 2, the server 2 may include an input device (for example, a mouse, a keyboard, a touch panel, etc.) and a display device (CRT (Cathode Ray Tube), a liquid crystal display, an organic EL display, etc.). The communication IF200A is an interface for communicating with other devices (for example, the first user terminal 3, the second user terminal 4, etc.). The storage device 200B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD (Solid State Drive)). Various data and information processing programs are stored in the storage device 200B. Note that a part or all of the various data stored in the storage device 200B may be stored in an external storage device such as a USB (Universal Serial Bus) memory or an external HDD, or in the storage device of another information processing device connected via a network 5. In this case, the server 2 can refer to or obtain the data stored in the external storage device or the storage device of another information processing device.

[0013] The communication IF200A is an interface for communicating with other devices (such as the first user terminal 3, the second user terminal 4, etc.).

[0014] The storage device 200B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD (Solid State Drive)). Various data and information processing programs are stored in the storage device 200B. Note that a part or all of the various data stored in the storage device 200B may be stored in an external storage device such as a USB (Universal Serial Bus) memory or an external HDD, or in the storage device of another information processing device connected via a network 5. In this case, the server 2 can refer to or obtain the data stored in the external storage device or the storage device of another information processing device. ​​​​​​Thereby, data is stored in an external storage device or a storage device of another information processing device.

[0015] The storage device 200B stores the account information of the first user terminal 3, for example, the identification number, name, contact information (email address, phone number) of the first user terminal 3, and the identification number of the second user terminal 4 possessed by the second user (for example, one's own child). Also, the storage device 200B stores the account information of the second user terminal 4, for example, the identification number of the second user terminal 4, name, and the identification number of the first user terminal 3 possessed by the first user (for example, family members such as one's own parents or grandparents). Further, the storage device 200B stores logs including data transmitted and received by the first user terminal 3 and the second user terminal 4 in association with the account. Also, the storage device 200B for transmitting to the second user terminal 4 stores downloadable voice files (for example, voice files of messages recorded by people such as voice actors, actors, idols, voice files of messages by voice synthesis engines such as Vocaloid (registered trademark), etc.).

[0016] The CPU 200C controls the server 2 according to this embodiment and includes a ROM and a RAM (not shown) and the like.

[0017] FIG. 3 is a functional block diagram of the server 2. As shown in FIG. 3, the server 2 has functions such as a receiving unit 2 01, a transmitting unit 202, and a storage device control unit 203. The functions shown in FIG. 3 are realized by the CPU 200C executing an information processing program stored in the storage device 200B.

[0018] The receiving unit 201 receives data transmitted from the first user terminal 3, the second user terminal 4, etc., for example, voice data, setting instructions, etc.

[0019] The transmitting unit 202 transmits the data received from the first user terminal 3, for example, voice data or setting instructions, to the second user terminal 4. Also, the transmitting unit 202 transmits the data received from the second user terminal 4, for example, voice data, to the first user terminal 3.

[0020] The storage device control unit 203 stores the data transmitted and received by the first user terminal 3 and the second user terminal 4 in the storage device 200B in association with the account or the identification number of the user terminal that transmitted and received the data.

[0021] (First user terminal 3) The first user terminal 3 is a terminal possessed by the first user, for example, a smartphone installed with application software. The first user can transmit and receive voice messages with the second user terminal 4 registered using the first user terminal 3, for example, their own child. FIG. 4 shows the main hardware configuration of the first user terminal 3, including a communication IF 300A, a storage device 300B, an input device 300C, a display device 300D, a CPU 300E, a microphone 300F, a speaker 300G, etc. (For example, their own child)

[0022] The communication IF 300A is an interface for communicating with other devices (in this embodiment, the server 2).

[0023] The storage device 300B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD ( The storage device 300B is a solid state drive (SSD). The storage device 300B stores the terminal identification number and the information processing program. RAM (application software), presets for transmission to the second user terminal 4 Messages recorded by voice actors, actors, idols, etc. A message generated by a voice synthesis engine such as Kakaloid (registered trademark), The message entered by the first user includes the voice message recorded by the first user. (including the message and the text message entered by the text) The storage device 300B stores, for example, the first Data transmitted and received between the user terminal 3 and the second user terminal 4 is stored. The separate number is a number for identifying the first user terminal 3. By adding the identification number of the terminal to the received data, the server 2 can determine which first user the received data belongs to. It is possible to determine whether the message was sent from the user terminal 3. IP (Internet Protocol) address, MAC (Media Access Control) address, etc. Any of the above may be used, and the server 2 may grant it to the first user terminal 3.

[0024] The input device 300C is, for example, an input device such as a keyboard, a mouse, or a touch panel. However, other devices or equipment may be used as long as they are capable of inputting voice. It is also possible.

[0025] The display device 300D may be, for example, a liquid crystal display, a plasma display, or an organic EL display. However, other devices or equipment (e.g., CRT: Cathode ray tube) are also acceptable if they are capable of displaying images. It may be a Ray Tube).

[0026] The CPU 300E controls the first user terminal 3 according to the present embodiment and includes a ROM and a RAM (not shown).

[0027] The microphone 300F is an acoustic device that converts sound into an electrical signal. The user of the first user terminal 3 can use the microphone 300F to input voice (for example, a message for sending to the second user terminal 4, etc.). The input voice is sent to the server 2 by the transmission unit 302 described later.

[0028] The speaker 300G is an acoustic device that converts an electrical signal into sound. The speaker 300G reproduces, for example, the voice data transmitted from the second user terminal 4 via the server 2 and stored in the storage device 300B.

[0029] FIG. 5 shows a functional block diagram of the first user terminal 3. The first user terminal 3 has functions such as a reception unit 301, a transmission unit 302, a storage device control unit 303, an input reception unit 304 (reception unit), and a display device control unit 305. Note that the functions shown in FIG. 5 are realized by the CPU 300E executing an information processing program stored in the storage device 300B.

[0030] The reception unit 301 receives, for example, data transmitted from the server 2.

[0031] The transmission unit 302 transmits data to the server 2, for example, in response to an input operation received by the input reception unit 304.

[0032] The storage device control unit 303 controls the storage device 300B. For example, the storage device control unit 30 ​​​3 stores data transmitted and received by the first user terminal 3 and the second user terminal 4, etc., in the storage device 300B in association with the identification number of the account or user terminal that transmitted and received the data. Also, the storage device control unit 303 stores, for example, the voice data transmitted and received between the first user terminal 3 and the second user terminal 4 in the storage device 300B. The input reception unit 304 receives an input operation from the input device 300C. The display device control unit 305 controls the display device 300D and displays, for example, the screens illustrated in FIGS. 8 to 11 described later on the display device 300D.

[0033] The input reception unit 304 receives an input operation from the input device 300C.

[0034] The display device control unit 305 controls the display device 300D and displays, for example, the screens illustrated in FIGS. 8 to 11 described later on the display device 300D. The display device control unit 305 controls the display device 300D and displays, for example, the screens illustrated in FIGS. 8 to 11 described later on the display device 300D.

[0035] (Second user terminal 4) The second user terminal 4 is a terminal used by the second user of the present information processing system 1. The second user can communicate with the first user terminal 3 registered using the second user terminal 4 by transmitting and receiving voice data, and can communicate with the first user (for example, their family) by voice. FIG. 6 shows the main hardware configuration of the second user terminal 4. The second user terminal 4 includes a communication IF 400A, a storage device 400B, an input device 400C, a display device 400D (LED), The second user can communicate with the first user (for example, their family) by voice by transmitting and receiving voice data with the first user terminal 3 registered using the second user terminal 4. FIG. 6 shows the main hardware configuration of the second user terminal 4. The second user terminal 4 includes a communication IF 400A, a storage device 400B, an input device 400C, a display device 400D (LED), The second user can communicate with the first user (for example, their family) by voice by transmitting and receiving voice data with the first user terminal 3 registered using the second user terminal 4. FIG. 6 shows the main hardware configuration of the second user terminal 4. The second user terminal 4 includes a communication IF 400A, a storage device 400B, an input device 400C, a display device 400D (LED), The second user can communicate with the first user (for example, their family) by voice by transmitting and receiving voice data with the first user terminal 3 registered using the second user terminal 4. FIG. 6 shows the main hardware configuration of the second user terminal 4. The second user terminal 4 includes a communication IF 400A, a storage device 400B, an input device 400C, a display device 400D (LED), a CPU 400E, a microphone 400F, a speaker 400G, a GPS sensor 400H, etc. a CPU 400E, a microphone 400F, a speaker 400G, a GPS sensor 400H, etc. The communication IF 400A is an interface for communicating with other devices (in this embodiment, the server 2).

[0036] The communication IF 400A is an interface for communicating with other devices (in this embodiment, the server 2). The storage device 400B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD (

[0037] The storage device 400B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD ( It is a Solid State Drive. The storage device 400B stores the identification number of the terminal, information processing programs, RAM, audio data transmitted from the first user terminal 3, etc. The identification number of the terminal is a number for identifying the second user terminal 4. By attaching the identification number of the terminal to the data transmitted from the second user terminal 4, the server 2 can determine which second user terminal the received data was transmitted from. Note that the identification number of the terminal may use an IP (Internet Protocol) address, MAC (Media Access Control) address, etc., or may be assigned by the server 2 to the second user terminal 4.

[0038] The input device 400C is, for example, an input device such as a keyboard, mouse, touch panel, but other devices or equipment may be used as long as input is possible. It may also be a voice input device. The second user can operate the input device 400C to input voice and transmit it to the first user terminal 3, or play back the voice data transmitted from the first user terminal 3.

[0039] The display device 400D is, for example, an LED. The display device 400D is controlled by the notification unit 40 5 described later and lights up or blinks in a set pattern or a predetermined pattern to notify that voice has been received.

[0040] The CPU 400E controls the second user terminal 4 according to this embodiment and includes a ROM and a RAM (not shown).

[0041] The microphone 400F is an acoustic device that converts sound into an electrical signal. The second user terminal The user of 4 can input voice using the microphone 400F. The input voice is transmitted to the server 2 by the transmission unit 402 described later.

[0042] The speaker 400G is an acoustic device that converts an electrical signal into sound. The speaker 400G reproduces, for example, the voice data transmitted from the first user terminal 3 via the server 2 and stored in the storage device 400B. In addition, the speaker 400G is controlled by the notification unit 405 described later and notifies that voice has been received by generating sound in a set pattern or a predetermined pattern.

[0043] The GPS sensor 400H receives a signal from a GPS satellite that includes data such as the time data of an atomic clock mounted on the satellite and the celestial ephemeris (orbit) of the satellite, and calculates the distance from the satellite based on the difference between the transmission time and the reception time of the received signal to identify the current position. In addition, the GPS sensor 400H outputs the identified current position.

[0044] FIG. 7 shows a functional block diagram of the second user terminal 4. The second user terminal 4 has functions such as a reception unit 401, a transmission unit 402, a storage device control unit 403, an input reception unit 404, a notification unit 405, a setting unit 406, and a determination unit 407 (first to third determination units). The functions shown in FIG. 7 are realized by the CPU 400E executing an information processing program stored in the storage device 400B. The reception unit 401 receives, for example, data (such as voice data) transmitted from the server 2 and a setting instruction for setting a notification pattern for notifying that the data has been received.

[0045]

[0046] The transmission unit 402 transmits data, such as voice data, to the server 2, for example, according to the input operation received by the input reception unit 304. Further, the transmission unit 402 transmits the determination result by the determination unit 407 to the first user terminal 3 (via the server 2). Also, the transmission unit 402 transmits a recommendation instruction for recommending setting the notification pattern of the notification unit 405 to a predetermined notification pattern according to the determination result by the determination unit 407 to the first user terminal 3. The storage device control unit 403 controls the storage device 400B. For example, the storage device control unit 403 controls the storage device 400B to write and read data. The storage device control unit 403 stores, for example, the data received by the reception unit 401 in the storage device 400B. The input reception unit 404 receives an input operation from the input device 400C. The input reception unit 404 receives, for example, a reproduction operation of the voice data stored in the storage device 400B. The notification unit 405 notifies that the reception unit 401 has received data. The notification unit 405 notifies that the reception unit 401 has received data, for example, by lighting or flashing the display device 400D (LED) or generating sound from the speaker based on the notification pattern set by the setting unit 406. The setting unit 406 sets the notification pattern of the notification unit 405 based on the setting instruction received by the reception unit 401. Also, the setting unit 406 sets the notification pattern of the notification unit 405 to a predetermined notification pattern according to the determination result by the determination unit 407. Note that the notification pattern includes notification by reproduction of the data received by the reception unit 401 (the first notification pattern).

[0047]

[0048]

[0049]

[0049]

[0050]

[0050] In the case of , the notification unit 405 notifies that the reception unit 401 has received data by playing back the data received by the reception unit 40 1 has received data.

[0051] The determination unit 407 determines the state regarding the notification of the data received by the reception unit 301, for example, whether voice data has been played back, etc. Further, the determination unit 407 determines whether at least one of the date and time, the position, and the attributes of the first user terminal 3 satisfies a predetermined condition. Here, the date and time is the current date and time, and the position may be the current position.

[0052] (Display screen) Figs. 8 to 11 are diagrams showing an example of the screen G1 displayed on the display device 300D of the first user terminal 3. Hereinafter, an example of the screen G1 displayed on the display device 300D of the first user terminal 3 will be described with reference to Figs. 8 to 11. Note that the same components as those described with reference to Figs. 1 to 7 are denoted by the same reference numerals and redundant descriptions are omitted.

[0053] As shown in Fig. 8, voice data transmitted and received between the first user terminal 3 and the second user terminal 4 is displayed in chronological order in units of voice files on the display device 300D (hereinafter also referred to as time line display). In the example shown in Fig. 8, the name 11 of the second user (which may be a handle name) is displayed at the upper part of the screen G1. On the left side of the screen G1, a display frame 12B indicating the voice data (voice file of the second user) transmitted from the second user terminal 4 is displayed together with the transmission time 12D (using the information of the time stamp ) and the icon 12A (icon indicating the second user). Also, when the play button 12C is selected (tapped), the voice data corresponding to the display frame 12B ​(Voice file) can be played and the voice can be listened to. Also, on the right side of the screen G1, there is a display frame 13A showing the voice data (voice file of the first user) transmitted from the first user terminal 3 to the second user terminal 4, together with the transmission time 13C (using the information of the time stamp). Also, near the display frame 13A, there is a state 13D regarding the notification of voice data (for example, whether the voice data has been played on the second user terminal 4 or not) is also noted. Also, when the play button 13B is selected, the voice data (voice file) corresponding to the display frame 13A can be played and the voice can be listened to. Also, on the left side of the screen G1, according to the state of the second user terminal 4 (for example, time or position), a comment 14B indicating the situation automatically transmitted from the second user terminal 4 or the server 2 is displayed, together with the transmission time 14D (using the information of the time stamp) and the icon 14A (icon indicating the second user terminal 4). When the first user wants to send voice data to the second user terminal 4, the first user operates an input device 300C such as a touch panel and selects an icon 1 5 that mimics a microphone displayed at the bottom of the screen G1.

[0054] The screen G2 shown in FIG. 9 is a screen that transitions when the icon 15 described with reference to FIG. 8 is selected (tapped). As shown in FIG. 9, when the icon 15 is selected in FIG. 8, a display frame 16 for sending a message to the second user terminal 4 appears by rising from the lower side of the screen G2. The first user can record a voice by operating an input device 300C such as a touch panel and selecting a microphone icon 16A displayed within the display frame 16 of the screen G2, and then send it to the second user terminal 4. Note that when the microphone icon 16A is selected, ​​​​​​​The display form (e.g., the color of the icon) of the microphone icon 16A changes, indicating that recording has started. When the first user finishes speaking a message (e.g., "I'm coming to pick you up now"), and re - selects the microphone icon 16A again, the display form of the microphone icon 16A (e.g., the color of the icon) returns to its original state, indicating that recording has ended. Also, at the bottom of the microphone icon 16A, a plurality of messages 16B are displayed, including the preset message 16B in the storage device 300B, the message 16B input by the first user, the message 16B downloaded from the server 2, etc. The first user can select any one of the plurality of displayed messages 16B by operating the input device 300C such as a touch panel, and send the selected message 16B to the second user terminal 4.

[0055] The message input by the first user includes, as already described, the voice message blown in by the first user using the microphone 300F and the text message input in text by the first user operating the input device 300C. Here, the voice message is transcribed (texturized) and displayed as the title of the voice file. Figure 10 is an example of a screen G3 in which a voice message is transcribed (texturized) and displayed as the title of a voice file. As illustrated in Figure 10, on the screen G3, the message of the voice file obtained by transcribing (texturizing) the voice message is displayed as the title 16B. The first user can select the voice stamp store 17A on the screen G3 by operating the input device 300C such as a touch panel, and thus download a voice file from the server 2 (e.g., a voice file of a message blown in by a voice actor, a comedian, an idol, etc., a vocaloid (registered trademark ​​​​​​​​ download voice files of messages (such as those by voice synthesis engines like [Mark]) and they can be used. Also, the first user can operate an input device 300C such as a touch panel to select the replacement button 17B placed on the left side of the title 16B (by long pressing or tapping, etc.) to swap the display order of the title 16B. Also, the first user can operate an input device 300C such as a touch panel to select the edit button 17C placed on the right side of the title 16B (by long pressing or tapping, etc.) to edit the title 16B. Also, the first user can operate an input device 300C such as a touch panel to select the play button 17D placed on the right side of the title 16B (by long pressing or tapping, etc.) to play (preview) the voice file that is the source of the title 16B. Also, the first user can operate an input device 300C such as a touch panel to select the recording button 17E placed on the right side of the title 16B (by long pressing or tapping, etc.) to re-record the voice file that is the source of the title 16B. Note that the title 16B of the voice file may also be set to be displayed in descending order of usage frequency. When displaying in descending order of usage frequency, it is preferable to calculate the usage frequency of the message considering the variation in message notation (such as message similarity, etc.).

[0056] Also, the message 16B displayed on the screen G2 in FIG. 9 is preferably displayed in an order according to the usage frequency of the message by the first user or according to the settings by the first user. For example, when displayed according to the usage frequency, it is preferable that the messages are displayed in descending order of usage frequency. Also, the message 16B displayed on the screen G2 in FIG. 9 is In this case, similarly to the explanation in FIG. The first user operates the input device 300C to manually rearrange the display order of the messages 16B. In addition, the preset message 16B may be set based on the frequency of use. The messages 16B input by the first user may be displayed in descending order of frequency. It is also possible to set it so that the items are displayed in order of frequency of use. The frequency of message usage is calculated by taking into account the variation in the message (e.g., the similarity of the message). It is preferable to calculate

[0057] The screen G4 shown in FIG. 11 is a screen in which the microphone icon 16A described with reference to FIG. 9 is selected (tapped). After recording audio by pressing the This is the screen to which the first user transitions when the first user selects the touch screen 16B. By operating the input device 300C such as a panel to select the icon 18A on the screen G4, recording is started. The first user can preview and check the voice generated by the voice input device such as a touch panel. By operating the device 300C and selecting the icon 18B on the screen G4, the screen transitions to the screen G2. The first user can then re-record the voice. Alternatively, the message may be selected on the transition screen G2. In addition, the first user is notified that the second user terminal 4 has received a message from the first user terminal 3. In the example shown in FIG. 11, the first user The user can select "Ringtone ON" 19A, "Ringtone OFF" 19B, or "Use this sound as a ringtone" From "Rasu", a notification pattern can be selected. When the first user selects any one of 19A to 19C, a check mark is displayed in the selected item (in the example shown in Fig. 11, "Incoming call sound ON" 19A is selected). Note that in the example shown in Fig. 11, three or more notification patterns can be selected, but the notification patterns are not limited to the example shown in Fig. 11. For example, when "Incoming call sound ON" 19A is selected, it may be configured such that the incoming call sound can be selected, or it may be configured such that vibration can be selected as the notification pattern. When any one of them is selected, a check mark is displayed in the selected item (in the example shown in Fig. 11, "Incoming call sound ON" 19A is selected). Note that in the example shown in Fig. 11, three or more notification patterns can be selected, but the notification patterns are not limited to the example shown in Fig. 11. For example, when "Incoming call sound ON" 19A is selected, it may be configured such that the incoming call sound can be selected, or it may be configured such that vibration can be selected as the notification pattern. When the first user operates the input device 300C such as a touch panel and selects the transmission icon 18C on the screen G4, the data corresponding to the recorded voice data or the selected message 16B is transmitted to the server 2 together with the setting instruction of the notification pattern. When the first user operates the input device 300C such as a touch panel and selects the transmission icon 18C on the screen G4, the data corresponding to the recorded voice data or the selected message 16B is transmitted to the server 2 together with the setting instruction of the notification pattern.

[0058] (Information processing) Figs. 12 to 15 are flowcharts showing an example of the information processing of the information processing system 1. Hereinafter, the information processing of the information processing system 1 will be described with reference to Figs. 12 to 15. Note that the same components as those described with reference to Figs. 1 to 11 are denoted by the same reference numerals, and redundant descriptions are omitted.

[0059] (Message transmission processing) Fig. 12 is a flowchart showing an example of the message transmission processing of the information processing system 1. Hereinafter, an example of the message transmission processing of the information processing system 1 will be described with reference to Fig. 12. Note that in Fig. 12, the case where voice data is transmitted from the second user terminal 4 to the first user terminal 3 will be described.

[0060] (Step S101) The second user operates the input device 400C of the second user terminal 4 to input voice.

[0061] (Step S102) The input voice is converted into an electrical signal by the microphone 400F and then transmitted from the transmitter 402 to the server 2 as voice data. Note that data transmitted from the second user terminal 4 is attached with data such as the identification number and timestamp of the second user terminal 4.

[0062] (Step S103) The receiver 201 of the server 2 receives the voice data transmitted from the second user terminal 4.

[0063] (Step S104) The storage device control unit 203 of the server 2 stores the voice data transmitted by the second user terminal 4 in the storage device 200B in association with the account or the identification number of the user terminal that sent and received the data.

[0064] (Step S105) The transmitter 202 of the server 2 refers to the storage device 200B, identifies the identification number of the first user terminal 3 associated with the identification number given to the voice data received by the receiver 201, and transmits the voice data transmitted from the second user terminal 4 to the identified first user terminal 3.

[0065] (Step S106) The receiver 301 of the first user terminal 3 receives the voice data transmitted from the server 2.

[0066] (Step S107) The notification unit 311 of the first user terminal 3 notifies that the voice has been received.

[0067] (Message Sending Process) FIG. 13 is a flowchart showing an example of the message sending process of the information processing system 1. ​​​​​​​This will be described below with reference to FIG. 13, taking an example of the message transmission process of the information processing system 1. Note that FIG. 13 describes the case where voice data is transmitted from the first user terminal 3 to the second user terminal 4. This will be described below.

[0068] (Step S201) The first user operates the input device 300C of the first user terminal 3 to input a message to be transmitted to the second user terminal 4 and a setting instruction for the notification pattern. This input operation will be described later. This will be described later. This will be described later.

[0069] (Step S202) The transmission unit 302 of the first user terminal 3 transmits the input input data to the server 2. In addition, the input data transmitted from the first user terminal 3 is provided with data such as the identification number of the first user terminal 3 and the time stamp. This will be described later. This will be described later.

[0070] (Step S203) The receiving unit 201 of the server 2 receives the input data transmitted from the first user terminal 3.

[0071] (Step S204) The storage device control unit 203 of the server 2 stores the voice data among the input data transmitted by the first user terminal 3 in the storage device 200B in association with the account or the identification number of the user terminal that has transmitted and received the data. This will be described later. This will be described later.

[0072] (Step S205) The transmission unit 202 of the server 2 refers to the storage device 200B, specifies the identification number of the second user terminal 4 associated with the identification number given to the voice data received by the receiving unit 201, and transmits the input data transmitted from the first user terminal 3 to the specified second user terminal 4. This will be described later. This will be described later.

[0073] (Step S206) The receiving unit 401 of the second user terminal 4 receives the input data transmitted from the server 2.

[0074] (Step S207) The setting unit 406 of the second user terminal 4 sets a notification pattern. The setting of the notification pattern by the setting unit 406 will be described later.

[0075] (Step S208) The notification unit 405 of the second user terminal 4 notifies that data has been received in the notification pattern set by the setting unit 406. The notification unit 405 notifies that a message has been received based on the notification pattern set by the setting unit 406 by means of lighting or flashing of a display device (LED), sound, vibration, etc.

[0076] (Input processing) FIG. 14 is a flowchart showing an example of the input processing in step S201 of FIG. 13. Hereinafter, with reference to FIG. 14, an example of the input processing in step S201 of FIG. 13 will be described .

[0077] (Step S301) The first user operates the input device 300C of the first user terminal 3 to display the screen G 2 described in FIG. 9 or the screen G3 described in FIG. 10. The display device control unit 30 5 of the first user terminal 3 causes the screen G2 or the screen G3 to be displayed on the display device 300D.

[0078] (Step S302) The input reception unit 304 of the first user terminal 3 determines whether any of the messages 16B displayed on the screen G2 or the screen G3 is selected by operating the input device 300C. If any of the messages 16B is selected (YES), the first user terminal 3 proceeds to step S3 ​​​Execute the process of 05. If no message is selected (NO), the first user terminal 3 executes the process of step S303.

[0079] (Step S303) The input reception unit 304 of the first user terminal 3 determines whether the microphone icon 16A displayed on the screen G2 or the screen G3 is selected by operating the input device 300C. If the microphone icon 1 6A is selected (YES), the first user terminal 3 executes the process of step S304. If the microphone icon 16A is not selected (NO), the first user terminal 3 returns to the process of step S302.

[0080] (Step S304) The first user terminal 3 records the voice of the first user input using the microphone. For example, the storage device control unit 303 of the first user terminal 3 stores the voice of the first user input using the microphone in the storage device 300B.

[0081]

[0082] Note that the order of the process of step S302 and the processes of step S303 and step S304 may be reversed. (Step S305) The display device control unit 305 of the first user terminal 3 causes the display device 3 00D to display the screen G4 described in FIG. 11. The input reception unit 304 of the first user terminal 3 receives the notification pattern input by the first user operating the input device 3 00C.

[0083] (Notification pattern setting process) FIG. 15 shows an example of the notification pattern setting process of step S207 in FIG. 13 as a flowchart. It is as follows. Hereinafter, with reference to FIG. 15, the notification pattern setting process of step S207 in FIG. 13 will be described by way of an example.

[0084] (Step S401) The determination unit 407 of the second user terminal 4 determines whether at least one of the date and time, the position, and the attributes of the first user terminal 3 satisfies a predetermined condition. If the predetermined condition is satisfied (YES) , the second user terminal 4 executes the process of step S402. If the predetermined condition is not satisfied (NO), the second user terminal 4 executes the process of step S403.

[0085] (Step S402) The setting unit 406 of the second user terminal 4 sets the notification pattern of the above notification unit 405 based on the setting instruction received by the reception unit 401.

[0086] (Step S403) The transmission unit 402 of the second user terminal 4 sets the notification pattern of the notification unit 405 to a predetermined notification pattern and transmits it to the first user terminal 3 (via the server 2).

[0087] (Step S404) The setting unit 406 of the second user terminal 4 sets the notification pattern of the notification unit 405 to a predetermined notification pattern and sets it.

[0088] In the above description, when at least one of the date and time, the position, and the attributes of the first user terminal 3 does not satisfy the predetermined condition, the notification pattern of the notification unit 405 is set to a predetermined notification pattern However, the determination unit 407 determines whether at least one of the date and time, the position, and the attributes and status of different terminals satisfies a predetermined condition, and the date and time, the position, and the first user terminal 3 When at least one of the attributes does not satisfy a predetermined condition, it is recommended to set the notification pattern of the notification unit 405 to a predetermined notification pattern, and send this recommendation instruction to the first user terminal 3. When a permission signal is received from the first user terminal 3, the setting unit 406 may be configured to set the notification pattern of the notification unit 405 to a predetermined notification pattern. As described above, the second user terminal 4 receives data (for example, voice data) and a setting instruction for setting a notification pattern when notifying the reception of the data from different terminals. The reception unit 401, the notification unit 405 that notifies that the reception unit 401 has received the data, and the setting unit 406 that sets the notification pattern of the notification unit based on the setting instruction.

[0089] The second user terminal 4 includes a reception unit 401, a notification unit 405 that notifies that the reception unit 401 has received the data, and a setting unit 406 that sets the notification pattern of the notification unit based on the setting instruction. Normally, on a mobile terminal, the setting of the notification of the terminal is performed by the owner of the terminal according to the situation. It is not a specification that a third party such as the sender of a message can set it. However, as described above, in the present invention, since the notification pattern of data reception can be set from the first user terminal 3 which is a different terminal, it is highly convenient. For example, when a message arrives during a school or cram school class and is notified by sound or the like, it may be troublesome. On the other hand, if it is always set to silent, there is a risk that the second user may never notice the message. However, since the notification pattern of the second user terminal 4 can be changed, the above problems can be solved. Normally, on a mobile terminal, the setting of the notification of the terminal is performed by the owner of the terminal according to the situation. It is not a specification that a third party such as the sender of a message can set it. However, as described above, in the present invention, since the notification pattern of data reception can be set from the first user terminal 3 which is a different terminal, it is highly convenient. For example, when a message arrives during a school or cram school class and is notified by sound or the like, it may be troublesome. On the other hand, if it is always set to silent, there is a risk that the second user may never notice the message. However, since the notification pattern of the second user terminal 4 can be changed, the above problems can be solved.

[0090] The second user terminal 4 further includes a determination unit 407 that determines the state regarding the notification of the data received by the reception unit 401, and a transmission unit 402 that transmits the determination result by the determination unit 407 to the first user terminal 3 which is a different terminal. In this way, the state regarding the notification of the data of the second user terminal 4 (for example, listening to a message) Since it transmits whether the second user (for example, a child) is listening to the message or not to the first user terminal 3, the first user terminal 3 can confirm whether the second user is listening to the message or not, which improves convenience. In this way, at least one of the date and time of the second user terminal 4 (for example, whether it is school or cram school time), the position (for example, whether at school or cram school), and the attribute of the first user terminal 3 which is a different terminal (whether it is a parent, a sibling, a grandparent, etc.) is determined whether it satisfies a predetermined condition. If the condition is not satisfied, for example, when it is school or cram school time, when at school or cram school, or when the attribute of the first user terminal 3 is other than a parent, a recommendation instruction for setting the notification pattern of the notification unit 405 to a predetermined notification pattern is transmitted to the first user terminal 3 which is a different terminal, etc., which improves convenience.

[0091] Further, the second user terminal 4 includes a determination unit 407 that determines whether at least one of the date and time, the position, and the attributes and statuses of different terminals satisfies a predetermined condition. The setting unit 40 6 sets the notification pattern of the notification unit to a predetermined notification pattern according to the determination result by the determination unit 407. In this way, at least one of the date and time of the second user terminal 4 (for example, whether it is school or cram school time), the position (for example, whether at school or cram school), and the attribute of the first user terminal 3 which is a different terminal (whether it is a parent, a sibling, a grandparent, etc.) is determined whether it satisfies a predetermined condition. For example, when it is school or cram school time, when at school or cram school, or when the attribute of the first user terminal 3 is other than a parent, the notification pattern of the notification unit 405 can be set to a predetermined notification pattern, etc., which improves convenience.

[0092] ​​​​​​​​​​​​ In addition, the second user terminal 4 determines whether at least one of the date and time, location, and attributes and status of different terminals satisfies a predetermined condition. A determination unit 407, and according to the determination result by the determination unit 407, a transmission unit 402 that transmits a recommendation instruction for setting the notification pattern of the notification unit 405 to a predetermined notification pattern to the first user terminal 3, which is a different terminal, may be provided.

[0093] Also, it is preferable that either the date and time is the current date and time, or the location is the current location, or both. By setting either the date and time to the current date and time, or the location to the current location, or both, it is possible to determine whether the second user is currently, for example, at school or at a cram school, or whether the second user is present at school or at a cram school.

[0094] In this embodiment, the notification pattern includes notification by data playback as the first notification pattern. When the reception unit 401 of the second user terminal 4 receives the setting instruction set in the first notification pattern, the notification unit 405 notifies that data has been received by data playback. In this way, since notification can be made by playing back a message, convenience is improved.

[0095] In this embodiment, the reception unit 401 of the second user terminal 4 receives data and a setting instruction from the first user terminal 3, which is a different terminal, via the server 2 (information processing device). However, the first user terminal 3 and the second user terminal 4 may transmit and receive data (for example, audio data) and a setting instruction without going through the server 2 (information processing device) (for example, by a peer-to-peer method).

[0096] ​​​​​​​​​​​​​​[Modification Example 1 of the Embodiment] In the above embodiment, the first user terminal 3 is provided with a text conversion unit that converts voice data into text data (character data), and at least a part of the voice data transmitted and received between the first user terminal 3 and the second user terminal 4 is converted into text data and displayed (output) on the display device 300D . Since the voice can be confirmed in characters, the convenience is improved . Also, the character data obtained by converting the voice data transmitted to the second user terminal 4 may be configured to be displayed (output) on the screen G2 as the message 16B described with reference to FIG. 9 . Also in this case, the message 16B (text data) is preferably displayed in the order according to the usage frequency of the message by the first user or the setting by the first user .

[0097] [Modification Example 2 of the Embodiment] Further, at least a part of the functions of the first user terminal 3 may be provided in the server 2 . For example, the server 2 may be provided with a text conversion unit that converts at least a part of the voice data transmitted and received between the first user terminal 3 and the second user terminal 4 described above into character data . Also in this case, the message 16B (text data) is determined by the server in the order according to the usage frequency of the message by the first user or the setting by the first user , so that the message 16B (text data) is displayed (output) on the first user terminal 3 in the order according to the usage frequency of the message by the first user or the setting by the first user .

[0098] Further, at least a part of the functions of the second user terminal 4 shown in FIG. 7 may be provided in the server 2 ​​​​​​​For example, the function of the determination unit 407 among the functions of the second user terminal 4 may be The server 2 may have the information. In this case, the status, date, time, and location of the data notification may be stored. Whether at least one of the following conditions is satisfied: The decision as to whether or not this is the case is made by server 2.

[0099] In addition, at least a part of the functions of the second user terminal 4 shown in FIG. For example, the second user terminal 4 may have the following functions: The function of the determination unit 407 and the notification pattern of the notification unit 405 are set to a predetermined notification pattern. The recommendation function (recommendation unit) may be provided in the server 2 or the first user terminal 3. In this case, the status of the data broadcast, the date and time, the location, and the attributes and status of different terminals Whether or not at least one of the above conditions is satisfied is determined by the server 2 or the first user terminal 3. It is judged.

[0100] In addition, the above-mentioned embodiment and modifications are merely examples of the present invention. The above is merely an example, and the technical scope of the present invention should not be construed as being limited thereby. In other words, the present invention does not deviate from its gist or main characteristics. It can be implemented in a variety of ways. [Explanation of symbols]

[0101] 1. Information Processing Systems 2. Server (information processing device) 200A Communication IF 200B storage device 200C CPU 201 Receiving unit 202 Transmitter 203 Storage device control unit 3 First user terminal (information processing terminal) 300A Communication IF 300B Memory device 300C Input device 300D Display device 300E CPU 300F Microphone 300G Speaker 301 Receiver 302 Transmitter 303 Memory device control unit 304 Input reception unit (reception unit) 305 Display device control unit 4 Second user terminal 400A Communication IF 400B Memory device 400C Input device 400D Display device (LED) 400E CPU 400F Microphone 400G Speaker 400H GPS sensor 401 Receiver 402 Transmitter 403 Memory device control unit 404 Input reception unit 405 Notification unit 406 Setting unit 407 Judgment unit 5 Network

Claims

1. An information processing apparatus that communicates with a first terminal and a second terminal whose location information is monitored by the first terminal obtains location information of the second terminal from the second terminal; transmits at least a part of the location information to the first terminal; displays the location of the second terminal based on the location information on the first terminal; obtains a first voice message input to the first terminal from the first terminal; transmits the first voice message to the second terminal; obtains a second voice message input to the second terminal from the second terminal; transmits the second voice message to the first terminal; converts at least a part of the second voice message into text data; transmits the converted text data to the first terminal; displays an object indicating the first voice message, an object indicating the second voice message, and the text data on the same screen of the first terminal; An information processing method for performing the above.

2. The information processing method according to claim 1, wherein the first voice message includes a preset voice message.

3. The information processing apparatus further receives a notification pattern for each of the first voice messages from the first terminal; transmits information for causing the second terminal to notify with the notification pattern. The information processing method according to claim 1 or 2.

4. The notification pattern is a notification pattern for notifying by vibrating the second terminal; a notification pattern for notifying by lighting the light of the second terminal; and a notification pattern for notifying by playing the first voice message on the second terminal The information processing method according to claim 3, including at least one of them.

5. The information processing apparatus further obtains a comment indicating the situation of the second terminal based on the location information of the second terminal from the second terminal; transmits the comment to the first terminal; The information processing method according to any one of claims 1 to 4, wherein the same screen further includes the comment.

6. The information processing method according to any one of claims 1 to 5, wherein the same screen includes an input icon for inputting the first voice message.

7. The information processing method according to any one of claims 1 to 6, wherein the first terminal is for a caregiver and the second terminal is carried by the care recipient.

8. The information processing method according to any one of claims 1 to 7 (however, excluding those where the second terminal is a smartphone).

9. The information processing method according to any one of claims 1 to 8, wherein the number of the second terminals is two or more.

10. The information processing method according to any one of claims 1 to 9, wherein the number of the first terminals is two or more.

11. An information processing apparatus that communicates with a first terminal and a second terminal whose location information is monitored by the first terminal, means for acquiring the location information of the second terminal from the second terminal; means for transmitting at least a part of the location information to the first terminal; means for displaying the location of the second terminal based on the location information on the first terminal; means for acquiring a first voice message input to the first terminal from the first terminal; means for transmitting the first voice message to the second terminal; means for acquiring a second voice message input to the second terminal from the second terminal; means for transmitting the second voice message to the first terminal; means for converting at least a part of the second voice message into text data; means for transmitting the converted text data to the first terminal; means for displaying an object indicating the first voice message, an object indicating the second voice message, and the text data on the same screen of the first terminal; An information processing apparatus comprising the above.

12. An information processing apparatus that communicates with a first terminal and a second terminal whose location information is monitored by the first terminal, means for acquiring the location information of the second terminal from the second terminal, means for transmitting at least a part of the location information to the first terminal, means for displaying the location of the second terminal based on the location information on the first terminal, means for acquiring a first voice message input to the first terminal from the first terminal, means for transmitting the first voice message to the second terminal, means for acquiring a second voice message input to the second terminal from the second terminal, means for transmitting the second voice message to the first terminal, means for converting at least a part of the second voice message into text data, means for transmitting the converted text data to the first terminal, and Means for displaying, on the same screen of the first terminal, an object indicating the first voice message, an object indicating the second voice message, and the text data. An information processing program that functions as such.

Images