Information processing terminal, information processing device, information processing method, information processing program

Abstract

To provide highly convenient information processing terminals, information processing devices, information processing methods, and information processing programs. The information processing terminal according to the present invention comprises a receiving unit that receives data and setting instructions for setting a notification pattern for notifying that the data has been received from different terminals, a notification unit that notifies that the receiving unit has received the data, and a setting unit that sets the notification pattern for the notification unit based on the setting instructions.

Description

Technical Field

[0001] The present invention relates to an information processing terminal, an information processing apparatus, an information processing method, and an information processing program capable of exchanging voice data.

Background Art

[0002] When a child reaches a certain age, for example, becomes an elementary school student and often acts alone, a guardian with a child worries about the child's actions, such as whether the child has safely arrived at school or a cram school without encountering an accident or has returned home.

[0003] Therefore, as a mechanism for dealing with the above problems, for example, a service is provided that enables the confirmation of a child's position information by using a GPS function mounted on a portable information terminal such as a smartphone (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, there is still room for improvement in convenience in the conventional information processing system.

[0006] The present invention has been made in view of the above problems, and an object thereof is to provide an information processing terminal, an information processing apparatus, an information processing method, and an information processing program with high convenience.

Means for Solving the Problems

[0007] To solve the above problems, the information processing terminal according to the present invention comprises a receiving unit that receives data and setting instructions for setting a notification pattern when notifying that data has been received from different terminals, a notification unit that notifies that the receiving unit has received data, and a setting unit that sets the notification pattern for the notification unit based on the setting instructions. [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a highly convenient information processing terminal, information processing device, information processing method, and information processing program. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows an example of the arrangement of an information processing system according to the embodiment. [Figure 2] This figure shows an example of the configuration of an information processing server according to the embodiment. [Figure 3] This figure shows an example of the configuration of an information processing device server according to the embodiment. [Figure 4] This figure shows an example of the configuration of the first user terminal according to the embodiment. [Figure 5] This figure shows an example of the configuration of the first user terminal according to the embodiment. [Figure 6] This figure shows an example of the configuration of a second user terminal according to the embodiment. [Figure 7] This figure shows an example of the configuration of a second user terminal according to the embodiment. [Figure 8] This figure shows an example of a screen displayed on the display device of the first user terminal according to the embodiment. [Figure 9] This figure shows an example of a screen displayed on the display device of the first user terminal according to the embodiment. [Figure 10] This figure shows an example of a screen displayed on the display device of the first user terminal according to the embodiment. [Figure 11] This figure shows an example of a screen displayed on the display device of the first user terminal according to the embodiment. [Figure 12]This flowchart shows an example of processing performed by the information processing system according to the embodiment. [Figure 13] This flowchart shows an example of processing performed by the information processing system according to the embodiment. [Figure 14] This flowchart shows an example of processing performed by the information processing system according to the embodiment. [Figure 15] This flowchart shows an example of processing performed by the information processing system according to the embodiment. [Modes for carrying out the invention]

[0010] [Embodiment] The information processing system 1 according to the embodiment will be described below with reference to the drawings. The information processing system 1 according to this embodiment is a so-called monitoring system. The location of the second user terminal 4, carried by the person being monitored (e.g., a child), is determined from information uploaded to the server 2 at predetermined intervals, such as every 1.5 minutes. The determined location is then notified from the server 2 to the first user terminal 3, carried or used by the caregiver (e.g., a parent or grandparent). In addition, the information processing system 1 according to this embodiment is equipped with a microphone and a speaker on both the first user terminal 3 and the second user terminal 4, and is configured to send and receive voice messages (hereinafter also referred to as voice messages) to and from each other. In the following description, the caregiver will also be referred to as the first user, and the person being monitored will also be referred to as the second user.

[0011] As shown in Figure 1, the information processing system 1 comprises a server 2 and one or more first user terminals 3 and second user terminals 4 connected to the server 2 via a network 5. In the example shown in Figure 1, the information processing system 1 is configured to have one server 2, one first user terminal 3, and one second user terminal 4, but the number of servers 2, first user terminals 3, and second user terminals 4 in the information processing system 1 is arbitrary.

[0012] (Server 2) FIG. 2 and FIG. 3 are block diagrams of Server 2. FIG. 2 shows the main hardware configuration of Server 2, and Server 2 includes a communication IF 200A, a storage device 200B, a CPU 200C, etc. Although not shown in FIG. 2, Server 2 may include an input device (e.g., a mouse, keyboard, touch panel, etc.) and a display device (CRT (Cathode Ray Tube), liquid crystal display, organic EL display, etc.).

[0013] The communication IF 200A is an interface for communicating with other devices (e.g., the first user terminal 3, the second user terminal 4, etc.).

[0014] The storage device 200B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD (Solid State Drive)). Various data and information processing programs are stored in the storage device 200B. Note that part or all of the various data stored in the storage device 200B may be stored in an external storage device such as a USB (Universal Serial Bus) memory or an external HDD, or in the storage device of another information processing device connected via the network 5. In this case, Server 2 refers to or acquires the data stored in the external storage device or the storage device of another information processing device, and stores the data in the external storage device or the storage device of another information processing device.

[0015] The storage device 200B stores the account information of the first user terminal 3, for example, the first user terminal The identification number, name, and contact information (email address, phone number) of user 3 are stored in the second user terminal 4, which is owned by a second user (for example, one's own child). The storage device 200B also stores the account information of the second user terminal 4, for example, the identification number and name of the second user terminal 4, and the identification number of the first user terminal 3 owned by the first user (for example, one's parents or grandparents). The storage device 200B also stores logs, including data sent and received by the first user terminal 3 and the second user terminal 4, associated with the accounts. Furthermore, the storage device 200B for sending to the second user terminal 4 stores downloadable and usable audio files (for example, audio files of messages recorded by voice actors, actors, idols, etc., or audio files of messages created by speech synthesis engines such as Vocaloid®).

[0016] The CPU200C controls the server 2 according to this embodiment and includes ROM, RAM, and other components (not shown).

[0017] Figure 3 is a functional block diagram of Server 2. As shown in Figure 3, Server 2 includes functions such as a receiving unit 201, a transmitting unit 202, and a storage device control unit 203. The functions shown in Figure 3 are realized by the CPU 200C executing the information processing program stored in the storage device 200B.

[0018] The receiving unit 201 receives data transmitted from the first user terminal 3, the second user terminal 4, etc., such as voice data and setting instructions.

[0019] The transmitting unit 202 transmits data received from the first user terminal 3, such as voice data and setting instructions, to the second user terminal 4. The transmitting unit 202 also transmits data received from the second user terminal 4, such as voice data, to the first user terminal 3.

[0020] The storage device control unit 203 stores the data transmitted and received by the first user terminal 3 and the second user terminal 4 in the storage device 200B, associating it with the identification number of the account or user terminal that transmitted or received the data.

[0021] (First user terminal 3) The first user terminal 3 is a device owned by the first user, such as a smartphone with application software installed. The first user can send and receive voice messages with the second user (for example, their child) by sending and receiving voice data with the second user terminal 4, which is registered using the first user terminal 3. Figure 4 shows the main hardware configuration of the first user terminal 3, which includes a communication IF 300A, storage device 300B, input device 300C, display device 300D, CPU 300E, microphone 300F, speaker 300G, etc.

[0022] The communication IF300A is an interface for communicating with other devices (in this embodiment, server 2).

[0023] The storage device 300B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD (Solid State Drive)). The storage device 300B stores the terminal identification number, information processing programs (application software), preset messages to be sent to the second user terminal 4 (for example, messages recorded by people such as voice actors, actors, or idols, messages from speech synthesis engines such as Vocaloid (registered trademark), messages entered by the first user (messages entered by the first user include voice messages recorded by the first user and text messages entered by the first user), and messages downloaded from server 2). The storage device 300B also stores, for example, the first The data transmitted and received between user terminal 3 and second user terminal 4 is stored. The terminal identification number is a number used to identify the first user terminal 3. By assigning the terminal identification number to the data transmitted from the first user terminal 3, server 2 can determine which first user terminal 3 the received data originated from. Note that the terminal identification number is an IP (Internet Protocol) address, MAC (Media Access Control) address, etc. Any method may be used, and server 2 may also grant it to the first user terminal 3.

[0024] The input device 300C is, for example, an input device such as a keyboard, mouse, or touch panel, but it may be any other device or equipment that can accept input. It may also be an audio input device.

[0025] The display device 300D may be, for example, a liquid crystal display, a plasma display, or an organic EL display, but it may also be any other device or equipment capable of displaying (for example, a CRT: Cathode Ray Tube).

[0026] The CPU300E controls the first user terminal 3 according to this embodiment and includes ROM and RAM (not shown).

[0027] The microphone 300F is an audio device that converts sound into electrical signals. Users of the first user terminal 3 can use the microphone 300F to input voice (for example, a message to be sent to the second user terminal 4). The input voice is transmitted to the server 2 by the transmission unit 302, which will be described later.

[0028] Speaker 300G is an audio device that converts electrical signals into sound. Speaker 300G plays audio data transmitted from a second user terminal 4 via server 2 and stored in storage device 300B.

[0029] Figure 5 shows a functional block diagram of the first user terminal 3, which has functions such as a receiving unit 301, a transmitting unit 302, a storage device control unit 303, an input receiving unit 304 (receiving unit), and a display device control unit 305. The functions shown in Figure 5 are realized by the CPU 300E executing the information processing program stored in the storage device 300B.

[0030] The receiving unit 301 receives data transmitted from, for example, the server 2.

[0031] The transmission unit 302 transmits data to the server 2 in response to input operations received by the input reception unit 304, for example.

[0032] The storage device control unit 303 controls the storage device 300B. For example, the storage device control unit 303 stores data transmitted and received by the first user terminal 3 and the second user terminal 4 in the storage device 300B, associating it with the identification numbers of the accounts or user terminals that transmitted and received the data. The storage device control unit 303 also stores, for example, voice data transmitted and received between the first user terminal 3 and the second user terminal 4 in the storage device 300B.

[0033] The input receiving unit 304 receives input operations from the input device 300C.

[0034] The display device control unit 305 controls the display device 300D and displays, for example, screens exemplified in Figures 8 to 11, which will be described later, on the display device 300D.

[0035] (Second user terminal 4) The second user terminal 4 is a terminal used by the second user of this information processing system 1. The user can communicate with the first user (for example, their family) by sending and receiving voice data with the first user terminal 3, which is registered using the second user terminal 4. Figure 6 shows the main hardware configuration of the second user terminal 4, which is equipped with a communication IF 400A, storage device 400B, input device 400C, display device 400D (LED), CPU 400E, microphone 400F, speaker 400G, GPS sensor 400H, etc.

[0036] The communication IF400A is an interface for communicating with other devices (in this embodiment, server 2).

[0037] The storage device 400B is, for example, an HDD (Hard Disk Drive) or a semiconductor storage device (SSD (Solid State Drive)). The storage device 400B stores the terminal identification number, information processing programs, and audio data transmitted from the first user terminal 3. The terminal identification number is used to identify the second user terminal 4. By assigning the terminal identification number to the data transmitted from the second user terminal 4, the server 2 can determine which second user terminal 4 the received data originated from. The terminal identification number may utilize an IP (Internet Protocol) address, MAC (Media Access Control) address, etc. Alternatively, server 2 may grant it to the second user terminal 4.

[0038] The input device 400C is, for example, an input device such as a keyboard, mouse, or touch panel, but it may be any other device or equipment that can accept input. It may also be an audio input device. The second user can operate the input device 400C to input audio and send it to the first user terminal 3, or to play back audio data sent from the first user terminal 3.

[0039] The display device 400D is, for example, an LED. The display device 400D is controlled by the notification unit 405, described later, and notifies that sound has been received by lighting up or flashing in a set pattern or a predetermined pattern.

[0040] The CPU400E controls the second user terminal 4 according to this embodiment and includes ROM and RAM (not shown).

[0041] The microphone 400F is an audio device that converts sound into electrical signals. Users of the second user terminal 4 can input voice using the microphone 400F. The input voice is transmitted to the server 2 by the transmission unit 402, which will be described later.

[0042] Speaker 400G is an audio device that converts electrical signals into sound. Speaker 400G plays audio data transmitted from the first user terminal 3 via server 2 and stored in storage device 400B. Speaker 400G is also controlled by notification unit 405 (described later) and notifies that audio has been received by generating sound in a set pattern or a predetermined pattern.

[0043] The GPS sensor 400H receives signals from GPS satellites that include data such as the time from the atomic clock on board the satellite and the satellite's ephemeris (orbit). It then calculates the distance from the satellite based on the difference between the transmission time and reception time of the received signal to determine the current position. The GPS sensor 400H also outputs the determined current position.

[0044] Figure 7 shows a functional block diagram of the second user terminal 4, which has functions such as a receiving unit 401, a transmitting unit 402, a storage device control unit 403, an input receiving unit 404, a notification unit 405, a setting unit 406, and a determination unit 407 (first to third determination units). The function is achieved by the CPU 400E executing the information processing program stored in the memory device 400B.

[0045] The receiving unit 401 receives, for example, data transmitted from the server 2 (e.g., audio data) and setting instructions for setting a notification pattern to notify when the data has been received.

[0046] The transmitting unit 402 transmits data, such as voice data, to the server 2 in response to an input operation received by the input receiving unit 304. The transmitting unit 402 also transmits the determination result from the determination unit 407 to the first user terminal 3 (via the server 2). The transmitting unit 402 also transmits a recommendation instruction to the first user terminal 3 to recommend setting the notification pattern of the notification unit 405 to a predetermined notification pattern, in accordance with the determination result from the determination unit 407.

[0047] The storage device control unit 403 controls the storage device 400B. For example, the storage device control unit 403 controls the storage device 400B to write and read data. For example, the storage device control unit 403 stores the data received by the receiving unit 401 in the storage device 400B.

[0048] The input receiving unit 404 receives input operations from the input device 400C. The input receiving unit 404 also receives, for example, an operation to play back audio data stored in the storage device 400B.

[0049] The notification unit 405 notifies that the receiving unit 401 has received data. The notification unit 405 notifies that the receiving unit 401 has received data by, for example, lighting or flashing the display device 400D (LED) or generating a sound from the speaker, based on a notification pattern set by the setting unit 406.

[0050] The setting unit 406 sets the notification pattern of the notification unit 405 based on the setting instructions received by the receiving unit 401. The setting unit 406 also sets the notification pattern of the notification unit 405 to a predetermined notification pattern according to the determination result by the determination unit 407. The notification pattern includes notification by playback of data received by the receiving unit 401 (first notification pattern). In the case of this notification pattern, the notification unit 405 notifies that the receiving unit 401 has received data by playback of the data received by the receiving unit 401.

[0051] The determination unit 407 determines the status of the notification of the data received by the receiving unit 301, for example, whether audio data has been played back. The determination unit 407 also determines whether at least one of the following conditions is met: date and time, location, and attributes of the first user terminal 3. Here, the date and time is the current date and time, and the location may be the current location.

[0052] (display screen) Figures 8 to 11 show examples of screen G1 displayed on the display device 300D of the first user terminal 3. Hereinafter, an example of screen G1 displayed on the display device 300D of the first user terminal 3 will be described with reference to Figures 8 to 11. Note that components identical to those described with reference to Figures 1 to 7 are denoted by the same reference numerals, and redundant explanations are omitted.

[0053] As shown in Figure 8, the display device 300D displays audio data transmitted and received between the first user terminal 3 and the second user terminal 4 in chronological order on an audio file basis (hereinafter also referred to as timeline display). In the example shown in Figure 8, the name 11 (or handle name) of the second user is displayed at the top of screen G1. On the left side of screen G1, a display frame 12B showing the audio data (second user's audio file) sent from the second user's terminal 4 is displayed along with the time of transmission 12D (using timestamp information) and an icon 12A (an icon representing the second user). When the play button 12C is selected (tapped), the audio data corresponding to the display frame 12B is played. The (audio file) will play and you can listen to the audio. Furthermore, on the right side of screen G1, a display frame 13A showing the audio data (the first user's audio file) transmitted from the first user terminal 3 to the second user terminal 4 is displayed along with the transmission time 13C (using timestamp information). In addition, the status 13D related to the notification of the audio data (for example, whether or not the audio data was played on the second user terminal 4) is also displayed near the display frame 13A. When the play button 13B is selected, the audio data (audio file) corresponding to the display frame 13A is played and the audio can be heard. Furthermore, on the left side of screen G1, a comment 14B indicating the status, which is automatically sent from the second user terminal 4 or server 2 depending on the status of the second user terminal 4 (for example, time and location), is displayed along with the time 14D (using timestamp information) and icon 14A (an icon representing the second user terminal 4). If the first user wants to send audio data to the second user terminal 4, they operate an input device 300C such as a touch panel to select the microphone-like icon 15 displayed at the bottom of screen G1.

[0054] The screen G2 shown in Figure 9 is the screen that appears when icon 15, as explained with reference to Figure 8, is selected (tapped). As shown in Figure 9, when icon 15 is selected in Figure 8, a display frame 16 for sending a message to the second user terminal 4 appears rising from the bottom of screen G2. The first user can record voice and send it to the second user terminal 4 by operating an input device 300C such as a touch panel and selecting the microphone icon 16A displayed in the display frame 16 of screen G2. When the microphone icon 16A is selected, its display form (for example, the color of the icon) changes to indicate that recording has started. When the first user finishes speaking a message (for example, "I'm coming to pick you up now") and selects the microphone icon 16A again, the display form (for example, the color of the icon) of the microphone icon 16A returns to its original state, indicating that recording has ended. Furthermore, below the microphone icon 16A, multiple messages 16B, including messages 16B pre-set in the storage device 300B, messages 16B entered by the first user, and messages 16B downloaded from server 2, are displayed. The first user can select one of the displayed messages 16B by operating an input device 300C such as a touch panel, and then send the selected message 16B to the second user terminal 4.

[0055] As mentioned earlier, the messages entered by the first user include both voice messages recorded by the first user using microphone 300F and text messages entered by the first user using input device 300C. Here, the voice messages are transcribed (converted to text) and displayed as the title of the audio file. Figure 10 shows an example of screen G3, where the audio message has been transcribed (converted to text) and displayed as the title of the audio file. As illustrated in Figure 10, screen G3 displays the transcribed (converted to text) audio file message as the title 16B. The first user can download and use audio files (for example, audio files of messages recorded by people such as voice actors, actors, or idols, or audio files of messages created by speech synthesis engines such as Vocaloid®) from server 2 by operating an input device 300C such as a touch panel and selecting the voice stamp store 17A on screen G3. Furthermore, the first user can change the display order of the title 16B by operating an input device 300C such as a touch panel and selecting the swap button 17B located to the left of the title 16B (by long-pressing or tapping). Furthermore, the first user can edit the title 16B by operating an input device 300C such as a touch panel to select the edit button 17C located to the right of the title 16B (by long-pressing or tapping). Furthermore, the first user operates the input device 300C, such as a touch panel, to access title 16B. By selecting the play button 17D located on the right (by long-pressing or tapping), you can play (preview) the original audio file for title 16B. Furthermore, the first user can re-record the audio file that forms the basis of title 16B by operating an input device 300C such as a touch panel and selecting the recording button 17E located to the right of title 16B (by long-pressing or tapping). Furthermore, the audio file titles 16B may be set to be displayed in order of frequency of use. When displaying in order of frequency of use, it is preferable to calculate the frequency of use of messages while considering variations in message notation (for example, similarity of messages).

[0056] Furthermore, it is preferable that the messages 16B displayed on screen G2 in Figure 9 are displayed in an order corresponding to the frequency of message usage by the first user or the settings made by the first user. For example, if displayed according to usage frequency, it is preferable that the messages be displayed in order of highest usage frequency. Alternatively, the messages 16B displayed on screen G2 in Figure 9 may be displayed in an order corresponding to the settings made by the first user. In this case, as explained in Figure 10, the first user may be able to manually rearrange and set the display order of the messages 16B by operating the input device 300C. Alternatively, the preset messages 16B may be displayed in order of highest usage frequency, or the messages 16B entered by the first user may be displayed in order of highest usage frequency. When displaying messages in order of frequency, it is preferable to calculate the frequency of message usage while considering variations in message notation (e.g., similarity of messages).

[0057] The screen G4 shown in Figure 11 is the screen that is accessed after selecting (tapping) the microphone icon 16A as explained with reference to Figure 9 to record audio, or by selecting the message 16B displayed below the microphone icon 16A. As shown in Figure 11, the first user can listen to and confirm the recorded audio by operating an input device 300C such as a touch panel to select icon 18A on screen G4. Alternatively, the first user can access screen G2 and re-record the audio by operating an input device 300C such as a touch panel to select icon 18B on screen G4. The first user may also select a message on screen G2 instead of re-recording the audio. Furthermore, the first user can set a notification pattern for when the second user terminal 4 is notified that it has received a message from the first user terminal 3. In the example shown in Figure 11, the first user can select a notification pattern from "Ringtone ON" 19A, "Ringtone OFF" 19B, and "Play this audio as a ringtone" 19C. When the first user selects any of 19A to 19C, a check mark will appear on the selected item (in the example shown in Figure 11, "Ringtone ON" 19A is selected). Note that in the example shown in Figure 11, there are three notification patterns to choose from, but the notification patterns are not limited to the example shown in Figure 11. For example, if "Ringtone ON" 19A is selected, the system may be configured to allow the user to select a ringtone, or to allow the user to select vibration as the notification pattern. When the first user operates an input device 300C such as a touch panel and selects the transmit icon 18C on screen G4, the recorded audio data or data corresponding to the selected message 16B is sent to server 2 along with instructions for setting the notification pattern.

[0058] (Information processing) Figures 12 to 15 are flowcharts illustrating an example of information processing in Information Processing System 1. The information processing of Information Processing System 1 will be explained below with reference to Figures 12 to 15. Note that components identical to those described with reference to Figures 1 to 11 are denoted by the same reference numerals, and redundant explanations are omitted.

[0059] (Message sending process) Figure 12 is a flowchart showing an example of the message transmission process of information processing system 1. The following describes an example of the message transmission process of the information processing system 1, with reference to Figure 12. Figure 12 illustrates the case where voice data is transmitted from the second user terminal 4 to the first user terminal 3.

[0060] (Step S101) The second user inputs voice by operating the input device 400C of the second user terminal 4.

[0061] (Step S102) The input audio is converted into an electrical signal by microphone 400F and then transmitted as audio data from transmission unit 402 to server 2. The data transmitted from the second user terminal 4 is accompanied by data such as the identification number of the second user terminal 4 and a timestamp.

[0062] (Step S103) The receiving unit 201 of server 2 receives the voice data transmitted from the second user terminal 4.

[0063] (Step S104) The storage device control unit 203 of server 2 stores the voice data transmitted by the second user terminal 4 in the storage device 200B, associating it with the identification number of the account or user terminal that sent or received the data.

[0064] (Step S105) The transmitting unit 202 of server 2 refers to the storage device 200B, identifies the identification number of the first user terminal 3 which is associated with the identification number assigned to the audio data received by the receiving unit 201, and transmits the audio data sent from the second user terminal 4 to the identified first user terminal 3.

[0065] (Step S106) The receiving unit 301 of the first user terminal 3 receives the voice data transmitted from the server 2.

[0066] (Step S107) The notification unit 311 of the first user terminal 3 notifies that it has received audio.

[0067] (Message sending process) Figure 13 is a flowchart illustrating an example of the message transmission process of Information Processing System 1. The following explanation will refer to Figure 13 to describe an example of the message transmission process of Information Processing System 1. Figure 13 specifically illustrates the case where voice data is transmitted from the first user terminal 3 to the second user terminal 4.

[0068] (Step S201) The first user operates the input device 300C of the first user terminal 3 to input messages and notification pattern setting instructions to be sent to the second user terminal 4. This input operation will be described later.

[0069] (Step S202) The transmission unit 302 of the first user terminal 3 sends the input data to the server 2. The input data transmitted from the first user terminal 3 is accompanied by data such as the identification number of the first user terminal 3 and a timestamp.

[0070] (Step S203) The receiving unit 201 of server 2 receives input data transmitted from the first user terminal 3.

[0071] (Step S204) The storage device control unit 203 of server 2 stores the voice data from the input data transmitted by the first user terminal 3 in the storage device 200B, associating it with the identification number of the account or user terminal that sent or received the data.

[0072] (Step S205) The transmission unit 202 of server 2 refers to the storage device 200B, identifies the identification number of the second user terminal 4 which is associated with the identification number assigned to the voice data received by the receiving unit 201, and transmits the input data sent from the first user terminal 3 to the identified second user terminal 4.

[0073] (Step S206) The receiving unit 401 of the second user terminal 4 receives input data transmitted from the server 2.

[0074] (Step S207) The setting unit 406 of the second user terminal 4 sets the notification pattern. The setting of the notification pattern by the setting unit 406 will be described later.

[0075] (Step S208) The notification unit 405 of the second user terminal 4 notifies that data has been received according to the notification pattern set by the setting unit 406. Based on the notification pattern set by the setting unit 406, the notification unit 405 notifies that a message has been received by lighting or flashing a display device (LED), sound, vibration, etc.

[0076] (Input processing) Figure 14 is a flowchart showing an example of the input process in step S201 of Figure 13. The following explanation will refer to Figure 14 to describe an example of the input process in step S201 of Figure 13.

[0077] (Step S301) The first user operates the input device 300C of the first user terminal 3 to display screen G2 as described in Figure 9 or screen G3 as described in Figure 10. The display device control unit 305 of the first user terminal 3 displays screen G2 or screen G3 on the display device 300D.

[0078] (Step S302) The input receiving unit 304 of the first user terminal 3 operates the input device 300C to determine whether either of the messages 16B displayed on screen G2 or screen G3 has been selected. If either of the messages 16B has been selected (YES), the first user terminal 3 executes the process in step S305. If no message has been selected (NO), the first user terminal 3 executes the process in step S303.

[0079] (Step S303) The input receiving unit 304 of the first user terminal 3 operates the input device 300C to determine whether the microphone icon 16A displayed on screen G2 or screen G3 has been selected. If the microphone icon 16A is selected (YES), the first user terminal 3 executes the process in step S304. If the microphone icon 16A is not selected (NO), the first user terminal 3 returns to the process in step S302.

[0080] (Step S304) The first user terminal 3 records the first user's voice input using the microphone. For example, the storage control unit 303 of the first user terminal 3 stores the first user's voice input via the microphone in the storage device 300B.

[0081] Note that the order of the processing in step S302 and the processing in steps S303 and S304 may be reversed.

[0082] (Step S305) The display device control unit 305 of the first user terminal 3 displays the screen G4 described in Figure 11 on the display device 300D. The input receiving unit 304 of the first user terminal 3 receives the notification pattern input by the first user operating the input device 300C.

[0083] (Notification pattern setting process) Figure 15 is a flowchart showing an example of the notification pattern setting process in step S207 of Figure 13. The following explanation will describe an example of the notification pattern setting process in step S207 of Figure 13 with reference to Figure 15.

[0084] (Step S401) The determination unit 407 of the second user terminal 4 determines whether at least one of the following conditions is met: date and time, location, and attributes of the first user terminal 3. If the conditions are met (YES), the second user terminal 4 executes the process in step S402. If the conditions are not met (NO), the second user terminal 4 executes the process in step S403.

[0085] (Step S402) The setting unit 406 of the second user terminal 4 sets the notification pattern of the notification unit 405 based on the setting instructions received by the receiving unit 401.

[0086] (Step S403) The transmission unit 402 of the second user terminal 4 transmits to the first user terminal 3 (via the server 2) that the notification pattern of the notification unit 405 is set to a predetermined notification pattern.

[0087] (Step S404) The setting unit 406 of the second user terminal 4 sets the notification pattern of the notification unit 405 to a predetermined notification pattern.

[0088] In the above description, if at least one of the date and time, location, and attributes of the first user terminal 3 does not meet the predetermined conditions, the notification pattern of the notification unit 405 is set to a predetermined notification pattern. However, the determination unit 407 may also be configured to determine whether at least one of the date and time, location, and attributes and status of different terminals meet the predetermined conditions, and if at least one of the date and time, location, and attributes of the first user terminal 3 does not meet the predetermined conditions, it recommends setting the notification pattern of the notification unit 405 to a predetermined notification pattern, transmit this recommendation instruction to the first user terminal 3, and when it receives a permission signal from the first user terminal 3, the setting unit 406 sets the notification pattern of the notification unit 405 to a predetermined notification pattern.

[0089] As described above, the second user terminal 4 includes a receiving unit 401 that receives data (e.g., voice data) and setting instructions for setting a notification pattern when notifying that the data has been received from a different terminal, a notification unit 405 that notifies that the receiving unit 401 has received the data, and a setting unit 406 that sets the notification pattern for the notification unit based on the setting instructions. Normally, with mobile devices, the notification settings for the device are made by the device owner according to the situation, and there is no specification that allows a third party such as the message sender to set them. However, as described above, in the present invention, the notification pattern for data reception from a different device, the first user terminal 3 The ability to configure these settings makes it highly convenient. For example, if incoming messages are announced by sound during school or tutoring classes, it may be disruptive. On the other hand, if the system is always silent, a second user may never notice the messages. However, since the notification pattern of the second user's terminal 4 can be changed, these problems can be solved.

[0090] Furthermore, the second user terminal 4 includes a determination unit 407 that determines the status of the notification of the data received by the receiving unit 401, and a transmission unit 402 that transmits the determination result by the determination unit 407 to the first user terminal 3, which is a different terminal. In this way, the status of data notification from the second user terminal 4 (for example, whether or not the message was heard) is transmitted to the first user terminal 3, so the first user terminal 3 can check whether or not the second user (for example, a child) has heard the message, thus improving convenience. In this way, the system determines whether at least one of the following conditions is met: the date and time of the second user terminal 4 (for example, whether it is school or cram school time), its location (for example, whether it is at school or cram school), and the attributes of the first user terminal 3, which is a different terminal (for example, whether it is a parent, sibling, or grandparent). If the conditions are not met, for example, if it is school or cram school time, if the user is at school or cram school, or if the attributes of the first user terminal 3 are not those of a parent, the system sends a recommendation to the first user terminal 3, which is a different terminal, to recommend setting the notification pattern of the notification unit 405 to a predetermined notification pattern, thereby improving convenience.

[0091] Furthermore, the second user terminal 4 is equipped with a determination unit 407 that determines whether at least one of the following conditions is met: date and time, location, and attributes and status of different terminals. The setting unit 406 sets the notification pattern of the notification unit to a predetermined notification pattern according to the determination result of the determination unit 407. In this way, the system determines whether at least one of the following conditions is met: the date and time of the second user terminal 4 (for example, whether it is school or cram school time), its location (for example, whether it is at school or cram school), and the attributes of the first user terminal 3, which is a different terminal (for example, whether it is a parent, sibling, or grandparent). For example, if it is school or cram school time, if the user is at school or cram school, or if the attributes of the first user terminal 3 are not those of a parent, the notification pattern of the notification unit 405 can be set to a predetermined notification pattern, thus improving convenience.

[0092] The second user terminal 4 may also include a determination unit 407 that determines whether at least one of the following conditions is met: date and time, location, and attributes and status of a different terminal; and a transmission unit 402 that sends a recommendation instruction to the first user terminal 3, which is a different terminal, recommending that the notification pattern of the notification unit 405 be set to a predetermined notification pattern, according to the determination result of the determination unit 407.

[0093] Furthermore, it is preferable that the date and time be the current date and time, or the location be the current location, or both. By making the date and time the current date and time, or the location be the current location, or both, it is possible to determine whether, for example, it is currently school or cram school time, or whether the second user is at school or cram school.

[0094] Furthermore, in this embodiment, the notification pattern includes notification by data playback as the first notification pattern, and when the receiving unit 401 receives a setting instruction set in the first notification pattern, the notification unit 405 notifies that data has been received by data playback. In this way, the notification can be made by playing the message, thus improving convenience.

[0095] In this embodiment, the receiving unit 401 of the second user terminal 4 receives data and setting instructions from the first user terminal 3, which is a different terminal, via the server 2 (information processing device). However, the first user terminal 3 and the second user terminal 4 may send and receive data (e.g., voice data) and configuration instructions without going through the server 2 (information processing device) (for example, by a peer-to-peer method).

[0096] [Modified Example 1 of the Embodiment] In the above embodiment, the first user terminal 3 may be equipped with a text conversion unit that converts audio data into text data (character data), and at least a portion of the audio data transmitted and received between the first user terminal 3 and the second user terminal 4 may be converted into text data which is then displayed (output) on the display device 300D. This improves convenience as the audio can be confirmed in text. Furthermore, the system may be configured to display (output) the text data obtained by converting the audio data transmitted to the second user terminal 4 as message 16B, as explained with reference to Figure 9, on screen G2. In this case as well, it is preferable that the messages 16B (text data) are displayed in an order according to the frequency of message usage by the first user or the settings made by the first user.

[0097] [Modification of Embodiment 2] Furthermore, the server 2 may have at least some of the functions of the first user terminal 3. For example, the server 2 may be equipped with a text conversion unit that converts at least some of the audio data transmitted and received between the first user terminal 3 and the second user terminal 4 into text data. In this case, the server may determine the order of the messages 16B (text data) according to the frequency of message usage by the first user or the settings made by the first user, so that the messages 16B (text data) are displayed (output) on the first user terminal 3 in an order according to the frequency of message usage by the first user or the settings made by the first user.

[0098] Furthermore, the server 2 may have at least some of the functions of the second user terminal 4 shown in Figure 7. For example, the server 2 may have the function of the determination unit 407, which is one of the functions of the second user terminal 4. In this case, the server 2 determines whether at least one of the following conditions is met: the status of data notification, date and time, location, and attributes and status of different terminals.

[0099] Furthermore, the server 2 or the first user terminal 3 may have at least some of the functions of the second user terminal 4 shown in Figure 7. For example, the server 2 or the first user terminal 3 may have the functions of the determination unit 407 or the function (recommendation unit) that recommends setting the notification pattern of the notification unit 405 to a predetermined notification pattern, which are functions of the second user terminal 4. In this case, the server 2 or the first user terminal 3 will determine whether at least one of the following conditions regarding the status of data notification, date and time, location, and attributes and status of different terminals is met.

[0100] Furthermore, the above embodiments and modifications are merely examples of how the present invention may be implemented, and the technical scope of the invention should not be interpreted as being limited by them. In other words, the present invention can be implemented in various forms without departing from its gist or its main features. [Explanation of symbols]

[0101] 1. Information Processing System 2. Server (Information Processing Device) 200A Communication IF 200B storage device 200C CPU 201 Receiving Unit 202 Transmitter 203 Storage Unit 3. First User Terminal (Information Processing Terminal) 300A communication IF 300B storage device 300C Input Device 300D display device 300E CPU 300F Microphone 300G Speaker 301 Receiver 302 Transmitter 303 Storage Unit 304 Input Reception Department (Reception Department) 305 Display device control unit 4. Second User Terminal 400A Communication IF 400B storage device 400C Input Device 400D display device (LED) 400E CPU 400F Microphone 400G Speaker 400H GPS Sensor 401 Receiver 402 Transmitter 403 Storage Unit 404 Input Reception Section 405 News Department 406 Settings Section 407 Judgment section 5 Network

Claims

1. A data processing method in a monitoring system comprising a terminal for the person being monitored carried by the person being monitored, a terminal for the person being monitored used by the person being monitored, and a server, The first step is that the server receives location information of the monitored person's terminal and transmits it to the monitor's terminal, The second step involves the server receiving the audio input to the microphone of the monitored person's terminal as first audio data and transmitting it to the monitor's terminal. The server receives the audio input to the microphone of the monitoring terminal as second audio data and transmits it to the monitoring terminal, in a third step. A data processing method comprising: a fourth step of the server causing the monitor terminal to display a time-series display screen on the monitor terminal, which includes on one end a first icon for playing the first audio data and on the other end a second icon for playing the second audio data, and which includes on one end a comment that is automatically sent from the server to the monitor terminal according to the time and location information of the monitor terminal, and which includes on one end a first icon for playing the first audio data and on the other end a comment that includes information indicating when and from what location the person being monitored departed, and which is sent from the server to the monitor terminal according to the time and location information of the person being monitored terminal.

2. The data processing method according to claim 1, wherein the first icon is displayed in association with the icon representing the person being monitored.

3. The data processing method according to claim 1 or 2, wherein the time-series display screen displays information indicating that the second audio data was played back by the monitored person's terminal.

4. The data processing method according to any one of claims 1 to 3, wherein the first step involves receiving location information of the monitored person's terminal at predetermined intervals.

5. The data processing method according to any one of claims 1 to 4, wherein the person being monitored is a child, and the person monitoring is their guardian.

Images