Information processing terminal, information processing device, information processing method, and information processing program
By designing convenient information processing terminals and equipment, using GPS and voice message functions, real-time monitoring and communication of children's location and behavior are achieved, solving the problem of insufficient convenience of the existing system and improving security and convenience.
Patent Information
- Application Number
- JP2024111442
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-07-11
- Publication Date
- 2025-04-18
- Estimated Expiration
- 2042-02-25
AI Technical Summary
The existing information processing system still has room for improvement in convenience, especially in child safety monitoring. Parents hope to monitor and communicate with their children in a convenient way.
An information processing terminal and device are designed to realize convenient information processing and communication by receiving and sending data and notifying according to the set notification mode. The system includes a server, a first user terminal and a second user terminal, and uses GPS and voice message functions to realize real-time location monitoring and voice interaction.
It improves the convenience of the information processing system, and parents can monitor their children's location and behavior in a convenient way, and communicate with their children in real time, enhancing security and convenience.
Smart Images

Figure 0007664663000001 
Figure 0007664663000002 
Figure 0007664663000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing terminal, an information processing device, and an information processing method capable of exchanging voice data. , relating to information processing programs. [Background technology]
[0002] When children reach a certain age, for example, when they become elementary school students and start to move around on their own, Parents with children should be careful about whether their children have arrived safely at school or cram school without getting into any accidents or other incidents. You may be worried about your child's behavior, such as whether they will do something or not.
[0003] Therefore, as a mechanism to deal with the above problems, for example, smartphones It is possible to check the location information of children by using the GPS function installed in portable information terminals such as A service is provided (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 6953055 Summary of the Invention [Problem to be solved by the invention]
[0005] However, there is still room for improvement in the convenience of conventional information processing systems.
[0006] The present invention has been made in consideration of the above problems, and provides a highly convenient information processing terminal, an information processing The object of the present invention is to provide an information processing apparatus, an information processing method, and an information processing program. [Means for solving the problem]
[0007] In order to solve the above problems, an information processing terminal according to the present invention includes: a receiving unit for receiving from a different terminal a setting instruction for setting a notification pattern when notifying the user of the fact that the notification has been received; a notification unit that notifies that the receiving unit has received data; and a notification unit that notifies the receiving unit based on a setting instruction. and a setting unit for setting a pattern. Effect of the Invention
[0008] According to the present invention, a highly convenient information processing terminal, an information processing device, an information processing method, and an information processing It is possible to provide a management program. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of a layout of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a configuration of an information processing server according to the embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a configuration of an information processing device server according to the embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a configuration of a first user terminal according to the embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of a configuration of a first user terminal according to the embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of a configuration of a second user terminal according to the embodiment. [Figure 7] FIG. 2 is a diagram illustrating an example of a configuration of a second user terminal according to the embodiment. [Figure 8] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first user terminal according to the embodiment. [Figure 9] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first user terminal according to the embodiment. [Figure 10] FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first user terminal according to the embodiment. [Figure 11]FIG. 4 is a diagram showing an example of a screen displayed on a display device of a first user terminal according to the embodiment. [Figure 12] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 13] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 14] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. [Figure 15] 4 is a flowchart illustrating an example of processing by the information processing system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] [Embodiment] An information processing system 1 according to an embodiment will be described below with reference to the drawings. The information processing system 1 according to the embodiment is a so-called monitoring system. The second user terminal 4 carried by the user (e.g., a child) transmits a message every 1.5 minutes, for example. The location of the second user terminal 4 is determined from the information uploaded to the server 2 at such a predetermined interval. The determined location is transmitted from the server 2 to the mobile phone of the person who is watching over the person (e.g., a family member such as a parent or grandparent). The information is notified to the first user terminal 3 that carries or uses the information. In the system 1, a microphone and a speaker are provided in the first user terminal 3 and the second user terminal 4. The system is equipped with a voice message terminal, and can send and receive voice messages (hereinafter referred to as voice messages) to each other. In the following description, the watcher is referred to as the first user. The person being watched over is also called the second user.
[0011] As shown in FIG. 1, an information processing system 1 includes a server 2 and a network 5 connected to the server 2. The system includes one or more first user terminals 3 and second user terminals 4 connected via a In the illustrated example, the information processing system 1 includes a server 2, a first user terminal 3, and a second user terminal 4. The information processing system 1 includes a server 2 and a first The number of user terminals 3 and the number of second user terminals 4 are each arbitrary.
[0012] (Server 2) 2 and 3 are configuration diagrams of the server 2. FIG. 2 shows the main hardware configuration of the server 2. The server 2 includes a communication IF 200A, a storage device 200B, a CPU 200C, etc. Although not shown in FIG. 2, the server 2 may include an input device (e.g., a mouse, a keyboard, etc.). display devices (CRT (Cathode Ray Tube), LCD display, etc.) , an organic EL display, etc.
[0013] The communication IF 200A is connected to other devices (for example, the first user terminal 3, the second user terminal 4, etc.). It is an interface for communicating with
[0014] The storage device 200B is, for example, a hard disk drive (HDD) or a semiconductor storage device (SSD ( The storage device 200B is a solid state drive (SD). Various data and information processing programs are stored in the storage device 200B. In addition, a part or all of the various data stored in the storage device 200B is External storage devices such as USB (Universal Serial Bus) memory and external HDDs, and network The information may be stored in a storage device of another information processing device connected via the network 5. The server 2 refers to or retrieves data stored in an external storage device or a storage device of another information processing device. The data is then stored in an external storage device or in a storage device of another information processing device.
[0015] The storage device 200B stores account information of the first user terminal 3, for example, 3 identification number, name, contact information (email address, phone number), second user (e.g., yourself The identification number of the second user terminal 4 carried by the user (the child of the user) is stored in the storage device. In 200B, the account information of the second user terminal 4, for example, the identification number of the second user terminal 4, The first user's name, name, and the first user terminal owned by the first user (for example, your parents, grandparents, or other family members) The identification number of the first user terminal 3 and the Logs including data transmitted and received by the second user terminal 4 are stored in association with the account. In addition, the storage device 200B for transmitting to the second user terminal 4 has downloaded Audio files that can be used for streaming (e.g. messages recorded by voice actors, actors, idols, etc.) Messages generated by voice synthesis engines such as Sage voice files and Vocaloid (registered trademark) This stores the audio files of the messages, etc.
[0016] The CPU 200C controls the server 2 according to this embodiment, and includes a ROM and a RAM (not shown). Equipped with:
[0017] FIG. 3 is a functional block diagram of the server 2. As shown in FIG. 3, the server 2 includes a receiving unit 2 01, a transmission unit 202, a storage device control unit 203, etc. The CPU 200C executes the information processing program stored in the storage device 200B. This is achieved by:
[0018] The receiving unit 201 receives data, e.g., For example, it receives voice data, setting instructions, and the like.
[0019] The transmission unit 202 transmits data received from the first user terminal 3, such as voice data and setting instructions. The transmission unit 202 transmits the indication to the second user terminal 4. The received data, for example, voice data, is transmitted to the first user terminal 3 .
[0020] The storage device control unit 203 controls the data transmitted and received by the first user terminal 3 and the second user terminal 4. The data is stored in the storage device 20 in association with the identification number of the account or user terminal that transmitted or received the data. Store in 0B.
[0021] (First user terminal 3) The first user terminal 3 is a terminal owned by the first user, and is, for example, The first user is a first user terminal, such as a smartphone with installed software. The second user terminal 4 is used to transmit and receive voice data to and from the second user terminal 4 registered therein. The first user can send and receive voice messages to other users (e.g., his / her child). The main hardware configuration of the user terminal 3 is shown in FIG. 1, which includes a communication IF 300A, a storage device 300B, and an input device 300C. 300C, a display device 300D, a CPU 300E, a microphone 300F, and a speaker 3 Equipped with 00G etc.
[0022] The communication IF 300A is an interface for communicating with other devices (in this embodiment, the server 2). -face.
[0023] The storage device 300B is, for example, a hard disk drive (HDD) or a semiconductor storage device (SSD ( The storage device 300B is a solid state drive (SSD). The storage device 300B stores the terminal identification number and the information processing program. RAM (application software), presets for transmission to the second user terminal 4 Messages recorded by voice actors, actors, idols, etc. A message generated by a voice synthesis engine such as Kakaloid (registered trademark), The message entered by the first user includes the voice message recorded by the first user. (including the message and the text message entered by the text) The storage device 300B stores, for example, the first Data transmitted and received between the user terminal 3 and the second user terminal 4 is stored. The separate number is a number for identifying the first user terminal 3. By adding the identification number of the terminal to the received data, the server 2 can determine which first user the received data belongs to. It is possible to determine whether the message was sent from the user terminal 3. IP (Internet Protocol) address, MAC (Media Access Control) address, etc. Any of the above may be used, and the server 2 may grant it to the first user terminal 3.
[0024] The input device 300C is, for example, an input device such as a keyboard, a mouse, or a touch panel. However, other devices or equipment may be used as long as they are capable of inputting voice. This is also possible.
[0025] The display device 300D may be, for example, a liquid crystal display, a plasma display, or an organic EL display. However, other devices or equipment (e.g., CRT: Cathode ray tube) are also acceptable if they are capable of displaying images. Ray Tube).
[0026] The CPU 300E controls the first user terminal 3 according to this embodiment, and stores a ROM and and RAM.
[0027] The microphone 300F is an acoustic device that converts sound into an electrical signal. The third user uses the microphone 300F to transmit voice (for example, You can input voice messages such as messages to send. The input voice is sent to the The information is transmitted to the server 2 by the unit 302.
[0028] The speaker 300G is an acoustic device that converts electrical signals into sound. For example, the speaker 300G For example, the following is transmitted from the second user terminal 4 via the server 2 and stored in the storage device 300B: Plays audio data.
[0029] FIG. 5 shows a functional block diagram of the first user terminal 3. The first user terminal 3 receives A display unit 301, a transmission unit 302, a storage device control unit 303, an input reception unit 304 (reception unit), The functions shown in FIG. 5 are implemented by the CPU 300E. This is realized by executing an information processing program stored in device 300B.
[0030] The receiving unit 301 receives data transmitted from the server 2, for example.
[0031] The transmission unit 302 transmits data in response to an input operation received by the input reception unit 304, for example. Send the data to server 2.
[0032] The storage device control unit 303 controls the storage device 300B. For example, the storage device control unit 30 The first user terminal 3 and the second user terminal 4 transmit and receive data, etc. The received account or user terminal identification number is associated with the received account or user terminal identification number and stored in storage device 300B. In addition, the storage device control unit 303 controls, for example, The transmitted and received audio data is stored in the storage device 300B.
[0033] The input receiving unit 304 receives an input operation from the input device 300C.
[0034] The display device control unit 305 controls the display device 300D, for example, as shown in FIGS. 8 to 11. The screen example shown in is displayed on the display device 300D.
[0035] (Second user terminal 4) The second user terminal 4 is a terminal used by a second user of the information processing system 1. The user uses the second user terminal 4 to transmit and receive voice data to and from the registered first user terminal 3. By doing so, you can communicate with the first user (for example, your family) by voice. FIG. 6 shows the main hardware configuration of the second user terminal 4. The second user terminal 4 is Communication IF400A, storage device 400B, input device 400C, display device 400D (LED), CPU 400E, microphone 400F, speaker 400G, GPS sensor 400H, etc. etc.
[0036] The communication IF 400A is an interface for communicating with other devices (in this embodiment, the server 2). -face.
[0037] The storage device 400B is, for example, a hard disk drive (HDD) or a semiconductor storage device (SSD ( The storage device 400B is a solid state drive (SSD). The storage device 400B stores the terminal identification number and the information processing program. The RAM, voice data transmitted from the first user terminal 3, etc. are stored. The terminal identification number is , which is a number for identifying the second user terminal 4. Data transmitted from the second user terminal 4 By assigning the terminal identification number to each second user terminal, the server 2 can determine which second user terminal the received data is from. It is possible to determine whether the message was sent from IP (Internet Protocol) address, MAC (Media Access Control) address, etc. Alternatively, the server 2 may assign it to the second user terminal 4.
[0038] The input device 400C is, for example, an input device such as a keyboard, a mouse, or a touch panel. However, other devices or equipment may be used as long as they are capable of inputting voice. The second user may operate the input device 400C to input voice and transmit the voice to the first user terminal. The voice data transmitted from the first user terminal 3 can be played back. .
[0039] The display device 400D is, for example, an LED. 5, and the light or blinking in a set pattern or a specified pattern will sound. The device notifies the user that a message has been received.
[0040] The CPU 400E controls the second user terminal 4 according to this embodiment, and stores a ROM and and RAM.
[0041] The microphone 400F is an acoustic device that converts sound into an electrical signal. The user of the device 4 can input voice using the microphone 400F. The captured voice is transmitted to the server 2 by a transmitting unit 402, which will be described later.
[0042] The speaker 400G is an acoustic device that converts electrical signals into sound. For example, the speaker 400G For example, the following is transmitted from the first user terminal 3 via the server 2 and stored in the storage device 400B: The speaker 400G reproduces audio data. The speaker 400G is controlled by a notification unit 405, which will be described later. By generating a sound in a preset or predetermined pattern, the device notifies the user that it has received a voice. do.
[0043] The GPS Sensor 400H collects time data from the atomic clock on board the satellite, the satellite's celestial ephemeris ( The GPS satellite receives a signal containing data such as the satellite's orbit, and the time of the signal's transmission and the The distance from the satellite is calculated based on the difference in the reception time to determine the current position. The sensor 400H outputs the identified current position.
[0044] FIG. 7 shows a functional block diagram of the second user terminal 4. The second user terminal 4 receives A unit 401, a transmission unit 402, a storage device control unit 403, an input reception unit 404, a notification unit 405, The determination unit 406 and the judgment unit 407 (first to third judgment units) are included. The function is that the CPU 400E executes an information processing program stored in the storage device 400B. This is achieved by carrying out the
[0045] The receiving unit 401 receives, for example, data (for example, voice data) transmitted from the server 2 and The receiving device 100 also receives a setting instruction for setting a notification pattern to be used when notifying the receiving device that the received data has been received.
[0046] The transmission unit 402 transmits data, e.g., For example, the transmission unit 402 transmits voice data to the server 2. The transmission unit 402 transmits the result of the determination to the first user terminal 3 (via the server 2). According to the result of the determination by the setting unit 407, the notification pattern of the notification unit 405 is set to a predetermined notification pattern. A recommendation instruction for recommending that the first user terminal 3 be set is transmitted to the first user terminal 3.
[0047] The storage device control unit 403 controls the storage device 400B. For example, the storage device control unit 40 The storage device control unit 3 controls the storage device 400B to write and read data. For example, the unit 403 stores the data received by the receiving unit 401 in the storage device 400B.
[0048] The input reception unit 404 receives an input operation from the input device 400C. 4, for example, accepts an operation to play back audio data stored in the storage device 400B.
[0049] The notification unit 405 notifies the reception unit 401 that the data has been received. For example, the display device 400D (LED) is turned on based on the notification pattern set by the setting unit 406. The receiving unit 401 receives data by lighting or blinking the light or generating a sound from the speaker. Inform them of what has happened.
[0050] The setting unit 406 notifies the notification unit 405 based on the setting instruction received by the receiving unit 401. In addition, the setting unit 406 sets a notification pattern according to the result of the determination by the determination unit 407. The notification pattern of the reception unit 405 is set to a predetermined notification pattern. The notification pattern includes a notification by reproducing the data received by the device 01 (first notification pattern). In this case, the notification unit 405 notifies the receiving unit 40 by reproducing the data received by the receiving unit 401. 1 reports that data has been received.
[0051] The determination unit 407 determines the status of the notification of the data received by the receiving unit 301, for example, the status of the voice data. The determination unit 407 also determines whether the first user has played back the data or not. It is determined whether or not at least one of the attributes of the terminal 3 satisfies a predetermined condition. is the current date and time, and the location may be the current location.
[0052] (display screen) 8 to 11 show an example of a screen G1 displayed on the display device 300D of the first user terminal 3. 8 to 11, the display device 300D of the first user terminal 3 will be described below. An example of the displayed screen G1 will be described. Note that the configuration described with reference to FIGS. The same components are designated by the same reference numerals and duplicated explanations will be omitted.
[0053] As shown in FIG. 8, the display device 300D has a first user terminal 3 and a second user terminal 4. The audio data sent and received between the two devices is displayed in chronological order per audio file (hereinafter, Also called line display. In the example shown in FIG. 8, the name 11 of the second user (which may be a handle name) is displayed at the top of the screen G1. ) is displayed. On the left side of the screen G1, voice data (the The time stamp 12D (timestamp) indicates the time when the display frame 12B showing the user's voice file was sent. information) and icon 12A (icon indicating the second user). In addition, when the playback button 12C is selected (tapped), the audio data corresponding to the display frame 12B is displayed. (Audio file) will be played and you can listen to the audio. Also, on the right side of the screen G1, the voice transmitted from the first user terminal 3 to the second user terminal 4 is displayed. A display frame 13A showing the data (voice file of the first user) is displayed with a time 13C (time Also, near the display frame 13A, the voice data is displayed. A status 13D related to the notification of the data (for example, whether or not the voice data has been reproduced on the second user terminal 4) When the playback button 13B is selected, the audio corresponding to the display frame 13A is displayed. The data (audio file) will be played and you will be able to listen to the audio. Also, on the left side of the screen G1, depending on the state (for example, time or location) of the second user terminal 4, A comment 14B indicating the status is automatically sent from the second user terminal 4 or the server 2. The time 14D (using time stamp information) and the icon 14A (second user terminal 4 icon indicating that the When the first user wishes to transmit voice data to the second user terminal 4, the first user operates an input device such as a touch panel. The input device 300C is operated to display an icon 1 resembling a microphone at the bottom of the screen G1. Select 5.
[0054] The screen G2 shown in FIG. 9 is a screen for selecting (tapping) the icon 15 described with reference to FIG. As shown in FIG. 9, when icon 15 is selected in FIG. 8, A display frame 16 for sending a message to the second user terminal 4 rises from the bottom of the screen G2. The first user operates the input device 300C such as a touch panel to You can record audio by selecting the microphone icon 16A displayed in the display frame 16 on screen G2. The microphone icon 16A can be selected to transmit the voice to the second user terminal 4. The appearance of the microphone icon 16A (for example, the color of the icon) will change to indicate that recording has started. The first user speaks a message (for example, "I'm coming to pick you up now") and When you finish, select the microphone icon 16A again to change the display form of the microphone icon 16A (e.g. For example, the icon color will change back to normal to indicate that recording has ended. Also, below the microphone icon 16A, a message preset in the storage device 300B is displayed. Message 16B, entered by user 1, downloaded from server 2 A plurality of messages such as message 16B are displayed, and the first user operates the input device 300 such as a touch panel. By operating C to select one of the multiple messages 16B displayed, The message 16B can then be sent to the second user terminal 4.
[0055] As already mentioned, the message entered by the first user includes the A voice message recorded by the first user using the phone 300F and an input device 300C and text messages entered by operating the mobile phone. The message will be transcribed (converted into text) and displayed as the title of the audio file. Figure 10 shows the title of the audio file after transcribing the voice message (converting it into text). As shown in FIG. 10, the screen G3 shows a voice message. The message in the audio file that was transcribed (converted into text) is titled 16B. The first user operates the input device 300C such as a touch panel to press a button on the screen G3. By selecting the voice stamp store 17A, voice files (e.g., voice actors, Voice files of messages recorded by actors, idols, etc., Vocaloid (registered trademark) Download voice files of messages generated by voice synthesis engines such as It can be used. The first user also operates the input device 300C such as a touch panel to input the title 16B. By selecting the swap button 17B located on the left (long press or tap operation), You can change the display order of Tor 16B. The first user also operates the input device 300C such as a touch panel to input the title 16B. By selecting the edit button 17C located on the right side (by long pressing or tapping), You can edit Tor 16B. The first user also operates the input device 300C such as a touch panel to input the title 16B. By selecting the play button 17D located on the right (long press or tap operation), You can play (listen to) the audio file that is the source of Tor 16B. The first user also operates the input device 300C such as a touch panel to input the title 16B. By selecting the recording button 17E located on the right side (long press or tap operation), You can re-record the original audio file for Tor 16B. In addition, the title of the audio file, 16B, is also set to be displayed in order of frequency of use. In addition, when displaying the most frequently used messages, the display of messages may vary (for example, It is preferable to calculate the frequency of use of a message by taking into consideration the similarity of messages between the messages.
[0056] Also, the message 16B displayed on the screen G2 of FIG. 9 is a message by the first user. It is preferable that the items are displayed in an order according to frequency of use or a setting made by the first user. For example, If messages are displayed according to frequency of use, it is preferable to display them in order of frequency of use. Also, the message 16B displayed on the screen G2 in FIG. 9 is In this case, similarly to the explanation in FIG. The first user operates the input device 300C to manually rearrange the display order of the messages 16B. In addition, the preset message 16B may be set based on the frequency of use. The messages 16B input by the first user may be displayed in descending order of frequency. It is also possible to set it so that the items are displayed in order of frequency of use. The frequency of message usage is calculated by taking into account the variation in the message (e.g., the similarity of the message). It is preferable to calculate
[0057] The screen G4 shown in FIG. 11 is a screen in which the microphone icon 16A described with reference to FIG. 9 is selected (tapped). After recording audio by pressing the This is the screen to which the first user transitions when the first user selects the touch screen 16B. By operating the input device 300C such as a panel to select the icon 18A on the screen G4, recording is started. The first user can preview and check the voice generated by the voice input device such as a touch panel. By operating the device 300C and selecting the icon 18B on the screen G4, the screen transitions to the screen G2. The first user can then re-record the voice. Alternatively, the message may be selected on the transition screen G2. In addition, the first user is notified that the second user terminal 4 has received a message from the first user terminal 3. In the example shown in FIG. 11, the first user The user can select "Ringtone ON" 19A, "Ringtone OFF" 19B, or "Use this sound as a ringtone" The first user can select a notification pattern from 19A to 19C. When you select one of them, a check mark will be displayed next to the selected item (in the example shown in Figure 11, " (In the example shown in FIG. 11, "ring tone ON" 19A is selected.) In the example shown in FIG. 11, there are three notification patterns. However, the notification pattern is not limited to the example shown in FIG. When 9A is selected, the ringtone may be selectable, or vibration may be used as a notification. A configuration in which the pattern can be selected may also be used. The first user operates the input device 300C such as a touch panel to input a transmission icon Selecting 18C will display the recorded voice data or the data corresponding to the selected message 16B. The data is transmitted to the server 2 together with an instruction to set the notification pattern.
[0058] (Information Processing) 12 to 15 are flowcharts showing an example of information processing by the information processing system 1. Hereinafter, the information processing of the information processing system 1 will be described with reference to FIGS. In addition, the same components as those described with reference to FIGS. 1 to 11 are denoted by the same reference numerals and will not be repeated. The explanation will be omitted.
[0059] (Message sending process) FIG. 12 is a flowchart showing an example of a message transmission process of the information processing system 1. An example of a message transmission process of the information processing system 1 will be described below with reference to FIG. In FIG. 12, voice data is transmitted from the second user terminal 4 to the first user terminal 3. The following describes the case where this is done.
[0060] (Step S101) The second user operates the input device 400C of the second user terminal 4 to input speech.
[0061] (Step S102) The input voice is converted into an electrical signal by the microphone 400F and then output as voice data. The data is transmitted from the transmission unit 402 to the server 2. The data includes the identification number of the second user terminal 4, a time stamp, and other data. There are.
[0062] (Step S103) The receiving unit 201 of the server 2 receives the voice data transmitted from the second user terminal 4 .
[0063] (Step S104) The storage device control unit 203 of the server 2 converts the voice data transmitted by the second user terminal 4 into data. The data is stored in the storage device 200B in association with the identification number of the account or user terminal that transmitted or received the data. To remember.
[0064] (Step S105) The transmitting unit 202 of the server 2 refers to the storage device 200B and receives the voice The identification number of the first user terminal 3 associated with the identification number assigned to the data is identified, The voice data transmitted from the second user terminal 4 is transmitted to the specified first user terminal 3 .
[0065] (Step S106) The receiving unit 301 of the first user terminal 3 receives the voice data transmitted from the server 2 .
[0066] (Step S107) The notification unit 311 of the first user terminal 3 notifies that the voice has been received.
[0067] (Message sending process) FIG. 13 is a flowchart showing an example of a message transmission process of the information processing system 1. An example of a message transmission process of the information processing system 1 will be described below with reference to FIG. In FIG. 13, voice data is transmitted from the first user terminal 3 to the second user terminal 4. The following describes the case where this is done.
[0068] (Step S201) The first user operates the input device 300C of the first user terminal 3 to transmit the information to the second user terminal 4. The message to be sent and the notification pattern are input. This input operation will be described later. do.
[0069] (Step S202) The transmission unit 302 of the first user terminal 3 transmits the input data to the server 2. The input data transmitted from the first user terminal 3 includes the identification number of the first user terminal 3, The data includes time stamps and other information.
[0070] (Step S203) The receiving unit 201 of the server 2 receives the input data transmitted from the first user terminal 3 .
[0071] (Step S204) The storage device control unit 203 of the server 2 selects the voice data from the input data transmitted by the first user terminal 3. The voice data is stored in association with the identification number of the account or user terminal that transmitted or received the data. Store in device 200B.
[0072] (Step S205) The transmitting unit 202 of the server 2 refers to the storage device 200B and receives the voice The identification number of the second user terminal 4 associated with the identification number assigned to the data is identified, The input data transmitted from the first user terminal 3 is transmitted to the specified second user terminal 4 .
[0073] (Step S206) The receiving unit 401 of the second user terminal 4 receives the input data transmitted from the server 2.
[0074] (Step S207) The setting unit 406 of the second user terminal 4 sets the notification pattern. The pattern settings will be described later.
[0075] (Step S208) The notification unit 405 of the second user terminal 4 receives data in the notification pattern set by the setting unit 406. The notification unit 405 notifies the user that a message has been received based on the notification pattern set by the setting unit 406. The display device (LED) lights up or flashes, and sounds and vibrations are used to receive messages. Report what you believe.
[0076] (Input processing) FIG. 14 is a flowchart showing an example of the input process in step S201 of FIG. An example of the input process in step S201 in FIG. 13 will be described below with reference to FIG. .
[0077] (Step S301) The first user operates the input device 300C of the first user terminal 3 to display the screen G described with reference to FIG. 2 or the screen G3 described in FIG. 10. 5 causes the display device 300D to display screen G2 or screen G3.
[0078] (Step S302) The input reception unit 304 of the first user terminal 3 receives a screen G2 or a screen G3 by operating the input device 300C. It is determined whether any of the messages 16B displayed on the surface G3 has been selected. If either one of 16B is selected (YES), the first user terminal 3 proceeds to step S3 If no message is selected (NO), the first user terminal 3 executes the process of step S303.
[0079] (Step S303) The input reception unit 304 of the first user terminal 3 receives a screen G2 or a screen G3 by operating the input device 300C. Determine whether the microphone icon 16A displayed on the surface G3 is selected. If 6A is selected (YES), the first user terminal 3 executes the process of step S304. If the microphone icon 16A is not selected (NO), the first user terminal 3 The process returns to step S302.
[0080] (Step S304) The first user terminal 3 records the voice of the first user inputted using a microphone. For example, the storage device control unit 303 of the first user terminal 3 receives input using a microphone. The input voice of the first user is stored in the storage device 300B.
[0081] The process of step S302 and the processes of steps S303 and S304 The order may be reversed.
[0082] (Step S305) The display device control unit 305 of the first user terminal 3 displays the screen G4 described with reference to FIG. 00D. The input reception unit 304 of the first user terminal 3 receives the input from the input device 3 The notification pattern input by operating 00C is accepted.
[0083] (Notification pattern setting process) FIG. 15 is a flowchart showing an example of the notification pattern setting process in step S207 of FIG. Hereinafter, with reference to FIG. 15, the notification pattern setting process in step S207 in FIG. An example will be described.
[0084] (Step S401) The determination unit 407 of the second user terminal 4 determines at least one of the date and time, the location, and the attributes of the first user terminal 3. Determine whether at least one of the conditions satisfies the specified condition. If the condition is satisfied (YES), If the predetermined condition is not satisfied, the second user terminal 4 executes the process of step S402. (NO), the second user terminal 4 executes the process of step S403.
[0085] (Step S402) The setting unit 406 of the second user terminal 4 performs the above-mentioned setting based on the setting instruction received by the receiving unit 401. The notification pattern of the notification unit 405 is set.
[0086] (Step S403) The transmission unit 402 of the second user terminal 4 changes the notification pattern of the notification unit 405 to a predetermined notification pattern. The setting is transmitted to the first user terminal 3 (via the server 2).
[0087] (Step S404) The setting unit 406 of the second user terminal 4 sets the notification pattern of the notification unit 405 to a predetermined notification pattern. Set it up.
[0088] In the above description, at least one of the date and time, the location, and the attribute of the first user terminal 3 is used. does not satisfy the predetermined condition, the notification pattern of the notification unit 405 is set to a predetermined notification pattern. However, the determination unit 407 can use at least some of the following information: date and time, location, and attributes and status of different terminals. Determine whether at least one of the first user terminals 3 satisfies a predetermined condition, and If at least one of the attributes does not satisfy a predetermined condition, the notification pattern of the notification unit 405 is set to a predetermined value. a recommendation instruction to set the first user terminal 3 to a specific notification pattern, and transmits the recommendation instruction to the first user terminal 3; When a permission signal is received from the user terminal 3, the setting unit 406 sets the notification pattern of the notification unit 405. The notification pattern may be set to a predetermined notification pattern.
[0089] As described above, the second user terminal 4 receives data (for example, voice data) and A setting instruction for setting a notification pattern for notifying that a user has performed a task is received from a different terminal. a notification unit 405 that notifies that the receiving unit 401 has received data; and a setting unit 406 that sets the notification pattern of the notification unit based on the setting unit 406 . Usually, in the case of a mobile terminal, the terminal notification setting is set by the terminal owner according to the situation, etc. This is a specification that cannot be set by a third party such as the sender of the message, but As described above, in the present invention, the first user terminal 3, which is a different terminal, sends a notification pattern of data reception. For example, you can set the time when a message arrives during a class at school or cram school. If the signal is notified by sound, it may be annoying. On the other hand, if the signal is always silent, it is convenient for the second user. There is a risk that the user will not notice the message for a long time, but the notification pattern of the second user terminal 4 Since it is possible to change the above, the above problem can be solved.
[0090] In addition, the second user terminal 4 determines the state regarding the notification of the data received by the receiving unit 401. The determination unit 407 determines whether the first user terminal 3 is a different terminal from the first user terminal 3 by using the result of the determination by the determination unit 407. and a transmitting unit 402 for transmitting the In this way, the state of the second user terminal 4 regarding the data notification (for example, whether the second user terminal 4 is listening to a message) The second user (e.g., Whether the child is listening to the message or not can be confirmed on the first user terminal 3, improving convenience. To rise. In this way, the date and time of the second user terminal 4 (for example, whether it is school or cram school time), the location (For example, whether the user is at school or cram school) and the attributes of the first user terminal 3, which is a different terminal (such as a parent At least one of the following conditions must be met: If the condition is not met, for example, if it is school or cram school time, If the first user terminal 3 is in the parent position, the notification pattern of the notification unit 405 is A recommendation instruction for recommending that the user set the notification pattern to a predetermined notification pattern is sent to a different terminal, This improves convenience because the information can be transmitted to one user terminal 3.
[0091] The second user terminal 4 also receives the date, time, location, and attributes and status of different terminals. The setting unit 40 includes a determination unit 407 that determines whether or not at least one of the items satisfies a predetermined condition. 6, the notification pattern of the notification unit is changed to a predetermined notification pattern according to the result of the determination by the determination unit 407. Set it up. In this way, the date and time of the second user terminal 4 (for example, whether it is school or cram school time), the location (For example, whether the user is at school or cram school) and the attributes of the first user terminal 3, which is a different terminal (such as a parent At least one of the following conditions must be met: For example, if it is school or cram school time, if the first user is at school or cram school, If the attribute of the terminal 3 is other than parent, the notification pattern of the notification unit 405 is set to a predetermined notification pattern. This makes it easier to set up, which improves convenience.
[0092] The second user terminal 4 can store the date, time, location, and attributes and status of different terminals. A determination unit 407 that determines whether at least one of the plurality ... Depending on the result of the determination, the notification pattern of the notification unit 405 is set to a predetermined notification pattern. A transmission unit 402 that transmits a recommendation instruction to a first user terminal 3 that is a different terminal; The above configuration may be adopted.
[0093] In addition, the date and time are either the current date and time or the location is the current location, or both. Preferably, both. The date and time must be the current date and time, or the location must be the current location. By setting either or both of the above, the second user can now, for example, use the time for school or cram school. It is possible to determine whether the person is in a school or cram school.
[0094] In this embodiment, the notification pattern is a first notification pattern, which is a notification by reproducing data. The notification unit 405 notifies the reception unit 401 of the setting instruction set in the first notification pattern. If so, the data is reproduced to notify the user that the data has been received. In this way, the message can be reproduced as a notification, improving convenience. .
[0095] In this embodiment, the receiving unit 401 of the second user terminal 4 is connected to the server 2 (information processing device ) and receives data and a setting instruction from a different terminal, the first user terminal 3, via the However, the first user terminal 3 and the second user terminal 4 communicate with each other without going through the server 2 (information processing device) (e.g. For example, by a peer-to-peer method, data (e.g., voice data) and setting instructions are sent. It may be arranged to receive the signal.
[0096] [First Modification of the Embodiment] In the above embodiment, the voice data is input to the first user terminal 3 as text data (characters A text conversion unit converts the data into text, and transmits and receives the data between the first user terminal 3 and the second user terminal 4. At least a part of the received voice data is converted into text data, and the text data is displayed on the display device 300D. The voice can be confirmed as text, which improves convenience. . Also, the voice data transmitted to the second user terminal 4 is converted into character data, as shown in FIG. The message 16B may be displayed (output) on the screen G2. In this case, the message 16B (text data) is also a message by the first user. Preferably, the messages are displayed in an order according to frequency of use of the messages or a setting made by the first user.
[0097] [Modification 2 of the embodiment] In addition, the server 2 is configured to have at least a part of the functions of the first user terminal 3. For example, the voice transmitted and received between the first user terminal 3 and the second user terminal 4 may be The server 2 is provided with a text conversion unit that converts at least a part of the data into character data. In this case, the message 16B (text data) may be transmitted to the first user. The server determines the frequency of use of the messages by the first user or the order according to a setting by the first user. As a result, the message 16B (text data) is sent to the first user terminal 3. The messages are displayed (output) in the order according to the frequency of message usage by the first user or the setting by the first user. This may also be configured.
[0098] In addition, the server 2 has at least some of the functions of the second user terminal 4 shown in FIG. For example, the function of the determination unit 407 among the functions of the second user terminal 4 may be The server 2 may have the information. In this case, the status, date, time, and location of the data notification may be stored. Whether at least one of the following conditions is satisfied: The decision as to whether or not this is the case is made by server 2.
[0099] In addition, at least a part of the functions of the second user terminal 4 shown in FIG. For example, the second user terminal 4 may have the following functions: The function of the determination unit 407 and the notification pattern of the notification unit 405 are set to a predetermined notification pattern. The recommendation function (recommendation unit) may be provided in the server 2 or the first user terminal 3. In this case, the status of the data broadcast, the date and time, the location, and the attributes and status of different terminals Whether or not at least one of the above conditions is satisfied is determined by the server 2 or the first user terminal 3. It is judged.
[0100] In addition, the above-mentioned embodiment and modifications are merely examples of the present invention. The above is merely an example, and the technical scope of the present invention should not be construed as being limited thereby. In other words, the present invention does not deviate from its gist or main characteristics. It can be implemented in a variety of ways. [Explanation of symbols]
[0101] 1. Information Processing Systems 2. Server (information processing device) 200A Communication IF 200B storage device 200C CPU 201 Receiving unit 202 Transmitter 203 Storage device control unit 3. First user terminal (information processing terminal) 300A communication IF 300B storage device 300C Input Device 300D display device 300E CPU 300F Microphone 300G Speaker 301 Receiving unit 302 Transmitter 303 Storage device control unit 304 Input reception unit (reception unit) 305 Display device control unit 4. Second user terminal 400A Communication IF 400B storage device 400C Input Device 400D display device (LED) 400E CPU 400F Microphone 400G Speaker 400H GPS Sensor 401 Receiving unit 402 Transmitter 403 Storage device control unit 404 Input reception section 405 Notification Department 406 Settings 407 Judgment section 5. Network
Claims
1. A monitoring system for transmitting location information of a terminal for a person being watched carried by a person being watched to a terminal for a watcher, a receiving unit that receives first voice data from the watched-over person terminal and location information for displaying a location history of the watched-over person terminal; an audio output control unit that outputs the first audio data; a transmitting unit that transmits, to the watched-over person terminal, a voice input to a microphone of the watching-over terminal as second voice data; a text conversion unit that converts at least a portion of the first voice data into character data to convert the character data into text data; and A program that functions as a display device control unit that displays a time-series display screen that includes at least a portion of the text data in a time-series format.
2. A monitoring system for transmitting location information of a terminal for a person being watched carried by a person being watched to a terminal for a watcher, a receiving unit that receives first voice data from the watched-over person terminal, text data obtained by converting at least a portion of the first voice data into character data, and location information for displaying a location history of the watched-over person terminal; an audio output control unit that outputs the first audio data; a transmitting unit that transmits a voice input to a microphone of the watcher terminal as second voice data to be transmitted to the watched-over person terminal; and A program that functions as a display device control unit that displays a time-series display screen that includes at least a portion of the text data in a time-series format.
3. 3. The program according to claim 1, wherein the time-series display screen further displays information indicating that the second audio data has been reproduced by the watched-over person terminal.
4. 4. The program according to claim 1, wherein the time-series display screen further includes an indication of a playback time of the second audio data, a transmission time of the second audio data, or an indication of the presence of the second audio data.
5. 5. The program according to claim 1, wherein the time series display screen further includes a comment including information indicating when and from what location the user of the watched-over person terminal departed.
6. A monitor terminal in a monitoring system that transmits location information of a monitor terminal carried by a person being watched to a monitor terminal, a receiving unit that receives first voice data from the watched-over person terminal and location information for displaying a location history of the watched-over person terminal; an audio output control unit that outputs the first audio data; a transmitting unit that transmits, to the watched-over person terminal, a voice input to a microphone of the watching-over terminal as second voice data; a text conversion unit that converts at least a portion of the first voice data into character data to convert the character data into text data; and A terminal for a watcher, comprising a display device control unit that displays a time-series display screen including at least a portion of the text data in time series.
7. A monitor terminal in a monitoring system that transmits location information of a monitor terminal carried by a person being watched to a monitor terminal, a receiving unit that receives first voice data from the watched-over person terminal, text data obtained by converting at least a portion of the first voice data into character data, and location information for displaying a location history of the watched-over person terminal; an audio output control unit that outputs the first audio data; a transmitting unit that transmits a voice input to a microphone of the watcher terminal as second voice data to be transmitted to the watched-over person terminal; and A terminal for a watcher, comprising a display device control unit that displays a time-series display screen including at least a portion of the text data in time series.
8. A monitoring system for transmitting location information of a device for a person being watched carried by a person being watched to a terminal for a watcher, comprising: receiving first voice data from the watched-over person terminal and location information for displaying a location history of the watched-over person terminal; outputting the first audio data; a step of transmitting, as second voice data, a voice input to a microphone of the watcher terminal to be transmitted to the watched-over person terminal; A step of converting at least a portion of the first voice data into character data to generate text data; and A data processing method comprising the step of displaying a time-series display screen including at least a portion of the text data in time series.
9. A monitoring system for transmitting location information of a device for a person being watched carried by a person being watched to a terminal for a watcher, comprising: receiving first voice data from the watched-over person terminal, text data obtained by converting at least a part of the first voice data into character data, and location information for displaying a location history of the watched-over person terminal; outputting the first audio data; A step of transmitting a voice input to a microphone of the watcher terminal as second voice data to be transmitted to the watched-over person terminal; and A data processing method comprising the step of displaying a time-series display screen including at least a portion of the text data in time series.
Citation Information
Patent Citations
Voice communication using real-time status notifications
JP2016531498A
Message user interface for capture and transmission of media and location content
JP2017521804A
Information transmission system and positional information server
JP2020048093A
Communication system
JP2021136668A
Location information sharing control system and location information sharing control device
JP6953055B1