Communication device and communication method
The communication device addresses 'head truncation' by recording audio during call notifications and controlling playback, ensuring seamless audio output and efficient resource use.
Patent Information
- Application Number
- JP2024024615
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-21
- Publication Date
- 2025-09-02
AI Technical Summary
In voice calls, receiving terminals often experience 'head truncation' where the beginning of incoming audio is missed due to varying output times of incoming call notification information, leading to incomplete audio playback.
A communication device and method that detects the transition between silent and audio states in incoming data, initiating recording when audio starts during call notification and controlling playback after notification ends, ensuring seamless audio output.
Efficient audio recording and playback without interruptions, preventing 'head truncation' and optimizing device resource usage.
Smart Images

Figure 2025127730000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a communication device and a communication method. [Background technology]
[0002] Patent Document 1 discloses a technology related to a recording processing device for recording input audio. The recording processing device disclosed in Patent Document 1 creates a management file each time a recording start event occurs, creates a data file for storing audio data each time recording starts, and records additional information related to the data file being created in the management file. The recording processing device disclosed in Patent Document 1 also detects silent intervals from a digital signal corresponding to the input audio, stops the recording process when it detects a silent interval, and starts recording using a new data file when it detects audio from the digital signal after the recording has stopped. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-221565 Summary of the Invention [Problem to be solved by the invention]
[0004] In a voice call, a receiving terminal, which is a communication device on the receiving side, generally outputs incoming call notification information, which is information for notifying the user of the receiving terminal of an incoming call, when it receives data related to a call from a transmitting terminal, which is another communication device. The incoming call notification information is output at a predetermined time. The output time of the incoming call notification information often varies depending on the receiving terminal. Therefore, if the receiving terminal receives voice from the transmitting terminal while outputting the incoming call notification information, the beginning of the voice may not be output, which is known as "head truncation."
[0005] In view of the above-mentioned problems, an object of the present disclosure is to provide a communication device and method for outputting sound corresponding to the output status of incoming call notification information. [Means for solving the problem]
[0006] The communication device according to the present disclosure includes a communication unit that transmits and receives data to and from other communication devices, a detection unit that detects incoming call information and audio data from the data received by the communication unit and detects a change between a silent state and an audio state in the audio data, a recording control unit that starts recording the audio data when it detects that the audio data has changed from a silent state to an audio state while incoming call notification information is being output in response to the incoming call information, and a playback unit that controls playback of the recorded audio data after the output of the incoming call notification information has ended.
[0007] The communication method of the present disclosure includes the steps of a computer transmitting and receiving data to and from another communication device, detecting incoming call information and audio data from the received data and detecting a switch between a silent state and an audio state in the audio data, starting recording of the audio data when it detects that the audio data has switched from a silent state to an audio state while incoming call notification information output in response to the incoming call information is being output, and controlling playback of the recorded audio data after the output of the incoming call notification information has ended. [Effects of the Invention]
[0008] According to the present disclosure, audio can be efficiently recorded in accordance with the output status of incoming call notification information, and audio can be output without interruption. [Brief explanation of the drawings]
[0009] [Figure 1] FIG. 1 is a block diagram showing the configuration of a communication device according to the present disclosure. [Figure 2] FIG. 2 is a flowchart showing the flow of processing at the time of an incoming call according to the present disclosure. [Figure 3]FIG. 3 is a timing chart for explaining the start of recording of audio data according to the present disclosure. [Figure 4] FIG. 4 is a timing chart for explaining a case where recording of audio data according to the present disclosure is not started. [Figure 5] FIG. 5 is a flowchart showing the flow of processing during playback of recorded audio data according to the present disclosure. [Figure 6] FIG. 6 is a flowchart showing the flow of processing after the start of recording of audio data according to the present disclosure. [Figure 7] FIG. 7 is a timing chart for explaining a case where recording of audio data according to the present disclosure is continued. [Figure 8] FIG. 8 is a timing chart for explaining the case where recording of audio data according to the present disclosure is terminated. [Figure 9] FIG. 9 is a block diagram showing a hardware configuration of a communication device according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION
[0010] Hereinafter, specific embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same elements are denoted by the same reference numerals, and for clarity of explanation, duplicated explanations will be omitted as necessary.
[0011] <Embodiment 1> FIG. 1 is a block diagram showing a configuration of a communication device 100 according to a first embodiment. The communication device 100 is a communication device for transmitting and receiving data to and from other communication devices (not shown) and for performing voice calls between a user of the communication device 100 and a user of the other communication devices. Therefore, the other communication devices may have functions equivalent to those of the communication device 100. Hereinafter, for convenience of explanation, the other communication devices may be referred to as a "transmitting terminal" and the communication device 100 as a "receiving terminal." However, the communication device 100 and the other communication devices may each function as both a transmitting terminal and a receiving terminal. The communication device 100 outputs predetermined incoming call notification information when starting to receive data from a transmitting terminal, and after the output of the incoming call notification information is completed, outputs voice data received from the transmitting terminal, thereby enabling a voice call with the transmitting terminal. Note that the communication device 100 may output the received voice data at any timing after the output of the incoming call notification information is completed, without a user's operation to receive the call. The communication device 100 may also be, for example, a portable terminal using a wireless communication system for business voice calls. Therefore, the communication device 100 and other communication devices may be communicably connected to a communication network including a wireless communication network.
[0012] The communication device 100 includes a communication unit 110, a detection unit 120, a determination unit 130, a playback unit 140, an output unit 150, a recording control unit 160, and a storage unit 170. The communication device 100 is realized by a combination of hardware and software components operating in cooperation with each other, as described below. The communication unit 110 includes, for example, an antenna for transmitting signals for wireless communication and a communication interface circuit. The output unit 150 includes a speaker and a display. The processor of the communication device 100, described below, loads a program into memory and executes the program to realize the functions of the communication unit 110, the detection unit 120, the determination unit 130, the playback unit 140, the output unit 150, and the recording control unit 160. Some or all of the communication unit 110, the detection unit 120, the determination unit 130, the playback unit 140, the output unit 150, and the recording control unit 160 may be realized by hardware separate from the processor. The separate hardware may be, for example, a general-purpose or dedicated circuit implemented in a semiconductor device. The program according to this embodiment may be one that implements at least part of the processing of the playback unit 140 and the recording control unit 160. Therefore, part or all of the processing of the communication unit 110, detection unit 120, determination unit 130, and output unit 150 may be implemented in a program separate from the program 231. Furthermore, the communication unit 110, detection unit 120, determination unit 130, playback unit 140, output unit 150, and recording control unit 160 may be partially separated or integrated.
[0013] The communication unit 110 transmits and receives data to and from other communication devices. Here, the "data" transmitted and received includes incoming call information and voice data. Furthermore, the "data" transmitted and received may include sender ID information, destination ID information, text data, GPS (Global Positioning System) data, etc. Furthermore, the incoming call information is, for example, information transmitted from a transmitting terminal to a receiving terminal and is information that the receiving terminal can determine as being receivable. In particular, the incoming call information is preferably information that allows the receiving terminal to confirm an incoming call from the transmitting terminal, i.e., the start of communication. For example, the transmitting terminal may transmit data including information about its own communication device in the incoming call information to the receiving terminal using a first frequency, and the receiving terminal may receive the data including the incoming call information when it is waiting for reception using the first frequency. Alternatively, the transmitting terminal may transmit incoming call information including a destination ID, and the receiving terminal may determine that a call has been received when the received incoming call information includes the ID of its own communication device as the destination ID. Furthermore, the voice data is data related to sound including the voice uttered by the user of the transmitting terminal. Therefore, the audio data includes data in a voice state and data in a silent state. Note that the "data" transmitted and received is not limited to audio data, and may include sound information and other electronic data.
[0014] The detection unit 120 detects incoming call information and voice data from data received by the communication unit 110. The detection unit 120 also detects a switch between a silent state and a voice state in the detected voice data. At this time, the detection unit 120 may output the switch between a silent state and a voice state in the voice data to the determination unit 130 as voice switching information. Therefore, the voice switching information may be information indicating either (1) that the voice data has switched from a silent state to a voice state, or (2) that the voice data has switched from a voice state to a silent state. Alternatively, the detection unit 120 may detect whether the most recently received voice data is in a silent state or a voice state. Note that the detection unit 120 may consider the voice data to be in a silent state if the data received by the communication unit 110 does not include voice data. Therefore, the detection unit 120 may detect, as the above-mentioned (1), that the received data has switched from a state in which no voice data is included to a state in which voice data is included. Similarly, the detection unit 120 may detect, as the above (2), that the received data has switched from a state in which voice data is included in the received data to a state in which voice data is not included.
[0015] The determination unit 130 determines whether or not incoming call information has been detected by the detection unit 120. When the detection unit 120 detects incoming call information, the determination unit 130 instructs the reproduction unit 140 to start reproduction of incoming call notification information 171, which will be described later, i.e., to start outputting it. The determination unit 130 also determines whether or not the incoming call notification information 171 is currently being reproduced, i.e., whether or not it is currently being outputted. When the output of the incoming call notification information 171 has finished and there is audio data that has been recorded in the storage unit 170 and has not yet been reproduced, the determination unit 130 may instruct the reproduction unit 140 to start reproducing the unreproduced audio data. The determination unit 130 also determines whether or not audio data is currently being recorded. The determination unit 130 also determines whether or not the recorded audio data is currently being reproduced.
[0016] Furthermore, the determination unit 130 determines that recording of audio data should be started if the detection unit 120 detects the above (1) "audio data has switched from a silent state to an active state" while the incoming call notification information 171 is being output. In this case, the determination unit 130 instructs the recording control unit 160 to start recording the audio data.
[0017] Furthermore, when the detection unit 120 detects the above-mentioned (2) "audio data has switched from a voice state to a silent state" during recording of audio data, if the output of the incoming call notification information 171 has not ended, the determination unit 130 determines to continue recording the audio data. In this case, the determination unit 130 may instruct the recording control unit 160 to continue recording the audio data.
[0018] Furthermore, when the detection unit 120 detects the above-mentioned (2) "that the audio data has switched from a voice state to a silent state" during recording of the audio data, if the output of the incoming call notification information 171 has ended, the determination unit 130 determines to end recording of the audio data. In this case, the determination unit 130 instructs the recording control unit 160 to end recording of the audio data.
[0019] Specifically, the determination unit 130 may determine whether to start recording, continue recording, or end recording of audio data based on the determination result of whether the incoming call notification information 171 is being output or not and the audio switching information output from the detection unit 120.
[0020] Furthermore, determination unit 130 may determine whether or not incoming call notification information 171 is being output based on an incoming call notification information output flag, which will be described later. Alternatively, determination unit 130 may determine whether or not incoming call notification information 171 is being output based on the output state of incoming call notification information 171 in output unit 150 or the output state of a speaker, which will be described later.
[0021] Alternatively, the determination unit 130 may determine whether the incoming call notification information 171 is being output based on the recording status of the incoming call playback start point and the incoming call playback end point. Here, the incoming call playback start point is information indicating the point in time or the time when playback of the incoming call notification information 171 in the storage unit 170 started in response to reception of the incoming call information. Furthermore, the incoming call playback end point is information indicating the point in time or the time when playback of the incoming call notification information 171 ended. Therefore, the determination unit 130 may determine that the incoming call notification information 171 is being output when the incoming call playback start point is recorded in the storage unit 170 or the like, but the incoming call playback end point after the incoming call playback start point is not recorded. Furthermore, the determination unit 130 may determine that the output of the incoming call notification information 171 has ended when the incoming call playback end point after the incoming call playback start point is recorded in the storage unit 170 or the like.
[0022] Furthermore, the determination unit 130 may determine that audio data is being recorded if it has instructed the recording control unit 160 to start recording audio data but has not yet instructed the recording control unit 160 to stop recording the audio data. Alternatively, the determination unit 130 may determine whether audio data is being recorded based on the recording status of the audio data in the storage unit 170 by the recording control unit 160. For example, a recording flag indicating "recorded" or "not recorded" may be used as the recording status of the audio data.
[0023] In addition, the judgment unit 130 may determine whether to start additional recording of audio data, continue recording, or end recording based on the judgment result of whether the incoming call notification information 171 is being output or not, the audio switching information output from the detection unit 120, and the judgment result of whether audio data is being recorded or not.
[0024] In addition, the judgment unit 130 may determine whether to start recording additional audio data, continue recording, or end recording based on the judgment result of whether the recorded audio data is being played back or not and the audio switching information output from the detection unit 120.
[0025] When incoming call information is detected by the detection unit 120, or when the reproduction unit 140 receives an instruction to start outputting the incoming call notification information 171 from the judgment unit 130, the reproduction unit 140 reads out the incoming call notification information 171 from the memory unit 170 and starts outputting the incoming call notification information 171 via the output unit 150.
[0026] Furthermore, after the output of incoming call notification information 171 has been completed, playback unit 140 controls playback of the audio data recorded in storage unit 170. Specifically, when the output of incoming call notification information 171 has been completed and there is recorded audio data 173 that has been recorded in storage unit 170 and has not been played back, playback unit 140 controls to read out the unplayed recorded audio data 173 from storage unit 170 and start outputting it via output unit 150. Note that playback unit 140 may also control to start outputting the unplayed recorded audio data 173 in storage unit 170 in response to an instruction from determination unit 130 to start playing back the audio data.
[0027] The output unit 150 outputs the incoming call notification information 171 or the recorded audio data 173 in the storage unit 170 in accordance with the control of the reproduction unit 140. After outputting the incoming call notification information 171 or the recorded audio data 173, the output unit 150 outputs the audio data included in the data received by the communication unit 110.
[0028] The recording control unit 160 starts recording audio data when it detects that audio data included in the received data has switched from a silent state to a vocal state while outputting incoming call notification information 171, which is output in response to incoming call information included in the received data from another communication device. Specifically, when the detection unit 120 detects (1) above that "audio data has switched from a silent state to a vocal state" while outputting incoming call notification information 171, the recording control unit 160 starts recording audio data included in the received data from the communication unit 110. Thereafter, the audio data recorded in the storage unit 170 becomes recorded audio data 173. For example, the recording control unit 160 may start recording audio data in response to an instruction to start recording audio data from the determination unit 130. At this time, the recording control unit 160 may record the recording start time, which is the time when recording of the audio data, in the storage unit 170, by including the recording attribute information 172.
[0029] Furthermore, when the recording control unit 160 detects that the audio data has switched from a voice state to a silent state while the audio data is being recorded, if the output of the incoming call notification information 171 has not yet finished, the recording control unit 160 continues recording the audio data. Specifically, even if the detection unit 120 detects the above (2) "that the audio data has switched from a voice state to a silent state" while the recording control unit 160 is recording the recorded audio data 173 in the storage unit 170, the recording control unit 160 continues recording the audio data included in the received data as long as the incoming call notification information 171 is being output. For example, the recording control unit 160 may continue recording the audio data in response to an instruction from the determination unit 130 to continue recording the audio data.
[0030] Furthermore, when the recording control unit 160 detects that the audio data has switched from a voice state to a silent state while recording the audio data, if the output of the incoming call notification information has ended, the recording control unit 160 ends the recording of the audio data. Specifically, when the detection unit 120 detects (2) "that the audio data has switched from a voice state to a silent state" while recording the recorded audio data 173 in the storage unit 170, if the output of the incoming call notification information 171 has ended at that time, the recording control unit 160 ends the recording of the audio data included in the received data. For example, the recording control unit 160 may end the recording of the audio data in response to an instruction from the determination unit 130 to end the recording of the audio data. At this time, the recording control unit 160 may include the recording end time, which is the time when the recording of the audio data ended, in the recording attribute information 172 and record it in the storage unit 170. In addition, the recording control unit 160 may include the difference between the most recent recording start time and recording end time in the recording attribute information 172 as the recording time and record it in the storage unit 170.
[0031] Furthermore, the recording control unit 160 may start recording audio data when it detects that the audio data of the received data at that time has switched from a silent state to a voice state during playback of the recorded audio data.
[0032] The recording control unit 160 may identify the above-mentioned incoming call playback start point and incoming call playback end point and record them in the storage unit 170 each time.
[0033] The storage unit 170 includes a non-volatile storage device such as a hard disk or flash memory, and a memory such as a RAM (Random Access Memory), that is, a volatile storage device. The storage unit 170 stores at least incoming call notification information 171, recording attribute information 172, and recorded voice data 173. The storage unit 170 stores, as a component not shown, a computer program in which processing for controlling the communication device 100, including processing of the communication method according to the present disclosure, is implemented.
[0034] Incoming call notification information 171 is information to be output when incoming call information is detected in received data by detection unit 120. Incoming call notification information 171 is information for notifying a user of communication device 100 that communication device 100 has received an incoming call from another communication device. Incoming call notification information 171 is stored in advance in storage unit 170. Incoming call notification information 171 may be information such as sound data, an image, or text.
[0035] The recording attribute information 172 includes a pair of recording start time and recording end time of the recorded audio data 173, and at least a part of the recording time, which is the difference between the most recent recording start time and recording end time.
[0036] The recorded audio data 173 is audio data recorded by the recording control unit 160 .
[0037] It is preferable that any one of the detection unit 120, the determination unit 130, the reproduction unit 140, the output unit 150, and the recording control unit 160 sets an incoming call notification information output flag (not shown) in the storage unit 170 to "output ON" when output of the incoming call notification information 171 starts. Similarly, any one of the detection unit 120, the determination unit 130, the reproduction unit 140, the output unit 150, and the recording control unit 160 sets an incoming call notification information output flag in the storage unit 170 to "output OFF" when output of the incoming call notification information 171 ends.
[0038] Furthermore, any one of the detection unit 120, the determination unit 130, the playback unit 140, the output unit 150, and the recording control unit 160 may set a recording status flag (not shown) in the storage unit 170 to "recorded" when recording of the recording audio data 173 in the storage unit 170 starts. Similarly, any one of the detection unit 120, the determination unit 130, the playback unit 140, the output unit 150, and the recording control unit 160 may set a recording status flag (not shown) in the storage unit 170 to "recorded" when recording of the recording audio data 173 ends.
[0039] Furthermore, any one of the detection unit 120, the determination unit 130, the playback unit 140, the output unit 150, and the recording control unit 160 may set a recorded audio data playback flag (not shown) in the storage unit 170 to "playing" when playback of unplayed recorded audio data 173 in the storage unit 170 starts. Similarly, any one of the detection unit 120, the determination unit 130, the playback unit 140, the output unit 150, and the recording control unit 160 may set a recorded audio data playback flag (not shown) in the storage unit 170 to "playback completed" when playback of the recorded audio data 173 ends.
[0040] Fig. 2 is a flowchart showing a processing flow at the time of an incoming call according to the first embodiment. Fig. 3 is a timing chart for explaining a case where recording of voice data according to the first embodiment is started. Fig. 4 is a timing chart for explaining a case where recording of voice data according to the first embodiment is not started. In the following explanation, Figs. 3 and 4 will be referred to as appropriate in the explanation of Fig. 2.
[0041] First, another communication device, which is a transmitting terminal, makes a call to the receiving terminal. Specifically, the transmitting terminal transmits data including incoming call information and voice data to the receiving terminal using one of the methods described above. In response, communication device 100, which is the transmitting terminal, receives data including incoming call information and voice data from the other communication device (S11). For example, as shown in S11 at time t11 in FIG. 3, the status of the received data becomes "received."
[0042] Next, the communication device 100 starts outputting incoming call notification information in accordance with the incoming call information included in the received data (S12). For example, as shown in S12 at time t11 in Fig. 3, the incoming call notification information output flag becomes "output ON", and the speaker output state becomes "output enabled". Therefore, the communication device 100 outputs a ringtone as an example of incoming call notification information.
[0043] Furthermore, a transmitting terminal typically sounds a notification sound in response to an incoming call at a receiving terminal. This may prompt the user of the transmitting terminal to start speaking upon hearing the notification sound. However, at this point, the receiving terminal is outputting incoming call notification information and is unable to output the audio data received from the transmitting terminal. Therefore, a typical receiving terminal starts outputting the audio data received at that time after finishing outputting the incoming call notification information. This results in a typical receiving terminal not outputting the beginning of the audio, a phenomenon known as "head truncation." In response to this, communication device 100, which is a receiving terminal according to the present disclosure, processes as follows.
[0044] Following step S12, the communication device 100 determines whether or not the incoming call notification information is being output (S13). For example, as indicated by "S13: YES" at time t12 in FIG. 3, if the incoming call notification information output flag is "output ON," the process of the communication device 100 proceeds to step S14. In this case, the communication device 100 determines whether or not the voice data included in the received data has switched from a silent state to a voiced state (S14). For example, as described above, it is assumed that the user of the transmitting terminal begins speaking while the incoming call notification information is being played back at the receiving terminal. In this case, for example, as indicated by "S14: YES" at time t12 in FIG. 3, the received voice data switches from a silent state to a voiced state (voice data "A"). Therefore, the communication device 100 determines YES in step S14 and starts recording the voice data (S15). For example, as indicated by S15 at time t12 in FIG. 3, the recording state becomes "recorded," and recording of the voice data "A" and subsequent voice data begins. However, as shown in FIG. 3, the speaker output state at time t12 is "output on" and the ring tone continues to be output.
[0045] Thereafter, the communication device 100 determines whether or not the output of the incoming call notification information has finished (S16). If the incoming call notification information is being output, the communication device 100 performs the determination of step S16 again after a certain period of time has elapsed. On the other hand, if it is determined that the output of the incoming call notification information has finished, the communication device 100 plays back the recorded audio data (S17). For example, as shown by "S16: YES" and S17 at time t13 in FIG. 3, the incoming call notification information output flag is "output OFF", so the communication device 100 reads out the audio data "A" recorded at time t12 from the storage unit 170 and outputs it.
[0046] On the other hand, if the user of the transmitting terminal starts speaking after the playback of the incoming call notification information on the receiving terminal has finished, the communication device 100 determines NO in step S14. For example, as shown by "S13: YES" and "S14: NO" at time t23 in FIG. 4, the incoming call notification information output flag is "output ON" and the received voice data is "silent state." In this case, the communication device 100 does not record the voice data (S18). For example, as shown by S18 at time t23 in FIG. 4, the recording state remains "no recording." Thereafter, the communication device 100 determines whether the output of the incoming call notification information has finished (S19). If the incoming call notification information is being output, the communication device 100 performs the determination of step S14 again after a certain time has elapsed. On the other hand, if it is determined that the output of the incoming call notification information has finished, the communication device 100 outputs the voice data (S20). For example, as shown at time t24 in Fig. 4, when the incoming call notification information output flag is "output OFF," the communication device 100 determines YES in step S19. Thereafter, as shown at S20 at time t25 in Fig. 4, the speaker output state becomes "output ON." In this case, the audio data "A" and subsequent data received at time t25 are output directly from the speaker.
[0047] If it is determined in step S13 that the output of the incoming call notification information has ended, the communication device 100 outputs the subsequently received audio data as is (S20). This makes it possible to prevent the recording of audio data more than necessary, which contributes to extending the life of the memory and battery of the communication device 100.
[0048] Fig. 5 is a flowchart showing the flow of processing during playback of recorded audio data according to the first embodiment. Fig. 6 is a flowchart showing the flow of processing after starting recording of audio data according to the first embodiment. Fig. 7 is a timing chart for explaining a case where recording of audio data according to the first embodiment is continued. Fig. 8 is a timing chart for explaining a case where recording of audio data according to the first embodiment is terminated. In the following description, Figs. 7 and 8 will be referred to as appropriate in the description of Figs. 5 and 6.
[0049] First, following step S15 in FIG. 2, the communication device 100 executes the processes from step S21 onward in FIG. 5 in parallel with the processes from step S16 onward. Specifically, the communication device 100 determines whether or not audio data is being recorded (S21). For example, as shown at time t34 in FIG. 7, if the recording status is "recorded," the communication device 100 determines YES in step S21. Next, the communication device 100 determines whether or not the audio data has switched from a voice state to a silent state (S22). For example, as shown at time t34 in FIG. 7, if the received audio data has switched from a "voice state" to a "silent state," the communication device 100 determines YES in step S22. In that case, the communication device 100 determines whether or not incoming call notification information is being output (S23). For example, as shown at time t34 in Fig. 7, if the incoming call notification information output flag is "output ON," the communication device 100 determines YES in step S23. Therefore, the communication device 100 continues recording the audio data (S24). For example, as shown from time t34 to t35 in Fig. 7, the recording status is maintained as "recorded." After a certain period of time has elapsed, the communication device 100 performs the determination in step S22 again.
[0050] If the determination in step S22 is NO, the communication device 100 executes step S24. Since the audio data is being recorded and is in a voice state, by continuing the recording, when the recorded audio data 173 is played back, the audio data in the voice state can be output without any omissions.
[0051] If the determination in step S23 is NO, the communication device 100 ends the recording of the audio data (S25). For example, as shown at time t35 in FIG. 7, the received audio data is in a "silent state," so the communication device 100 determines YES in step S22. Then, because the incoming call notification information output flag is "output OFF," the communication device 100 determines NO in step S23. Then, as the communication device 100 ends the recording of the audio data, the recording status becomes "no recording," as shown in S25 at time t35 in FIG. 7.
[0052] If it is determined in step S21 that audio data is not being recorded, the communication device 100 ends the process of FIG.
[0053] Furthermore, following step S17 in FIG. 2, the communication device 100 executes the processes from step S13a onward in FIG. 6 in parallel with the process in FIG. 5. Specifically, the communication device 100 determines whether the recorded audio data AD1 is being played back (S13a). Here, the audio data AD1 is, for example, audio data "A," "B," "C," "D," and "E" recorded between time t32 and time t34 in FIG. 7. The communication device 100 may identify the audio data AD1, for example, when the audio data received at time t32 switches from a silent state to a spoken state and the audio data received at time t34 switches from a spoken state to a silent state. At time t36 in FIG. 7, the speaker output state is "output on" and "A" to "B" are being output, so the communication device 100 determines that the audio data AD1 is being played back (YES in S13a).
[0054] Next, the communication device 100 determines whether the audio data included in the received data has switched from a silent state to a vocal state (S14). For example, as shown by "S14: YES" at time t36 in FIG. 7, the received audio data switches from a silent state to a vocal state ("F"). Therefore, the communication device 100 determines YES in step S14 and starts recording the audio data AD2 (S15a). For example, as shown by S15a at time t36 in FIG. 7, the recording status becomes "recorded," and recording of audio data "F" and onward begins. However, as shown in FIG. 7, the speaker output status at time t36 is "output on," and audio data AD1 continues to be output.
[0055] Thereafter, the communication device 100 determines whether the playback of the audio data AD1 has finished (S16a). If the audio data AD1 is being played back, i.e., being output, the communication device 100 performs the determination of step S16a again after a certain period of time has elapsed. For example, since the audio data AD1 continues to be output after time t36 and before time t37 in FIG. 7, the communication device 100 determines that the audio data AD1 is being played back, i.e., being output.
[0056] On the other hand, if it is determined in step S16a that the playback of the audio data AD1 has ended, the communication device 100 plays the recorded audio data AD2 (S17a). For example, at time t37 in FIG. 7, the playback of the last data "E" of the audio data AD1 has ended, so the communication device 100 determines that the playback of the audio data AD1 has ended (YES in S16a). Then, the communication device 100 reads and outputs the recorded audio data 173 that has not been played back as of time t37, i.e., the first data "F" of the audio data AD2, from the storage unit 170 (S17a). Thereafter, the communication device 100 plays back the audio data AD2. Then, the communication device 100 replaces "audio data AD1" in FIG. 6 with "audio data AD2" and executes the process of FIG. 6.
[0057] 6, if it is determined that the audio data included in the received data has not switched from a silent state to a vocal state, that is, if the audio data remains silent, the communication device 100 does not record the audio data (S18). Then, as in FIG. 2, if the communication device 100 determines YES in step S19, it executes step S20, and if the communication device 100 determines NO in step S19, it returns to step S14. Also, if it determines in step S13a that the recorded audio data AD1 is not being played, that is, if the playback of the audio data AD1 has ended, the communication device 100 outputs the subsequently received audio data as is (S20).
[0058] 5, if it is determined that the received audio data has switched from a "sound state" to a "silence state," the communication device 100 may end recording of the silent audio data in step S25 instead of step S24. For example, in FIG. 7, audio data of a silent interval is recorded between times t34 and t35, but audio data of a silent interval does not need to be recorded during this period. Thereafter, the communication device 100 may execute step S13a and subsequent steps in FIG. 6. This can reduce the recording of silent audio data, contributing to extending the life of the memory and battery of the communication device 100.
[0059] 9 is a block diagram showing the hardware configuration of the communication device 100 according to the first embodiment. The communication device 100 includes a memory 101, a processor 102, a communication interface 103, a speaker 104, a microphone 105, and a display 106.
[0060] The memory 101 is configured by a combination of volatile memory and non-volatile memory. The volatile memory is, for example, a volatile storage device such as RAM, and is a storage area for temporarily holding information while the processor 102 is operating. The non-volatile memory is, for example, a non-volatile storage device such as a hard disk or flash memory. The memory 101 stores at least a computer program that implements processing for controlling the communication device 100, including processing of the communication method according to the present disclosure for the communication device 100 according to the present disclosure.
[0061] The processor 102 is a control device that controls each component of the communication device 100. The processor 102 reads and executes software (computer programs) from the memory 101. As a result, the processor 102 realizes the functions of the communication unit 110, the detection unit 120, the determination unit 130, the playback unit 140, the output unit 150, and the recording control unit 160. That is, the processor 102 performs the authentication history management process according to the present disclosure. The processor 102 may be, for example, a microprocessor, an MPU (Multi Processing Unit), or a CPU (Central Processing Unit). Alternatively, the processor 102 may be, for example, a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), a quantum processor (quantum computer control chip), or the like. The processor 102 may also include multiple processors.
[0062] The communication interface 103 may be used to communicate with other communication devices. The communication interface 103 may include, for example, a network interface card (NIC) conforming to the IEEE 802.3 series. IEEE stands for Institute of Electrical and Electronics Engineers. The communication interface 103 may also include a wireless local area network (LAN), a wired LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0063] The speaker 104 is a device that outputs sound data. The microphone 105 is a device that inputs sound data. The display 106 is a display device that displays information instructed by the processor 102. The display 106 is, for example, a screen such as a liquid crystal display or an organic electroluminescence (EL) display.
[0064] In this way, the communication device 100 according to this embodiment can efficiently record audio data in accordance with the output status of the incoming call notification information. Specifically, when the audio data switches from a silent state to an active state while the incoming call notification information is being output, the recording control unit 160 starts recording the audio data received at that time. Then, the playback unit 140 controls the playback to start playing the audio data recorded up to that point after the output of the incoming call notification information ends. Therefore, the communication device 100 can output audio without interruption, without causing so-called "head cutoff." In other words, a seamless process can be achieved from the output of the incoming call notification information to the playback of the recorded audio. In other words, it is also possible to reduce the discomfort felt by the user of the receiving terminal.
[0065] However, communication device 100 may start playing the recorded voice data a certain time after the end of output of the incoming call notification information. In other words, communication device 100 starts playing the recorded voice data at least after the end of output of the incoming call notification information, thereby reducing the sense of discomfort felt by the user of the receiving terminal.
[0066] Furthermore, if the audio data switches from a voice state to a silent state while being recorded and the output of the incoming call notification information has not yet finished at that point, the recording control unit 160 continues recording the audio data. This allows the audio data being output as the incoming call notification information to be recorded without any omissions. Therefore, after the output of the incoming call notification information has finished, the audio data during that time can be output without any omissions.
[0067] Furthermore, if the audio data switches from a voice state to a silent state while being recorded and the output of the incoming call notification information has ended at that point, the recording control unit 160 ends the recording of the audio data. In this case, since the audio data being output as the incoming call notification information has already been recorded, the recorded audio data can be played back after the output of the incoming call notification information has ended, so that all audio can be output. Furthermore, recording of more audio data than necessary can be prevented, which contributes to extending the life of the memory and battery of the communication device 100.
[0068] Furthermore, when the recording control unit 160 detects that the audio data of the currently received data has switched from a silent state to a voice state during playback of the recorded audio data AD1, it starts recording the audio data AD2 that has switched to a voice state. Thereafter, the playback unit 140 controls playback so that the audio data AD2 is played back after the output of the incoming call notification information is completed. Therefore, even if audio data AD1 in a voice state is initially recorded while the incoming call notification information is being output, and then another audio data AD2 is received during playback of the audio data AD1 recorded after the output of the incoming call notification information, the playback timing of the audio data AD1 and the audio data AD2 can be prevented from overlapping. Specifically, the incoming call notification information, audio data AD1, and audio data AD2 can be output in this order without any omissions.
[0069] <Embodiment 2> In the second embodiment, the recording control unit 160 transmits the recording attribute information 172 recorded in the storage unit 170 in the first embodiment to the transmitting terminal. That is, after finishing recording the voice data, the communication unit 110 according to the second embodiment transmits the recording attribute information 172 related to the recording to another communication device. This allows, for example, the user of the transmitting terminal to confirm the pair of recording start time and recording end time of the recorded voice data 173 and the recording duration included in the recording attribute information 172 received by the transmitting terminal. This makes it easier for the user of the transmitting terminal to confirm that the voice data from the transmitting terminal is not interrupted at the receiving terminal, for example, that the contents of the user's own speech are not truncated at the receiving terminal. Furthermore, by the receiving terminal transmitting the recording attribute information 172 to the transmitting terminal, the user of the transmitting terminal can confirm that at least the beginning of the user's own speech has been recorded at the receiving terminal. Furthermore, the user of the transmitting terminal can predict the waiting time before speaking at the next outgoing call, taking into account the playback time of the incoming call notification information at the receiving terminal, etc., from the contents of the recording attribute information 172. The configuration diagram of the communication device according to the second embodiment and the flowchart of other processes are the same as those in the above-described embodiment, so illustrations and overlapping explanations will be omitted.
[0070] <Other embodiments> Although the above-described embodiment has been described as a hardware configuration, the present disclosure is not limited to this. Any processing in the present disclosure can also be realized by causing a CPU to execute a computer program.
[0071] In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.
[0072] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.
[0073] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but also to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate. [Explanation of symbols]
[0074] 100 Communication equipment 110 Communications Department 120 Detector 130 Judgment section 140 Playback Department 150 Output section 160 Recording control section 170 Storage section 171 Incoming call notification information 172 Record attribute information 173 Recorded Audio Data 101 Memory 102 processors 103 Communication Interface 104 Speaker 105 Microphone 106 Display t11~t13, t23~t25, t32, t34~t38, t44~t46 time
Claims
1. a communication unit for transmitting and receiving data to and from other communication devices; a detection unit that detects incoming call information and voice data from the data received by the communication unit and detects a transition between a silent state and a voice state of the voice data; a recording control unit that starts recording the audio data when detecting that the audio data has switched from a silent state to a voice state during output of the incoming call notification information that is output in response to the incoming call information; a playback unit that controls playback of the recorded voice data after the output of the incoming call notification information is completed; A communication device comprising:
2. When the recording control unit detects that the audio data has switched from a voice state to a silent state during recording of the audio data, if the output of the incoming call notification information has not ended, the recording control unit continues recording the audio data. The communication device according to claim 1 .
3. When the recording control unit detects that the audio data has switched from a voice state to a silent state during recording of the audio data, if the output of the incoming call notification information has ended, the recording control unit ends recording of the audio data.
3. The communication device according to claim 1 or 2.
4. After the recording of the audio data is completed, the communication unit transmits recording attribute information regarding the recording to the other communication device. The communication device according to claim 3 .
5. The computer transmitting and receiving data to and from other communication devices; detecting incoming call information and voice data from the received data and detecting a transition between a silent state and a voice state of the voice data; a step of starting recording of the audio data when detecting that the audio data has switched from a silent state to a voice state during output of incoming call notification information that is output in response to the incoming call information; a step of controlling playback of the recorded voice data after the output of the incoming call notification information is completed; A communication method.
Citation Information
Patent Citations
Voice data file storing method and sound-recording processor
JP2005221565A