Voice data generation device, voice reproduction device, voice reproduction system and program

Abstract

To suppress reproduction time delay without changing reproduction speed or a reproduction position.SOLUTION: A voice data generation device 100 includes: a delay adjustment section detection part 121 for detecting a silent section in one voice material and a silent section between continuous voice materials as delay adjustment sections; and a voice data generation part 124 for generating voice data which includes listening voice data based on the voice material in a listening section which is a section other than the delay adjustment section and silent delay adjustment voice data having a plurality of time lengths and in which listening voice data and delay adjustment voice data are alternately reproduced.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an audio data generating device, an audio reproducing device, an audio reproducing system, and a program. [Background technology]

[0002] A typical web browser installed in a playback device today has a function for playing audio or video. With such a web browser, audio and video can be played by specifying the URL (Uniform Resource Locator) of the web server where the audio or video file to be played is stored as the playback resource attribute.

[0003] Methods of playing audio or video using a general-purpose Web server with HTTP (Hypertext Transfer Protocol) include a download method in which the entire audio or video data is received in advance and then played, and a streaming method in which parts of the audio or video data are received in sequence and then played. The streaming method has become mainstream for playing audio or motion on the Internet these days. However, when playing simultaneously on multiple playback devices with a limited network bandwidth, the download method is sometimes used to avoid playback stopping due to data not being received in time.

[0004] Conventionally, when playing audio or video on multiple playback devices, differences in the playback times of the playback devices may occur even if playback start commands are issued to all playback devices at the same time due to factors such as the processing load of the playback devices and communication conditions. Therefore, in order to play audio or video by synchronizing the playback times of multiple playback devices, a technology has been proposed that periodically monitors the playback times of all playback devices and adjusts the playback speed or playback position. For example, Patent Document 1 proposes a technology for synchronizing videos played on multiple playback devices by adjusting the playback speed of each playback device from a synchronization control device connected to each playback device via a network at each monitoring time so that the difference in playback times of the multiple playback devices is eliminated. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2014-150408 A Summary of the Invention [Problem to be solved by the invention]

[0006] When playing back audio data on multiple playback devices, differences in playback time delays may occur among the playback devices due to factors such as the processing load of the playback devices and communication conditions. The playback time delay is the difference between the actual time up to an arbitrary playback position in the audio data and the time elapsed from the start of playback of the audio data until the playback position is reached (elapsed playback time).

[0007] In order to synchronously play back audio data on multiple playback devices, it is possible to apply the technology described in Patent Document 1. Here, in the technology described in Patent Document 1, all playback devices periodically transmit playback positions to a synchronization control device via a network, and receive commands to change the playback speed from the synchronization control device. Here, when playing back audio data on multiple playback devices with a limited network bandwidth, it may not be possible to send and receive data for synchronous playback of the audio data.

[0008] Furthermore, to start audio output and change the playback position, the user may need to operate buttons on the screen, depending on the type of web browser installed in the playback device, the version of the web browser, whether the playback device's screen is turned off (sleep), the playback device's audio output policy, etc. In this case, it may not be possible to command a change in the playback position from a program and continue playing the audio data.

[0009] Therefore, there is a demand for a technique that can suppress the playback time delay without changing the playback speed or playback position.

[0010] An object of the present invention is to provide an audio data generating device, an audio playback device, an audio playback system, and a program that can solve the above-mentioned problems and suppress playback time delay without changing the playback speed or playback position. [Means for solving the problem]

[0011] (1) An audio data generating device according to the present disclosure is an audio data generating device that generates audio data from one or more audio materials, and includes: a delay adjustment interval detection unit that detects silent intervals in one of the audio materials and silent intervals between consecutive audio materials as delay adjustment intervals; and an audio data generating unit that generates the audio data in which the listening audio data and the delay adjustment audio data are played alternately, the audio data including listening audio data based on audio materials in listening intervals that are intervals other than the delay adjustment intervals, and silent delay adjustment audio data having a plurality of time lengths.

[0012] (2) In the audio data generating device described in (1), the multiple time lengths include a time length corresponding to the delay adjustment interval and a time length obtained by increasing or decreasing the time length corresponding to the delay adjustment interval.

[0013] (3) In the audio data generating device according to (1) or (2), the audio data generating unit generates the audio data by including a part of the delay adjustment section in the listening section.

[0014] (4) In the audio data generating device described in any one of (1) to (3), the silent section is a section that includes at least one of a time section in which the amplitude of the audio signal is 0, a time section in which the amplitude of the audio signal is smaller than the minimum audible value for humans, and a time section that includes only an audio signal in an inaudible frequency band.

[0015] (5) An audio playback device that plays back audio data generated from one or more audio materials, the audio data including listening audio data based on audio materials of listening sections other than delay adjustment sections, which are silent sections in one of the audio materials and silent sections between consecutive audio materials, and silent delay adjustment audio data having a plurality of time lengths, the device comprising: a playback processing unit that alternately plays back the listening audio data and the delay adjustment audio data; a playback status monitoring unit that monitors a playback time delay, which is the difference between the actual time to an arbitrary playback position of the audio data and the elapsed playback time from the start of playback of the audio data to the playback position; and a playback data determination unit that determines delay adjustment audio data having a time length corresponding to the playback time delay as the delay adjustment audio data to be played back after playback of the listening audio data is completed.

[0016] (6) An audio playback system including an audio data generation device that generates audio data from one or more audio materials, and an audio playback device that plays back the audio data, wherein the audio data generation device comprises a delay adjustment interval detection unit that detects silent intervals in one of the audio materials and silent intervals between consecutive audio materials as delay adjustment intervals, and an audio data generation unit that generates the audio data including listening audio data based on audio materials in a listening interval that is an interval other than the delay adjustment interval, and silent delay adjustment audio data having a plurality of time lengths, in which the listening audio data and the delay adjustment audio data are alternately played back, and the audio playback device comprises a playback processing unit that alternately plays back the listening audio data and the delay adjustment audio data, a playback status monitoring unit that monitors a playback time delay that is the difference between the actual time to an arbitrary playback position of the audio data and the elapsed playback time from the start of playback of the audio data to the playback position, and a playback data determination unit that determines delay adjustment audio data having a time length corresponding to the playback time delay as the delay adjustment audio data to be played back after playback of the listening audio data is completed.

[0017] (7) A program according to the present disclosure causes a computer to operate as the audio data generation device described in (1).

[0018] (8) A program according to the present disclosure causes a computer to operate as the audio playback device described in (5). Effect of the Invention

[0019] According to the audio data generating device, audio reproducing device, audio reproducing system, and program of the present invention, the audio reproducing device itself can suppress delays in playback time without changing the playback speed or playback position. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an audio reproduction system according to an embodiment of the present disclosure. [Diagram 2]2 is a diagram illustrating an example of the configuration of the voice data generating device illustrated in FIG. 1. [Figure 3A] 3 is a diagram showing an example of an audio material input to a delay adjustment interval detection unit shown in FIG. 2; [Figure 3B] 3B is a diagram showing an example of a detection result of the delay adjustment section detection unit shown in FIG. 2 when the audio material shown in FIG. 3A is input. FIG. [Figure 3C] 3B is a diagram showing an example of listening audio data generated by the listening audio data generating unit shown in FIG. 2 when the audio material shown in FIG. 3A is input. FIG. [Figure 3D] 3B is a diagram showing an example of delay adjustment audio data generated by the delay adjustment audio data generating unit shown in FIG. 2 when the audio material shown in FIG. 3A is input. FIG. [Figure 4A] 3 is a diagram showing another example of the audio material input to the delay adjustment interval detection unit shown in FIG. 2. [Figure 4B] 4B is a diagram showing an example of a detection result of the delay adjustment section detection section shown in FIG. 2 when the audio material shown in FIG. 4A is input. FIG. [Figure 4C] 4B is a diagram showing an example of listening audio data generated by the listening audio data generating unit shown in FIG. 2 when the audio material shown in FIG. 4A is input. FIG. [Figure 4D] 4B is a diagram showing an example of delay adjustment audio data generated by the delay adjustment audio data generating unit shown in FIG. 2 when the audio material shown in FIG. 4A is input. FIG. [Diagram 5] 2 is a diagram illustrating an example of the configuration of the audio reproduction device illustrated in FIG. 1. [Figure 6A] 6 is a diagram for explaining the operation of the reproduction data determination unit shown in FIG. 5 when reproduction time data is input. FIG. [Figure 6B] 6 is a diagram for explaining the operation of the reproduction data determination unit shown in FIG. 5 when reproduction time data is input. FIG. [Figure 6C] 6 is a diagram for explaining the operation of the reproduction data determination unit shown in FIG. 5 when reproduction time data is input. FIG. [Figure 7A] 6 is a diagram for explaining the operation of the reproduction data determination unit shown in FIG. 5 when reproduction status data is input. FIG. [Figure 7B] 6 is a diagram for explaining the operation of the reproduction data determination unit shown in FIG. 5 when reproduction status data is input. FIG. [Figure 8] 6 is a flowchart showing an example of the operation of the audio reproducing device shown in FIG. 5. [Figure 9] 7 is a flowchart showing another example of the operation of the audio reproducing device shown in FIG. 5. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0022] 1 is a diagram showing an example of the configuration of an audio reproduction system 10 according to an embodiment of the present disclosure. In the audio reproduction system 10 according to this embodiment, audio data generated by an audio data generating device 100 is distributed to a plurality of audio reproduction devices 400 by an audio distribution server 200, and the audio data is synchronously reproduced by the plurality of audio reproduction devices 400. Note that, although audio distribution will be described below as an example, the present invention is not limited to this, and can also be applied to audio included in a video, for example.

[0023] As shown in Fig. 1, the audio reproduction system 10 according to this embodiment includes an audio data generating device 100, an audio distribution server 200, a reproduction time distribution server 300, and a plurality of audio reproduction devices 400. Note that Fig. 1 shows an example in which there are three audio reproduction devices 400, but the present invention is not limited to this.

[0024] One or more audio materials are input to the audio data generating device 100. The audio data generating device 100 generates audio data from the one or more input audio materials. The audio data generating device 100 generates audio data for listening and audio data for delay adjustment, as will be described in detail later.

[0025] The audio data generating device 100 may generate audio data for listening by, for example, dividing the input audio material into time periods ranging from a few seconds to a few minutes. Alternatively, the audio data generating device 100 may not divide the input audio material into time periods, but may use the audio material as audio data for listening as is.

[0026] Moreover, the audio data generating device 100 generates audio data for delay adjustment by extracting a silent section. The audio data generating device 100 may generate silent audio material by a program or the like and use it as audio data for delay adjustment. Here, the silent section is, for example, a time section in a silent state, that is, a time section in which the amplitude of the audio signal is 0. The silent section may also include a time section in which the amplitude of the audio signal is smaller than the minimum audible value that can be heard by humans. The silent section may also include a time section that includes only an audio signal in an inaudible frequency band. That is, the silent section is a section that includes at least one of a time section in which the amplitude of the audio signal is 0, a time section in which the amplitude of the audio signal is smaller than the minimum audible value for humans, and a time section that includes only an audio signal in an inaudible frequency band.

[0027] Hereinafter, the audio data for listening and the audio data for delay adjustment will be collectively referred to as audio data. That is, the audio data includes the audio data for listening and the audio data for delay adjustment. Although details will be described later, when the audio data is played back, the audio data for listening and the audio data for delay adjustment are played back alternately. The audio data generating device 100 stores the generated audio data (the audio data for listening and the audio data for delay adjustment) in the audio distribution server 200.

[0028] In this embodiment, an example will be described in which audio material is input to the audio data generating device 100, but as described above, for example, video with audio may be input to the audio data generating device 100. When video with audio is input, the audio data generating device 100 may separate the audio from the video and generate audio data (audio data for listening and audio data for delay adjustment) from the separated audio. In this case, it is preferable that the video corresponding to the audio data for delay adjustment (video played when playing the audio data for delay adjustment) is a video that does not cause viewing problems even if the playback time is increased or decreased, for example, a video that contains continuous still images.

[0029] The audio distribution server 200 stores the audio data (audio data for listening and audio data for delay adjustment) generated by the audio data generating device 100. The audio distribution server 200 distributes, from among the stored audio data, audio data corresponding to a request from the audio reproducing device 400 to the audio reproducing device 400 via a network. The audio distribution server 200 can be realized, for example, by a general Web server.

[0030] The playback time distribution server 300 holds the playback time data while updating it successively. The playback time data is data indicating the playback time of the audio data, and is indicated by a numerical value in units of seconds, for example. The playback time distribution server 300 itself may operate as a stopwatch and update the playback time data. The playback time distribution server 300 may also have a function of synchronizing with the playback time of a playback device that performs video playback (not shown in FIG. 1), and may update the playback time data in synchronization with the playback time of the playback device. In response to a request from the audio playback device 400, the playback time distribution server 300 distributes the playback time data it holds to the audio playback device 400 via a network. The playback time distribution server 300 can be realized, for example, by a general Web server.

[0031] The audio reproducing device 400 is, for example, an electronic device such as a smartphone terminal, a tablet terminal, a personal computer, a wearable terminal, etc. Each functional unit of the audio reproducing device 400, which will be described later, can be executed by a web browser installed in the audio reproducing device 400, etc.

[0032] When an audio playback program is started, for example, when a screen is loaded, audio playback device 400 receives playback time data from playback time distribution server 300, and receives and stores audio data from audio distribution server 200 based on the received playback time data. When audio playback device 400 detects an operation signal instructing the start of playback of audio data, such as by a user operating a button on the screen, audio playback device 400 receives playback time data from playback time distribution server 300, and starts playback of the stored audio data at the appropriate playback time based on the received playback time data.

[0033] As described above, the audio data includes listening audio data and delay adjustment audio data, which are alternately played back. When the playback time of the listening audio data reaches the length of the listening audio data, the audio playback device 400 switches the playback resource attribute to appropriate delay adjustment audio data and continues playback. When the playback time of the delay adjustment audio data reaches the length of the delay adjustment audio data, the audio playback device 400 switches the playback resource attribute to appropriate listening audio data and continues playback. When the audio playback device 400 detects an operation signal instructing playback to stop by a user operating a button on the screen during playback of the audio data, or when playback of all stored listening audio data has ended, the audio playback device 400 stops playback of the audio data.

[0034] Next, the configuration and operation of the voice data generating device 100 and the voice reproducing device 400 according to this embodiment will be described. As described above, the voice distribution server 200 and the reproduction time distribution server 300 can be realized by a general Web server, and the configuration and operation are not directly related to the present invention, so the description will be omitted. First, the configuration of the voice data generating device 100 according to this embodiment will be described.

[0035] 2 is a diagram showing an example of the configuration of the voice data generating device 100 according to this embodiment. The voice data generating device 100 can be realized by a computer such as a general-purpose computer, a dedicated computer, or a workstation.

[0036] As shown in FIG. 2, the voice data generating device 100 includes a storage unit 110 and a control unit 120.

[0037] The storage unit 110 is one or more memories. The memory is, for example, a semiconductor memory, a magnetic memory, or an optical memory, but is not limited to these and may be any memory. The storage unit 110 stores a program (audio data generation program) according to this embodiment. The audio data generation program is expanded in a RAM (Random Access Memory) not shown in FIG. 2 and operates to realize various functions of the control unit 120 described later.

[0038] The control unit 120 is one or more processors. The processor may be, for example, a general-purpose processor or a dedicated processor specialized for a specific process, but is not limited to these and may be any processor. When the control unit 120 reads and executes the audio data generating program expanded in the RAM, it operates as a delay adjustment section detection unit 121, a listening audio data generation unit 122, and a delay adjustment audio data generation unit 123. The listening audio data generation unit 122 and the delay adjustment audio data generation unit 123 constitute an audio data generation unit 124.

[0039] One or more audio materials are input to the delay adjustment interval detection unit 121. The delay adjustment interval detection unit 121 detects a silent interval in one audio material as a delay adjustment interval. The delay adjustment interval detection unit 121 also detects a silent interval between consecutive audio materials as a delay adjustment interval. As described above, a silent interval is an interval that includes at least any one of a time interval in which the amplitude of the audio signal is 0, a time interval in which the amplitude of the audio signal is smaller than the minimum audible value for humans, and a time interval that includes only an audio signal in an inaudible frequency band.

[0040] The delay adjustment interval detection unit 121 generates a delay adjustment interval identifier a indicating the start time and end time of the delay adjustment interval based on the detected delay adjustment interval. If the start time of the delay adjustment interval is t1 and the end time of the delay adjustment interval is t2, the delay adjustment interval identifier a is expressed as a value a={t1, t2}. The delay adjustment interval detection unit 121 outputs the generated delay adjustment interval identifier a to the listening sound data generation unit 122 and the delay adjustment sound data generation unit 123.

[0041] The listening audio data generating unit 122 generates listening audio data based on audio material of a section other than the delay adjustment section (hereinafter, sometimes referred to as a "listening section"). Specifically, the listening audio data generating unit 122 may generate listening audio data based on the audio material of the listening section, with the ends of the delay adjustment section (the start time and end time of the delay adjustment section) as boundaries, based on the delay adjustment section identifier a.

[0042] Furthermore, the listening audio data generating unit 122 may generate listening audio data based on the audio material of the listening section, with the vicinity of the end of the delay adjustment section as the boundary, based on the delay adjustment section identifier a. Specifically, the listening audio data generating unit 122 may generate listening audio data by including a part of the delay adjustment section in the listening section. In this case, a silent section is included in a part of the listening section. For example, the listening audio data generating unit 122 generates listening audio data by adding the audio of the silent section included in the listening section to the audio material in the listening section. For example, the listening audio data generating unit 122 generates listening audio data by adding a silent audio signal for the silent section included in the listening section to the audio material in the listening section. In addition, the listening audio data generation unit 122 sets the listening section so that the time length of the silent section (a section that is a part of the delay adjustment section) included in the listening section is shorter than the time length of a section that is not a silent section, and generates the listening audio data.

[0043] The listening audio data generating unit 122 outputs the generated listening audio data to the audio distribution server 200.

[0044] The delay adjustment audio data generating unit 123 generates silent delay adjustment audio data having a plurality of time lengths. Specifically, based on the delay adjustment interval identifier a, the delay adjustment audio data generating unit 123 generates silent delay adjustment audio data having a time length equivalent to the delay adjustment interval, with the ends of the delay adjustment interval (the start time and end time of the delay adjustment interval) as boundaries. As described above, a part of the delay adjustment interval may be included in the listening interval. In this case, the delay adjustment audio data generating unit 123 generates delay adjustment audio data having a time length equivalent to the delay adjustment interval excluding the part included in the listening interval.

[0045] Since the delay adjustment section is a silent section, there are cases where replacing delay adjustment audio data generated for a certain delay adjustment section with delay adjustment data for another delay adjustment section does not cause a problem in reproducing the audio data. In this case, the delay adjustment audio data generating unit 123 may use the delay adjustment audio data generated for a certain delay adjustment section as delay adjustment data for the other delay adjustment section. In addition, the delay adjustment audio data generating unit 123 may generate a silent audio signal by a program or the like and use it as delay adjustment audio data. In this way, the delay adjustment data for a plurality of delay adjustment sections can be made common, and the number of delay adjustment data to be generated can be reduced. As a result, the amount of audio data transferred to the audio reproduction device 400 can be reduced.

[0046] The delay adjustment audio data generating unit 123 generates delay adjustment audio data having a time length corresponding to the delay adjustment section, and further generates delay adjustment audio data having a time length obtained by increasing or decreasing the time length corresponding to the delay adjustment section. The delay adjustment audio data generating unit 123 performs processing to add and cut delay adjustment of, for example, about several hundred milliseconds to the delay adjustment audio data having a time length corresponding to the delay adjustment section, and generates additional delay adjustment audio data having a plurality of time lengths. That is, the delay adjustment audio data generating unit 123 generates delay adjustment audio data having a time length corresponding to the delay adjustment section and a time length obtained by increasing or decreasing the time length corresponding to the delay adjustment section. By generating a plurality of delay adjustment audio data having different time lengths in this way, when playing back the delay adjustment audio data, delay adjustment audio data having an appropriate time length according to the playback time delay is selected and played back, thereby making it possible to suppress the playback time delay.

[0047] By increasing the number of delay adjustment audio data with different time lengths, it becomes possible to perform delay adjustment with high accuracy, for example, to the order of several tens of milliseconds. On the other hand, as the number of delay adjustment audio data increases, the amount of data transfer to the audio reproduction device 400 increases. Therefore, the number of delay adjustment audio data to be generated may be determined according to the desired accuracy of delay adjustment and the amount of data transfer.

[0048] As described above, the listening audio data generating unit 122 and the delay adjustment audio data generating unit 123 constitute the audio data generating unit 124. Therefore, the audio data generating unit 124 generates audio data including listening audio data based on audio material in a listening section that is a section other than the delay adjustment section, and silent delay adjustment audio data having a plurality of time lengths. Here, the delay adjustment section is a silent section in one audio material, or a silent section between consecutive audio materials. Therefore, the listening section that is a section other than the delay adjustment section and the delay adjustment section are arranged alternately. Since the listening audio data is generated corresponding to the listening section and the delay adjustment audio data is generated corresponding to the delay adjustment section, the listening audio data and the delay adjustment audio data are played back alternately.

[0049] Next, the operation of the voice data generating device 100 will be described.

[0050] 3A is a diagram showing an example of audio materials input to the delay adjustment section detection unit 121. FIG. 3A shows an example in which audio materials 1 to 3 are continuously input. As shown in FIG. 3A, each of audio materials 1 to 3 has a time length of 59 seconds. Also, assume that there is a silent section of 1 second between audio material 1 and audio material 2, and between audio material 2 and audio material 3. Therefore, the section of audio material 1 is from 0 seconds to 59 seconds, the silent section is from 59 seconds to 60 seconds, the section of audio material 2 is from 60 seconds to 119 seconds, the silent section is from 119 seconds to 120 seconds, and the section of audio material 3 is from 120 seconds to 179 seconds.

[0051] FIG. 3B is a diagram showing an example of the detection result of delay adjustment section detection section 121 when the audio material shown in FIG. 3A is input.

[0052] The delay adjustment interval detection unit 121 detects a silent interval as a delay adjustment interval. In the example shown in FIG. 3A, the silent intervals are from 59 seconds to 60 seconds and from 119 seconds to 120 seconds. When the delay adjustment interval detection unit 121 detects these silent intervals as delay adjustment intervals, it outputs a delay adjustment interval identifier a indicating the start time and end time of the detected delay adjustment interval. As shown in FIG. 3B, the delay adjustment interval detection unit 121 generates a delay adjustment interval identifier a1={59,60} indicating the delay adjustment interval from 59 seconds to 60 seconds and a delay adjustment interval identifier a2={119,120} indicating the delay adjustment interval from 119 seconds to 120 seconds. The delay adjustment interval detection unit 121 outputs the generated delay adjustment interval identifiers a1 and a2 to the listening audio data generation unit 122 and the delay adjustment audio data generation unit 123.

[0053] FIG. 3C is a diagram showing an example of listening audio data generated by listening audio data generating section 122 when the audio material shown in FIG. 3A is input.

[0054] The listening audio data generating unit 122 generates listening audio data based on the delay adjustment interval identifiers a1 and a2, with the ends (start time and end time) of the delay adjustment interval as boundaries. In the example shown in Fig. 3C, the listening audio data generating unit 122 uses {0,59} seconds of audio material 1 as listening audio data 1 as it is, {60,119} seconds of audio material 2 as listening audio data 2 as it is, and {120,179} seconds of audio material 3 as listening audio data 3 as it is.

[0055] FIG. 3D is a diagram showing an example of delay adjustment audio data generated by the delay adjustment audio data generating unit 123 when the audio material shown in FIG. 3A is input.

[0056] The delay adjustment audio data generation unit 123 generates delay adjustment audio data based on the delay adjustment interval identifiers a1 and a2, with the ends (start time and end time) of the delay adjustment interval as boundaries. In the example shown in Fig. 3D, the delay adjustment audio data generation unit 123 generates delay adjustment audio data 1 for a time interval of {59, 60} seconds by generating silent audio material using a program or the like. In other words, the delay adjustment audio data generation unit 123 generates delay adjustment audio data 1 having a time length equivalent to the delay adjustment interval indicated by the delay adjustment interval identifier a1.

[0057] Also, as shown in FIG. 3D, the delay adjustment audio data generation unit 123 generates delay adjustment audio data 2 of a time interval of {59, 60.5} seconds (delay adjustment audio data 2 having a time length of 1.5 seconds) by adding a delay adjustment of 0.5 seconds to delay adjustment audio data 1 having a time length of 1 second.

[0058] Also, as shown in FIG. 3D, the delay adjustment audio data generation unit 123 generates delay adjustment audio data 3 of a time interval of {59,59.5} seconds (delay adjustment audio data 3 having a time length of 0.5 seconds) by cutting out a delay adjustment of 0.5 seconds from delay adjustment audio data 1 having a time length of 1 second.

[0059] In this way, the delay adjustment audio data generating unit 123 generates delay adjustment audio data 1 to 3 having a time length corresponding to the delay adjustment interval and a time length obtained by increasing or decreasing the time length corresponding to the delay adjustment interval.

[0060] 3A to 3D, the delay adjustment section indicated by the delay adjustment section identifier a1 and the delay adjustment section indicated by the delay adjustment section identifier a2 have the same time length. In this case, the delay adjustment audio data generated for the delay adjustment section indicated by the delay adjustment section identifier a1 may be used as the delay adjustment audio data for the delay adjustment section indicated by the delay adjustment section identifier a2. This can reduce the amount of data transferred to the audio reproduction device 400.

[0061] Next, another example of the operation of the voice data generating device 100 will be described.

[0062] Fig. 4A is a diagram showing another example of an audio material input to the delay adjustment section detection unit 121. Fig. 4A shows an example in which audio material 1 is input. As shown in Fig. 4A, audio material 1 has a time length of 300 seconds. Assume that audio material 1 has silent sections of 10 seconds from 50 seconds to 60 seconds, 30 seconds from 120 seconds to 150 seconds, and 10 seconds from 240 seconds to 250 seconds.

[0063] FIG. 4B is a diagram showing an example of the detection result of delay adjustment section detection section 121 when the audio material shown in FIG. 4A is input.

[0064] The delay adjustment interval detection unit 121 detects silent intervals as delay adjustment intervals. As described above, the silent intervals are from 50 seconds to 60 seconds, from 120 seconds to 150 seconds, and from 240 seconds to 250 seconds. When the delay adjustment interval detection unit 121 detects these silent intervals as delay adjustment intervals, it outputs a delay adjustment interval identifier a indicating the start time and end time of the detected delay adjustment interval. As shown in FIG. 4B, the delay adjustment interval detection unit 121 generates a delay adjustment interval identifier a1={50,60} indicating a delay adjustment interval from 50 seconds to 60 seconds, a delay adjustment interval identifier a2={120,150} indicating a delay adjustment interval from 120 seconds to 150 seconds, and a delay adjustment interval identifier a3={240,250} indicating a delay adjustment interval from 240 seconds to 250 seconds. The delay adjustment section detection section 121 outputs the generated delay adjustment section identifiers a1, a2, and a3 to the listening sound data generation section 122 and the delay adjustment sound data generation section 123.

[0065] FIG. 4C is a diagram showing an example of listening audio data generated by listening audio data generating section 122 when the audio material shown in FIG. 4A is input.

[0066] The listening audio data generating unit 122 generates listening audio data based on the delay adjustment interval identifiers a1, a2, and a3, with the ends (start time and end time) of the delay adjustment interval as boundaries. In the example shown in Fig. 4C, the listening audio data generating unit 122 generates listening audio data with time intervals of {0,50}, {60,130}, {140,240}, and {250,300} seconds as listening intervals. That is, the listening audio data generating unit 122 includes the interval from 120 seconds to 130 seconds in the delay adjustment interval indicated by the delay adjustment interval identifier a2 = {120,150} in the listening interval before the delay adjustment interval. Furthermore, the listening sound data generating unit 122 includes the section from 140 seconds to 150 seconds of the delay adjustment section indicated by the delay adjustment section identifier a2={120, 150} in the listening section following the delay adjustment section.

[0067] Then, the listening audio data generating unit 122 generates listening audio data based on the audio material in the listening section. Therefore, in the example shown in Fig. 4C, the listening audio data generating unit 122 divides the audio material 1 into four time sections of {0,50}, {60,130}, {140,240}, and {250,300} seconds, and generates listening audio data 1 to 4.

[0068] FIG. 4D is a diagram showing an example of delay adjustment audio data generated by the delay adjustment audio data generating section 123 when the audio material shown in FIG. 4A is input.

[0069] The delay adjustment audio data generation unit 123 generates delay adjustment audio data based on the delay adjustment interval identifiers a1, a2, and a3, with the ends (start time and end time) of the delay adjustment interval or their vicinity as boundaries. In the example shown in Fig. 4D, the delay adjustment audio data generation unit 123 generates delay adjustment audio data 1 having a time length of 10 seconds ({50, 60} seconds), which corresponds to the delay adjustment interval indicated by the delay adjustment interval identifier a1.

[0070] Also, as shown in FIG. 4D, the delay adjustment audio data generation unit 123 generates delay adjustment audio data 2 of a time interval of {50, 60.5} seconds (delay adjustment audio data 2 having a time length of 10.5 seconds) by adding a delay adjustment of 0.5 seconds to delay adjustment audio data 1 having a time length of 10 seconds.

[0071] Also, as shown in FIG. 4D, the delay adjustment audio data generation unit 123 generates delay adjustment audio data 3 of a time interval of {50, 59.5} seconds (delay adjustment audio data 3 having a time length of 9.5 seconds) by cutting out a delay adjustment of 0.5 seconds from delay adjustment audio data 1 having a time length of 10 seconds.

[0072] In the example shown in Figures 4A to 4D, the delay adjustment section indicated by the delay adjustment section identifier a2 = {120, 150} includes the section from 120 seconds to 130 seconds and the section from 140 seconds to 150 seconds in the delay adjustment section. In other words, 20 seconds of the 30-second silent section indicated by the delay adjustment section identifier a2 are included in the listening section, so the remaining silent section is 10 seconds. In this case, the delay adjustment audio data generating unit 123 can use delay adjustment audio data 1 to 3 having a time length of 9.5 seconds to 10.5 seconds, which were created for the delay adjustment section indicated by the delay adjustment section identifier a1, as delay adjustment data for the delay adjustment section indicated by the delay adjustment section identifier a2.

[0073] In this way, by generating audio data (listening audio data and delay adjustment audio data) by including a part of the delay adjustment section in the listening section, the delay adjustment audio data for a plurality of delay adjustment sections can be standardized, and the amount of delay adjustment audio data to be generated can be reduced. As a result, the amount of audio data transferred to the audio reproduction device 400 can be reduced.

[0074] Next, the configuration and operation of the audio reproduction device 400 according to this embodiment will be described.

[0075] FIG. 5 is a diagram showing an example of the configuration of an audio reproduction device 400 according to this embodiment.

[0076] As shown in FIG. 5, the audio reproduction device 400 according to this embodiment includes a storage unit 410, an interface unit 420, and a control unit 430.

[0077] The storage unit 410 is one or more memories. The memory is, for example, a semiconductor memory, a magnetic memory, or an optical memory, but is not limited to these and may be any memory. The storage unit 410 stores a program (audio playback program) according to this embodiment. The audio playback program is expanded in a RAM (not shown in FIG. 5) and operates to realize various functions of the control unit 430, which will be described later.

[0078] The interface unit 420 includes an input interface unit 421 , a communication interface unit 422 , and an output interface unit 423 .

[0079] The input interface unit 421 outputs an operation signal to the control unit 430 to instruct the start of an audio playback program, for example, when reading a screen. The input interface unit 421 also outputs an operation signal to the control unit 430 to instruct the start of an audio playback program, for example, in response to reading a QR code (registered trademark) or the like. The input interface unit 421 also outputs an operation signal to the control unit 430 to instruct the start or stop of playback of audio data, which is caused by a user operating a button on the screen, for example.

[0080] The communication interface unit 422 communicates with the audio distribution server 200 and the playback time distribution server 300 via the network. The communication interface unit 422 transmits a playback time data request input from the control unit 430 to the playback time distribution server 300, and transmits an audio data request input from the control unit 430 to the audio distribution server 200. The communication interface unit 422 receives playback time data from the playback time distribution server 300 and outputs it to the control unit 430. The communication interface unit 422 receives audio data from the audio distribution server 200 and outputs it to the control unit 430.

[0081] The output interface unit 423 reproduces the audio signal input from the control unit 430 using an audio output device such as a speaker provided in the audio reproduction device 400 or a headphone connected to the audio reproduction device 400. Note that the output interface unit 423 may be separated from the audio reproduction device 400, and the audio signal may be reproduced by another audio output device via the communication interface unit 422.

[0082] The control unit 430 receives an operation signal from the input interface unit 421, which instructs the start of an audio playback program, for example, in response to reading a screen or reading a QR code (registered trademark) or the like. The control unit 430 also receives an operation signal from the input interface unit 421, which instructs the start or stop of playback of audio data, for example, due to a user operating a button on the screen.

[0083] The control unit 430 also transmits and receives playback time data requests and playback time data to and from the playback time distribution server 300 via the communication interface unit 422. The control unit 430 also transmits and receives audio data requests and audio data to and from the audio distribution server 200 via the communication interface unit 422.

[0084] The control unit 430 is one or more processors. The processor may be, for example, a general-purpose processor or a dedicated processor specialized for a specific process, but is not limited to these and may be any processor. When the control unit 430 reads and executes the audio playback program expanded in the RAM, it operates as a playback status monitoring unit 431, a playback time data request unit 432, a playback time data receiving unit 433, a requested data determination unit 434, an audio data request unit 435, an audio data receiving unit 436, an audio data storage unit 437, a playback data determination unit 438, and a playback processing unit 439.

[0085] The playback status monitoring unit 431 monitors the playback status of the audio data in the audio playback device 400, and generates playback status data indicating the monitoring result. The playback status data includes, for example, a playback completion status indicating that the playback time of the audio data has reached the length of the audio data. The playback status data also includes, for example, a playback time delay status indicating the difference (playback time delay) between the real time to an arbitrary playback position of the audio data and the elapsed playback time elapsed from the start of playback of the audio data to the playback position. In other words, the playback status monitoring unit 431 monitors the playback time delay, which is the difference between the real time to an arbitrary playback position of the audio data and the elapsed playback time from the start of playback of the audio data to the playback position.

[0086] In the following, the playback time delay status is a positive value when the elapsed playback time is delayed compared to the real time, and a negative value when the elapsed playback time is ahead of the real time. For example, if the playback time delay status is +0.4 seconds, it indicates that the elapsed playback time is 0.4 seconds behind the real time. Also, if the playback time delay status is -0.01 seconds, it indicates that the elapsed playback time is 0.01 seconds ahead of the real time.

[0087] The playback status monitoring unit 431 outputs the generated playback status data to the requested data determining unit 434 and the playback data determining unit 438 .

[0088] When an operation signal instructing the start of an audio playback program or an operation signal instructing the start or stop of playback of audio data is input from the input interface unit 421, the playback time data request unit 432 sends a playback time data request to the playback time distribution server 300 via the communication interface unit 422.

[0089] The playback time data receiving unit 433 receives the playback time data transmitted from the playback time distribution server 300 in response to the playback time data request via the communication interface unit 422. The playback time data receiving unit 433 outputs the received playback time data to the requested data determining unit 434 and the playback data determining unit 438.

[0090] The requested data determination unit 434 generates a requested data identifier for identifying the audio data to be acquired from the audio distribution server 200, based on the playback time data input from the playback time data receiving unit 433 or the playback status data input from the playback status monitoring unit 431. As described above, the audio data distributed from the audio distribution server 200 includes listening audio data and delay adjustment audio data. The requested data determination unit 434 may request the listening audio data and delay adjustment audio data from the playback time indicated by the playback time data onward all at once from the audio distribution server 200, or may request them successively during playback of the audio data. The requested data determination unit 434 outputs the generated requested data identifier to the audio data request unit 435.

[0091] When the requested data identifier is input from the requested data determination unit 434, the audio data request unit 435 transmits an audio data request via the communication interface unit 422 to the audio distribution server 200, requesting distribution of the audio data indicated in the requested data identifier.

[0092] The audio data receiving unit 436 receives the audio data (audio data for listening and audio data for delay adjustment) transmitted from the audio distribution server 200 in response to the audio data request via the communication interface unit 422. The audio data receiving unit 436 outputs the received audio data to the audio data storage unit 437.

[0093] The audio data storage unit 437 stores the audio data input from the audio data receiving unit 436 in a memory area in the audio playback device 400. In response to a request from the playback processing unit 439, the audio data storage unit 437 outputs to the playback processing unit 439 the audio data corresponding to the request.

[0094] The playback data determination unit 438 generates a playback data identifier that identifies the audio data to be played back and a playback position setting value that identifies the playback time in the audio data to be played back, based on the playback time data input from the playback time data receiving unit 433 or the playback status data input from the playback status monitoring unit 431. The playback data determination unit 438 outputs the generated playback data identifier and playback position setting value to the playback processing unit 439.

[0095] When an operation signal instructing to start reproducing audio data is input from the input interface unit 421, the reproduction processing unit 439 acquires audio data indicated by the reproduction data identifier input from the reproduction data determination unit 438 from the audio data storage unit 437. The reproduction processing unit 439 generates an audio signal for reproducing the audio data acquired from the audio data storage unit 437 from the reproduction time indicated by the reproduction position setting value, and outputs the generated audio signal to the output interface unit 423. As described above, the audio data includes listening audio data and delay adjustment audio data, which are reproduced alternately. The reproduction processing unit 439 outputs an audio signal to the output interface unit 423 such that the listening audio data and the delay adjustment audio data are reproduced alternately. Furthermore, when an operation signal instructing to stop reproducing the audio data is input from the input interface unit 421, the reproduction processing unit 439 stops outputting the audio signal to the output interface unit 423.

[0096] Next, the operation of the reproduction data determination unit 438 will be described in more detail. First, the operation of the reproduction data determination unit 438 when reproduction time data is input will be described with reference to Figs. 6A to 6C. In Figs. 6A to 6C, it is assumed that the listening audio data 1 to 3 and the delay adjustment audio data 1 to 3 described with reference to Figs. 3C and 3D have been generated.

[0097] FIG. 6A is a diagram for explaining the operation of playback data determination section 438 when playback time data indicating a playback time 40 seconds after the start of audio data (playback time data=40) is input.

[0098] As shown in Fig. 6A, the time indicated by the playback time data = 40 is included in the time interval of the listening audio data 1. Therefore, the playback data determination unit 438 generates a playback data identifier (playback data identifier = listening audio data 1) indicating that the playback data is the listening audio data 1 indicated by the white arrow in Fig. 6A. In addition, the playback data determination unit 438 subtracts the start time = 0 of the listening audio data 1 from the playback time data = 40 to generate a playback position setting value = 40 indicating that playback will start from a position 40 seconds after the start of the listening audio data 1.

[0099] FIG. 6B is a diagram for explaining the operation of playback data determination section 438 when playback time data indicating a playback time 59.5 seconds after the start of audio data (playback time data=59.5) is input.

[0100] As shown in Fig. 6B, the time indicated by the playback time data = 59.5 is included in the time interval of the delay adjustment audio data 1. Therefore, the playback data determination unit 438 generates a playback data identifier (playback data identifier = delay adjustment audio data 1) indicating that the playback data is the delay adjustment audio data 1 indicated by the white arrow in Fig. 6B. In addition, the playback data determination unit 438 subtracts the start time = 59 of the delay adjustment audio data 1 from the playback time data = 59.5 to generate a playback position setting value = 0.5 indicating that playback will start from a position 0.5 seconds after the start of the delay adjustment audio data 1.

[0101] FIG. 6C is a diagram for explaining the operation of playback data determination section 438 when playback time data indicating a playback time 70 seconds after the start of audio data (playback time data=70) is input.

[0102] As shown in Fig. 6C, the time indicated by the playback time data = 70 is included in the time interval of the listening audio data 2. Therefore, the playback data determination unit 438 generates a playback data identifier (playback data identifier = listening audio data 2) indicating that the playback data is the listening audio data 2 indicated by the white arrow in Fig. 6C. In addition, the playback data determination unit 438 subtracts the start time = 60 of the listening audio data 2 from the playback time data = 70, and generates a playback position setting value = 10 indicating that playback will start from a position 10 seconds after the start of the delay adjustment audio data 2.

[0103] Next, the operation of the playback data determination unit 438 when the playback of the listening audio data ends and the playback resource attribute (playback target) is switched to the delay adjustment audio data will be described with reference to Figs. 7A and 7B. In the following, the case where the playback of the listening audio data ends at the playback time data = 59 and the playback resource attribute is switched to the delay adjustment audio data will be described as an example.

[0104] FIG. 7A is a diagram for explaining the operation of playback data determination section 438 when playback status data indicating a playback time delay of −0.01 seconds is input.

[0105] The playback data determination unit 438 compares the absolute value of the playback time delay with a predetermined threshold. In FIG. 7A, the absolute value of the playback time delay (0.01) is assumed to be equal to or less than the predetermined threshold. The predetermined threshold is an arbitrary value, but when a delay adjustment of 500 milliseconds (0.5 seconds) is added or cut as described with reference to FIG. 3D, a value of about 250 milliseconds (0.25 seconds), which is half the delay adjustment, may be set. By preparing delay adjustment audio data to which a delay adjustment has been added or cut, the playback time delay can be suppressed by the amount of the delay adjustment. When the absolute value of the playback time delay is smaller than the delay adjustment, if an attempt is made to adjust the playback time delay using delay adjustment audio data to which a delay adjustment has been added or cut, the playback time delay may become large. Therefore, it is desirable to set the predetermined threshold to a value about half the delay adjustment.

[0106] When the playback data determination unit 438 determines that the absolute value of the playback time delay is equal to or less than a predetermined threshold, it determines the delay adjustment audio data 1, indicated by the white arrow in Fig. 7A, for which no delay adjustment has been added or cut, as the next playback data. Then, the playback data determination unit 438 generates a playback data identifier (playback data identifier = delay adjustment audio data 1) indicating that the playback data is delay adjustment audio data 1. In addition, the playback data determination unit 438 subtracts the start time = 59 of the delay adjustment audio data 1 from the playback time data = 59, and generates a playback position setting value = 0 indicating that the delay adjustment audio data 1 is to be played back from the beginning.

[0107] FIG. 7B is a diagram for explaining the operation of playback data determination section 438 when playback status data indicating a playback time delay of +0.4 seconds is input.

[0108] The playback data determination unit 438 compares the absolute value of the playback time delay with a predetermined threshold value. In Fig. 7B, the predetermined threshold value is, for example, 250 milliseconds (0.25 seconds), and the absolute value of the playback time delay is greater than the predetermined threshold value.

[0109] When the playback data determination unit 438 determines that the absolute value of the playback time delay is greater than the predetermined threshold, the playback time delay is a positive value (i.e., the playback elapsed time is ahead of the real time), so it determines the delay adjustment audio data 3, which has been subjected to a process of cutting out the delay adjustment from the delay adjustment audio data 1, as the next playback data, as indicated by the outlined arrow in Fig. 7B. Then, the playback data determination unit 438 generates a playback data identifier (playback data identifier = delay adjustment audio data 3) indicating that the playback data is the delay adjustment audio data 3. In addition, the playback data determination unit 438 subtracts the start time = 59 of the delay adjustment audio data 3 from the playback time data = 59, and generates a playback position setting value = 0 indicating that the delay adjustment audio data 3 is to be played from the beginning.

[0110] In this way, the playback data determination unit 438 determines delay adjustment audio data having a time length corresponding to the playback time delay as delay adjustment audio data to be played back after the playback of the listening audio data is completed. In this way, the playback time of the delay adjustment audio data is adjusted, and as a result, the playback time delay can be suppressed. In addition, in this embodiment, the playback time delay is suppressed by selecting delay adjustment audio data to be played back according to the playback time delay from among delay adjustment audio data having a plurality of time lengths, so that there is no need to change the playback speed or playback position in the audio playback device 400. Therefore, according to the present disclosure, the playback time delay can be suppressed without changing the playback speed or playback position.

[0111] Fig. 8 is a flowchart showing an example of the operation of the audio reproducing device 400 according to this embodiment. In Fig. 8, an example of the operation of the audio reproducing device 400 starting from an input to the input interface unit 421 is shown.

[0112] In the standby state, the input interface unit 421 acquires an operation signal in response to a predetermined operation input by the user (step S11). The operation signal is, for example, an operation signal instructing the start of an audio playback program, or an operation signal instructing the start or stop of playback of audio data. The input interface unit 421 outputs the acquired operation signal to the control unit 430.

[0113] The control unit 430 determines the content of the operation signal (step S12).

[0114] When the content of the operation signal is an instruction to start an audio playback program (step S12: start program), the control unit 430 (playback time data request unit 432) transmits a playback time data request to the playback time distribution server 300. The control unit 430 (playback time data receiving unit 433) acquires (receives) the playback time data transmitted from the playback time distribution server 300 in response to the playback time data request (step S13).

[0115] Based on the playback time data, control unit 430 (request data determination unit 434) generates a request data identifier that identifies the voice data to be obtained from voice distribution server 200. Control unit 430 (voice data request unit 435) transmits a voice data request to voice distribution server 200 in accordance with the request data identifier. Control unit 430 (voice data receiving unit 436) acquires (receives) the voice data transmitted from voice distribution server 200 in response to the voice data request (step S14) and stores it in voice data accumulation unit 437. After storing the voice data, voice playback device 400 returns to a standby state.

[0116] When the content of the operation signal instructs the start of playback of audio data (step S12: start playback), the control unit 430 (playback time data request unit 432) transmits a playback time data request to the playback time distribution server 300. The control unit 430 (playback time data receiving unit 433) acquires (receives) the playback time data transmitted from the playback time distribution server 300 in response to the playback time data request (step S15).

[0117] The control unit 430 (playback data determination unit 438) generates a playback data identifier that identifies the playback data to be played back, based on the playback time data. The control unit 430 (playback processing unit 439) acquires the corresponding audio data from the audio data storage unit 437 according to the playback data identifier, and generates an audio signal for playing back the audio from the playback time indicated by the playback position setting value. The control unit 430 (playback processing unit 439) outputs the generated audio signal to the output interface 23, and starts playing the audio data (step S16). After that, the audio playback device 400 returns to the standby state.

[0118] If the operation signal indicates an instruction to stop playing the audio data (step S12: stop playing), the control unit 430 (playback processing unit 439) stops outputting the audio signal to the output interface unit 423 and stops playing the audio data (step S17). After that, the audio playback device 400 returns to the standby state.

[0119] Fig. 9 is a flowchart showing another example of the operation of the audio reproduction device 400 according to this embodiment. Fig. 9 shows an example of the operation of the audio reproduction device 400 starting from the result of monitoring the playback status by the playback status monitoring unit 431.

[0120] The control unit 430 (playback status monitoring unit 431) monitors the playback status of the audio data by the audio playback device 400, and acquires playback status data (step S21). The playback status data indicates, for example, a shortage of audio data required for playback, the end of the audio data being played, or the end of playback of all the audio data to be listened to.

[0121] The control unit 430 judges the content of the playback status data (step S22).

[0122] If the playback status data indicates a lack of audio data necessary for playback (step S22: lack of audio data), control unit 430 (request data determination unit 434) generates a request data identifier that identifies the audio data to be acquired from audio distribution server 200 according to the playback status data. Control unit 430 (audio data request unit 435) transmits an audio data request to audio distribution server 200 according to the request data identifier. Control unit 430 (audio data receiving unit 436) acquires (receives) the audio data transmitted from audio distribution server 200 in response to the audio data request (step S23) and stores it in audio data accumulation unit 437. After storing the audio data, audio playback device 400 returns to a standby state.

[0123] When the playback status data indicates the end of playback of the audio data being played (step S22: end of playback of the audio data being played), the control unit 430 (playback data determination unit 438) switches the audio data to be played (step S24). Specifically, the control unit 430 (playback data determination unit 438) generates a playback data identifier that identifies the audio data to be played back after the audio data that has finished playing.

[0124] Here, when switching the playback resource attribute from the listening audio data to the delay adjustment audio data, the control unit 430 (playback data determination unit 438) selects the delay adjustment audio data according to the playback time delay based on the playback status data indicating the playback time delay. For example, the playback data determination unit 438 determines the delay adjustment audio data that can minimize the playback delay time among the delay adjustment audio data having a plurality of time lengths as the audio data to be played next to the listening audio data.

[0125] The control unit 430 (playback processing unit 439) acquires the corresponding audio data from the audio data storage unit 437 according to the playback data identifier, and generates an audio signal for playing the audio from the playback time indicated by the playback position setting value. The control unit 430 (playback processing unit 439) outputs the generated audio signal to the output interface 23, and plays the audio data. After that, the audio playback device 400 returns to the standby state.

[0126] If the playback status data indicates that playback of all the audio data for listening has ended (step S22: playback of all the audio data for listening has ended), the control unit 430 (playback processing unit 439) stops outputting the audio signal to the output interface 23 and stops the playback of the audio data (step S25). After that, the audio playback device 400 returns to the standby state.

[0127] As described above, the audio data generating device 100 according to this embodiment includes a delay adjustment interval detection unit 121 and an audio data generation unit 124. The delay adjustment interval detection unit 121 detects silent intervals in one audio material and silent intervals between consecutive audio materials as delay adjustment intervals. The audio data generation unit 124 generates audio data including listening audio data based on audio materials in listening intervals that are intervals other than the delay adjustment intervals, and silent delay adjustment audio data having a plurality of time lengths, in which the listening audio data and the delay adjustment audio data are played back alternately.

[0128] Moreover, the audio playback device 400 according to this embodiment includes a playback processing unit 439, a playback status monitoring unit 431, and a playback data determination unit 438. The playback processing unit 439 alternately plays back the listening audio data and the delay adjustment audio data. The playback status monitoring unit 431 monitors the playback time delay, which is the difference between the actual time up to an arbitrary playback position of the audio data and the playback elapsed time from the start of playback of the audio data to the playback position. The playback data determination unit 438 determines the delay adjustment audio data having a time length corresponding to the playback time delay as the delay adjustment audio data to be played back after the playback of the listening audio data ends.

[0129] A delay in playback time can be suppressed by preparing delay adjustment audio data having a plurality of time lengths and determining delay adjustment audio data having a time length corresponding to the playback time delay as delay adjustment audio data to be played back after playback of listening audio data is completed. In addition, in this embodiment, since delay adjustment audio data to be played back according to the playback time delay is determined from delay adjustment audio data having a plurality of time lengths, there is no need to change the playback speed or playback position in the audio playback device 400. Therefore, according to the present disclosure, a playback time delay can be suppressed without changing the playback speed or playback position.

[0130] Although not specifically mentioned in the embodiments, a program for causing a computer to operate as the audio data generating device 100 or the audio reproducing device 400 may be provided. The program may also be recorded in a computer-readable medium. The computer-readable medium can be used to install the program in a computer. Here, the computer-readable medium on which the program is recorded may be a non-transient recording medium. The non-transient recording medium is not particularly limited, and may be, for example, a recording medium such as a CD-ROM or a DVD-ROM.

[0131] Alternatively, a chip may be provided which is configured with a memory that stores programs for executing each process performed by the audio data generating device 100 or the audio reproducing device 400, and a processor that executes the programs stored in the memory, and is mounted on the audio data generating device 100 or the audio reproducing device 400.

[0132] Although the above-mentioned embodiment has been described as a representative example, it is clear to those skilled in the art that many modifications and substitutions are possible within the spirit and scope of the present invention. Therefore, the present invention should not be interpreted as being limited by the above-mentioned embodiment, and various modifications and changes are possible without departing from the scope of the claims. For example, it is possible to combine multiple building blocks shown in the configuration diagram of the embodiment into one, or to divide one building block. [Explanation of symbols]

[0133] 10 Audio playback system 100 Voice data generating device 110 Storage section 120 Control section 121 Delay adjustment section detection unit 122 Listening voice data generation unit 123 Delay adjustment audio data generator 124 Voice data generation unit 200 Audio distribution server 300 Playback time distribution server 400 Audio playback device 410 Storage section 420 Interface section 421 Input Interface Section 422 Communication Interface Unit 423 Output Interface Section 430 Control Unit 431 Playback Status Monitoring Unit 432 Playback time data request section 433 Playback time data receiving unit 434 Request Data Determination Unit 435 Voice Data Request Section 436 Voice data receiving unit 437 Voice Data Storage Unit 438 Playback Data Determination Unit 439 Regeneration Processing Unit

Claims

1. A voice data generating device for generating voice data from one or more voice materials, comprising: a delay adjustment interval detection unit that detects a silent interval in one of the audio materials and a silent interval between consecutive audio materials as a delay adjustment interval; An audio data generating device comprising: an audio data generating unit that generates audio data including listening audio data based on audio material in a listening section which is a section other than the delay adjustment section, and silent delay adjustment audio data having a plurality of time lengths, in which the listening audio data and the delay adjustment audio data are played back alternately.

2. 2. The audio data generating device according to claim 1, wherein the plurality of time lengths include a time length corresponding to the delay adjustment section and time lengths obtained by increasing or decreasing the time length corresponding to the delay adjustment section.

3. The audio data generating device according to claim 1 , wherein the audio data generating section generates the audio data by including a part of the delay adjustment section in the listening section.

4. 2. The audio data generating device of claim 1, wherein the silent section includes at least one of a time section in which the amplitude of the audio signal is zero, a time section in which the amplitude of the audio signal is smaller than the minimum audible value for humans, and a time section including only an audio signal in an inaudible frequency band.

5. An audio playback device that plays back audio data generated from one or more audio materials, comprising: the audio data includes listening audio data based on an audio material of a listening section other than a delay adjustment section, which is a silent section in one of the audio materials and a silent section between consecutive audio materials, and silent delay adjustment audio data having a plurality of time lengths; a reproduction processing unit that alternately reproduces the listening audio data and the delay adjustment audio data; a playback status monitoring unit that monitors a playback time delay, which is a difference between an actual time up to an arbitrary playback position of the audio data and an elapsed playback time from the start of playback of the audio data up to the arbitrary playback position; a playback data determination unit that determines delay adjustment audio data having a time length corresponding to the playback time delay as the delay adjustment audio data to be played back after playback of the listening audio data is completed.

6. 1. A sound reproduction system including: a sound data generation device that generates sound data from one or more sound materials; and a sound reproduction device that reproduces the sound data, The audio data generating device comprises: a delay adjustment interval detection unit that detects a silent interval in one of the audio materials and a silent interval between consecutive audio materials as a delay adjustment interval; a sound data generating unit that generates sound data including listening sound data based on sound material in a listening section that is a section other than the delay adjustment section, and silent delay adjustment sound data having a plurality of time lengths, the listening sound data and the delay adjustment sound data being reproduced alternately; The audio reproduction device includes: a reproduction processing unit that alternately reproduces the listening audio data and the delay adjustment audio data; a playback status monitoring unit that monitors a playback time delay, which is a difference between an actual time up to an arbitrary playback position of the audio data and an elapsed playback time from the start of playback of the audio data up to the arbitrary playback position; a playback data determination unit that determines delay adjustment audio data having a time length corresponding to the playback time delay as the delay adjustment audio data to be played back after playback of the listening audio data is completed.

7. A program for causing a computer to operate as the voice data generating device according to claim 1.

8. A program for causing a computer to operate as the audio reproducing device according to claim 5.

Images