Method for real-time transcription of a continuous audio
data stream (1) from an
internet radio station into text, by a
server (2), and for playing back the audio
data stream and time-synchronously displaying the transcribed text on an end device (3, 3-1, 3-2, 3-3), wherein the
server (2) performs the following steps: Retrieving a continuous audio
data stream (1) from
the internet radio
station; Extracting or generating (15) time-sequential audio bit data sets (ABD), for example as WAV files, from the continuous audio data
stream (1); Determining (21) split time points (Z) within the audio bit data sets (ABD), wherein each split time point (Z) specifies a time of a pause between sentences or words, using an initial AI model to detect
sentence pauses and speech pauses between words; Assembling (23) successive audio bit data sets (ABD) into a respective audio
data chunk (AC), the
start time and end time of which are determined by a respective split time (AZ) such that the
start time of a currently assembled audio
data chunk (AC) is prior to an end time of an earlier assembled and temporally adjacent audio
data chunk (AC), and the temporally adjacent audio data chunks (AC) overlap with a predetermined minimum buffer length (PL), in particular a buffer length of at least one audio bit
data set (ABD); Transcribing (24) a respective audio data chunk (AC) into an associated transcript chunk (TC) using a second, in particular generative, AI model for transcription, wherein the second AI model is more complex than the first AI model, wherein a respective transcript chunk (TC) specifies a language contained in the audio data chunk (AC) as text annotated with
time information, wherein the text is represented as segments and The token is specified, and the
time information specifies the start and end time of each segment or token in the audio data chunk; Filtering out overlapping duplicate text from a given transcript chunk (TC) to obtain a non-overlapping transcript chunk (TC); Transmitting each non-overlapping transcript chunk (TC) as the current part of a time-annotated text data
stream to the terminal (3, 3-1, 3-2, 3-3); and Transmitting the continuous audio data
stream as temporally sequential audio data segments (ADS1, ADS2), wherein the audio data segments contain information about their occurrence times from the start of the audio data stream, where the terminal (3, 3-1, 3-2, 3-3) performs the following steps: Receiving the temporally sequential audio data segments (ADS1, ADS2) as an audio data stream from the
server (2); Receiving the transcript chunks (TC) as a text data stream from the server (2); Playing back the audio data stream and time-synchronized display of a text from the text data stream, wherein the relative start and end times of segments and tokens stored in the transcript chunks (TC) are converted into absolute start and end times with reference to the start of the audio data stream, and the terminal device (3, 3-1, 3-2, 3-3) displays a respective transcript chunk segment at the
occurrence time of an audio
data segment and preferably highlights a respective token in the displayed segment if its absolute
start time is before and its absolute end time is after the
occurrence time.