Method and device for processing and transmitting a video stream

Abstract

The invention relates to a method, in particular a computer-implemented method, for processing a video stream stored in an image memory and transmitting the video stream to a display interface of a display of a vehicle, comprising: (i) performing signal sampling of the video stream, which is present with a first frame rate, the video stream being composed of first images (100), each first image (100) having pixels which are arranged in columns (115, 125) and rows, the columns on the one hand and the rows on the other hand being consecutively numbered with integer consecutive numerical values; (ii) generating two fields (110, 120) of each first image (100) using the signal-sampled video stream, (ii-1) wherein a first field (110) of the two fields has first columns (115) with odd numbers of the consecutive numerical values, and (ii-2) a second field (120) of the two fields has second columns (125) with even numbers of the consecutive numerical values, wherein, between adjacent first columns (115) and between adjacent second columns (125), an empty column is arranged in each case; (iii) generating a first marker row (130) which has a coding for each column (115) which is denoted by an odd number and for each empty column lying therebetween; (iv) generating a second marker row (140) which has a coding for each column (125) which is denoted by an even number and for each empty column lying therebetween; (v) transferring the first field (110) with the first marker row (130) and the second field (120) with the second marker row (140) to the display interface.

Description

[0001] METHOD AND DEVICE FOR PROCESSING AND TRANSFERRING

[0002] A VIDEO STREAM

[0003] The present invention relates to a method, particularly a computer-implemented method, and a device for processing and transmitting a video stream. The invention further relates to a motor vehicle and a computer program.

[0004] During the data transmission of a video stream, large amounts of image information or image data are transmitted per unit of time, i.e., data rates. It can happen that individual electrical and / or electronic components along the transmission path are not designed for the high data rates typical of video streams. Therefore, it is common practice to divide the image data of each frame of the video stream into two fields and transmit them as fields, with each field consisting of lines of the image. The fields contain line breaks. This means, for example, that the first field has an even number of lines, and the second field has an odd number of lines.The first and second fields are then combined at the receiving device, for example a television or laptop computer, to create a full frame with twice the number of lines of a single field, i.e., from the first and second fields. When the fields are displayed sequentially on the television at the received field rate, the viewer, due to the persistence of vision, sees the full frame with full vertical resolution.

[0005] A display method based on the described interlaced field reproduction has certain disadvantages with regard to fine and large-area structures. For example, if an edge is displayed interlaced, it is represented by successively transmitted interlaced fields from alternating lines. This can lead to edge flicker.

[0006] The described method also requires that the electronic components involved in the transmission are capable of transmitting complete lines of the interlaced fields. In so-called 8K videos, each line has approximately 8,000 pixels, or approximately 8,000 columns. Since 8K videos or 8K video streams have only been displayable on TVs or displays for a few years, it is possible that electronic components along the transmission path are not yet designed for transmitting an 8K video stream. Therefore, the receiving device or display may exhibit the described edge flickering or other effects resulting from suboptimal transmission.

[0007] The present invention is based on the objective of enabling the processing of a video stream, in particular a high-resolution video stream, for improved transmission of the video stream.

[0008] A solution to this problem is achieved according to the teaching of the independent claims. Various embodiments and further developments of the present invention are the subject of the dependent claims.

[0009] A first aspect of the solution relates to a method, particularly computer-implemented, for processing and transmitting a video stream stored in an image memory to a display interface of a display of a vehicle, in particular a motor vehicle, comprising: (i) signal-technical sampling of the video stream, which is available at a first frame rate, wherein the video stream is composed of first images, each first image having pixels arranged in columns and rows, the columns and rows being numbered with consecutive integer values;(ii) Generating two fields of each first frame using the signal-sampled video stream, (ii-1) wherein a first field of the two fields has first columns with odd numbers of consecutive numerical values, and (ii-2) a second field of the two fields has second columns with even numbers of consecutive numerical values, with a blank column between each adjacent first column and adjacent second column; (iii) Generating a first marker row having a code for each column labeled with an odd number and for each intervening blank row; (iv) Generating a second marker row having a code for each column labeled with an even number and for each intervening blank row;(v) Transmitting the first field with the first marker line, and the second field with the second marker line, to the display interface.

[0010] Any terms used herein, such as "comprises," "includes," "features," "has," "with," or any other variant thereof, are intended to cover non-exclusive inclusion. For example, a method or apparatus that includes or features a list of elements is not necessarily limited to those elements but may include other elements not expressly listed or inherent in such method or apparatus.

[0011] Furthermore, unless explicitly stated otherwise, "or" refers to an inclusive "or" and not an exclusive "or". For example, a condition A or B is satisfied by one of the following: A is true (or present) and B is false (or not present), A is false (or not present) and B is true (or present), and both A and B are true (or present).

[0012] The terms "ein" or "eine," as used here, are defined as "one or more." The terms "ein anderer" and "ein Weitere," as well as any other variant thereof, are to be understood as "at least one more."

[0013] The term "plural", as used here, is to be understood in the sense of "two or more".

[0014] The terms "configured" or "set up" to perform a specific function (and their respective variations), as used here, mean that the device in question is already in a configuration or setting in which it can perform the function, or at least that it is adjustable—i.e., configurable—so that it can perform the function after appropriate adjustment. Configuration can be achieved, for example, by adjusting parameters of a process sequence or by using switches or similar devices to activate or deactivate functionalities or settings. In particular, the device can have several predefined configurations or operating modes, allowing configuration to be performed by selecting one of these configurations or operating modes.

[0015] The term "control unit," as used here, refers in particular to an electronic device that controls the operation of a vehicle system, especially by means of a processor, particularly a CPU. Specifically, the control unit may include a transmitter and receiver for sending and receiving wireless signals, such as electromagnetic signals, and / or wired signals, such as electrical signals, via cables. Such a control unit may, in particular, include a microprocessor for analyzing received and / or previously stored data and / or for initiating a control process.

[0016] The term "video data" as used here refers in particular to digital data that represents a video, i.e., a moving image, and that can be sent from a transmitter to a receiving unit for display on a screen, in particular an LCD (Liquid Crystal Display) or OLED (Organic Light Emitting Diode) based screen, whereby the receiving unit may be integrated into the screen.

[0017] The term "video stream," as used here, refers specifically to the simultaneous transmission and playback of video data over a computer network via a data stream. When the transmitted content or data stream of the video data occurs in real time, this is also known as "live streaming." Unlike downloading a video file, a video stream typically does not create a copy on the user's computer. Instead, the video stream is usually displayed as a video on the user's screen and then discarded.

[0018] The term "interlacing," as used here, refers specifically to a storage method for raster graphics, i.e., graphics in which image points, also known as pixels, are arranged in a matrix of rows and columns, each assigned a color. In particular, before transmitting a raster graphic, two fields are generated from it, each containing rows with interlaced lines. The first field can contain a sequence of even-numbered rows, and the second field a sequence of odd-numbered rows of a full frame. Blank lines or rows without color assignments are placed between each set of lines.

[0019] The term "interleaving", as used here, refers in particular to the process of converting two half-images generated by an interlacing method into a full image, which can then be displayed, in particular, by a display.

[0020] The term "pixel" as used here refers in particular to a picture element of a raster graphic to which a color value is assigned.

[0021] The term "framebuffer" as used here refers in particular to an image memory, especially as part of a computer's video memory (RAM: English: Read Access Memory), in which a digital copy of a display image can be stored.

[0022] The method described in the first aspect makes it possible to transmit a high-resolution video stream using transmission components designed for lower resolutions. This can be achieved by generating the video stream into two fields, each containing half the columns of the respective frame to be transmitted, with these columns separated by a blank column or marked by a marker row. By generating two fields for each frame, each field structured column by column, a limitation of a transmission component regarding the line length that can be transmitted can be circumvented.

[0023] Preferred embodiments of the method are described below. These embodiments can be combined with one another and with the other described aspects as desired, unless expressly excluded or technically impossible. In some embodiments, the display interface is configured to generate a second image using the first field, the first marker line, the second field, and the second marker line. This advantageously allows a video stream to be displayed based on the two transmitted fields using the second image.

[0024] In some designs, the display interface forwards the second image to the display for presentation there. This allows a video stream to be displayed based on the second image.

[0025] In some embodiments, the video stream is sampled at a first frame rate, and the transmission of the first field with the first marker line, as well as the second field with the second marker line, occurs at a second frame rate, where the second frame rate is twice that of the first. This allows for the preferential generation of a second frame, thus enabling a flicker-free display of a video stream based on second frames for the viewer.

[0026] In some embodiments, the first field with the first marker line and the second field with the second marker line are interleaved and transmitted to the display interface via a single line, particularly an electrical line. This enables efficient and rapid transmission as well as efficient and rapid generation of a second image based on the transmitted fields with their respective marker lines.

[0027] A second aspect of the solution concerns a device for processing and transmitting a video stream stored in an image memory to a display interface of a vehicle display, wherein the device is configured to perform the method according to the first aspect.

[0028] Preferred embodiments of the device are described below, which, unless expressly excluded or technically impossible, can be combined with one another and with the other aspects described. In some embodiments, the device comprises: (i) an image memory in which a video stream is stored; (ii) a control unit configured to perform the following steps using an algorithm stored in the control unit: (ii-1) signal sampling of the video stream, which is present at a first frame rate, wherein the video stream is composed of first images, each first image having pixels arranged in columns and rows, the columns and rows being numbered consecutively with integer values;(ii-2) Generating two fields of each first frame using the signal-sampled video stream, wherein (ii-2a) a first field of the two fields has first columns with odd numbers of consecutive numerical values, and (ii-2b) a second field of the two fields has second columns with even numbers of consecutive numerical values, wherein (ii-2c) a blank column is placed between adjacent first columns and adjacent second columns; (ii-3) Generating a first marker row having an encoding for each first column labeled with an odd number, and for each intervening blank row; (ii-4) Generating a second marker row having an encoding for each second column labeled with an even number, and for each intervening blank row;(ii-5) Transmitting the first field with the first marker line, and the second field with the second marker line to the display interface.;

[0029] In some embodiments, the device has a display, wherein the display interface is configured to generate a second image using the first field, the first marker line, the second field and the second marker line, which is passed to the display and is shown by the display.

[0030] A third aspect of the solution concerns a motor vehicle having a device according to the second aspect.

[0031] A fourth aspect of the solution concerns a computer program with instructions that, when executed on a device according to the second aspect, cause it to execute the method according to the first aspect. The computer program can, in particular, be stored on a non-volatile data carrier. Specifically, the data carrier can be located in a vehicle's control unit. Preferably, this is a data carrier in the form of an optical data carrier or a flash memory module. This can be advantageous if the computer program itself is to be handled independently of a processor platform on which the one or more programs are to be executed.In another implementation, the computer program can exist as a file on a data processing unit, particularly on a server, and be downloadable via a data connection, such as the internet or a dedicated data connection, like a proprietary or local network. Furthermore, the computer program can comprise a plurality of interacting individual program modules. These modules can be configured, or at least deployable, to run on different devices (computers or processor units) that are geographically separated and interconnected via a data network, in accordance with the principles of distributed computing.

[0032] The features and advantages explained in relation to the first aspect of the solution also apply to the other aspects described.

[0033] Further advantages, features and application possibilities will result from the following description of preferred embodiments in conjunction with the figures.

[0034] This shows

[0035] Fig. 1 schematically shows a first image and a second image of a video stream;

[0036] Fig. 2 schematically shows a flowchart to illustrate one embodiment of a method; and

[0037] Fig. 3 schematically shows a motor vehicle in a top view. The same reference symbols are used throughout the figures for the same or corresponding elements.

[0038] Fig. 1 schematically shows a first image 100 and a second image 180 of a video stream.

[0039] The first image (100) and the second image (180) are to be understood as individual frames from a plurality of individual frames of a video stream. Accordingly, all individual frames, or the first images (100), of the video stream are processed or transmitted, and subsequently assembled as the second images (180) or displayed as a video stream, as described below.

[0040] The first image, 100, consists of pixels arranged in rows and columns (115, 125). In a so-called 8k image, this can result in 7680 columns and 2160 rows. The specific number of columns (115, 125) and rows in the first image, 100, also depends on the aspect ratio of the displayed image.

[0041] From the first image 100, a first field 110 and a second field 120 are generated. This is schematically represented by the arrows pointing away from the first image 110. The first field 110 contains the pixels from the first columns (115) of the first image 100, as well as columns without images, so-called black columns or empty columns, arranged in between. Similarly, the second field 120 contains the second columns (125), as well as columns without images, so-called black columns or empty columns, arranged in between. In this example, the first field 110 and the second field 120 each have a resolution of 3820 x 2160 pixels with an aspect ratio of 32:9. For easier identification, the columns (115, 125), i.e., first column 115 and second column 125 combined, are numbered from 1 to 7680 with whole numbers.The first field 110 then has the first columns 115 with the odd column numbers, and the second field 120 has the second columns 125 with the even column numbers. The column sequence of the first field 110 can be column / blank / column / blank, etc. In this case, the column sequence of the second field 120 should be inverted, and have the sequence blank / column / blank / column.... This ensures that when the first field 110 is superimposed on the second field 120, the columns of the two fields 110 and 120 lie next to each other and form a complete second image 180.

[0042] Accordingly, a first marker row 130 is added to the first field 110, thereby marking the (odd) first columns 115 and the blank columns as such. Likewise, a second marker row 140 is added to the second field 120, thereby marking the (even) second columns 125 and the blank columns as such.

[0043] The first field (110 Hz) and the second field (120 Hz) are then transmitted to a receiving unit. The first field (110 Hz) can be transmitted via a first line (L1), and the second field (120 Hz) via a second line (L2). Alternatively, the first field (110 Hz) and the second field (120 Hz) can be interleaved and transmitted over one of the lines (L1, L2). It is also conceivable that the first field (110 Hz), the second field (120 Hz), or both fields (110 Hz, L2) can be transmitted via the other of the two lines (L1, L2) to one or more additional displays (not shown here).

[0044] The staggered column sequence described above, where the first columns 115 of the first field 110 correspond to the second columns 125 of the second field 120, allows the pixels of a row in a receiving unit, such as a display interface 315, to be read in a desired order. The first marker row 130 and the second marker row 140 are used to fill the marked empty columns or pixels of one field 110, 120 with a column 115, 125 or a pixel of the other field 110, 120, respectively. This is schematically illustrated by an example pixel 150 of the first field 110 and a pixel 160 of the second field 120, each with adjacent empty pixels (see dashed rectangles). When the two pixel-lee pixel pairs are superimposed, the adjacent pixels 150 and 160 remain. This process step is also known as "nesting" or, in English, "interleaving".As a result, a second image 180 is generated for display from the first field 110 and the second field 120.

[0045] In the case that the first field 110 and the second field 120 were each transmitted at a refresh rate of 30 frames per second (fps), the resulting second image 180 is preferably displayed at 30 fps.

[0046] Fig. 2 schematically shows a flowchart 200 to illustrate an embodiment of a method for processing and transferring a video stream stored in an image memory 330 to a display interface 315 of a display 310 of a motor vehicle 300.

[0047] In a first step S210 of the procedure, a signal-technical sampling of the video stream is carried out, which is available with a first frame rate, wherein the video stream is composed of first images 100, wherein each first image has 100 pixels which are arranged in columns and rows, wherein the columns and rows are each numbered with consecutive integer values.

[0048] In a further step S220 of the procedure, two fields 110, 120 of each first image 100 are generated using the signal-technically sampled video stream, wherein a first field 110 of the two fields 110, 120 has first columns 115 with odd numbers of the successive numerical values, and a second field 120 of the two fields 110, 120 has second columns 125 with even numbers of the successive numerical values, wherein an empty column is arranged between adjacent first columns 115 and adjacent second columns 125.

[0049] In a further step S230 of the procedure, a first marker row 130 is generated, which contains a code for each first column 115, which is labeled with an odd number, as well as for each empty row between them. In a further step S240 of the procedure, a second marker row 140 is generated, which contains a code for each second column 125, which is labeled with an even number, as well as for each empty row between them.

[0050] In a further step S250 of the procedure, the first half-field 110 with the first marker line 130, as well as the second half-field 120 with the second marker line 140, are transmitted via a line L1, L2 to the display interface 315.

[0051] Figure 3 schematically shows a motor vehicle 300 in a top view. The motor vehicle 300 has a display 310 which is configured to display a video stream transmitted to the display 310 via a display interface 315.

[0052] In this process, a video stream from an image memory 330, also known as a frame buffer, is first sampled column by column by a control unit 320, which is also arranged in the motor vehicle 300, and a suitable algorithm is used to sample the video stream from the image memory 330, and from this a first half-field 110 and a second half-field 120 and associated marker lines 130, 140 are generated, as described in Fig. 1 and the process step S220 in Fig. 2.

[0053] These generated half-frames 110, 120 with the associated marker lines 130, 140 are then transmitted to the display interface 315, where they are combined to form a complete image or video stream, which can then be displayed by the display.

[0054] While at least one exemplary embodiment has been described above, it should be noted that a large number of variations exist. It should also be noted that the described exemplary embodiments are merely non-limiting examples, and it is not intended to restrict the scope, applicability, or configuration of the devices and methods described herein. Rather, the preceding description will provide the person skilled in the art with guidance for implementing at least one exemplary embodiment. It is understood that various modifications to the function and arrangement of the elements described in an exemplary embodiment can be made without derogating from the subject matter defined in the appended claims and their legal equivalents.

[0055] REFERENCE MARK LIST

[0056] 100 First image

[0057] 110 First half-image

[0058] 115 First columns

[0059] 120 Second half-image

[0060] 125 Second columns

[0061] 130 First marker row

[0062] 140 Second marker row

[0063] 150 pixels first field

[0064] 160 pixels second field

[0065] 180 Second image

[0066] L1 First Line

[0067] L2 Second Line

[0068] 200 Flowchart

[0069] S210 Signal scanning video stream

[0070] S220 Generating two fields

[0071] S230 Generating a first marker line

[0072] S240 Generating a second marker row

[0073] S250 Transmitting the interlaced fields

[0074] 300 motor vehicles

[0075] 310 Display

[0076] 315 Display Interface

[0077] 320 Control unit

[0078] 330 image storage

Claims

REQUIREMENTS 1. Method for processing and transmitting a video stream stored in an image memory (330) to a display interface (315) of a display (310) of a vehicle (300), comprising: Signal-technical sampling of the video stream, which is available at a first frame rate, wherein the video stream is composed of first images (100), each first image (100) having pixels arranged in columns (115, 125) and rows, wherein the columns (115, 125) and rows are each numbered with consecutive integer values; Generating two fields (110, 120) of each first frame (100) using the signal-technically sampled video stream, wherein a first field (110) of the two fields (110, 120) has first columns (115) with odd numbers of the successive numerical values, and a second field (120) of the two fields (110, 120) has second columns (125) with even numbers of the successive numerical values, wherein an empty column is arranged between adjacent first columns (115) and adjacent second columns (125); Generating a first marker row (130) that has a code for each first column (115) that is labelled with an odd number, as well as for each intermediate blank row; Generating a second marker row (140) that has a code for every second column (125) that is labelled with an even number, as well as for every empty row in between; Transmitting the first field (110) with the first marker line (130), and the second field (120) with the second marker line (140) to the display interface (315).

2. Method according to claim 1, wherein the display interface (315) is configured to generate a second image (180) using the first field (110), the first marker line (130), the second field (120) and the second marker line (140).

3. Method according to claim 2, wherein the display interface (315) forwards the second image (180) to the display (310) for display there.

4. Method according to one of the preceding claims, wherein the signal sampling of the video stream is carried out at a first frame rate, and wherein the transmission of the first field (110) with the first marker line (130), as well as of the second field (120) with the second marker line (140) is carried out at a second frame rate, wherein the second frame rate is twice as high as the first frame rate.

5. Method according to one of the preceding claims, wherein the first field (110) with the first marker line (130) and the second field (120) with the second marker line (140) are interleaved and transmitted to the display interface (315) via a line (L1 , L2).

6. Device for processing and transmitting a video stream stored in an image memory (330) to a display interface (315) of a display (310) of a vehicle (300), wherein the device is configured to perform the method according to one of the preceding claims.

7. Device according to claim 6, comprising: An image memory (310) in which a video stream is stored; A control device (320) that is configured to perform the following steps using an algorithm stored in the control device: Signal-technical sampling of the video stream, which is available at a first frame rate, wherein the video stream is composed of first images (100), each first image (100) having pixels arranged in columns (115, 125) and rows, wherein the columns (115, 125) and rows are each numbered with consecutive integer values; Generating two fields (110, 120) of each first frame (100) using the signal-sampled video stream, wherein a first field (110) of the two fields (110, 120) has first columns (115) with odd numbers of the consecutive numerical values, and a second The first field (120) of the two fields (110, 120) has second columns (125) with even numbers of the successive numerical values, with an empty column arranged between adjacent first columns (115) and adjacent second columns (125); Generating a first marker row (130) that has a code for each first column (115) that is labelled with an odd number, as well as for each intermediate blank row; Generating a second marker row (140) that has a code for every second column (125) that is labelled with an even number, as well as for every empty row in between; Transmitting the first field (110) with the first marker line (130), and the second field (120) with the second marker line (140) to the display interface (315).

8. Device according to claim 7, comprising a display (310), wherein the display interface is configured to generate a second image (180) using the first field (110), the first marker line (130), the second field (120) and the second marker line (140), which is forwarded to the display and is shown by the display (310).

9. Motor vehicle (300) comprising a device according to one of claims 6 to 8.

10. Computer program with instructions which, when executed on a device according to one of claims 6 to 8, cause the device to execute the method according to one of claims 1 to 5.

Images