Providing and displaying video data

Abstract

An apparatus (1) for providing video data in a motor vehicle includes: an input interface (2, 2') configured to receive an initial video data stream (4, 4') in a first file format; and a converter module (6) configured to convert the initial video data stream (4, 4') from the first file format to a second file format. The apparatus (1) includes a decoder module (7) coupled to the converter module (6) and configured to decode the converted video data stream (8) and present the converted video data stream (8) on a canvas element for decoding. The apparatus (1) includes an output interface (9) for outputting the decoded video data stream (11) to a display device (10).

Description

Background Technology

[0001] In modern motor vehicles, many functions using video data streaming (also known as video broadcasting) can be envisioned. These include, for example, video calling or video monitoring of infants and toddlers. Such functions can significantly improve the comfort of motor vehicle users.

[0002] Document DE 20 2013 012 645 U1 describes how to transmit route information from the guiding vehicle to the following vehicles in real time within the vehicle. For example, the route information can be transmitted in the form of a video stream.

[0003] However, displaying video streams places certain demands on the hardware and software architecture of the systems used to provide or display them. For example, a video codec is typically required. This means that displaying video streams may not be feasible in existing computer architectures, particularly those used in motor vehicles. Summary of the Invention

[0004] In this context, the purpose of this invention is to illustrate an improved scheme for providing video data, which can be implemented more flexibly through different hardware and / or software architectures.

[0005] The objective is achieved through the relevant subject matter of the independent claim. Advantageous improvements are the subject matter of the appendix claims.

[0006] The improved solution is based on the idea of ​​converting the initial video data stream into a suitable data format and then decoding it using canvas elements.

[0007] According to this improved scheme, an apparatus for providing video data in a motor vehicle is described. The apparatus has an input interface configured to receive an initial video data stream in a first file format, particularly from a video source. The apparatus has a converter module coupled to the input interface and configured to convert the initial video data stream from the first file format to a second file format to produce a converted video data stream. The apparatus has a decoder module coupled to the converter module and configured to decode the converted video data stream and to present the converted video data stream using a canvas element for decoding. The apparatus has an output interface for outputting the decoded video data stream to a display device.

[0008] Here and below, an interface can be understood as containing hardware components (i.e., connecting elements, plugs, and, where necessary, electronic circuitry) and / or software components.

[0009] In this context and below, a module can be understood as a hardware module and / or a software module. Specifically, a module can contain one or more hardware components and one or more software components implemented on those hardware components. A software module or a software component of a module can be understood as a functional unit of program code. Therefore, a software module can contain or implement different processing steps and / or data structures.

[0010] The video data source can generate an initial video data stream in real time and provide it via the device's input interface, or the initial video data stream can be stored on the video data source's storage unit. In particular, the video data source can include a camera or a server computing unit.

[0011] A video data stream can be understood here and below as a sequence of continuous image datasets, which may also be referred to as a single image or frame. A video data stream may also include associated audio data.

[0012] The coupling between two units (e.g., modules) can be understood here and below as the respective units being able to exchange data unidirectionally or bidirectionally. The coupling can here be physical or wired, or it can be designed to be wireless.

[0013] A canvas element (which may also be called a canvas tag) can be understood in particular as a markup-defined area used to display or render graphic elements or images. The markup language may correspond, for example, to Hypertext Markup Language (HTML). In particular, the canvas element may correspond to a canvas element according to the HTML5 standard.

[0014] A display device is not necessarily part of the apparatus according to this improved solution. However, in different embodiments of the apparatus, the apparatus may also include a display device. A display device can be understood as a video display device. In particular, a display device includes a screen or monitor for displaying decoded video data streams.

[0015] Since the initial video data stream from the video source is typically provided in a video format (which requires a video codec for decoding and rendering), this initial video data cannot be easily played by systems without such a codec. According to this improved solution, this problem is overcome by first converting the initial video data stream so that it can be directly decoded through rendering on a canvas element. This eliminates the need for video tags. Consequently, widely available scripting languages ​​(such as JavaScript, in particular) can be used to decode the converted video data stream. This advantageously allows for increased flexibility in terms of system requirements for playing or providing video data streams.

[0016] According to at least one embodiment of the device based on this improved scheme, the input interface includes a bus interface, particularly a Universal Serial Bus interface (USB interface). The input interface may include an Internet Protocol (IP) interface, a Real-Time Transport Protocol (RTP) interface, or other network interfaces to obtain an initial data stream.

[0017] This interface allows various video sources, especially cameras (such as USB cameras or IP cameras), to be coupled to the device.

[0018] According to at least one embodiment, the device includes a browser module, particularly a web browser module, which includes a decoder module.

[0019] The browser module may also have a connection to a server computing unit or cloud computer so that the initial video data stream and / or the converted video data stream can be transmitted to the server computing unit or cloud computer.

[0020] In particular, the browser module can be designed here as a so-called headless browser, that is, a browser without a graphical user interface (GUI).

[0021] According to at least one embodiment, the device has a display device, and the display device is coupled to an output interface.

[0022] According to at least one embodiment, the device has a WebSocket server module configured to obtain a converted video data stream from a converter module and provide it to a decoder module in accordance with the WebSocket protocol.

[0023] Thus, for example, the converted video data stream can be transmitted from the converter module to a local relay server, which initiates a WebSocket connection and provides the converted video data stream to the decoder module via the WebSocket protocol.

[0024] According to the improved design, a motor vehicle having a device according to the improved design is also described.

[0025] According to at least one embodiment, the motor vehicle has a video data source and / or a communication interface for wireless communication with the video source.

[0026] According to at least one embodiment, the motor vehicle has a display device.

[0027] According to this improved scheme, a method for displaying video data, particularly in motor vehicles, and especially a computer-implemented method, is also described. Here, a video data stream in a first file format is obtained from a video data source, particularly by means of an input interface. The initial video data stream is converted from the first file format to a second file format, particularly by means of a converter module. The converted video data stream is decoded, particularly by means of a decoder module, wherein the converted video data stream is presented using a canvas element for decoding. The decoded video data stream is displayed using a display device.

[0028] According to at least one embodiment of the method according to the improved scheme, a scripting language, especially JavaScript, is used to decode the converted video data stream, and especially to render the converted video data stream on a canvas element.

[0029] This enables greater flexibility in designing the underlying hardware and software used to display or present converted video data streams.

[0030] According to at least one embodiment, the initial video data stream is obtained as an MPEG-4 data stream.

[0031] In other words, the first file format corresponds to the MPEG-4 video format. Therefore, the initial video data stream can be obtained, in particular, by a server computer system as the video source (which typically provides the video data stream as an MPEG-4 data stream) and displayed according to this improved scheme.

[0032] According to at least one implementation, the initial video data stream is obtained as a Real-Time Transport Protocol (RTP) data stream.

[0033] In other words, the first file format corresponds to an RTP video format or an RTP-compatible video format. Therefore, IP cameras can be used as video sources, typically providing the initial video data stream according to RTP.

[0034] According to at least one embodiment, the converted video data stream is generated by converting it into an MPEG-1 data stream.

[0035] In other words, the second file format corresponds to the MPEG-1 video format. This provides greater flexibility in decoding the converted video data stream. In particular, scripting languages ​​such as JavaScript can decode converted video data streams in MPEG-1 format using canvas elements.

[0036] According to at least one embodiment, the converted video data stream is provided to the decoder module according to the WebSocket protocol for decoding the converted video data stream.

[0037] According to at least one embodiment, the steps of acquiring and converting the initial video data stream and decoding the converted video data stream are performed by means of a computing unit of a motor vehicle.

[0038] According to at least one embodiment, the initial video data stream is generated and provided by means of a camera in a motor vehicle, particularly an IP camera or a USB camera.

[0039] According to at least one embodiment, the initial video data stream is wirelessly transmitted to the vehicle's communication interface via a server computing unit, and in particular, from the communication interface to a converter module.

[0040] Further embodiments of the apparatus according to the improved scheme arise directly from different embodiments of the method according to the improved scheme, and vice versa. In particular, the apparatus according to the improved scheme can be configured or programmed to perform the method according to the improved scheme, or it performs such a method.

[0041] According to this improved scheme, a computer program product having instructions is also described. When the instructions or computer program are implemented by an apparatus according to the improved scheme, the instructions cause the apparatus to perform the method according to the improved scheme.

[0042] According to the improved scheme, a computer-readable storage medium is also described, which stores a computer program according to the improved scheme.

[0043] The computer program and the computer-readable storage medium can be understood as computer program products with instructions.

[0044] The present invention also includes combinations of features of the embodiments described. Attached Figure Description

[0045] Embodiments of the present invention are described below.

[0046] to this end, Figure 1 A schematic block diagram of an exemplary embodiment of the device according to the improved scheme is shown. Detailed Implementation

[0047] The embodiments explained below are preferred embodiments of the present invention. In these embodiments, the described components are respective features of the invention that should be viewed independently of each other, and these features also independently improve the invention, and therefore can be considered individually or in combinations different from those shown as part of the invention. Furthermore, the embodiments can be supplemented by additional features among the already described features of the invention.

[0048] Figure 1 An exemplary embodiment of a device 1 for providing video data in a motor vehicle (not shown) is illustrated. The motor vehicle may contain device 1. Device 1 may, in particular, include a computing unit 1' of the motor vehicle. The computing unit 1' has an input interface 2 for connecting the computing unit 1' to a camera 3, which may be designed, for example, an IP camera or a USB camera.

[0049] The computing unit 1' also has a converter module 6, which is coupled to the input interface 2 to obtain the initial video data stream 4 provided from the camera 3 via the input interface 2. For example, the converter module 6 may be part of a network application 5.

[0050] The computing unit 1' further includes a decoder module 7, which is coupled to the converter module 6, and may, for example, be part of another network application 12. The other network application 12 may be designed as a web browser, particularly a headless browser. The computing unit 1' also includes an output interface 9, to which the vehicle's display device 10 can be connected.

[0051] Optionally, the computing unit 1' has a WebSocket relay server 13, which is arranged between the converter module 6 and the decoder module 7.

[0052] Camera 3 provides an initial video data stream 4 via input interface 2 as described. Here, the video data stream can exist, for example, as an RTP video data stream, especially if camera 3 is designed as an IP camera. However, the video data stream 4 can also exist in other video formats, such as if camera 3 is designed as a USB camera.

[0053] A converter module 6, which includes a video converter (e.g., ffmpeg), receives the initial video data stream 4 and converts it to other video formats, particularly MPEG-1, to produce a converted video data stream 8. The converted video data stream 8 is then provided to the decoder module 7.

[0054] For this purpose, network application 5 or converter module 6 can, for example, forward the converted video data stream 8 to WebSocket relay server 13, which establishes a WebSocket connection with decoder module 7 or another network application 12 and provides the converted video data stream 8 to the other network application 12 in accordance with the WebSocket protocol, and thus to decoder module 7.

[0055] Then, decoder module 7 decodes the converted video data stream 8 into a decoded video data stream 11, for example, using a JavaScript video decoder, where canvas elements are used. In particular, decoder module 7 does not use video tags for this purpose.

[0056] Another network application 12 or decoder module 7 provides the decoded video data stream 11 to the display device 10 via the output interface 9, and the display device can then display the decoded video data stream 11 to the user of the motor vehicle.

[0057] Optionally, the computing unit 1' may also have an additional input interface 2' for coupling with the server computing unit 3'. The server computing unit 3' may, for example, provide an additional initial video data stream 4' to the network application 5 or the converter module 6 via the additional input interface 2'. The processing of the additional initial video data stream 4' can then be performed as described with respect to the initial video data stream 4. The additional initial video data stream 4' may, for example, exist in MPEG-4 video format.

[0058] In different implementations, the network application 5 may also provide the initial video data stream 4 to the server computing unit 3' via another input interface 2'.

[0059] As described, this improved solution illustrates a more flexible possibility for implementing video data streaming functionality in motor vehicles.

[0060] List of reference numerals

[0061] 1 device

[0062] 1' Computing Unit

[0063] 2,2' Input Interface

[0064] 3,3' Video data source

[0065] 4,4' Initial video data stream

[0066] 5. Web Applications

[0067] 6. Converter Module

[0068] 7. Decoder Module

[0069] 8. Converted video data stream

[0070] 9 Output Interfaces

[0071] 10 Display devices

[0072] 11 Decoded video data stream

[0073] 12 Network Applications

[0074] 13 WebSocket Relay Servers

Claims

1. An apparatus for providing video data in a motor vehicle, the apparatus (1) comprising: - Input interface (2), which is configured to obtain an initial sequence (4) of consecutive single images in a first file format generated by means of a camera (3) of the motor vehicle; - A converter module (6) coupled to the input interface (2) and configured to convert an initial sequence (4) of consecutive single images from the first file format to a second file format that can be used to decode using a scripting language; - Decoder module (7), which is coupled to the converter module (6) and is configured to decode the sequence (8) of the converted consecutive single images using a scripting language without using video tags, and to present the sequence (8) of the converted consecutive single images using a canvas element for decoding. - Output interface (9) for outputting a sequence (11) of decoded consecutive single images to the display device (10) of the motor vehicle.

2. The apparatus according to claim 1, Its features are, The device includes a browser module (12), which includes a decoder module (7).

3. The apparatus according to claim 1 or 2, Its features are, The device (1) has a display device (10) and the display device (10) is coupled to the output interface (9).

4. The apparatus according to claim 1 or 2, Its features are, The device (1) includes a WebSocket server (13) configured to obtain a sequence (8) of converted consecutive single images from the converter module (6) and provide them to the decoder module (7) according to the WebSocket protocol.

5. A motor vehicle having the means (1) according to any one of the preceding claims.

6. A method for displaying video data in a motor vehicle, wherein, - An initial sequence (4) of consecutive single images is generated by means of the camera (3) of the motor vehicle; - Obtain an initial sequence (4) of consecutive single images in a first file format from the camera (3) of the motor vehicle; - Convert the initial sequence (4) of consecutive single images from the first file format to a second file format that can be used for decoding using a scripting language; - Decode the sequence of converted consecutive single images (8) using a scripting language without using video tags, wherein the sequence of converted consecutive single images (8) is presented with the aid of canvas elements for decoding; - A sequence (11) of decoded consecutive single images is displayed by means of the display device (10) of the motor vehicle.

7. The method according to claim 6, Its features are, JavaScript is used to decode the sequence (8) of consecutive single images after conversion.

8. The method according to claim 6 or 7, Its features are, - An initial sequence (4) of consecutive single images is obtained as an MPEG-4 data stream; or - The initial sequence (4) of consecutive single images is obtained as a real-time transport protocol data stream.

9. The method according to claim 8, Its features are, The converted continuous single image sequence (8) is generated as an MPEG-1 data stream.

10. The method according to claim 6 or 7, Its features are, The sequence (8) of the converted consecutive single images is provided to the decoding module (7) according to the WebSocket protocol for decoding the sequence (8) of the converted consecutive single images.

11. The method according to claim 6 or 7, Its features are, The steps of acquiring and converting the initial sequence (4) of consecutive single images and decoding the sequence (8) of converted consecutive single images are performed by means of the computing unit (1') of the vehicle.

12. The method according to claim 11, Its features are, An initial sequence (4) of consecutive individual images is wirelessly transmitted to the communication interface of the vehicle by means of a server computing unit (3').

13. A computer program product having instructions which, when implemented by a device (1) according to any one of claims 1 to 4, cause the device (1) to perform the method according to any one of claims 6 to 12.

Images