Electronic device, video stream transmission method and device

Abstract

The present application discloses an electronic device, a video stream transmission method, an apparatus, a device and a medium, which are used to quickly transmit an HDMI video stream to an Android operating system. Since a first conversion chip in the electronic device of the present application can directly receive an HDMI video stream based on an HDMI interface of the first conversion chip, the received HDMI video stream is converted into a video stream that can be directly received by the Android operating system, and the converted video stream that can be directly received by the Android operating system is sent to an Android operating system controller in the electronic device, and the Android operating system controller receives the video stream that can be directly received by the Android operating system, thereby quickly transmitting the HDMI video stream to the Android operating system.

Description

Technical Field

[0001] The present application relates to the technical field of video stream transmission, and in particular to an electronic device, a video stream transmission method, an apparatus, a device and a medium. Background Art

[0002] As the most popular human-computer interaction platform, Android operating system provides an excellent graphical user interface (GUI) interactive experience and is widely used.

[0003] High Definition Multimedia Interface (HDMI) is a digital video / audio interface technology. It is a dedicated digital interface suitable for image transmission. It can transmit audio and image signals at the same time, with a maximum data transmission speed of 2.25GB / s.

[0004] However, since the baseboard equipped with the Android operating system usually does not include an HDMI interface, how to transmit the HDMI video stream generated by an HDMI camera, etc. to the Android operating system development platform (for convenience of description, referred to as the Android operating system) is a technical problem that urgently needs to be solved. Summary of the invention

[0005] The present application provides an electronic device, a video stream transmission method, an apparatus, a device and a medium for quickly transmitting an HDMI video stream to an Android operating system.

[0006] In a first aspect, the present application provides an electronic device, the device comprising:

[0007] A first conversion chip, wherein the first conversion chip is used to receive an HDMI video stream based on a high-definition multimedia interface HDMI of the first conversion chip, and convert the received HDMI video stream into a video stream that can be directly received by an Android operating system;

[0008] An Android operating system controller, wherein the Android operating system controller is used to receive the converted video stream sent by the first conversion chip.

[0009] In a second aspect, the present application provides a video stream transmission method, the method comprising:

[0010] Receive High Definition Multimedia Interface HDMI video stream;

[0011] Convert the HDMI video stream into a video stream that can be directly received by the Android operating system;

[0012] The video stream is saved.

[0013] In a third aspect, the present application provides a video stream transmission device, the device comprising:

[0014] A receiving module, used for receiving a high-definition multimedia interface HDMI video stream;

[0015] A conversion module, used for converting the HDMI video stream into a video stream that can be directly received by an Android operating system;

[0016] A saving module is used to save the video stream.

[0017] In a fourth aspect, the present application provides an electronic device, which includes at least a processor and a memory, and the processor is used to implement the steps of any of the above-mentioned video stream transmission methods when executing a computer program stored in the memory.

[0018] In a fifth aspect, the present application provides a computer-readable storage medium storing a computer program, which implements the steps of any of the above-mentioned video stream transmission methods when executed by a processor.

[0019] Since the first conversion chip in the electronic device of the present application can directly receive the HDMI video stream based on the HDMI interface of the first conversion chip, the received HDMI video stream is converted into a video stream that can be directly received by the Android operating system, and the converted video stream that can be directly received by the Android operating system is sent to the Android operating system controller in the electronic device, and the Android operating system controller receives the video stream that can be directly received by the Android operating system, thereby quickly transmitting the HDMI video stream to the Android operating system. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the implementation methods in the embodiments of the present application or the related technologies, the following is a brief introduction to the drawings required for use in the embodiments or the related technology descriptions. Obviously, the drawings described below are some embodiments of the present application, and a person skilled in the art can also obtain other drawings based on these drawings.

[0021] Figure 1 A schematic diagram of the structure of a first electronic device provided by some embodiments is shown;

[0022] Figure 2 A schematic diagram of the structure of a second electronic device provided by some embodiments is shown;

[0023] Figure 3 A schematic diagram of the structure of a Qualcomm Snapdragon D845 baseboard provided by some embodiments is shown;

[0024] Figure 4 A schematic diagram of a video stream transmission process provided by some embodiments is shown;

[0025] Figure 5 A schematic diagram of a video stream transmission process provided by some embodiments is shown;

[0026] Figure 6 A schematic diagram of a video stream transmission device provided by some embodiments is shown;

[0027] Figure 7 A schematic diagram of the structure of a third electronic device provided by some embodiments is shown. DETAILED DESCRIPTION

[0028] In order to quickly transmit an HDMI video stream to an Android operating system, an embodiment of the present application provides an electronic device, a video stream transmission method, an apparatus, a device and a medium.

[0029] In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0030] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0031] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0032] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0033] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0034] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0035] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

[0036] During actual use, the first conversion chip in the electronic device can directly receive the HDMI video stream based on the HDMI interface of the first conversion chip, convert the received HDMI video stream into a video stream that can be directly received by the Android operating system, and send the converted video stream that can be directly received by the Android operating system to the Android operating system controller in the electronic device; the Android operating system controller receives the converted video stream sent by the first conversion chip, thereby achieving the purpose of quickly transmitting the HDMI video stream to the Android operating system.

[0037] Figure 1 A schematic diagram of the structure of an electronic device provided in some embodiments is shown, and the device includes:

[0038] A first conversion chip 11, wherein the first conversion chip 11 is used to receive an HDMI video stream based on a high-definition multimedia interface HDMI of the first conversion chip 11, and convert the received HDMI video stream into a video stream that can be directly received by an Android operating system;

[0039] An Android operating system controller 12 , wherein the Android operating system controller 12 is configured to receive the converted video stream sent by the first conversion chip 11 .

[0040] In a possible implementation, the electronic device of the present application may be a device such as a PC, a mobile terminal, or a server, etc. In a possible implementation, the electronic device may be a home brain server. The operating system of the electronic device includes at least an Android operating system. In a possible implementation, in view of the fact that the Android operating system, as the most popular human-computer interaction platform, provides an excellent interactive experience of a graphical user interface, however, the background capabilities of the Android operating system are deliberately designed to be relatively weak in order to ensure the fluency of the foreground human-computer interaction experience. The Linux operating system is known for its powerful background processing functions. The strength of the Linux operating system lies in the background services, and its foreground functions such as the human-computer interaction experience are relatively weak. In order to take into account the fluency of the foreground human-computer interaction experience and the power of the background processing functions, the Linux operating system and the Android operating system can be installed simultaneously in the electronic device of the present application, that is, the electronic device can be a dual-system electronic device with the Linux operating system and the Android operating system installed simultaneously.

[0041] In a possible implementation, in order to quickly transmit the HDMI video stream to the Android operating system of the electronic device, the electronic device is provided with a first conversion chip 11 and an Android operating system controller 12, wherein the first conversion chip 11 and the Android operating system controller 12 are connected. The first conversion chip 11 can receive the HDMI video stream based on its own High Definition Multimedia Interface (HDMI). In a possible implementation, the HDMI video stream received by the first conversion chip 11 can be the HDMI image acquisition module (such as an HDMI camera, etc.) and sent to the first conversion chip 11. In a possible implementation, if the electronic device is a dual-system electronic device with both the Linux operating system and the Android operating system installed, the HDMI video stream received by the first conversion chip 11 can also be the HDMI video stream processed by the Linux operating system.

[0042] For ease of understanding, the following is an explanation of the process of the first conversion chip 11 provided in the present application receiving the HDMI video stream processed by the Linux operating system through a specific embodiment. Figure 2 , Figure 2 A schematic diagram of the structure of a second electronic device provided by some embodiments is shown, such as Figure 2As shown, the electronic device can be a home brain server with both Linux operating system and Android operating system installed. Among them, NVIDIA's Xavier baseboard is equipped with Linux operating system, and Qualcomm Snapdragon's D845 baseboard is equipped with Android operating system (such as Android Q operating system), that is to say, the home brain server can be jointly built by NVIDIA's Xavier baseboard and Qualcomm Snapdragon's D845 baseboard. In a possible implementation, the HDMI video stream collected by the HDMI image acquisition module (HDMI visual texture sensor) can be first processed (background processing) by the Linux operating system in the home brain server, and then sent to the Android operating system, so that users can perform foreground human-computer interaction based on APPs installed on the Android operating system to watch the corresponding video stream, thereby ensuring the smoothness of the foreground human-computer interaction experience and the power of the background processing function.

[0043] Specifically, in a possible implementation, since the Linux operating system cannot directly process the HDMI video stream, a third conversion chip (not shown) can be set at the front end of the Linux operating system controller (such as NVIDIA's core module), that is, a third conversion chip is set between the NVIDIA core module and the HDMI visual texture sensor. In a possible implementation, the third conversion chip can be set on NVIDIA's Xavier baseboard. After the HDMI visual texture sensor captures the HDMI video stream, the HDMI video stream can be sent to the third conversion chip, which is used to receive the HDMI video stream sent by the HDMI visual texture sensor, and convert the received HDMI video stream into a video stream that the Linux operating system can directly process, such as a Mobile Industry Processor Interface (MIPI) video stream. For the convenience of description, the video stream that the Linux operating system can directly process is an MIPI video stream as an example.

[0044] After the third conversion chip converts the received HDMI video stream into a MIPI video stream, the converted MIPI video stream can be sent to the Linux operating system controller, which is used to receive the converted video stream sent by the third conversion chip, and enable NVIDIA's core module to perform certain processing on the MIPI video stream based on the Linux operating system. For example, based on the powerful image processing capabilities and computing power (30T) support of the Linux operating system, the video stream can be encoded and decoded, uploaded\pull-down video cloud, spliced ​​display, display rendering, cutout, etc., wherein the Linux operating system can use existing technology to process the video stream, which will not be repeated here. In one possible implementation, the Linux operating system controller can be NVIDIA's core module.

[0045] In addition, the Linux operating system controller can send the video stream (HDMI video stream) processed by the Linux operating system to the first conversion chip 11 based on the HDMI interface of the NVIDIA Xavier baseboard. The first conversion chip 11 can be arranged between the core SOM module of the NVIDIA Xavier baseboard and the D845 baseboard of Qualcomm Snapdragon, that is, the first conversion chip 11 is arranged at the front end of the core module (SOM) of the D845 baseboard of Qualcomm Snapdragon. In a possible implementation, the first conversion chip 11 can be arranged on the D845 baseboard. The first conversion chip 11 can receive the HDMI video stream processed by the Linux operating system sent by the Linux operating system controller based on its HDMI interface.

[0046] Also, see Figure 2If the HDMI video stream processed by the Linux operating system is not sent to the first conversion chip 11, but is directly sent to a display device (such as an OLED display) through a Universal Asynchronous Receiver / Transmitter (UART) or a Serial Peripheral Interface (SPI), the image information and other data of the HDMI video stream can be directly displayed in the display device based on a display plug-in (such as Ximage, etc.). In a possible implementation, the home brain server can also access data by configuring a serial advanced technology attachment (a serial hardware driver interface based on industry standards, Serial Advanced Technology Attachment, SATA) and a disk array (Redundant Arrays of Independent Disks, RAID), such as a redundant array of independent disks (RAID 1), etc., wherein the process of accessing data through SATA and RAID 1 is a prior art and will not be repeated here.

[0047] In a possible implementation, after the first conversion chip 11 receives the HDMI video stream, it can convert the HDMI video stream into a video stream that can be directly received by the Android operating system, such as a MIPI video stream. For the convenience of description, the video stream that can be directly received by the Android operating system is MIPI video stream for example. After the first conversion chip 11 converts the HDMI video stream into a MIPI video stream, it can send the converted MIPI video stream to the Android operating system controller 12, and the Android operating system controller 12 can receive the MIPI video stream sent by the first conversion chip 11, that is, the core module SOM (D845SOM) of the D845 baseboard of Qualcomm Snapdragon equipped with the Android operating system can receive the MIPI video stream, thereby achieving the purpose of transmitting the HDMI video stream to the Android operating system. In a possible implementation, the Android operating system controller 12 can be the core module SOM of the D845 baseboard of Qualcomm Snapdragon equipped with the Android operating system.

[0048] See also Figure 2 and Figure 3If the electronic device is a dual-system electronic device with both Linux operating system and Android operating system installed, the HDMI video stream processed by the Linux operating system can be directly received based on the HDMI interface of the first conversion chip 11. The first conversion chip 11 then converts the HDMI video stream into a MIPI video stream, and sends the converted MIPI video stream to the Android operating system controller 12, so that the HDMI video stream can be quickly transmitted from the Linux operating system development platform (for the convenience of description, referred to as the Linux operating system) to the Android operating system development platform (for the convenience of description, referred to as the Android operating system). At the same time, compared with the network transmission and USB transmission video stream methods in the related art, the HDMI interface based on the conversion chip provided in this application quickly transmits the HDMI video stream from the Linux operating system development platform to the Android operating system development platform (for the convenience of description, referred to as HDMI interface transmission), which can realize the efficient transparent transmission of the HDMI video stream between the Linux operating system development platform and the Android operating system development platform, and can reduce the delay of video stream transmission.

[0049] For ease of understanding, refer to Table 1, which is a schematic table of the delay data obtained by testing the video stream with the same resolution and frame rate provided by some embodiments of the present application, respectively, through network transmission, USB transmission and HDMI interface transmission provided by the present application under the same environment. As shown in Table 1, for video streams with the same resolution and frame rate, such as a video stream with a 4K resolution (3840 pixels × 2160 pixels) and a frame rate of 30FPS, in a dual-system electronic device, when the HDMI video stream is transmitted from the Linux operating system development platform to the Android operating system development platform through the HDMI interface transmission method provided by the present application, the delay used is 80ms to 130ms. When the video stream with the same resolution and frame rate is transmitted from the Linux operating system development platform to the Android operating system development platform through the network transmission method, the delay used is 230ms to 270ms. When the video stream with the same resolution and frame rate is transmitted from the Linux operating system development platform to the Android operating system development platform through the USB transmission method, the delay used is 180ms to 220ms.

[0050] It can be seen from this that the HDMI interface transmission method provided by the present application can reduce the delay to a large extent compared with the network transmission and USB transmission methods in the related art, and has great advantages. Moreover, for video streams with higher resolutions such as ultra-high-definition resolution, the transmission delay of the HDMI interface transmission method of the present application is much lower than that of network transmission or USB transmission, and its superiority is even more obvious. At the same time, compared with network transmission, the HDMI interface transmission method of the present application can be independent of the network environment, and the transmission stability is also higher.

[0051] Table 1

[0052] In addition, different hardware interfaces correspond to different data transmission protocols. Refer to Table 1 and combine Figure 2 and Figure 3 , the data transmission protocol corresponding to the HDMI interface of the present application is the HDMI protocol, and the data format of the video stream of the HDMI interface can be the YUV format. When transmitting over the network, it can be transmitted through the crystal plug (RJ45) interface, and the data transmission protocol corresponding to the RJ45 interface is the Real Time Streaming Protocol (RTSP), and the data format of the video stream corresponding to the RJ45 interface can be H.265. When transmitting over USB, it can be transmitted through the Type C interface, and the data transmission protocol corresponding to the Type C interface is UVC (USB video class or USB video device class), and the data format of the video stream corresponding to the Type C interface can be H.264. Among them, transmitting the video stream from the Linux operating system development platform to the Android operating system development platform through network transmission or USB transmission is a prior art and will not be repeated here.

[0053] Since the present application can directly receive an HDMI video stream based on the HDMI interface of the first conversion chip 11, the first conversion chip 11 can convert the HDMI video stream into a video stream that can be directly received by the Android operating system, and send the converted video stream that can be directly received by the Android operating system to the Android operating system controller 12. The Android operating system controller 12 receives the video stream that can be directly received by the Android operating system, thereby quickly transmitting the HDMI video stream to the Android operating system.

[0054] In order to determine the identification information (camera id) of the virtual image acquisition module corresponding to the video stream so that the user can subsequently view the data (image information) of the video stream, based on the above embodiment, in the embodiment of the present application, the Android operating system controller 12 is further used to execute:

[0055] The identification information of the virtual image acquisition module corresponding to the video stream is determined, and the corresponding relationship between the video stream and the identification information is sent to a display device, so that the display device displays the corresponding relationship between the video stream and the identification information.

[0056] In a possible implementation, the computing power of the D845 baseboard of Qualcomm Snapdragon equipped with the Android operating system is usually small, for example, 3T. The D845 baseboard can be equivalent to a home set-top box, and the application (Application, App) of the virtual image acquisition module can be set based on the Android operating system of the D845 baseboard. In a possible implementation, the Android operating system controller 12 can determine the identification information of the virtual image acquisition module corresponding to the received video stream, wherein the identification information can be flexibly set according to demand, and the present application does not make specific restrictions on this. After determining the identification information of the virtual image acquisition module corresponding to the received video stream, the Android operating system controller 12 can send the corresponding relationship between the video stream and the identification information to the display device, and the display device can display the corresponding relationship between the video stream and the identification information in the App of the virtual image acquisition module, so that the user can know the corresponding relationship between the video stream and the identification information of the virtual image acquisition module corresponding to the video stream through the display device.

[0057] In order to allow the user to watch the data of the video stream, based on the above embodiments, in the embodiment of the present application, the Android operating system controller 12 is further used to execute:

[0058] In response to the received identification information, according to the stored correspondence between the video stream and the identification information, determine the video stream corresponding to the identification information, and send the video stream corresponding to the identification information to the second conversion chip;

[0059] The device also includes:

[0060] The second conversion chip is used to convert the received video stream into the HDMI video stream, and based on the HDMI interface of the second conversion chip, send the converted HDMI video stream to the display device, so that the display device displays the HDMI video stream.

[0061] In one possible implementation, a user can specify identification information of a virtual image acquisition module based on an App of the virtual image acquisition module installed in an electronic device. An Android operating system controller 12 in the electronic device can receive the identification information of the virtual image acquisition module specified by the user, and in response to the received identification information, determine a video stream corresponding to the received identification information of the virtual image acquisition module according to a correspondence between a saved video stream and the identification information.

[0062] In a possible implementation, since the display device that displays the video stream usually includes an HDMI interface, in order to send the video stream (such as a MIPI video stream) corresponding to the received identification information to the display device for display, a second conversion chip can be set between the core module SOM (Android operating system controller 12) of the D845 baseboard of Qualcomm Snapdragon equipped with the Android operating system and the display device, wherein one end of the HDMI interface of the second conversion chip is connected to the display device, and the other end is connected to the Android operating system controller 12. Figure 3 , Figure 3 A schematic diagram of the structure of a Qualcomm Snapdragon D845 baseboard provided by some embodiments is shown, such as Figure 3 As shown, the first conversion chip 11 and the second conversion chip can both be Longxun LT6911UXC conversion chips, and the first conversion chip 11 and the second conversion chip can both be set in the D845 baseboard of Qualcomm Snapdragon, wherein the first conversion chip 11 is set at the front end of the core module SOM of the D845 baseboard, and the second conversion chip is set at the back end of the core module SOM of the D845 baseboard. Specifically, the Android operating system controller 12 can first send the MIPI video stream corresponding to the identification information to the second conversion chip, and the second conversion chip is used to convert the received MIPI video stream corresponding to the identification information into an HDMI video stream, and based on the HDMI interface of the second conversion chip, send the converted HDMI video stream to the display device, and then refer to Figure 2 Taking the display device as a TV display screen as an example, the display device can receive the HDMI video stream sent by the second conversion chip and display the HDMI video stream.

[0063] In the present application, the Android operating system controller can determine the video stream corresponding to the virtual image acquisition module in response to the identification information of the received virtual image acquisition module, so that it can obtain (determine) the MIPI video stream corresponding to the HDMI video stream captured by the HDMI image acquisition module after being processed by the Linux operating system (background processing), just like obtaining the data of the MIPI video stream captured by the MIPI image acquisition module that the Android operating system can directly receive, and can convert the MIPI video stream into an HDMI video stream through a second conversion chip and send it to the display device for display, so that the user can view the image information captured by the HDMI image acquisition module through the display device, thereby ensuring the smoothness of the foreground human-computer interaction experience based on the Android operating system, and ensuring the power of the background processing function based on the Linux operating system.

[0064] For ease of understanding, the data transmission process provided by the present application is described below through a specific embodiment. Figure 4 , Figure 4 A schematic diagram of a video stream transmission process provided by some embodiments is shown. Figure 4 As shown, the electronic device is a home brain server on which both the Linux operating system and the Android operating system are installed.

[0065] The third conversion chip (not shown) can be set in the Xavier baseboard of NVIDIA equipped with the Linux operating system, and can receive the HDMI video stream collected by the HDMI visual texture sensor based on the HDMI interface of the third conversion chip. In one possible implementation, the data format of the HDMI video stream can be YUV422. The third conversion chip can be the Longxun LT6911UXC conversion chip. The third conversion chip can convert the received HDMI video stream into a MIPI video stream, and send the converted MIPI video stream to the Linux operating system controller. In one possible implementation, the Linux operating system controller can be a core module of NVIDIA. After receiving the MIPI video stream, the Linux operating system controller can process the MIPI video stream based on the Linux operating system.

[0066] The Linux operating system controller can send the video stream processed by the Linux operating system (HDMI video stream, data format is YUV422) to the HDMI interface of the first conversion chip 11 through the HDMI interface, wherein the first conversion chip 11 can be set in the D845 baseboard equipped with Qualcomm Snapdragon, that is, the HDMI video stream processed by the Linux operating system can be transmitted from NVIDIA's Xavier baseboard to the D845 baseboard of Qualcomm Snapdragon through the HDMI interface. In a possible implementation, the Android operating system controller 12 can be the core module SOM of D845 (D845 SOM in the figure), and the first conversion chip 11 can be set at the front end of D845 SOM. After receiving the HDMI video stream, the first conversion chip 11 can convert the HDMI video stream into a MIPI video stream and send the MIPI video stream to the Android operating system controller 12 (D845 SOM).

[0067] The Android operating system controller 12 determines the identification information (camera id) of the virtual image acquisition module corresponding to the received MIPI video stream, and sends the correspondence between the MIPI video stream and the identification information of the virtual image acquisition module to the display device, so that the display device displays the correspondence between the MIPI video stream and the identification information of the virtual image acquisition module. In a possible implementation, the display device can be a user's terminal. Among them, the identification information of the virtual image acquisition module corresponding to the received MIPI video stream can be determined by using existing technology, and the correspondence between the MIPI video stream and the identification information of the virtual image acquisition module can be sent to the display device, which will not be repeated here.

[0068] The user can specify the identification information of the virtual image acquisition module based on the APP of the virtual image acquisition module installed in the user's terminal, etc. The Android operating system controller 12 in the electronic device can receive the identification information of the virtual image acquisition module specified by the user, and in response to the received identification information, determine the MIPI video stream corresponding to the identification information of the virtual image acquisition module specified by the user according to the correspondence between the saved video stream and the identification information, and send the MIPI video stream to the second conversion chip.

[0069] The second conversion chip can convert the received MIPI video stream into an HDMI video stream, and based on the HDMI interface of the second conversion chip, send the converted HDMI video stream to the display device, so that the display device displays (plays) the HDMI video stream. In a possible implementation, the display device can be a television display.

[0070] In a possible implementation, the display device that displays the HDMI video stream and the display device that displays the correspondence between the video stream and the identification information of the virtual image acquisition module can be the same display device or can be different display settings. They can be flexibly set according to needs, and this application does not make any specific limitations on this.

[0071] Based on the same technical concept, the present application also provides a video stream transmission method. Figure 5 A schematic diagram of a video stream transmission process provided by some embodiments is shown. Figure 5 As shown, the method includes:

[0072] S501: receiving a high-definition multimedia interface HDMI video stream;

[0073] S502: Convert the HDMI video stream into a video stream that can be directly received by the Android operating system;

[0074] S503: Save the video stream.

[0075] In a possible implementation, the video stream transmission method provided in the embodiment of the present application is applied to an electronic device, which may be a PC, a mobile terminal or other device, or a server or the like. In a possible implementation, the electronic device may be a home brain server. The operating system of the electronic device includes at least an Android operating system. In a possible implementation, the electronic device may be a dual-system electronic device having both a Linux operating system and an Android operating system installed thereon.

[0076] In a possible implementation, the method further includes:

[0077] The identification information of the virtual image acquisition module corresponding to the video stream is determined, and the corresponding relationship between the video stream and the identification information is sent to a display device, so that the display device displays the corresponding relationship between the video stream and the identification information.

[0078] In a possible implementation, the method further includes:

[0079] In response to the received identification information, the video stream corresponding to the identification information is determined according to the correspondence between the saved video stream and the identification information, and the video stream corresponding to the identification information is sent to the second conversion chip, so that the second conversion chip converts the received video stream into the HDMI video stream, and the second conversion chip sends the converted HDMI video stream to a display device based on the HDMI interface of the second conversion chip, so that the display device displays the HDMI video stream.

[0080] Based on the same technical concept, the present application also provides a video stream transmission device, Figure 6 A schematic diagram of a video stream transmission device provided by some embodiments is shown, the device comprising:

[0081] The receiving module 61 is used to receive a high-definition multimedia interface HDMI video stream;

[0082] A conversion module 62, used for converting the HDMI video stream into a video stream that can be directly received by the Android operating system;

[0083] The saving module 63 is used to save the video stream.

[0084] In a possible implementation, the device further includes:

[0085] The determination module is used to determine the identification information of the virtual image acquisition module corresponding to the video stream, and send the corresponding relationship between the video stream and the identification information to the display device, so that the display device displays the corresponding relationship between the video stream and the identification information.

[0086] In a possible implementation, the device further includes:

[0087] The sending module is used to respond to the received identification information, determine the video stream corresponding to the identification information according to the corresponding relationship between the stored video stream and the identification information, and send the video stream corresponding to the identification information to the second conversion chip, so that the second conversion chip converts the received video stream into the HDMI video stream, and the second conversion chip sends the converted HDMI video stream to the display device based on the HDMI interface of the second conversion chip, so that the display device displays the HDMI video stream.

[0088] Based on the same technical concept, the present application also provides an electronic device, Figure 7 A schematic diagram of the structure of a third electronic device provided by some embodiments is shown, such as Figure 7 As shown, it includes: a processor 71, a communication interface 72, a memory 73 and a communication bus 74, wherein the processor 71, the communication interface 72, and the memory 73 communicate with each other through the communication bus 74;

[0089] The memory 73 stores a computer program. When the program is executed by the processor 71, the processor 71 performs the following steps:

[0090] Receive High Definition Multimedia Interface HDMI video stream;

[0091] Convert the HDMI video stream into a video stream that can be directly received by the Android operating system;

[0092] The video stream is saved.

[0093] In a possible implementation, the processor 71 is further used to determine identification information of a virtual image acquisition module corresponding to the video stream, and send the correspondence between the video stream and the identification information to a display device so that the display device displays the correspondence between the video stream and the identification information.

[0094] In one possible implementation, the processor 71 is also used to respond to the received identification information, determine the video stream corresponding to the identification information according to the correspondence between the saved video stream and the identification information, and send the video stream corresponding to the identification information to the second conversion chip, so that the second conversion chip converts the received video stream into the HDMI video stream, and the second conversion chip sends the converted HDMI video stream to the display device based on the HDMI interface of the second conversion chip, so that the display device displays the HDMI video stream.

[0095] Since the principle of solving the problem by the above electronic device is similar to that of the video stream transmission method, the implementation of the above electronic device can refer to the implementation of the video stream transmission method, and the repeated parts will not be repeated.

[0096] The communication bus mentioned in the above electronic device can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0097] The communication interface 72 is used for communication between the above electronic device and other devices.

[0098] The memory may include a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0099] The above-mentioned processor can be a general-purpose processor, including a central processing unit, a network processor (Network Processor, NP), etc.; it can also be a digital signal processing processor (Digital Signal Processing, DSP), an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, etc.

[0100] Based on the above embodiments, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program executable by an electronic device. When the program is executed on the electronic device, the electronic device implements the following steps:

[0101] Receive High Definition Multimedia Interface HDMI video stream;

[0102] Convert the HDMI video stream into a video stream that can be directly received by the Android operating system;

[0103] The video stream is saved.

[0104] In a possible implementation, the method further includes:

[0105] The identification information of the virtual image acquisition module corresponding to the video stream is determined, and the corresponding relationship between the video stream and the identification information is sent to a display device, so that the display device displays the corresponding relationship between the video stream and the identification information.

[0106] In a possible implementation, the method further includes:

[0107] In response to the received identification information, the video stream corresponding to the identification information is determined according to the correspondence between the saved video stream and the identification information, and the video stream corresponding to the identification information is sent to the second conversion chip, so that the second conversion chip converts the received video stream into the HDMI video stream, and the second conversion chip sends the converted HDMI video stream to a display device based on the HDMI interface of the second conversion chip, so that the display device displays the HDMI video stream.

[0108] The above-mentioned computer-readable storage medium can be any available medium or data storage device that can be accessed by the processor in the electronic device, including but not limited to magnetic storage such as floppy disks, hard disks, magnetic tapes, magneto-optical disks (MO), etc., optical storage such as CD, DVD, BD, HVD, etc., and semiconductor storage such as ROM, EPROM, EEPROM, non-volatile memory (NANDFLASH), solid-state drive (SSD), etc.

[0109] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0110] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0111] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0112] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0113] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. An electronic device, characterized in that: The electronic device is a home brain server that is installed with both a Linux operating system and an Android operating system, and the device includes: A third conversion chip, the third conversion chip is used to receive the HDMI video stream sent by the high-definition multimedia interface HDMI image acquisition module, and convert the received HDMI video stream into a video stream that can be directly processed by the Linux operating system; wherein the third conversion chip is set on the Xavier baseboard of NVIDIA; A Linux operating system controller, the Linux operating system controller is used to receive the converted video stream sent by the third conversion chip, and send the HDMI video stream processed by the Linux operating system to the first conversion chip based on the HDMI interface of the NVIDIA Xavier baseboard; A first conversion chip, the first conversion chip is used to receive the HDMI video stream processed by the Linux operating system and sent by the Linux operating system controller based on the high-definition multimedia interface HDMI of the first conversion chip, and convert the received HDMI video stream into a video stream that can be directly received by the Android operating system; wherein the first conversion chip is arranged on the D845 baseboard of Qualcomm Snapdragon; An Android operating system controller, wherein the Android operating system controller is used to receive the converted video stream sent by the first conversion chip.

2. The device according to claim 1, characterized in that The Android operating system controller is also used to execute: The identification information of the virtual image acquisition module corresponding to the video stream is determined, and the corresponding relationship between the video stream and the identification information is sent to a display device, so that the display device displays the corresponding relationship between the video stream and the identification information.

3. The device according to claim 2, characterized in that The Android operating system controller is also used to execute: In response to the received identification information, according to the stored correspondence between the video stream and the identification information, determine the video stream corresponding to the identification information, and send the video stream corresponding to the identification information to the second conversion chip; The device also includes: The second conversion chip is used to convert the received video stream into the HDMI video stream, and based on the HDMI interface of the second conversion chip, send the converted HDMI video stream to the display device, so that the display device displays the HDMI video stream.

4. The device according to any one of claims 1 to 3, characterized in that: The video stream that the Android operating system can directly receive is a mobile industry processor interface MIPI video stream.

5. A video stream transmission method, characterized in that: The method comprises: Based on a third conversion chip arranged on the Xavier baseboard of NVIDIA, a high-definition multimedia interface HDMI video stream is received; the received HDMI video stream is converted into a video stream that can be directly processed by the Linux operating system, and the video stream is processed based on the Linux operating system; Based on the HDMI interface of NVIDIA's Xavier baseboard, the HDMI video stream processed by the Linux operating system is sent to a first conversion chip set on the D845 baseboard of Qualcomm Snapdragon; and based on the first conversion chip, the HDMI video stream processed by the Linux operating system is converted into a video stream that can be directly received by the Android operating system; The video stream that the Android operating system can directly receive is saved.

6. The method according to claim 5, characterized in that The method further comprises: Determine the identification information of the virtual image acquisition module corresponding to the video stream that the Android operating system can directly receive, and send the corresponding relationship between the video stream that the Android operating system can directly receive and the identification information to a display device, so that the display device displays the corresponding relationship between the video stream that the Android operating system can directly receive and the identification information.

7. The method according to claim 6, characterized in that The method further comprises: In response to the received identification information, the video stream corresponding to the identification information is determined according to the correspondence between the saved video stream and the identification information, and the video stream corresponding to the identification information is sent to the second conversion chip, so that the second conversion chip converts the received video stream into the HDMI video stream, and the second conversion chip sends the converted HDMI video stream to a display device based on the HDMI interface of the second conversion chip, so that the display device displays the HDMI video stream.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the video stream transmission method according to any one of claims 5 to 7 are implemented.

Images