Video live-streaming method and apparatus, video processing method and apparatus, and storage medium

Abstract

Disclosed in the present application are a video live-streaming method and apparatus, a video processing method and apparatus, and a storage medium, which methods are used for a live-streaming device. The video live-streaming method comprises: generating a push video to be pushed to a live-streaming platform; writing first video image data of the push video into a first device file deployed in an operating system, wherein the first device file corresponds to a first camera associated with a live-streaming application, and the live-streaming application corresponds to the live-streaming platform; and using the live-streaming application to read the first video image data from the first device file via the operating system, and transmitting the first video image data to the live-streaming platform.

Description

Video live broadcast and video processing method, device and storage medium Technical Field

[0001] The present application relates to the field of video live broadcast technology, and in particular to a video live broadcast and video processing method, device and storage medium. Background Art

[0002] Currently, with the advancement of network communication technology, live streaming has been increasingly developed and applied. Live streaming devices for live streaming have been proposed to generate push videos based on video images from different video sources and push them to a live streaming platform.

[0003] Among them, the invention patent application with the published application number 2023108768297 and the invention name “Live broadcast control method, device, system and storage medium” discloses a live broadcast device that can receive video images from multiple video sources (such as cameras, computers and mobile phones), and generate a push video based on the received video image to be pushed to the live broadcast platform (wherein the live broadcast platform can be, for example, the Douyin live broadcast platform, the Kuaishou live broadcast platform or the Huya live broadcast platform, etc.), and send the push video to the live broadcast platform. In addition, although the invention patent application has not been published, the Android system can be used as an operating system for live broadcast devices.

[0004] In reality, live streaming device users, or streamers, are often deeply tied to various live streaming platforms. Consequently, when using their live streaming devices, streamers inevitably want to use their desired live streaming applications (which correspond to live streaming platforms) to broadcast live, so that their videos can be pushed to the desired live streaming platforms. However, because existing live streaming applications (such as the Douyin and Kuaishou apps) are developed for tablet devices like mobile phones, these applications typically capture video images from the tablet's front or rear camera by default.

[0005] In this case, even if the live broadcasting application corresponding to the live broadcasting platform (such as the Douyin application and the Kuaishou application) is installed on the live broadcasting device, the live broadcasting application cannot push the push video generated by the live broadcasting device to the corresponding live broadcasting platform. Therefore, the anchor cannot push the push video generated by the live broadcasting device to the desired live broadcasting platform through the desired live broadcasting application, and thus cannot use the live broadcasting device to broadcast on the desired live broadcasting platform.

[0006] With respect to the technical problem in the above-mentioned prior art that the anchor personnel cannot send the push video generated by the live broadcast device to the corresponding live broadcast platform through the desired live broadcast application, no effective solution has been proposed yet. Summary of the Invention

[0007] The embodiments of the present disclosure provide a video live broadcast and video processing method, device and storage medium to at least solve the technical problem in the prior art that the anchor cannot send the push video generated by the live broadcast device to the corresponding live broadcast platform through the desired live broadcast application.

[0008] According to one aspect of an embodiment of the present disclosure, a video live broadcast method is provided for a live broadcast device, including: generating a push video for pushing to a live broadcast platform; writing first video image data of the push video into a first device file deployed on an operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform; and using the live broadcast application to read the first video image data from the first device file via the operating system, and transmitting the first video image data to the live broadcast platform.

[0009] According to another aspect of an embodiment of the present disclosure, a video processing method is also provided for a live broadcast device, including: generating a push video for pushing to a live broadcast platform; and writing the first video image data of the push video into a first device file configured by an operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

[0010] According to another aspect of an embodiment of the present disclosure, a storage medium is further provided, the storage medium including a stored program, wherein when the program is run, a processor executes any one of the above methods.

[0011] According to another aspect of an embodiment of the present disclosure, a video live broadcast device is also provided, including: a first push video generation module, used to generate a push video for being pushed to a live broadcast platform; a first data writing module, used to write the first video image data of the push video into a first device file deployed on an operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform; and a first data reading module, used to use the live broadcast application to read the first video image data from the first device file via the operating system, and transmit the first video image data to the live broadcast platform.

[0012] According to another aspect of an embodiment of the present disclosure, a video processing device is also provided, including: a second push video generation module, used to generate a push video for pushing to a live broadcast platform; and a second data writing module, used to write the first video image data of the push video into a first device file configured by an operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

[0013] According to another aspect of an embodiment of the present disclosure, a video live broadcast device is also provided, including: a first processor; and a first memory, connected to the first processor, for providing the first processor with instructions for processing the following processing steps: generating a push video for pushing to a live broadcast platform; writing the first video image data of the push video into a first device file deployed on an operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform; and using the live broadcast application to read the first video image data from the first device file via the operating system, and transmit the first video image data to the live broadcast platform.

[0014] According to another aspect of an embodiment of the present disclosure, a video processing device is also provided, including: a second processor; and a second memory connected to the second processor, for providing the second processor with instructions for processing the following processing steps: generating a push video for pushing to a live broadcast platform; and writing the first video image data of the push video into a first device file configured by an operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

[0015] This application provides a method for live video streaming, which is applied to a live streaming device. First, a video processing application generates a push video for push to a live streaming platform. Then, the video processing application writes first video image data of the push video to a first device file deployed in an operating system. Finally, the live streaming application reads the first video image data from the first device file via the operating system and transmits the first video image data to the live streaming platform.

[0016] Since the first device file in this application corresponds to the first camera associated with the live broadcast application, and the live broadcast application corresponds to the live broadcast platform, after the operating system receives a request to obtain data from the first camera, the operating system directly reads the corresponding data from the first device file and sends the read data to the live broadcast application.

[0017] Furthermore, since this application writes the first video image data of the pushed video into the first device file, the data read by the operating system from the first device file is the first video image data of the pushed video. Thus, after the operating system sends the first video image data to the live broadcast application, the live broadcast application transmits the first video image data to the live broadcast platform. Thus, the viewer user can watch the live broadcast corresponding to the pushed video on the corresponding live broadcast platform through the terminal device.

[0018] This achieves the technical effect of ensuring that the anchor can use the desired live broadcast platform for live broadcasting, thereby solving the technical problem in the prior art that the anchor cannot send the push video generated by the live broadcast device to the corresponding live broadcast platform through the desired live broadcast application. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The drawings described herein are used to provide a further understanding of the present disclosure and constitute a part of this application. The illustrative embodiments of the present disclosure and their descriptions are used to explain the present disclosure and do not constitute an improper limitation of the present disclosure. In the drawings:

[0020] FIG1 is a schematic diagram of a video live broadcast system and multiple live broadcast platforms according to Example 1 of the present application;

[0021] FIG2 is a schematic diagram of hardware modules of a video live broadcast system and multiple live broadcast platforms according to Example 1 of the present application;

[0022] FIG3 is a schematic diagram of the hierarchical relationship structure of the video live broadcast system according to Example 1 of the present application;

[0023] FIG4 is a flow chart of the video live broadcast method according to Example 1 of the present application;

[0024] FIG5 is a flowchart of a video processing method according to Embodiment 1 of the present application;

[0025] FIG6 is a schematic diagram of a video live broadcast device according to Example 2 of the present application;

[0026] FIG7 is a schematic diagram of a video processing device according to Embodiment 2 of the present application;

[0027] FIG8 is a schematic diagram of a video live broadcast device according to Embodiment 3 of the present application; and

[0028] FIG9 is a schematic diagram of a video processing device according to Embodiment 3 of the present application. DETAILED DESCRIPTION

[0029] In order to enable those skilled in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present disclosure.

[0030] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0031] First, some nouns or terms that appear in the description of the embodiments of the present disclosure are subject to the following explanations:

[0032] Pushed video: The pushed video mentioned in the present invention refers to a video generated by a live broadcast device and sent to a live broadcast platform for live broadcast.

[0033] Live video: The live video mentioned in the present invention refers to the video corresponding to the pushed video sent by the live broadcast platform to the terminal devices of each viewer user.

[0034] Live streaming device: The live streaming device described in this invention refers to a device with live streaming functionality, which refers to the ability to send generated push videos to a live streaming platform. Therefore, the live streaming device described in this invention also includes computers, mobile phones, tablets, etc. that have live streaming applications installed.

[0035] Example 1

[0036] According to this embodiment, an embodiment of a method for live video broadcast and video processing is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0037] Figure 1 is a schematic diagram of a video live broadcast system and multiple live broadcast platforms according to Example 1 of the present application. Referring to Figure 1 , the video live broadcast system includes: a live broadcast device 100 and multiple different types of video sources 201-206.

[0038] As shown in FIG1 , video sources 201 to 204 are connected to the live broadcast device 100, for example, via corresponding video source input interfaces, and video sources 205 to 206 can also be connected to the live broadcast device 100 for communication (wherein, the network used by the video sources 205 to 206 to communicate with the live broadcast device 100 includes, but is not limited to, a mobile communication network, a wireless network, etc.). Furthermore, video sources 201 to 206 can include, for example, a camera 201, a camera 202, a computer 203, a computer 204, a tablet computer 205, and a tablet computer 206. It should be noted that those skilled in the art should understand that the above are merely examples of the types of video sources and the methods of connecting the video sources to the live broadcast device 100, and the actual situation is not limited thereto.

[0039] In addition, as shown in Figure 1, multiple live streaming platforms 301 to 30n are also included. After generating a pushed video, the processor in the live streaming device 100 transmits the first video image data corresponding to the pushed video to the live streaming platforms 301 to 30n. Thus, the audience user can watch the live video corresponding to the pushed video from the corresponding live streaming platforms 301 to 30n through the terminal device. Among them, the live streaming platforms can be, for example, the Douyin live streaming platform, the Kuaishou live streaming platform, and the Huya live streaming platform.

[0040] It is worth noting that, although not shown in FIG1 , the video source may also be, for example, a video image stored locally in the live broadcast device 100 or a network video image accessed by the processor in the live broadcast device 100 through a link address, etc., and no specific limitation is made here.

[0041] FIG2 is a schematic diagram of the hardware modules of the video live broadcast system and multiple live broadcast platforms according to Example 1 of the present application. Referring to FIG2 , the camera 201 is connected to the processor 110 in the live broadcast device 100 via the deserializer 111; the camera 202 is connected to the processor 110 in the live broadcast device 100 via the USB interface 112; the computer 203 is connected to the processor 110 in the live broadcast device 100 via the HDMI interface 113; the computer 204 is connected to the processor 110 in the live broadcast device 100 via the HDMI interface 114; the mobile phone 205 is connected to the processor 110 in the live broadcast device 100 via the mobile communication circuit 115; and the mobile phone 206 is connected to the processor 110 in the live broadcast device 100 via the network communication circuit 116.

[0042] Furthermore, as shown in FIG2 , the processor 110 in the live broadcast device 100 is communicatively connected to the live broadcast platforms 301 to 30n via the network communication circuit 116, thereby being able to transmit the first video image data corresponding to the pushed video to the live broadcast platforms 301 to 30n. Furthermore, although not shown in FIG2 , the processor 110 may also be communicatively connected to the live broadcast platforms 301 to 30n via, for example, the mobile communication circuit 115.

[0043] It is worth noting that the processor 110 may send the first video image data to one live broadcast platform, or may send the first video image data to multiple different live broadcast platforms, which is not specifically limited here.

[0044] Figure 3 is a schematic diagram of the hierarchical structure of a live video streaming system according to an embodiment of the present application. As shown in Figure 3 , live streaming device 100 is deployed with an operating system and the hardware layer below the operating system. In this embodiment, Android is used as an example operating system. Furthermore, as shown in Figure 3 , the operating system includes a driver layer, a HAL layer, a camera service layer, a camera framework layer, and an application layer.

[0045] Among them, a video processing application is deployed at the application layer. The video processing application is used to generate push videos during the live broadcast process. In addition, multiple live broadcast applications 1 to n are also deployed at the application layer. Live broadcast applications 1 to n are used to transmit push videos to the corresponding live broadcast platform. Among them, live broadcast applications 1 to n can be, for example, live broadcast applications developed by third parties based on the Android system (for example, Douyin application and Kuaishou application, etc.).

[0046] Furthermore, the driver layer of the operating system is deployed with a first device file (for example, the first device file may be \dev\video0 deployed in the \dev directory of the operating system). And the corresponding function can be used at the HAL layer to specify the first device file as the device file corresponding to the first camera associated with the live broadcast application 1~n. For example, the first camera associated with the live broadcast application 1~n is the front camera of a tablet device such as a mobile phone, so the corresponding function can be used at the HAL layer to specify the first device file as the device file corresponding to the front camera associated with the live broadcast application 1~n. Alternatively, the first camera associated with the live broadcast application 1~n is the rear camera of a tablet device such as a mobile phone, so the corresponding function can be used at the HAL layer to specify the first device file as the device file corresponding to the rear camera associated with the live broadcast application 1~n. Thus, when the video processing application writes the video image data to the first device file, the live broadcast application 1~n can receive the video image data read from the first device file by the operating system.

[0047] The operating system can also create a corresponding second device file at the driver layer based on the type of the video source input interface at the hardware layer. For example, the hardware layer includes a deserializer 111, a USB interface 112, a network communication circuit 116, and an HDMI interface 113. For the deserializer 111, regardless of whether the deserializer 111 is connected to the camera 201, the operating system will generate a corresponding second device file. The second device file can be, for example, \dev\video1 under the \dev directory of the operating system. For the HDMI interface 113, regardless of whether the HDMI interface 113 is connected to the computer 203, the operating system will generate a corresponding second device file. The second device file can be, for example, \dev\video2 under the \dev directory of the operating system. For the USB interface 112, the operating system will only generate a corresponding second device file if the USB interface 112 is connected to the camera 202. The second device file can be, for example, \dev\video3 under the \dev directory of the operating system. For the network communication circuit 116, the operating system does not generate a corresponding second device file.

[0048] In addition, it is worth noting that in this embodiment, Android is used as an example of an operating system for description, but those skilled in the art should be aware that other types of operating systems are also within the scope of protection of this application.

[0049] In the above operating environment, according to the first aspect of this embodiment, a method for live video broadcasting is provided, which is implemented by the processor 110 shown in Figure 2. Figure 4 shows a flow chart of the method. Referring to Figure 4, the method includes:

[0050] S402: Generate a push video for pushing to the live broadcast platform;

[0051] S404: Writing first video image data of the pushed video into a first device file deployed in the operating system, wherein the first device file corresponds to a first camera associated with the live broadcast application, and the live broadcast application corresponds to the live broadcast platform; and

[0052] S406: Using the live broadcast application program to read the first video image data from the first device file via the operating system, and transmitting the first video image data to the live broadcast platform.

[0053] Specifically, first, when the anchor performs a live video broadcast, the anchor uses the live broadcast device 100 to generate a push video for pushing to the live broadcast platform (S402).

[0054] Furthermore, the live broadcast device 100 writes the generated first video image data of the pushed video into the first device file deployed in the operating system (S404). As described above, the first device file can be \dev\video0 deployed in the \dev directory of the operating system. Thus, the live broadcast device 100 writes the generated first video image data of the pushed video into the device file. In addition, with reference to the above, in this embodiment, the corresponding function can be used in advance in the HAL layer to specify the first device file as the device file corresponding to the first camera associated with the live broadcast application 1~n. Specifically, in this embodiment, the live broadcast application (for example, the TikTok application and the Kuaishou application, etc.) is a live broadcast application developed by a third party based on a tablet device such as a mobile phone, and the live broadcast application obtains video data from the front camera or rear camera of the tablet device by default. Therefore, in this embodiment, the first camera corresponds to the default front camera or rear camera of the live broadcast application. Furthermore, in this embodiment, the corresponding function can be used in advance in the HAL layer to specify the first device file as the device file corresponding to the front camera or rear camera of the tablet device, so that the live broadcast application can read video data from the first device file through the operating system.

[0055] Finally, the live broadcast application reads the first video image data from the first device file via the operating system and transmits the first video image data to the live broadcast platform (S406). Referring to the above description, since the first device file in this embodiment corresponds to the first camera associated with the live broadcast application, the live broadcast application can obtain the first video image data corresponding to the pushed video from the first device file via the operating system and send the first video image data as the pushed video to the live broadcast platform.

[0056] Based on the content described in the background technology, it can be known that existing live broadcast applications (for example, the Tik Tok application and the Kuaishou application, etc.) are all developed based on tablet devices such as mobile phones, and the live broadcast application obtains video image data from the front camera or rear camera of the tablet device by default. For example, when the anchor needs to broadcast live, the live broadcast application responds to the anchor's click operation and sends a request to the operating system in the tablet device to obtain the video image from the front camera. Then, the operating system responds to the request and reads the video image data taken by the front camera from the device file corresponding to the front camera. After that, the operating system sends the read video image data to the live broadcast application, so that the live broadcast application can generate a push video based on the video image data taken by the front camera, and transmit the push video to the live broadcast platform.

[0057] Since existing live broadcast applications are all developed based on tablet devices, that is, the live broadcast applications obtain video image data from the front camera or rear camera of the tablet device by default, even if a live broadcast application corresponding to the live broadcast platform (for example, the Douyin application and the Kuaishou application, etc.) is installed in the live broadcast device, the live broadcast application cannot push the push video generated by the live broadcast device to the live broadcast platform desired by the anchor.

[0058] Therefore, in order to solve the above problem, this embodiment deploys a first device file in the operating system of the live broadcast device. The first device file corresponds to the first camera associated with the live broadcast application. The first camera can be, for example, the default camera used by the live broadcast application (for example, the first camera corresponds to the front camera or rear camera of the tablet device). Thus, the live broadcast application can obtain the first video image data corresponding to the pushed video from the first device file through the operating system, and send the first video image data as the pushed video to the live broadcast platform.

[0059] Based on the above description, since the first device file corresponds to the first camera associated with the live broadcast application, no matter what the circumstances, as long as the operating system receives a request sent by the live broadcast application to obtain video image data from the first camera, the operating system will read the corresponding video image data from the pre-deployed first device file.

[0060] Thus, during a live broadcast, the live broadcast device can, for example, write the first video image data of a pushed video into a first device file. The live broadcast application can, through the operating system, retrieve the first video image data corresponding to the pushed video from the first device file and send the first video image data as a pushed video to the live broadcast platform. The host can then use the desired live broadcast application to send the pushed video generated by the live broadcast device to the corresponding live broadcast platform, and the audience can watch the live video corresponding to the pushed video on the corresponding live broadcast platform through their terminal devices.

[0061] This achieves the technical effect of ensuring that anchors can use live broadcast equipment to broadcast live on the desired live broadcast platform. This solves the technical problem in the prior art that anchors cannot send the push video generated by the live broadcast equipment to the corresponding live broadcast platform through the desired live broadcast application.

[0062] Optionally, the operation of reading the first video image data from the first device file via the operating system using the live broadcast application includes: using the live broadcast application to send a request to the operating system to obtain data from the first camera; and using the live broadcast application to receive from the operating system the first video image data read by the operating system from the first device file.

[0063] Specifically, as shown in FIG3 , for example, when a live streamer uses live streaming device 100 to broadcast live via the live streaming platform corresponding to live streaming applications 1-n, live streaming applications 1-n on live streaming device 100 each send a request to the operating system to obtain video image data from their respective associated first cameras (e.g., the front camera or rear camera of a tablet device). The operating system then responds to the data acquisition requests sent by live streaming applications 1-n by reading the first video image data from the first device file and sending the read first video image data to live streaming applications 1-n, respectively.

[0064] Therefore, in the technical solution of this application, the live broadcast device can be used to push the pushed video to the corresponding live broadcast platform through any live broadcast application supported by the operating system. Therefore, for the anchor, only the desired live broadcast application needs to be installed in the operating system of the live broadcast device, and the live broadcast device can be used to broadcast on the live broadcast platform corresponding to the live broadcast application, thus facilitating the use of the anchor.

[0065] Optionally, the operation of generating a push video for pushing to a live broadcast platform includes: generating a push video using a video processing application; and the operation of writing the first video image data of the push video into a first device file deployed on the operating system includes: writing the first video image data of the push video into the first device file using a video processing application.

[0066] Specifically, as shown in Figure 3, during a live broadcast, a video processing application generates a push video for push to the live broadcast platform. The video processing application then writes the first video image data of the push video to a first device file deployed in the driver layer of the operating system (for example, the first device file can be \dev\video0 deployed in the \dev directory of the operating system). Thus, once the video processing application writes the first video image data of the push video to the first device file, live broadcast applications 1-n can read the first video image data from the first device file.

[0067] In the existing technology, anchors usually use live broadcast applications installed on tablet devices to generate push videos. However, since live broadcast applications correspond one-to-one to live broadcast platforms (for example, the Douyin application corresponds to the Douyin platform, and the Kuaishou application corresponds to the Kuaishou platform), if anchors want to broadcast live on multiple live broadcast platforms at the same time, they must use multiple tablet devices to be able to broadcast live on different live broadcast platforms at the same time.

[0068] In the technical solution of this application, during live streaming, a video processing application installed on the live streaming device can be used to generate a push video and write the first video image data of the push video into a first device file. Furthermore, live streaming applications 1-n can each obtain the first video image data from the first device file through the operating system and transmit the first video image data as a push video to their corresponding live streaming platforms.

[0069] Therefore, for anchors, even if they need to broadcast live on multiple live broadcast platforms at the same time, they do not need to use multiple live broadcast applications installed on different tablet devices to broadcast live separately. They only need to install the video processing application and the live broadcast application corresponding to the live broadcast platform desired by the anchor on the live broadcast device, and they can broadcast live on different live broadcast platforms at the same time, thereby achieving the technical effect of reducing economic costs and facilitating live broadcasts for anchors.

[0070] Optionally, the operation of generating a push video for pushing to a live broadcast platform includes: obtaining second video image data from at least one video source, wherein at least one video source includes a video source different from a first camera associated with the live broadcast application; and generating a push video based on the second video image data.

[0071] Specifically, as shown in FIG3 , the video processing application first obtains second video image data from at least one video source. The at least one video source includes a video source different from the first camera associated with the live broadcast application. Furthermore, the second video image data may be, for example, video image data obtained by the live broadcast device 100 from the at least one video source and not yet processed by the video processing application.

[0072] The at least one video source mentioned above can be, for example, a camera connected to the live broadcast device 100, an external computer or mobile phone, a video image stored locally on the live broadcast device 100, or a network video image accessed by the live broadcast device 100 via a link address. In short, the at least one video source mentioned above is a different video source from the first camera associated with the live broadcast application, and no specific limitation is imposed herein.

[0073] Thereafter, when the video processing application obtains second video image data from at least one video source, a push video is generated based on the second video image data for pushing to the live broadcast platform.

[0074] Unlike existing anchors who can only use live broadcast applications installed on mobile phones, tablets or computers to generate push videos, in the technical solution of this application, at least one video source including a mobile phone, tablet computer or computer can be connected to the live broadcast device, so that the video processing application can receive the second video image data transmitted by at least one video source and generate push videos based on the second video image data.

[0075] Therefore, in the technical solution of the present application, the pushed video used to be pushed to the live broadcast platform contains richer image information than the pushed video directly generated by the live broadcast application installed on the mobile phone, tablet computer or computer, thereby achieving the technical effect of attracting audience users to watch the live broadcast.

[0076] Optionally, the at least one video source includes a second camera different from the first camera, and the operation of obtaining second video image data from the at least one video source includes: using the operating system to read the second video image data from a second device file corresponding to the second camera.

[0077] Specifically, referring to FIG3 , first, the operating system automatically creates a corresponding second device file at the driver layer according to the type of the video source input interface at the hardware layer, and writes the second video image data into the corresponding second device file.

[0078] In the case where the video source input interface is a deserializer and / or an HDMI interface, the operating system will pre-generate a corresponding second device file regardless of whether the deserializer and / or HDMI interface is connected to a corresponding video source. Furthermore, when the deserializer and / or HDMI interface is connected to a corresponding video source, the operating system directly writes the received second video image data into the corresponding second device file.

[0079] For example, when the video source input interface is the deserializer 111 and the deserializer 111 in the live broadcast device 100 is connected to the camera 201, the operating system directly writes the received second video image data into the corresponding second device file 1.

[0080] For another example, when the video source input interface is the HDMI interface 113 and the HDMI interface 113 of the live broadcast device 100 is connected to the computer 203, the operating system directly writes the received second video image data into the corresponding second device file 2.

[0081] Furthermore, when the video source input interface is the USB interface 112, the operating system dynamically generates the second device file 3. That is, when the USB interface 112 is connected to the camera 202, the operating system generates the corresponding second device file 3; when the USB interface 112 is not connected to the camera 202, the operating system does not generate the corresponding second device file 3.

[0082] In addition, it is worth noting that when the live broadcast device 100 receives the second video image data corresponding to the mobile phone 205 through the mobile communication circuit 115, and / or receives the second video image data corresponding to the mobile phone 206 through the network communication circuit 116, the operating system directly writes the second video image data into the memory without generating a second device file.

[0083] If the live broadcast device 100 does not have an external video source, and the second video image data transmitted to the video processing application is a video image locally stored in the live broadcast device 100 or a network video image accessed by the live broadcast device 100 via a link address, the operating system does not need to deploy the second device file at the driver layer. The operating system can directly send the second video image data of the locally stored video image or the second video image data of the network video image accessed via the link address to the video processing application at the application layer.

[0084] In addition, it is worth noting that there can be one or more second device files.

[0085] For example, when there is a deserializer 111 or an HDMI interface 113 in the live broadcast device 100, the operating system pre-generates a corresponding second device file 1 or second device file 2. Then, the operating system writes the second video image data received through the deserializer 111 or the HDMI interface 113 into the corresponding second device file 1 or second device file 2.

[0086] For another example, when the live broadcast device 100 includes a deserializer 111 and an HDMI interface 113, the operating system pre-generates corresponding second device files 1 and 2. The operating system then writes the second video image data received through the deserializer 111 and the HDMI interface 113 into the corresponding second device files 1 and 2.

[0087] For another example, when both a deserializer 111 and / or an HDMI interface 113 and a USB interface 112 are present in the live broadcast device 100, the operating system pre-generates a second device file 1 and / or a second device file 2 corresponding to the deserializer 111 and / or the HDMI interface 113. Then, when second video image data transmitted by the corresponding video source is received through the deserializer 111 and / or the HDMI interface 113, the second video image data is written into the pre-generated second device file 1 and / or the second device file 2. When the USB interface 112 is connected to a video source, the operating system dynamically generates a corresponding second device file 3 and writes the second video image data received through the USB interface 112 into the corresponding second device file 3.

[0088] The operating system then reads the second video image data from the second device file corresponding to the second camera, and sends the second video image data to the video processing application, so that the video processing application performs image fusion and / or image processing on the second video image data to generate a push video for pushing to the live broadcast platform.

[0089] In the technical solution of this application, since a second device file is deployed at the driver layer, the operating system can write the second video image data of at least one video source external to the live broadcast device into the second device file. The operating system can then read the second video image data from the second device file and send the second video image data to the video processing application. Therefore, when a live broadcaster needs to use an external video source for live broadcasting, the video processing application can obtain the second video image data from the external video source, thereby ensuring that the live broadcaster can continue normally.

[0090] Optionally, before generating a push video for pushing to a live broadcast platform, the method further includes: deploying a first device file in an operating system; and associating the first camera with the first device file in the operating system.

[0091] Specifically, as shown in reference figure 3, before the video processing application generates a push video for pushing to the live broadcast platform, a first device file is also deployed in the driver layer of the operating system. Thus, the corresponding function can be used at the HAL layer to specify the first device file as the device file corresponding to the first camera associated with the live broadcast application. For example, when the first camera associated with the live broadcast application is the rear camera of the mobile phone, the function ( / dev / video0 when specifying the rear camera const uint8_tfacing=ANDROID_LENS_FACING_BACK;UPDATE(ANDROID_LENS_FACING,&facing,1)) can be used at the HAL layer to specify the first device file, so that when the video processing application writes the first video image data to the first device file, the live broadcast application can read the first video image data from the first device file.

[0092] Alternatively, when the first camera associated with the live broadcast application is the front camera of the mobile phone, the front camera can be specified in the HAL layer using the function ( / dev / video1 const uint8_tfacing=ANDROID_LENS_FACING_FRONT; UPDATE(ANDROID_LENS_FACING, &facing, 1) to specify the first device file, so that when the video processing application writes the first video image data to the first device file, the live broadcast application can read the first video image data from the first device file.

[0093] Therefore, in the technical solution of the present application, when the live broadcast application sends a request to the operating system to obtain data from the first camera, the operating system reads the first video image data from the first device file and sends the first video image data to the live broadcast application. Therefore, for the live broadcaster, only need to send a live broadcast instruction to the live broadcast device 100 through the live broadcast application to start the live broadcast, thereby achieving the technical effect of facilitating the live broadcast of the live broadcast device by the live broadcaster.

[0094] Thus, according to the first aspect of this embodiment, the technical effect of ensuring that the anchor can use the desired live broadcast platform for live broadcast is achieved.

[0095] Thus, during the live broadcast process, the live broadcast device 100 obtains the second video image data from the external camera and uses the operating system to write the second video image data to the second device file. Then, the operating system reads the second video image data from the second device file and sends the second video image data to the video processing application. Thereafter, the video processing application generates a push video based on the second video image data and writes the first video image data of the push video to the first device file. Furthermore, the live broadcast application sends a request to the operating system to obtain video image data from the respective associated first cameras. Then, in response to the request, the operating system reads the first video image data from the first device file and sends the first video image data to the live broadcast application. Finally, the live broadcast application sends the first video image data of the push video to the corresponding live broadcast platform.

[0096] In addition, according to the second aspect of this embodiment, a video processing method is provided, which is implemented by the processor 110 shown in Figure 2. Figure 5 shows a flow chart of the method. Referring to Figure 5, the method includes:

[0097] S502: Generate a push video for pushing to the live broadcast platform; and

[0098] S504: Writing the first video image data of the pushed video into a first device file configured by the operating system, wherein the first device file corresponds to the first camera associated with the live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

[0099] It is worth noting that, as described in the first aspect of the embodiment of the present application, the live broadcast device 100 can be pre-installed with a live broadcast application, so that the operating system can send the first video image data read from the first device file to the pre-installed live broadcast application, and the live broadcast application transmits the first video image data to the live broadcast platform. As described in the second aspect of the embodiment of the present application, the live broadcast device 100 may not have a live broadcast application pre-installed, and the live broadcast application may be downloaded during the live video broadcast. For example, the live broadcast application may be downloaded after the live broadcast device 100 is connected to an external video source; or the live broadcast application may be downloaded after the live broadcast device 100 calls a locally stored video image or accesses a network video image through a link address. No specific limitation is made here.

[0100] Therefore, according to the second aspect of this embodiment, the technical effect of ensuring that the anchor can use the live broadcast equipment to broadcast live on the desired live broadcast platform is achieved.

[0101] In addition, referring to FIG1 , according to a third aspect of this embodiment, a storage medium is provided, wherein the storage medium includes a stored program, wherein when the program is run, a processor executes any one of the above methods.

[0102] Therefore, according to this embodiment, the technical effect of ensuring that the anchor can use the live broadcast equipment to broadcast live on the desired live broadcast platform is achieved.

[0103] It should be noted that for the aforementioned method embodiments, for simplicity of description, they are all expressed as a series of action combinations. However, those skilled in the art should be aware that the present invention is not limited by the order of the actions described, because according to the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

[0104] Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus the necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0105] Example 2

[0106] FIG6 shows a video live broadcast apparatus 600 according to the first aspect of this embodiment, which corresponds to the method according to the first aspect of Example 1. Referring to FIG6 , the apparatus 600 includes: a first push video generation module 610 for generating a push video for pushing to a live broadcast platform; a first data writing module 620 for writing first video image data of the push video to a first device file deployed in an operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform; and a first data reading module 630 for reading the first video image data from the first device file via the operating system using the live broadcast application, and transmitting the first video image data to the live broadcast platform.

[0107] Optionally, the first data reading module 630 includes: a first data acquisition module, used to use the live broadcast application to send a request to the operating system to obtain data from the first camera; and a data receiving module, used to use the live broadcast application to receive the first video image data read by the operating system from the first device file from the operating system.

[0108] Optionally, the first push video generation module 610 includes: a first push video generation sub-module, used to generate a push video using a video processing application; and a first data writing module 620, including: a first data writing sub-module, used to write the first video image data of the push video into the first device file using the video processing application.

[0109] Optionally, the first push video generation module 610 includes: a second data acquisition module, used to obtain second video image data from at least one video source, wherein at least one video source includes a video source different from the first camera associated with the live broadcast application; and a second push video generation submodule, used to generate a push video based on the second video image data.

[0110] Optionally, the second data acquisition module includes: a second data reading module, configured to read the second video image data from a second device file corresponding to the second camera using an operating system.

[0111] Optionally, the apparatus 600 further includes: a device file deployment module, configured to deploy the first device file in the operating system; and a device file association module, configured to associate the first camera with the first device file in the operating system.

[0112] In addition, FIG7 shows a video processing apparatus 700 according to the second aspect of this embodiment, which corresponds to the method according to the second aspect of Embodiment 1. Referring to FIG7 , apparatus 700 includes: a second push video generation module 710 for generating a push video for push to the live broadcast platform; and a second data writing module 720 for writing first video image data of the push video to a first device file configured by the operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

[0113] Therefore, according to this embodiment, the technical effect of ensuring that the anchor can use the live broadcast equipment to broadcast live on the desired live broadcast platform is achieved.

[0114] Example 3

[0115] FIG8 shows a video live broadcast apparatus 800 according to the first aspect of this embodiment, which corresponds to the method according to the first aspect of embodiment 1. Referring to FIG8 , the apparatus 800 includes: a first processor 810; and a first memory 820 connected to the first processor 810, configured to provide the first processor 810 with instructions for processing the following steps: generating a push video for pushing to a live broadcast platform; writing first video image data of the push video into a first device file deployed in an operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform; and using the live broadcast application to read the first video image data from the first device file via the operating system and transmit the first video image data to the live broadcast platform.

[0116] Optionally, the operation of reading the first video image data from the first device file via the operating system using the live broadcast application includes: using the live broadcast application to send a request to the operating system to obtain data from the first camera; and using the live broadcast application to receive from the operating system the first video image data read by the operating system from the first device file.

[0117] Optionally, the operation of generating a push video for pushing to a live broadcast platform includes: generating a push video using a video processing application; and the operation of writing the first video image data of the push video into a first device file deployed on the operating system includes: writing the first video image data of the push video into the first device file using a video processing application.

[0118] Optionally, the operation of generating a push video for pushing to a live broadcast platform includes: obtaining second video image data from at least one video source, wherein at least one video source includes a video source different from a first camera associated with the live broadcast application; and generating a push video based on the second video image data.

[0119] Optionally, the at least one video source includes a second camera different from the first camera, and the operation of obtaining second video image data from the at least one video source includes: using the operating system to read the second video image data from a second device file corresponding to the second camera.

[0120] Optionally, before generating a push video for pushing to a live broadcast platform, the method further includes: deploying a first device file in an operating system; and associating the first camera with the first device file in the operating system.

[0121] In addition, FIG9 shows a video processing device 900 according to the second aspect of this embodiment, which corresponds to the method according to the second aspect of Embodiment 1. Referring to FIG9 , the device 900 includes: a second processor 910; and a second memory 90 connected to the second processor 910, configured to provide the second processor 910 with instructions for processing the following steps: generating a push video for pushing to a live broadcast platform; and writing first video image data of the push video to a first device file configured by an operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

[0122] Therefore, according to this embodiment, the technical effect of ensuring that the anchor can use the live broadcast equipment to broadcast live on the desired live broadcast platform is achieved.

[0123] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.

[0124] In the above embodiments of the present invention, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0125] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0126] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0127] In addition, the functional units in the various embodiments of the present invention may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0128] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk, etc., various media that can store program code.

[0129] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as within the scope of protection of the present invention.

Claims

1. A video live broadcast method, used for a live broadcast device, characterized in that: include: Generate push videos for push to live broadcast platforms; Writing the first video image data of the pushed video into a first device file deployed in an operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform; as well as The live broadcast application is used to read the first video image data from the first device file via the operating system, and the first video image data is transmitted to the live broadcast platform.

2. The method according to claim 1, characterized in that The operation of reading the first video image data from the first device file via the operating system using the live broadcast application includes: Using the live broadcast application, sending a request to the operating system to obtain data from the first camera; and The first video image data read from the first device file by the operating system is received from the operating system using the live broadcast application.

3. The method according to claim 1, characterized in that The operation of generating a push video for pushing to a live broadcast platform includes: generating the push video using a video processing application; and The operation of writing the first video image data of the pushed video into a first device file deployed in the operating system includes: using the video processing application to write the first video image data of the pushed video into the first device file.

4. The method according to claim 1 or 3, characterized in that Generates operations for pushing videos to live streaming platforms, including: acquiring second video image data from at least one video source, wherein the at least one video source comprises a video source different from a first camera associated with the live broadcast application; and The pushed video is generated based on the second video image data.

5. The method according to claim 4, characterized in that The at least one video source includes a second camera different from the first camera, and the operation of acquiring second video image data from the at least one video source includes: The second video image data is read from a second device file corresponding to the second camera using the operating system.

6. The method according to claim 1, characterized in that Before generating a push video for pushing to the live broadcast platform, the process further includes: deploying the first device file in the operating system; and The first camera is associated with the first device file in the operating system.

7. A video processing method for a live broadcast device, characterized in that: include: Generate push videos for push to live broadcast platforms; as well as The first video image data of the pushed video is written into a first device file configured by an operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

8. A storage medium, characterized in that: The storage medium includes a stored program, wherein when the program is run, the processor executes the method according to any one of claims 1 to 7.

9. A video live broadcast device, characterized in that: include: A first push video generation module is used to generate a push video for pushing to the live broadcast platform; A first data writing module is configured to write the first video image data of the pushed video into a first device file deployed in the operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform; as well as The first data reading module is used to use the live broadcast application to read the first video image data from the first device file via the operating system, and transmit the first video image data to the live broadcast platform.

10. A video live broadcast device, characterized in that: include: a first processor; as well as A first memory is connected to the first processor and is configured to provide the first processor with instructions for processing the following processing steps: Generate push videos for push to live broadcast platforms; Writing the first video image data of the pushed video into a first device file deployed in an operating system, wherein the first device file corresponds to a first camera associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform; as well as The live broadcast application is used to read the first video image data from the first device file via the operating system, and the first video image data is transmitted to the live broadcast platform.

Images