Livestream device and method thereof

Abstract

The Livestream device includes a processing component, a plurality of decoding components, a display engine and a USB component. The decoding components receive the live audio and video data generated by the live broadcast terminals. The processing component determines the number of live broadcast terminals and activates a corresponding number of decoding components to decode the live video and audio data to generate a decoded live video and audio data. The display engine adjusts the resolution of the decoded live audio and video data to form streaming spliced ​​image data. The USB component converts the format of the streaming spliced ​​image data into a USB format live video and audio data to transmit to a client terminal.

Description

Technical Field

[0001] The present invention relates to a network system and method, and more particularly to a network live broadcast device and method. Prior Art

[0002] As people use the computer network more and more, and the network bandwidth is also increasing, live streaming of audio and video content to end users is a rapidly growing market, whether it is selling goods, real-time commentary on current events, or live game broadcast analysis. And driven by consumers' demand for live interactive video experience, more and more sellers or current affairs commentators use live streaming to interact with consumers.

[0003] However, the realization of live broadcasting usually requires a lot of additional hardware configuration and combination, and consumers' mobile phones have different platform systems, so compatibility issues often arise. In particular, when multiple different audio and video signals are to be streamed through the network, multiple different image input and output devices such as cameras, microphones, etc., and multiple complex cable adapters are required to correspond to different devices. This causes inconvenience to users and increases costs.

[0004] Therefore, how to improve the shortcomings of existing implementation methods becomes a key issue. Summary of the invention

[0005] According to one aspect of the present case, a network live broadcast device includes: a processing element; a plurality of decoding elements, coupled to the processing element, for receiving a live audio and video data generated by at least one live broadcast end, the processing element determines the number of the at least one live broadcast end to activate the decoding elements corresponding to the number among the plurality of decoding elements to decode the live audio and video data to generate decoded live audio and video data; a display engine, coupled to the plurality of decoding elements, for adjusting the resolution of the decoded live audio and video data to form a stream spliced image data; and a universal serial bus element, coupled to the display engine, for converting the format of the stream spliced image data into a USB format live audio and video data for transmission to at least one client.

[0006] In some embodiments, the live broadcast device further includes a memory element coupled to the plurality of decoding elements for temporarily storing the decoded live audio and video data.

[0007] In some embodiments, the live webcast device further includes a communication element coupled to the universal serial bus element for transmitting the stream spliced image data to a website.

[0008] In some embodiments, the live broadcast device further includes a high-definition multimedia interface for outputting the stream spliced image data.

[0009] In some embodiments, the live broadcast device further includes an audio input interface for coupling to an audio input device.

[0010] In some embodiments, the decoded live video data includes at least one live video data generated by different live broadcast terminals, and the display engine further includes: an image splicing module, adjusting the resolution of the at least one live video data to form at least one adjusted image data, and combining the at least one adjusted image data into a spliced image data; and an image streaming module coupled to the image splicing module, streaming the spliced image data to form the streamed spliced image data.

[0011] In some embodiments, the image stitching module uses a zoom function to adjust the resolution of the at least one live video data.

[0012] According to another aspect of the present invention, a method for live broadcasting on the Internet includes: receiving live audio and video data generated by at least one live broadcast terminal, a processing element determining the number of the at least one live broadcast terminal to activate a corresponding number of decoding elements among a plurality of decoding elements to decode the live audio and video data to generate decoded live audio and video data; adjusting the resolution of the decoded live audio and video data to form a stream spliced image data; and converting the format of the stream spliced image data into a USB format live audio and video data for transmission to at least one client.

[0013] In some embodiments, the live broadcast method further includes transmitting the live audio and video data in USB format to a website.

[0014] In some embodiments, the decoded live video data includes at least one live video data generated by different live broadcast terminals, and the network live broadcast method further includes: adjusting the resolution of the at least one live video data to form at least one adjusted image data, and combining the at least one adjusted image data into a spliced image data; and streaming the spliced image data to form the streamed spliced image data.

[0015] The present invention provides a network live broadcast device and method. The network live broadcast device of the present invention can directly receive audio and video signals of different formats from a single or multiple live broadcast devices, decode and convert them into USB signal formats for use in network streaming, and output them to other playback devices for use. Therefore, the live broadcast party does not need to prepare different capture devices or adapter cables to capture audio and video signals of different formats, thereby greatly reducing the burden and inconvenience of the live broadcast party in performing live broadcasts. Simple diagram description

[0016] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present case and, together with the specification, are used to illustrate the technical solutions of the embodiments of the present case. Figure 1 shows a schematic diagram of a live broadcast system according to a preferred embodiment of the present invention. Figure 2 shows a schematic diagram of a live broadcast device according to a preferred embodiment of the present invention. Figure 3 is a flow chart of a method for live webcasting according to a preferred embodiment of the present invention. Implementation

[0017] The following will clearly illustrate the spirit of the present invention with diagrams and detailed descriptions. After understanding the embodiments of the present invention, any person with ordinary knowledge in the technical field can make changes and modifications based on the techniques taught by the present invention without departing from the spirit and scope of the present invention.

[0018] The terms used herein are only for describing specific embodiments and are not intended to be limiting of the present invention. Singular forms such as "a", "this", "here", "this" and "the" as used herein also include plural forms.

[0019] As used herein, "coupling" or "connection" may refer to direct or indirect physical contact between two or more elements or devices, or may refer to mutual operation or action between two or more elements or devices.

[0020] The words "include", "including", "have", "contain", etc. used in this article are open-ended terms, meaning including but not limited to.

[0021] As used herein, "and / or" includes any or all combinations of the items mentioned.

[0022] The terms used in this document generally have the ordinary meaning of each term used in this field, in the context of the present invention and in the specific context, unless otherwise specified. Certain terms used to describe the present invention will be discussed below or elsewhere in this specification to provide additional guidance to those skilled in the art in the description of the present invention.

[0023] Since traditionally, the realization of live broadcasting scenes usually requires a lot of additional hardware configuration and combination, and consumers' mobile phones have different platform systems, compatibility issues often arise. Therefore, this case provides a network live broadcast device and method. The network live broadcast device of this case can directly receive audio and video signals of different formats from a single or multiple live broadcast devices, decode and convert them into USB signal formats for use in network streaming, and output to other playback devices for use. Therefore, the live broadcast party does not need to prepare different capture devices or adapter cables to capture audio and video signals of different formats, which can greatly reduce the burden and inconvenience of the live broadcast party in live broadcasting.

[0024] FIG. 1 is a schematic diagram of a network live broadcast system according to a preferred embodiment of the present invention. The network live broadcast system 10 includes a network live broadcast device 100, at least one live broadcast terminal 201, 202, ...20n and at least one client 301, 302, ...30n. In some embodiments, the network live broadcast device 100 can be connected to the at least one live broadcast terminal 201, 202, ...20n and at least one client 301, 302, ...30n by wired or wireless means. In some embodiments, the network live broadcast device 100 is used to receive the live audio and video data 210 transmitted by the live broadcast terminal 201, 202, ...20n and convert it into the live audio and video data 310 in USB format and transmit it to at least one client 301, 302, ...30n. It is worth noting that the live audio and video data 210 includes the live audio and video data generated by different live broadcast terminals 201, 202, ...20n. In some embodiments, if the live video data 210 includes live video data generated by at least two live terminals 201, 202, ...20n, the network live broadcast device 100 further splices the live video data generated by at least two live terminals 201, 202, ...20n, so that the live video data generated by at least two live terminals 201, 202, ...20n can be displayed on the display interface of the client 301, 302, ...30n at the same time. In some embodiments, the live terminal 201, 202, ...20n can be composed of an electronic device with a function of collecting video data, such as a mobile phone with a camera lens, a tablet computer, a computer and other smart devices. The client 301, 302, ...30n can be an electronic device with a display interface such as a mobile phone, a tablet computer, a computer and the like. In some embodiments, at least one live broadcast terminal 201, 202, ...20n is responsible for real-time acquisition of the sound and image of the live broadcast site to obtain live audio and video data 210, and upload the live audio and video data 210 to the network live broadcast device 100. The network live broadcast device 100 is used to convert the live audio and video data 210 into live audio and video data 310 in USB format and transmit it to at least one client 301, 302, ...30n.

[0025] FIG. 2 is a schematic diagram of a preferred embodiment of a live webcast device according to the present invention. The live webcast device 100 includes a processing element 102, a plurality of decoding elements 110, 111 ... 11n, a memory element 120, a display engine 130, and a Universal Serial Bus (USB) element 140. Please refer to FIG. 1 and FIG. 2 at the same time.

[0026] In some embodiments, a plurality of decoding elements 110, 111 ... 11n receive live audio and video data 210 formed by at least one live end 201, 202, ... 20n collecting sound and images from the live broadcast site. In some embodiments, at least one live end 201, 202, ... 20n can encode the live audio and video data 210 and transmit the encoded live audio and video data 210 to the network live broadcast device 100 for decoding. In some embodiments, the plurality of decoding elements 110, 111 ... 11n decode the encoded live audio and video data 210 to generate decoded live audio and video data 211.

[0027] In some embodiments, the processing element 102 is coupled to a plurality of decoding elements 110, 111 ... 11n. The processing element 102 is used to determine the number of live broadcast terminals 201, 202, ... 20n generating live broadcast audio and video data, and activate the corresponding number of decoding elements 110, 111 ... 11n for decoding. In some embodiments, if the live broadcast audio and video data 210 only includes live broadcast audio and video data generated by one live broadcast terminal, the processing element 102 controls one of the decoding elements 110, 111 ... 11n to be activated. If the live broadcast audio and video data 210 includes live broadcast audio and video data generated by multiple live broadcast terminals, the processing element 102 controls the corresponding number of decoding elements 110, 111 ... 11n to be activated to decode the live broadcast audio and video data 210 according to the number of live broadcast terminals generating the live broadcast audio and video data. In some embodiments, when the live broadcast audio and video data 210 includes live broadcast audio and video data generated by two live broadcast terminals of an iPhone mobile phone and an Android mobile phone, the processing element 102 activates the corresponding decoding element to decode the live broadcast audio and video data according to the encoding and decoding protocols of the two live broadcast terminals of the iPhone mobile phone and the Android mobile phone. In some embodiments, the processing element 102 may be a central processing unit (CPU), a general-purpose processor, etc., but the present invention is not limited thereto.

[0028] In some embodiments, the memory element 120 is coupled to the plurality of decoding elements 110, 111 ... 11n, and a portion of the memory element 120 can be used as a frame buffer 121. In some embodiments, the frame buffer 121 can temporarily store the live video data 211 decoded by the plurality of decoding elements 110, 111 ... 11n. The memory element 120 is a random access memory, such as a dynamic random access memory (DRAM) or a static random access memory (SRAM), but the present invention is not limited thereto.

[0029] The display engine 130 is coupled to the memory element 120 to perform splicing processing on the live video data generated by multiple live broadcast terminals. In some embodiments, if the decoded live video data 211 includes live video data generated by multiple live broadcast terminals, the first live video data and the second live video data, the display engine 130 will perform splicing processing on the first live video data and the second live video data. It is worth noting that the live video data 210 in this case is not limited to the live video data generated by two live broadcast terminals. In other embodiments, the live video data 210 may also include live video data generated by more than two live broadcast terminals, and the splicing method described below in this case may be used for image splicing processing.

[0030] In some embodiments, the display engine 130 further includes an image stitching module 131 and an image streaming module 132. In some embodiments, the image stitching module 131 receives the first live video data and the second live video data, and processes the first live video data and the second live video data. In some embodiments, the image stitching module 131 adjusts the resolution of the received first live video data and the second live video data, so that the first live video data and the second live video data can be transmitted to the client 301, 302, ... 30n for preview by stitching them into a single image. In some embodiments, the image stitching module 131 adjusts the resolution of the first live video data and the second live video data using a scaling function according to the size of the final display interface. This embodiment is a downscaling process so that the first live video data and the second live video data change the resolution after scaling to form the first adjusted image data and the second adjusted image data. Next, the image stitching module 131 combines the first adjusted image data and the second adjusted image data after adjusting the resolution into a stitched image data. In some embodiments, the display interface of the client 301, 302, ... 30n can display the first adjusted image data and the second adjusted image data in the stitched image data in a split screen manner. The image streaming module 132 is coupled to the image stitching module 131, and streams the stitched image in the image stitching module 131 to form a streamed stitched image 212, which is transmitted to the client 301, 302, ... 30n via the network.

[0031] In some embodiments, the universal serial bus component 140 is coupled to the display engine 130 to convert the format of the stream spliced image 212 into a live video data 310 in a USB format, and then transmit it to the display interface of the client 301, 302, ... 30n via the network for playback. The display interface can be, for example, a flat-panel display, a television, a projector, a computer screen, etc., but the present invention is not limited thereto.

[0032] In some embodiments, the Internet live broadcast device 100 of the present invention further includes a communication element 104 coupled to the processing element 102, and the processing element 102 controls the communication element 104 to receive audio and video data from an external live broadcast source, or directly transmits or converts the audio and video data of the live broadcast, that is, the streaming spliced image 212, to a specific Internet address or other website for live streaming use.

[0033] In some embodiments, the live broadcast device 100 of the present invention further includes a high definition multimedia input / output interface (HDMI) 106 and 107, which can directly output the stream spliced image 212, or receive a live broadcast image sent by another party for image monitoring.

[0034] In some embodiments, the live broadcast device 100 of the present invention further includes an audio input interface 108 for coupling an audio input device, such as a microphone. The audio input by the audio input device is mixed with the decoded live video data 211, and then converted into a format by the display engine 130 and the universal serial bus component 140 and transmitted to the display interface of the client 301, 302, ...30n for playback.

[0035] FIG. 3 is a flowchart of a preferred embodiment of a live webcast method according to the present invention. Please refer to FIG. 1 to FIG. 3 at the same time. The live webcast method 300 includes step 311, receiving a live video data. In some embodiments, a live webcast device 100 is used to receive the live video data transmitted by the live broadcast terminal 201, 202, ... 20n.

[0036] Step 312, determine the number of live broadcast terminals that generate the live audio and video data, and activate the corresponding number of decoding components to decode the live audio and video data. The processing component 102 of the network live broadcast device 100 determines the number of live broadcast terminals 201, 202, ...20n that generate the live audio and video data, and activates the corresponding number of decoding components 110, 111 ...11n to decode the live audio and video data.

[0037] Step 313, temporarily storing the decoded live video data. In some embodiments, the image buffer 121 in the memory element 120 can temporarily store the decoded live video data 211 of the plurality of decoding elements 110, 111 ... 11n.

[0038] Step 314, splicing the decoded live video data into a stream spliced image data. In some embodiments, the decoded live video data includes first live video data and second live video data, and the image splicing module 131 adjusts the resolution of the received first live video data and second live video data to splice the first live video data and the second live video data to form a single image. The image streaming module 132 streams the images spliced by the image splicing module 131 to form a stream spliced image 212.

[0039] Then, in step 315, the stream spliced image is converted into a USB format and transmitted to the client. In some embodiments, a universal serial bus component 140 converts the stream spliced image 212 into a live video data 310 in a USB format, which is then transmitted to the display interface of the client 301, 302, ... 30n via the network for playback.

[0040] Alternatively, in step 316, the stream splicing image is directly transmitted to a website via the communication element. In one embodiment, the communication element 104 directly forwards the stream splicing image 212 to a specific Internet address or other website for live streaming.

[0041] In summary, the network live broadcast device and method of the present invention can directly receive audio and video signals of different formats from a single or multiple live broadcast devices, decode and convert them into USB signal format for use in network streaming, and output to other playback devices for use. Therefore, the live broadcast party does not need to prepare different capture devices or adapter cables to capture audio and video signals of different formats, thereby greatly reducing the burden and inconvenience of the live broadcast party in performing live broadcasts.

[0042] Although the present invention has been disclosed as above by way of embodiments, it is not intended to limit the present invention. Any person with ordinary knowledge in the technical field may make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention shall be determined by the scope of the attached patent application.

[0043] 10: Live Broadcast System 100: Live streaming device 102: Processing Components 104: Communication components 106: High-definition multimedia output interface 107: High Definition Multimedia Input Interface 108: Audio Input Interface 110, 111…11n : Decoding element 120: Memory components 121: Image Buffer 130: Display Engine 131: Image stitching module 132: Video Streaming Module 140: Universal Serial Bus Component 201, 202, …20n: Live broadcast end 210: Live video and audio data 211: Decoded live video data 212: Streaming Stitched Images 300: How to broadcast live online 301, 302, …30n: Client 310: Live video and audio data 311-316: Steps

Claims

1. A webcast device, comprising: a processing element; A plurality of decoding elements, coupled to the processing element, for receiving at least one live audio and video data generated by at least one live end, the processing element determining the number of the at least one live end, and activating decoding elements corresponding to the number among the plurality of decoding elements to decode the at least one live audio and video data to generate decoded live audio and video data, wherein the at least one live end includes at least a first live end set in a first scene and a second live end set in a second scene different from the first scene, the at least one live audio and video data includes a first live audio and video data related to the first scene, and a second live audio and video data related to the second scene, wherein the processing element activates a first decoding element and a second decoding element among the plurality of decoding elements according to the encoding and decoding protocols of the first live end and the second live end to respectively decode the first live audio and video data and the second live audio and video data; A display engine, coupled to the plurality of decoding elements, is used to adjust the resolution of the decoded live audio and video data to form a stream spliced image data, wherein the first live audio and video data and the second live audio and video data are used to form the stream spliced image data; and a universal serial bus element, coupled to the display engine, performs format conversion on the stream spliced image data into a USB format live audio and video data for transmission to at least one client, wherein the at least one client includes a first client and a second client, and the first client and the second client respectively receive the USB format live audio and video data to display the first live audio and video data and the second live audio and video data simultaneously on the first client and the second client respectively.

2. The Internet live broadcast device as described in claim 1 further includes a memory element coupled to the plurality of decoding elements for temporarily storing the decoded live video data.

3. The webcast device as described in claim 1 further includes a communication element coupled to the processing element for receiving audio and video data from a live broadcast source, or directly transmitting or converting the stream spliced image data to a website.

4. The live broadcast device as described in claim 1 further includes a high-definition multimedia interface for outputting the stream spliced image data.

5. The live broadcast device as described in claim 1 further includes an audio input interface for coupling to an audio input device.

6. The Internet live broadcast device as described in claim 1 further includes a high-definition multimedia interface for inputting live video data.

7. The network live broadcast device as claimed in claim 1, wherein the decoded live video data includes at least one live video data generated by different live broadcast terminals, and the display engine further includes: An image stitching module adjusts the resolution of the at least one live video data to form at least one adjusted image data, and combines the at least one adjusted image data into a stitched image data; and an image streaming module is coupled to the image stitching module, streams the stitched image data, and forms the streamed stitched image data.

8. The webcasting device as described in claim 7, wherein the image stitching module uses a zoom function to adjust the resolution of the at least one live video data.

9. A method for live webcasting, comprising: At least one live video data generated by at least one live end is received, and a processing element determines the number of the at least one live end to activate a plurality of decoding elements corresponding to the number to decode the at least one live video data to generate a decoded live video data, wherein the at least one live end includes at least a first live end set in a first scene and a second live end set in a second scene different from the first scene, and the at least one live video data includes a first live video data related to the first scene and a second live video data related to the second scene, wherein the processing element activates a first decoding element and a second decoding element of the plurality of decoding elements according to the encoding and decoding protocols of the first live end and the second live end to respectively decode the first live video data and the second live video data; The resolution of the decoded live video data is adjusted to form a stream spliced image data, wherein the first live video data and the second live video data are used to form the stream spliced image data; and the stream spliced image data is format-converted into a USB-format live video data and transmitted to at least one client, wherein the at least one client includes a first client and a second client, and the first client and the second client respectively receive the USB-format live video data to display the first live video data and the second live video data simultaneously on the first client and the second client respectively.

10. The method for live broadcasting according to claim 9, wherein the decoded live broadcasting audio and video data includes at least one live broadcasting audio and video data generated by different live broadcasting terminals, and the method further comprises: The resolution of the at least one live video data is adjusted to form at least one adjusted image data, and the at least one adjusted image data is combined into a spliced image data; and the spliced image data is streamed to form the streamed spliced image data.

Images