Video transmission method, video computing power network, terminal device, and storage medium
By using edge nodes in the video computing power network to process video information and adjusting the video screen according to the user's location, the problem that the CDN network cannot achieve personalized video transmission is solved, and the authenticity and user experience of the virtual reality experience are improved.
Patent Information
- Application Number
- PCT/CN2024/096129
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-28
- Filing Date
- 2024-05-29
- Publication Date
- 2025-01-02
AI Technical Summary
The existing CDN network cannot adjust the video screen in real time according to the user's location in multi-user virtual reality scenarios, resulting in the same video screen being only received when different users observe the same target object at different locations.
By using edge nodes in the video computing power network to connect with the user terminal, receive video adjustment parameters, obtain initial video information and process it to generate target video, and send it to the user terminal, thereby realizing personalized video transmission.
Different user terminals have realized the distribution of video information of different content, so that different users can receive personalized video images based on their own perspectives, improving the authenticity and user experience of the virtual reality experience.
Smart Images

Figure CN2024096129_02012025_PF_FP_ABST
Abstract
Description
Video transmission method, video computing network, terminal device and storage medium
[0001] Related applications
[0002] This application claims priority to Chinese patent application No. 202310784091.1 filed on June 28, 2023, the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The present application relates to the field of Internet communication technology, and in particular to a video transmission method, a video computing network, a terminal device, and a storage medium. Background Art
[0004] With the continuous development of 5G network technology and new spatial video technology, virtual reality experience scenarios are becoming increasingly mature. In virtual reality experience scenarios, multiple users can view the same target object simultaneously. When multiple users view the same target object simultaneously, due to the different locations of each user, the corresponding perspective and the received video images should also be different for each user. However, the CDN (Content Delivery Network) network architecture used in related technologies can only distribute the same content video images to different users. Ultimately, different users in different locations viewing the same target object still only receive the same video images.
[0005] Summary of the Invention
[0006] The main purpose of this application is to provide a video transmission method, a video computing network, a terminal device and a storage medium.
[0007] To achieve the above-mentioned purpose, an embodiment of the present application provides a video transmission method, which is applied to any edge node in a video computing network, and the edge node is communicated with a first user terminal. The method includes: receiving a first request sent by the first user terminal, and determining the video adjustment parameters contained in the first request; obtaining initial video information corresponding to the first request, and processing the initial video information based on the video adjustment parameters to generate a target video; and sending the target video to the first user terminal.
[0008] In addition, an embodiment of the present application also provides a video computing network, which includes: multiple edge nodes and a central node, the central node is connected to the multiple edge nodes respectively, and any two of the multiple edge nodes are connected; the edge node is configured to communicate with the first user terminal, receive the first request sent by the first user terminal and determine the video adjustment parameters contained in the first request, obtain the initial video information corresponding to the first request, process the initial video information based on the video adjustment parameters to generate a target video, and send the target video to the first user terminal; the central node is configured to process the source video information injected by the second user terminal to obtain the initial video information, and upon receiving the video acquisition request reported by the edge node, send the initial video information to the edge node.
[0009] In addition, an embodiment of the present application further provides a terminal device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the video transmission method described above.
[0010] In addition, an embodiment of the present application further provides a storage medium, which is a computer-readable storage medium. A computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the video transmission method described above are implemented. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] FIG1 is a schematic diagram of the structure of a terminal device in a hardware operating environment according to an embodiment of the present application;
[0012] FIG2 is a schematic diagram of the steps of the first embodiment of the video transmission method provided in the embodiment of the present application;
[0013] FIG3 is a schematic diagram of a CDN network structure involved in an embodiment of a video transmission method provided in an embodiment of the present application;
[0014] FIG4 is a schematic diagram of a VCN network structure involved in an embodiment of a video transmission method provided in an embodiment of the present application;
[0015] FIG5 is a schematic diagram of another VCN network structure involved in an embodiment of the video transmission method provided in an embodiment of the present application;
[0016] FIG6 is a schematic diagram of functional modules of each node in a VCN network involved in an embodiment of a video transmission method provided in an embodiment of the present application;
[0017] FIG7 is a schematic diagram of the network node and computing power service initialization process involved in an embodiment of the video transmission method provided in an embodiment of the present application;
[0018] FIG8 is a schematic diagram of a user registration and logout process involved in an embodiment of a video transmission method provided in an embodiment of the present application;
[0019] FIG9 is a schematic diagram of a video content injection and distribution process involved in an embodiment of a video transmission method provided in an embodiment of the present application;
[0020] FIG10 is a schematic diagram of the user viewing and interaction process involved in an embodiment of the video transmission method provided in the embodiment of the present application.
[0021] The realization of the objectives, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0022] The specific embodiments described herein are merely used to explain the present application and are not intended to limit the present application.
[0023] Refer to Figure 1, which is a schematic diagram of the terminal device structure of the hardware operating environment involved in the embodiment of the present application.
[0024] In this embodiment, the terminal device of the hardware operating environment involved in the embodiment of the present application can be a terminal device with a VCN (Video Computing Network) integrated inside, and can send different target videos and interactive information to each user terminal by controlling the VCN network. Alternatively, the terminal device involved in the embodiment of the present application can also be a data storage control terminal, mobile terminal, PC or other terminal connected to the above-mentioned VCN network.
[0025] As shown in Figure 1, the terminal device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to implement connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may include a standard wired interface and a wireless interface (such as a wireless fidelity (WI-FI) interface). The memory 1005 may be a high-speed random access memory (RAM) or a stable non-volatile memory (NVM), such as a disk storage. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.
[0026] Those skilled in the art will understand that the structure shown in FIG1 does not constitute a limitation on the terminal device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0027] As shown in FIG. 1 , the memory 1005 as a storage medium may include an operating system, a data storage module, a network communication module, a user interface module, and a computer program.
[0028] In the terminal device shown in FIG1 , the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the terminal device of the present application can be set in the terminal device, and the terminal device calls the computer program stored in the memory 1005 through the processor 1001 and executes the video transmission method of the present application. Each embodiment of the video transmission method of the present application performs the following operations: receiving a first request sent by the first user terminal and determining the video adjustment parameters contained in the first request; obtaining initial video information corresponding to the first request, and processing the initial video information based on the video adjustment parameters to generate a target video; and sending the target video to the first user terminal.
[0029] Exemplarily, when a computing power container is cached in the edge node, the processor 1001 can call the computer program stored in the memory 1005 and perform the following operations: calling the computing power container to process the initial video information based on the video adjustment parameters to generate a target video.
[0030] Exemplarily, the initial video information includes first initial video information, and the processor 1001 can call the computer program stored in the memory 1005 and perform the following operations: when the initial video information corresponding to the first request is cached in the edge node, read the cache to obtain the first initial video information.
[0031] Exemplarily, the video computing power network also includes a central node, which is connected to the edge node. When there is no cache computing power container in the edge node, the processor 1001 can call the computer program stored in the memory 1005 and perform the following operations: sending a computing power call application to the central node, and receiving the computing power container allocated by the central node based on the computing power call application, and calling the computing power container to process the initial video information based on the video adjustment parameters to generate the target video.
[0032] Exemplarily, the initial video information includes second initial video information, and the processor 1001 can call the computer program stored in the memory 1005 and perform the following operations: when the initial video information corresponding to the first request is not cached in the edge node, send a video acquisition request to the central node; receive the second initial video information sent by the central node based on the video acquisition request, wherein the second initial video information is obtained by the central node processing the source video information injected by the second user terminal.
[0033] Exemplarily, the video computing network further includes a sub-center node, and the central node and the edge node are communicatively connected through the sub-center node. The processor 1001 can call the computer program stored in the memory 1005 and perform the following operations: when the initial video information is not cached in the edge node, the video acquisition request is sent to the sub-center node; and the third initial video information is received from the sub-center node based on the video acquisition request, wherein the third initial video information is sent to the sub-center node by the central node based on the video acquisition request forwarded by the sub-center node.
[0034] Exemplarily, the processor 1001 can call a computer program stored in the memory 1005, and after executing the operation of receiving the first request sent by the first user terminal, further perform the following operations: sending heartbeat information to the first user terminal, and judging the active state corresponding to the first user terminal based on the heartbeat information; if it is judged that the active state corresponding to the first user terminal is inactive, cutting off the communication connection with the first user terminal, and caching the computing power container corresponding to the first user terminal.
[0035] Exemplarily, the processor 1001 can call a computer program stored in the memory 1005, and after executing the operation of sending the target video to the first user terminal, further perform the following operations: receive a second request sent by the first user terminal; send the second request to the central node, wherein the central node determines the third user terminal corresponding to the first user terminal based on the second request, and establishes a communication link between the edge nodes corresponding to the first user terminal and the third user terminal.
[0036] Exemplarily, the video computing network also includes a gateway interface, and the processor 1001 can call the computer program stored in the memory 1005, and before executing the operation of receiving the first request sent by the first user terminal, further perform the following operations: establish a communication connection with the first user terminal, wherein the first user terminal is allocated after the central node verifies the preset login request, and the login request is received by the gateway interface and sent to the central node.
[0037] Exemplarily, the processor 1001 can call the computer program stored in the memory 1005, and before executing the operation of receiving the first request sent by the first user terminal, further perform the following operations: receive the registration information sent by the first user terminal and store the registration information; send the registration information to the sub-center node for storage, wherein the sub-center node sends the registration information to the central node for storage.
[0038] Exemplarily, the processor 1001 can call the computer program stored in the memory 1005, and after executing the operation of sending the target video to the first user terminal, also perform the following operations: receive an exit request sent by the first user terminal, clear the user information corresponding to the first user terminal, and cache the computing power container corresponding to the first user terminal; send the exit request to the sub-center node to notify the sub-center node and the central node to clear the user information, and notify the central node to update the login status of the first user terminal.
[0039] Exemplarily, the processor 1001 can call the computer program stored in the memory 1005, and before executing the operation of receiving the first request sent by the first user terminal, further perform the following operations: sending the preset edge node information to the sub-center node for storage to establish a message channel and business link with the sub-center node and establish a message channel and business link between the sub-center node and the central node.
[0040] Exemplarily, the processor 1001 may call a computer program stored in the memory 1005, and before executing the operation of receiving the first request sent by the first user terminal, further perform the following operations: sending computing power information to the sub-center node to generate sub-center computing power information and construct a computing power container.
[0041] Based on the terminal device structure of the hardware operating environment involved in the above-mentioned embodiment of the present application, the overall concept of the video transmission method provided by the embodiment of the present application is first proposed.
[0042] When multiple users watch the same target object at the same time in a virtual reality scene, due to the different positions of each user, the corresponding perspective and received video images of each user should also be different. However, please refer to Figure 3, which is a schematic diagram of the CDN network structure involved in an embodiment of the video transmission method provided by the embodiment of the present application. As shown in Figure 3, the CDN network architecture used in the related technology is a top-down tree-type architecture, that is, it only supports one-way media transmission and distribution from top to bottom. In this way, the CDN network can only distribute video images of the same content to different users, which ultimately results in different users in different positions observing the same target object and still only receiving the same video images.
[0043] In response to the above phenomenon, the embodiment of the present application proposes a video transmission method, which receives a first request sent by a first user terminal and determines the video adjustment parameters contained in the first request; obtains initial video information corresponding to the first request, and processes the initial video information based on the video adjustment parameters to generate a target video; and sends the target video to the first user terminal.
[0044] In this way, compared with the CDN network structure adopted by related technologies, the embodiment of the present application can distribute video information of different contents to different user terminals, thereby achieving the technical effect of allowing different users to receive target videos corresponding to their respective perspectives when observing the same target object at different positions.
[0045] Based on the overall concept of the video transmission method provided by the above-mentioned embodiment scheme of the present application, various embodiments of the video transmission method of the present application are proposed.
[0046] The video transmission method of the present application is applied to the above-mentioned terminal device, which can be a terminal device with an internally integrated VCN network and capable of sending different target videos and interactive information to each user terminal by controlling the VCN network. Based on the different design requirements of actual applications, in different feasible embodiments, the video transmission method of the present application can of course also be applied to other terminal devices. In order to facilitate understanding and explanation of the technical solution, the following text will use the terminal device with an internally integrated VCN network as the execution subject of the solution implementation to illustrate the video transmission method of the present application.
[0047] Please refer to Figure 2, which is a flowchart of the steps of the first embodiment of the video transmission method of the present application. It should be noted that although a logical order is shown in the flowchart, in some cases, the video transmission method of the present application can also perform the steps shown or described in a different order than here.
[0048] As shown in Figure 2, in the first embodiment of the video transmission method of the present application, the video transmission method provided by the present application is applied to any edge node in the video computing network, and the edge node is communicated with the first user terminal, and can include the following steps: Step S10, receiving the first request sent by the first user terminal, and determining the video adjustment parameters contained in the first request; in this embodiment, the first request is a viewing request generated by the first user terminal when the user enters a virtual reality space with real-time interactive function through the first user terminal to watch a video.
[0049] The video adjustment parameters are adjustment parameters generated by the first user terminal based on the position information of the user relative to any target when the user views the target in the virtual reality space. The video adjustment parameters include but are not limited to parameter information such as the viewing angle and viewing position corresponding to the user.
[0050] When a user enters a virtual reality space with real-time interactive function through a first user terminal, the first user terminal is connected to a terminal device with a VCN network integrated inside. The VCN network assigns the first user terminal to any edge node in the network. The first user terminal then sends a viewing request to the edge node. When the edge node receives the viewing request, it parses the viewing request to obtain the video adjustment parameters contained in the viewing request.
[0051] For example, please refer to Figure 10, which is a schematic diagram of the user viewing and interaction process involved in an embodiment of the video transmission method provided by the embodiment of the present application. As shown in step S500 in Figure 10, when a user uses a VR device to enter a virtual reality space to watch real-time live content, the user controls the first VR device to access any edge node in the VCN network and log in. The VCN network performs login authentication on the user. Afterwards, when the VCN network completes the login authentication, in order to allow the user to obtain real-time live content in the virtual reality space through the first VR device, the first VR device generates a viewing request with video adjustment parameters such as viewing angle and viewing position based on the position of the user's corresponding virtual character in the virtual reality space, and sends the viewing request to the edge node as shown in step S501 in Figure 10. The edge node receives the viewing request through the internally configured access and communication module, and parses the viewing request through the internally configured service module to obtain the video adjustment parameters such as viewing angle and viewing position contained in the viewing request.
[0052] In addition, in this embodiment, please refer to Figure 6, which is a schematic diagram of the functional modules of each node in the VCN network involved in an embodiment of the video transmission method provided by the embodiment of the present application. As shown in Figure 6, the edge node is configured with an access and communication module, a computing power module, a storage module, a business module, a message module and an audio processing module, wherein the access and communication module is mainly configured to be responsible for the access of user terminals, communicating with the dispatch center of the central node in the VCN network through the sub-center, recording the registration information of all users, recording the link information between the nodes at the same layer, and being responsible for the adaptation of the network communication protocol at the bottom layer of the node and the communication processing with the upper and lower layers; similarly, the business module is configured to be responsible for the business process processing of the node and the business docking of the upper and lower layers, the storage module is configured to cache video content, the audio and video processing module is configured to be responsible for the processing of the media stream of the media content, such as protocol conversion, multi-bitrate adaptation, transcoding, image quality enhancement, etc., the message module is configured to be responsible for the synchronization, forwarding and processing of messages between the node and the upper and lower layers, and the computing power module is configured to be responsible for the resource management of the video computing power pool of the node.
[0053] Step S20, obtain the initial video information corresponding to the first request, and process the initial video information based on the video adjustment parameters to generate the target video; in this embodiment, when the edge node parses the viewing request, it determines the video content specified by the viewing request, and the edge node thereby obtains the initial video information corresponding to the video content within the VCN network, and the edge node then calls the computing power module to perform real-time processing of the initial video information according to the video adjustment parameters obtained by parsing to generate the target video.
[0054] Exemplarily, for example, when the edge node parses the viewing request, it determines the video playback content specified in the viewing request based on the results of the parsing. As described in steps S502 to S504 in Figure 10, the edge node obtains the initial video information corresponding to the video playback content in the storage module configured in the node, or at the corresponding sub-center node and central node in the VCN network. After obtaining the initial video information, as shown in steps S505 to S507 in Figure 10, the edge node then uses the internally configured computing power module to perform protocol conversion, multi-bitrate adaptation, transcoding, image quality enhancement and other real-time rendering processing on the initial video information according to the viewing angle and viewing position contained in the video adjustment parameters, thereby generating a target video that meets the viewing angle and viewing position.
[0055] Step S30: Send the target video to the first user terminal.
[0056] In this embodiment, the edge node sends the generated target video information to the first user terminal, so that the first user terminal plays the target video to the user through the display module configured internally.
[0057] For example, as shown in steps S508 to S509 in Figure 10, after generating the target video information, the edge node transmits the target video information to the first VR device used by the user via the access and communication module. The first VR device then displays the target video corresponding to the user's position within the user's virtual reality space. Thus, after the edge node processes the initial video information in real time based on the video adjustment parameters to obtain the target video, the first user terminal plays the target video to the user, containing video content that matches the user's viewing angle and position within the virtual reality space.
[0058] In this way, compared with the related art that uses CDN network architecture to distribute video images of the same content only to different users at different viewing positions, which ultimately results in different users at different positions observing the same target object still only receiving the same video images, the video transmission method of the present application is because each edge node in the VCN network processes the video information in real time based on the user's viewing angle and viewing position in the virtual reality space to generate personalized video information, thereby achieving the distribution of video information of different contents to different user terminals, so that different users at different positions can receive personalized videos corresponding to their respective perspectives when observing the same target object.
[0059] In some feasible embodiments of the video transmission method of the present application, when a computing power container is cached in the edge node, the above-mentioned operation of "processing the initial video information based on the video adjustment parameters to generate the target video" may include: calling the computing power container to process the initial video information based on the video adjustment parameters to generate the target video.
[0060] Computing power refers to the ability to process information data to achieve a target output. In new target video applications, computing resources such as central processing units (CPUs), memory, hard drives, and graphics cards (GPUs) are integrated into a virtual, infinitely scalable "computing power resource pool" through cloud computing and software-defined methods. This is the computing power container.
[0061] In this embodiment, the edge node determines whether a computing power container is cached in the local computing power module. If the edge node determines that a computing power container is cached in the local computing power module, the computing power module allocates the computing power resources contained in the computing power container to the internally configured audio and video processing module. The audio and video processing module processes the initial video information in real time based on the video adjustment parameters to generate target video information that matches the video adjustment parameters.
[0062] Exemplarily, for example, as shown in step S505 in Figure 10, after obtaining the initial video information corresponding to the playback request, the edge node first reads the local computing power module and determines whether the computing power module has a cached computing power container. Then, if the edge node determines that there is a computing power container cached inside the computing power module, then as shown in step S507 in Figure 10, the computing power module is controlled to allocate computing power resources to the audio and video processing module, so that the audio and video processing module performs real-time processing and rendering of the initial video information to be played based on the viewing position and viewing angle contained in the video adjustment parameters, so that the initial video information is more matched with the user's corresponding viewing position and viewing angle, and then the corresponding target video information is generated.
[0063] In this embodiment, the computing power resources contained in the computing power container can be reused for the same video source. That is, when different real-time processing and rendering are performed on the same initial video information, the local audio and video processing module of the edge node can keep the computing power resources unchanged, thereby only processing the video information based on changes in video adjustment parameters to generate different target videos.
[0064] In addition, in another embodiment, as shown in step S506 in Figure 10, when the edge node reads the computing power module, if it is determined that there is a computing power container cached in the computing power module, but the computing power resources contained in the computing power container are insufficient to process the initial video information in real time, the edge node generates a computing power call application and sends the computing power call application to the central node in the VCN network through the access and communication module, so that the central node allocates additional computing power resources to the edge node, so that the edge node can process the initial video information in real time and render to generate target video information.
[0065] In this way, the edge node can process the initial video information in real time and generate the target video information more quickly by calling the computing power of the entire network to process the initial video information according to the video adjustment parameters, so that users can experience a low-latency playback experience in the virtual reality space.
[0066] The initial video information includes first initial video information. In some feasible embodiments of the video transmission method of the present application, the above-mentioned operation of "obtaining the initial video information corresponding to the first request" may include: when the initial video information corresponding to the first request is cached in the edge node, reading the cache to obtain the first initial video information.
[0067] In this embodiment, the edge node parses the obtained viewing request to obtain the video picture to be played, and determines the first initial video information corresponding to the video picture. As shown in step S502 in Figure 10, the edge node reads the local storage module and determines whether the first initial video information is cached in the storage module. If the edge node determines that the local storage module caches the first initial video information, it directly reads the storage module to obtain the first initial video information.
[0068] In this way, when the edge node directly caches the video images that need to be played in the local storage module, it can directly read the storage module to obtain the video images and perform real-time processing and rendering of the video images, thereby generating target video information faster, allowing users to experience a low-latency playback experience in a virtual reality environment.
[0069] In some feasible embodiments of the video transmission method of the present application, when there is no cache computing power container in the edge node, the above-mentioned operation of "processing the initial video information based on the video adjustment parameters to generate the target video" may include: sending a computing power call application to the central node, and receiving the computing power container allocated by the central node based on the computing power call application, and calling the computing power container to process the initial video information based on the video adjustment parameters to generate the target video.
[0070] In this embodiment, the edge node determines whether there is a computing power container cached in the local computing power module. If the edge node determines that there is no cached computing power container in the local computing power module, it generates a computing power call application, and the edge node sends the computing power call application to the central node in the VCN network. When the central node receives the computing power call application, it parses the computing power call application to determine the computing power resources required by the edge node, and allocates the computing power container to the edge node based on the computing power resources. After obtaining the computing power container allocated by the central node, the edge node allocates computing power resources to the local audio and video processing module through the computing power module, so that the audio and video processing module processes the initial video information according to the video adjustment parameters to generate the target video.
[0071] Exemplarily, for example, as shown in step S506 in Figure 10, if the edge node determines that the local computing power module does not have a cached computing power container, it generates a computing power call application and sends the computing power call application to the central node in the VCN network through the local business module. After receiving the computing power call application, the computing power management center in the central node parses the computing power call application to determine the computing power resources required by the edge node and allocates a computing power container to the edge node. Afterwards, the local audio processing module of the edge node calls the computing power resources contained in the computing power container, and processes the initialized video information according to the viewing angle and viewing position contained in the video adjustment parameters to generate the target video.
[0072] Please refer to Figure 6. As shown in Figure 6, the central node in the VCN network is equipped with a unified dispatching center, a message center, a communication module, an audio and video processing module, a computing power management center, a business management center, an operations management center, and a storage center. The functions of the message center, communication module, audio and video processing module, computing power management center, business management center, and storage center are basically the same as those of the modules configured in the aforementioned edge nodes, and will not be repeated here. The unified dispatching center in the VCN network is configured to manage the scheduling strategy of the entire network, manage user access and calculate the scheduling path, and dispatch users to the nearest edge node for service. The operations management center is configured to be responsible for the operation and management of the business and report business data.
[0073] In this way, the VCN network can control the central node to call computing resources to the edge node when there is no local cache computing container on the edge node, so that the edge node can process the video in real time, thereby generating the target video information more quickly, allowing users to experience a low-latency playback experience in a virtual reality environment.
[0074] The initial video information includes second initial video information. In some feasible embodiments of the video transmission method of the present application, the above-mentioned operation of "obtaining the initial video information corresponding to the first request" may also include: when the initial video information corresponding to the first request is not cached in the edge node, sending a video acquisition request to the central node; receiving the second initial video information sent by the central node based on the video acquisition request, wherein the second initial video information is obtained by the central node processing the source video information injected by the second user terminal.
[0075] In this embodiment, if the edge node determines that the local storage module does not cache the initial video information, it generates a video acquisition request and sends the video acquisition request to the central node in the VCN network. After that, the central node reads the storage center to obtain the source video information injected into the central node by the second user terminal through the connected edge node, and processes the source video information to generate second initial video information corresponding to the video acquisition request. The central node then sends the second initial video information to the edge node.
[0076] Exemplarily, for example, as shown in steps S502 to S504 in Figure 10, if the edge node determines that the initial video information is not stored in the local storage module, it controls the business module to generate a video acquisition request, and sends the video acquisition request to the central node in the VCN network through the access and communication module. When the business management center in the central node receives the video acquisition request, it reads the storage center based on the video acquisition request to obtain the second initial video information generated by processing the source video information injected by the second user terminal through the connected second edge node in the storage center, and then sends the second initial video information to the edge node through the communication module.
[0077] The first initial video information and the second initial video information are the initial video information corresponding to the same playback screen. Please refer to Figure 9. Figure 9 is a schematic diagram of the video content injection and distribution process involved in an embodiment of the video transmission method provided by the embodiment of the present application, as shown in steps S310 to S316 in Figure 9. In this embodiment and other embodiments, when the second user terminal serves as the terminal for publishing the video screen (that is, the user terminal in Figure 9), the source video information to be published can be injected into the edge node connected in the VCN network, and then the edge node connected to the second user terminal processes and caches the source video information and uploads it to the corresponding sub-center node, so that the acquired video information is processed and cached by the sub-center node and uploaded to the central node. Finally, the central node performs protocol conversion, multi-bitrate adaptation, transcoding, image quality enhancement and other processing on the video information through the audio and video processing module to obtain the second initial video information, and stores the second initial video information in the storage center. As shown in steps S301 to S303 in Figure 9, in this embodiment and other embodiments, in addition to injecting source video information into the central node through the connected edge node, when the second user terminal acts as a content provider CP (Content Provider), the second user terminal can be directly connected to the central node in the VCN network, thereby directly injecting the source video information into the central node.
[0078] In this way, when the edge node does not store the initial video information corresponding to the viewing request in the node's local storage module, the VCN network can control the central node to send the stored initial video information to the edge node for the edge node to process the initial information, thereby enabling the edge node to obtain the initial video information in a timely manner and generate the target video faster. At the same time, by controlling the central node to send the initial video to the edge node, the VCN network can also be compatible with the CDN network adopted by the relevant technology during use.
[0079] In some feasible embodiments of the video transmission method of the present application, the video computing network further includes a sub-center node, and the central node and the edge node are communicated with each other through the sub-center node. The above-mentioned operation of "obtaining the initial video information corresponding to the first request" may also include: when the initial video information is not cached in the edge node, sending the video acquisition request to the sub-center node; receiving the third initial video information sent by the sub-center node based on the video acquisition request, wherein the third initial video information is sent to the sub-center node by the central node based on the video acquisition request forwarded by the sub-center node.
[0080] In this embodiment, if the edge node determines that the local storage module does not cache the initial video information, it generates a video acquisition request and sends the video acquisition request to the sub-center node connected to the edge node in the VCN network. Afterwards, the sub-center node reads the local storage module and determines whether the local storage module caches the initial video information corresponding to the video acquisition request. If the sub-center node determines that the local storage module does not cache the initial video information, it forwards the video acquisition request to the central node. The central node reads the storage center to obtain the initial video information injected by the above-mentioned second user terminal, and sends the initial video information to the sub-center node. The sub-center node then sends the initial video information to the edge node.
[0081] Exemplarily, for example, if the edge node determines that the initial video information is not stored in the local storage module, the business module in the edge node generates a video acquisition request and sends the video acquisition request to the sub-center node connected to the edge node in the VCN network through the access and communication module. At this time, the sub-center node checks the local storage module and determines whether the storage module stores the initial video information corresponding to the video acquisition request. Afterwards, if the sub-center node determines that the storage module does not store the third initial video information, the video acquisition request is forwarded to the central node through the business module. When the central node receives the video acquisition request through the business management center, it reads the storage center based on the video acquisition request to obtain the source video information injected by the second user terminal in the storage center, and processes the source video information through the audio and video processing module to generate initial video information. The central node then sends the initial video information to the sub-center node through the communication module, and the sub-center node sends the initial video to the edge node.
[0082] In this and other embodiments, if an edge node determines that initial video information is stored in a local storage module, it directly retrieves the initial video information from the storage module and distributes the initial video information to the edge node. In this way, if the edge node does not store the initial video information corresponding to the viewing request in its local storage module, the VCN network can control a sub-center node connected to the edge node to retrieve the initial video information locally or at a central node, and then distribute the initial video information to the edge node for processing. This allows the edge node to obtain the initial video information in a timely manner and generate the target video more quickly.
[0083] In addition, as shown in Figure 6, the minute center node is equipped with an access and communication module, a computing power module, a storage module, a business module, a message module and an audio processing module. The functions of each module are basically the same as those of the modules in the above-mentioned edge nodes, so they will not be repeated here.
[0084] In some feasible embodiments of the video transmission method of the present application, in addition to controlling the VCN network to process video information in real time to generate the target video, the terminal device can also detect the activity of the connected user terminal. That is, after the above-mentioned operation of "receiving the first request sent by the first user terminal", the video transmission method of the present application can also include: sending heartbeat information to the first user terminal, and judging the activity status corresponding to the first user terminal based on the heartbeat information; if the activity status corresponding to the first user terminal is judged to be inactive, then cutting off the communication connection with the first user terminal and caching the computing power container corresponding to the first user terminal.
[0085] In this embodiment, after receiving the viewing request sent by the first user terminal, the edge node calls the business module to generate heartbeat information, and sends the heartbeat information to the first user terminal through the access and communication module to determine whether the first user terminal is in an active state. Afterwards, if the edge node determines that the first user terminal is in an inactive state based on the heartbeat information, it cuts off the communication connection with the first user terminal through the access and communication module, and calls the computing power module to cache the computing power container corresponding to the first user terminal.
[0086] For example, refer to FIG8 , which is a schematic diagram of a user registration and logout process involved in an embodiment of a video transmission method provided by an embodiment of the present application. As shown in step S209 of FIG8 , after the edge node receives a viewing request sent by the first VR device, the edge node calls the service module to generate a heartbeat signal, and sends the heartbeat signal to the first VR device through the access and communication module according to a preset transmission frequency. When the first VR device is playing a video or interacting with other VR devices in a virtual reality space, a response signal corresponding to the received heartbeat signal is generated and sent to the edge node. The edge node thus determines that the first VR device is in an active state upon receiving the response signal. When the user chooses to hang up, that is, the first VR device pauses or stops playing the video, or does not interact with other VR devices, the first VR device does not generate a corresponding response signal upon receiving the heartbeat signal. When the edge node does not receive a response signal from the first VR device within a period of time after transmitting the heartbeat signal, it determines that the first VR device is in an inactive state, thereby controlling the access and communication module to cut off the connection with the first VR device and controlling the computing power module to cache the computing power container corresponding to the first VR device. In this way, the edge node detects the activity of the user terminal and promptly cuts off the connection between the user terminal and the VCN network when it detects that the user terminal is in an inactive state. This can avoid the occupation of network resources and computing power resources, thereby releasing network and computing power resources to other edge nodes when the user is offline to ensure the user experience of other users in the network.
[0087] Based on the above-mentioned first embodiment of the video transmission method of the present application, a second embodiment of the video transmission method of the present application is proposed.
[0088] In the second embodiment of the video transmission method of the present application, after the above-mentioned operation of "sending the target video to the first user terminal", it can also include: receiving a second request sent by the first user terminal; sending the second request to the central node, wherein the central node determines the third user terminal corresponding to the first user terminal based on the second request, and establishes a communication link between the edge nodes corresponding to the first user terminal and the third user terminal.
[0089] In this embodiment, the second request is an interaction request generated by the first user terminal based on an interactive operation when the user performs an interactive operation such as commenting or interacting with any other virtual character in a virtual reality space with an interactive function through the first user terminal.
[0090] While watching the target video information, the user can select any other virtual character in the above-mentioned virtual reality scene to initiate an interactive operation. The first user terminal then generates an interaction request based on the interactive operation and sends the interaction request to the edge node. After receiving the interaction request, the edge node forwards the interaction request to the central node through the local business module. The central node then determines the third user terminal corresponding to the first user terminal and the address information corresponding to the third user terminal based on the interaction request. The central node queries multiple connected sub-center nodes based on the address information, thereby determining the target sub-center node connected to the third user terminal from the multiple sub-center nodes, and then determines to establish a communication link connected to the third user terminal based on the target sub-center node, and sends the interaction request to the second edge node. The second edge node sends the interaction request to the third user terminal. The third user terminal then determines the interaction operation included in the interaction request. Thereafter, when the first user terminal and the third user terminal interact with each other, the interaction operation can be completed through the established communication link.
[0091] Exemplarily, for example, as shown in steps S510 to S515 in FIG10 , when a user (i.e., user A in FIG10 ) watches a live broadcast activity initiated by a host (i.e., user B in FIG10 ) in a virtual reality scene through a third VR device through a first VR device, the user can comment or interact with the host character through the first VR device, and select the third VR device corresponding to the host as the interaction object. The first VR device then generates an interaction request based on the interaction, and sends the interaction request to a first edge node connected in the VCN network. Afterwards, the first edge node forwards the interaction request to a central node in the VCN network. The central node parses the interaction request to determine the third VR device corresponding to the first VR device and the address information of the third VR device (i.e., step S512 in the figure). When the edge node determines that the first VR device and the third VR device are connected When both the first and third VR devices are under the local node, a communication link is directly established between the first VR device and the third VR device. When the edge node determines that the first and third VR devices are not under the local node, the edge node reports the interaction request to the central node. The central node determines the second edge node connected to the third VR device in the VCN network based on the address information. The central node then establishes a communication link between the edge nodes corresponding to the first and third VR devices, and sends the received interaction request to the second edge node through the access and communication module. The second edge node then forwards the interaction request to the third VR device, so that the anchor receives the user-initiated interactive operation through the third VR device. Afterwards, when the user interacts with the anchor, the first VR device and the second VR device can directly complete the transmission of the interaction instructions through the communication link established by the central node.
[0092] In this way, compared with the related technology in which the edge nodes in the CDN network cannot interact with each other, the method of building communication links between multiple edge nodes in the VCN network through the central node can enable multiple user terminals in the network to directly interact with each other with low latency, so that the overall network structure can be applied to highly interactive virtual reality scenarios such as live broadcasts.
[0093] In some feasible embodiments of the video transmission method of the present application, the video computing network also includes a gateway interface. Before the above-mentioned operation of "receiving the first request sent by the first user terminal", it can also include: establishing a communication connection with the first user terminal, wherein the first user terminal is allocated after the central node verifies the preset login request, and the login request is received by the gateway interface and sent to the central node.
[0094] In this embodiment, before the first user terminal sends a viewing request to the edge node, the first user terminal needs to send an access request to the VCN network through the gateway interface. The unified scheduling center in the central node obtains the location information of the first user terminal based on the access request, and then calculates the scheduling path based on the location information, and determines the first edge node among the multiple edge nodes included in the VCN network based on the scheduling path, and then assigns the first user terminal to the first edge node, thereby establishing a communication connection between the edge node and the first user.
[0095] Exemplarily, for example, as shown in steps S201 to S204 in Figure 8, before the user enters the virtual reality space through the first VR device to watch the live video, he first controls the first VR device to generate an access request and sends the access request to the gateway interface in the VCN network. When the gateway interface receives the access request, it sends the access request to the central node in the VCN network. After that, the central node parses the access request to obtain the IP address carried in the access request. The unified scheduling center in the central node then calculates the scheduling path based on the IP address and the computing power corresponding to each edge node, so as to determine the first edge node that matches the first VR device among the multiple edge nodes contained in the network, and then establishes a communication connection between the first VR device and the first edge node.
[0096] In this way, the central node can allocate suitable edge nodes to user terminals based on the computing power distribution within the network and the location information of the user terminals, thereby allocating user terminals to edge nodes with sufficient computing power and smooth communication. This avoids the situation in related technologies where the CDN network allocates user terminals only based on distance information, which easily allocates user terminals to nodes that are close to the user terminals but have poor communication.
[0097] In some feasible embodiments of the video transmission method of the present application, before the above-mentioned operation of "receiving the first request sent by the first user terminal", it may also include: receiving registration information sent by the first user terminal and storing the registration information; sending the registration information to the sub-center node for storage, wherein the sub-center node sends the registration information to the central node for storage.
[0098] In this embodiment, as shown in steps S205 to S208 in FIG8 , before receiving a viewing request from a first user terminal, the VCN network must register the first user terminal connected to the VCN network. During registration, the user enters registration information into the first user terminal, which then transmits the registration information to a connected edge node. Upon receiving the registration information, the edge node stores the registration information in a local storage module and reports it to a sub-center node connected to the edge node within the VCN network. The sub-center node then stores the registration information in a corresponding storage module and reports it to the central node, which then stores the registration information. This allows the VCN network to subsequently verify the user terminal's login using the stored registration information when the user terminal subsequently connects to the VCN network, thereby ensuring the security of the VCN network.
[0099] In some feasible embodiments of the video transmission method of the present application, after the above-mentioned operation of "sending the target video to the first user terminal", it may also include: receiving an exit request sent by the first user terminal, clearing the user information corresponding to the first user terminal, and caching the computing power container corresponding to the first user terminal; sending the exit request to the sub-center node to notify the sub-center node and the central node to clear the user information, and notifying the central node to update the login status of the first user terminal.
[0100] In this embodiment, when the user finishes watching the video or exits the live broadcast room, the user controls the first user terminal to generate an exit request, and the first user terminal sends the exit request to the VCN network. When the edge node in the VCN network receives the exit request, the user information corresponding to the first user terminal is cleared from the local storage module of the edge node, and the computing power module is controlled to cache the computing power container used by the edge node during the login of the first user terminal. At the same time, the edge node forwards the exit request to the connected sub-center node, and the sub-center node further clears the user information corresponding to the first user terminal from the local storage module and reports the user information to the central node. When the central node receives the exit request, the business center updates the login status corresponding to the first user terminal to an offline status.
[0101] Exemplarily, for example, as shown in steps S210 to S215 in Figure 8, when the user watches the live broadcast and actively exits the virtual reality space, the first VR device generates an exit request and sends the exit request to the connected edge node. When the edge node receives the exit request, it cleans up the registration information uploaded by the first VR device, the established message link and other user information stored in the local storage module. At the same time, the edge node controls the computing power module to cache the computing power container called by the edge node during the login of the first VR device according to the preset cache period. After that, the edge node synchronizes the exit request to the adjacent sub-center node in the VCN network. The sub-center node then cleans up the user information uploaded by the first VR device in the local storage module and synchronizes the exit request to the central node in the VCN network. The central node then calls the business center to update the login status corresponding to the first VR device to an offline status.
[0102] In this embodiment and another embodiment, when a user is watching a video or live broadcast in a virtual reality space and is forced to exit due to network disconnection, power outage, etc., that is, the first VR device cuts off the communication connection with the edge node without issuing an exit request, the edge node also controls the computing power module to cache the computing power container called by the edge node during the login to the first VR device according to the preset cache period, and generates abnormal disconnection information, uploads the abnormal disconnection information to the sub-center node, and the sub-center node synchronizes the abnormal disconnection information to the central node, and the central node then updates the login status of the first VR device to the offline status.
[0103] In this way, the VCN network can promptly update the user's login status when the user logs out, and cache the computing power container corresponding to the user terminal according to the preset caching rules. When the user reconnects to the VCN network within the caching period, the edge node can directly call the computing power container to process the video information, thereby generating the target video information faster.
[0104] In some feasible embodiments of the video transmission method of the present application, before the above-mentioned operation of "receiving the first request sent by the first user terminal", it may also include: sending the preset edge node information to the sub-center node for storage, so as to establish a message channel and business link with the sub-center node and establish a message channel and business link between the sub-center node and the central node.
[0105] In this embodiment, during the construction of the VCN network, it is necessary to configure corresponding node information for each edge node, each sub-center node and central node included in the VCN network. Afterwards, when the VCN network is completed, the nodes included in the network are initialized. During the node initialization process, the edge node sends edge node information to the corresponding sub-center node through the access and communication module. The sub-center node stores the received edge node information in the storage module, and establishes a communication link and message channel between the sub-center node and the corresponding edge node center through the internal access and communication module. At the same time, the sub-center node reports the sub-center node information corresponding to the sub-center node to the central node in the network through the local access and communication module. After that, the central node records the received sub-center node information corresponding to each sub-center node in the storage center, and establishes a business communication link and message channel with each sub-center node through the scheduling center.
[0106] For example, please refer to FIG7 , which is a schematic diagram of the network node and computing power service initialization process involved in an embodiment of the video transmission method provided by the embodiment of the present application. As shown in steps S100-1 to S102-2 in FIG7 , a central node, multiple sub-central nodes and multiple edge nodes are deployed on a physical network, and various hardware devices and underlying network links are configured to build a VCN network. After configuring node attribute information such as node ID, node type and node IP for each of the central node, multiple sub-central nodes and multiple edge nodes, the VCN network as a whole is initialized. In the process of initializing the VCN network as a whole, multiple edge nodes are initialized. The nodes send their corresponding edge node information, such as node ID, node type, and node IP, to their corresponding sub-center nodes through the access and communication module. Each sub-center node stores the edge node information it receives in its local storage module and builds communication links and message channels with its corresponding multiple edge nodes through its own access and communication module. Afterwards, multiple sub-center nodes report sub-center node information containing their own node ID, node type, and node IP to the central node. The unified dispatching center in the central node records the sub-center node information corresponding to each sub-center node and builds business communication links and message channels with multiple sub-center nodes. In this way, after the VCN network is built, it can be operated normally by initializing each node in the network, avoiding the need to temporarily build communication links during business operations, which wastes time in business operations and causes high latency.
[0107] In some feasible embodiments of the video transmission method of the present application, before the above-mentioned operation of "receiving the first request sent by the first user terminal", it may also include: sending computing power information to the sub-center node to generate sub-center computing power information and construct a computing power container.
[0108] In this embodiment, as shown in steps S104 to S108 in FIG7 , upon completion of the VCN network construction, computing power services are deployed to each node within the network. During the computing power service deployment process, multiple edge nodes within the VCN network each call their local computing power modules to calculate the computing power information corresponding to the node and report this computing power information to their respective connected sub-center nodes. The computing power modules within the sub-center nodes record the computing power information corresponding to each edge node and register the sub-center computing power information within the local computing power modules. Each sub-center node then reports its corresponding sub-center computing power information to the central node. The computing power management center within the central node aggregates the computing power information from each sub-center to construct a computing power container. In this way, after the VCN network is completed, it can promptly collect the computing power resources corresponding to each node within the network and allocate computing power containers to each node based on these computing power resources.
[0109] In addition, an embodiment of the present application also provides a video computing network. The video computing network of the present application is also applied to the terminal device as described above.
[0110] The video computing network of the present application may include: multiple edge nodes and a central node, wherein the central node is respectively connected to the multiple edge nodes, and any two edge nodes among the multiple edge nodes are connected; the edge node is configured to communicate with the first user terminal, receive a first request sent by the first user terminal and determine the video adjustment parameters contained in the first request, obtain initial video information corresponding to the first request, process the initial video information based on the video adjustment parameters to generate a target video, and send the target video to the first user terminal; the central node is configured to process the source video information injected by the second user terminal to obtain the initial video information, and upon receiving the video acquisition request reported by the edge node, send the initial video information to the edge node.
[0111] In this embodiment, please refer to Figure 4. Figure 4 is a schematic diagram of the VCN network structure involved in an embodiment of the video transmission method provided by the embodiment of the present application. As shown in Figure 4, the VCN network includes multiple edge nodes and central nodes. The edge nodes are directly hung under the VCN central node. The edge nodes can communicate with each other. When the user enters a virtual reality space with real-time interactive function through the first user terminal, the first user terminal is connected to a terminal device with an integrated VCN network. The VCN network assigns the first user terminal to any edge node in the network. The first user terminal then sends a viewing request to the edge node. When the edge node receives the viewing request, it parses the viewing request to obtain the video adjustment parameters contained in the viewing request. At the same time, when the edge node parses the viewing request, it determines the viewing request. The edge node reads the local storage module of the node and determines whether the local storage module of the node stores the initial video information corresponding to the video content. If the edge node determines that the local storage module does not cache the initial video information, it generates a video acquisition request and sends the video acquisition request to the central node in the VCN network. After that, the central node reads the storage center to obtain the source video information injected into the central node by the second user terminal through the connected edge node, and processes the source video information to generate the initial video information corresponding to the video acquisition request. The central node then sends the initial video information to the edge node. When obtaining the initial video information, the edge node calls the computing power module to process the initial video information in real time according to the video adjustment parameters obtained by parsing to generate the target video.
[0112] In this embodiment and other embodiments, the second user terminal serves as a terminal for publishing video images and injects source video information into the VCN network. The injection process is basically the same as the above embodiment, so it will not be repeated here.
[0113] In some feasible embodiments of the video computing network of the present application, the video computing network further includes: multiple sub-center nodes, wherein the central node is respectively connected to multiple sub-center nodes, and multiple sub-center nodes are respectively connected to multiple edge nodes; the sub-center nodes are configured to receive video acquisition requests reported by the edge nodes, and forward the video acquisition requests to the central node to obtain the initial video information, and send the initial video information to the edge nodes.
[0114] In this embodiment, please refer to Figure 5. Figure 5 is a schematic diagram of another VCN network structure involved in an embodiment of the video transmission method provided by the embodiment of the present application. When the VCN network needs to process business exceeding a certain scale, a layer of sub-center nodes can be added to the VCN network. As shown in Figure 5, the VCN network includes a first-level sub-center layer, which includes 3 sub-center nodes. The 3 sub-center nodes can communicate with each other in pairs. Each sub-center node has several edge nodes and the edge nodes can communicate with each other in pairs. The edge nodes between sub-centers can forward communications through the sub-centers to which they belong; if the edge node determines that the local storage module does not cache the initial video information, it generates a video acquisition request and sends the video acquisition request to the sub-center node to which the edge node is connected in the VCN network. The sub-center node reads the local storage module and determines whether the local storage module caches the initial video information corresponding to the video acquisition request. If the sub-center node determines that the local storage module does not cache the initial video information, it forwards the video acquisition request to the central node. The central node reads the storage center to obtain the initial video information injected by the above-mentioned second user terminal, and sends the initial video information to the sub-center node. The sub-center node then sends the initial video information to the edge node.
[0115] In addition, an embodiment of the present application also provides a terminal device, which includes: the video transmission device as described above, a memory, a processor, and a computer program stored on the memory and capable of running on the processor, wherein the computer program is configured to implement the steps of the video transmission method as described above.
[0116] In addition, an embodiment of the present application further provides a storage medium, which is a computer-readable storage medium. A computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the video transmission method described above are implemented.
[0117] As used herein, the terms "comprises," "comprising," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system that includes a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or system that includes the element.
[0118] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM / RAM, disk, CD) as described above, including a number of instructions to enable a terminal device (which can be a terminal device with an internally integrated VCN (Video Computing Network-personalized video computing power) network, and can send different personalized video information and interactive information to each user terminal by controlling the VCN network, or the terminal device involved in the embodiment of the present application can also be a data storage control terminal, mobile terminal, PC and other terminals connected to the above-mentioned VCN network) to execute the methods described in each embodiment of the present application.
[0119] The above are merely optional embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A video transmission method, applied to any edge node in a video computing network, wherein: The edge node is communicatively connected with the first user terminal, and the method includes: receiving a first request sent by the first user terminal, and determining a video adjustment parameter included in the first request; Acquire initial video information corresponding to the first request, and process the initial video information based on the video adjustment parameter to generate a target video; The target video is sent to the first user terminal.
2. The video transmission method according to claim 1, wherein: In the case where a computing power container is cached in the edge node, the initial video information is processed based on the video adjustment parameter to generate a target video, including: The computing power container is called to process the initial video information based on the video adjustment parameters to generate a target video.
3. The video transmission method according to claim 1, wherein: The initial video information includes first initial video information, and obtaining the initial video information corresponding to the first request includes: In a case where the initial video information corresponding to the first request is cached in the edge node, the cache is read to obtain the first initial video information.
4. The video transmission method according to claim 1, wherein: The video computing network further includes a central node, the central node is connected to the edge node, and when there is no cache computing container in the edge node, the initial video information is processed based on the video adjustment parameter to generate a target video, including: A computing power call application is sent to the central node, and a computing power container allocated by the central node based on the computing power call application is received, and the computing power container is called to process the initial video information based on the video adjustment parameters to generate a target video.
5. The video transmission method according to claim 4, wherein: The initial video information includes second initial video information, and obtaining the initial video information corresponding to the first request further includes: When the edge node does not cache the initial video information corresponding to the first request, sending a video acquisition request to the central node; The second initial video information is received, which is sent by the central node based on the video acquisition request, wherein the second initial video information is obtained by the central node processing the source video information injected by the second user terminal.
6. The video transmission method according to claim 5, wherein: The video computing network further includes a sub-center node, and the central node and the edge node are communicatively connected through the sub-center node; The initial video information includes third initial video information, and obtaining the initial video information corresponding to the first request further includes: When the initial video information is not cached in the edge node, sending the video acquisition request to the sub-center node; Receive the third initial video information sent by the sub-center node based on the video acquisition request, wherein the third initial video information is sent to the sub-center node by the central node based on the video acquisition request forwarded by the sub-center node.
7. The video transmission method according to any one of claims 1 to 6, wherein: After receiving the first request sent by the first user terminal, the method further includes: Sending heartbeat information to the first user terminal, and determining an activity state corresponding to the first user terminal based on the heartbeat information; If it is determined that the active state corresponding to the first user terminal is inactive, the communication connection with the first user terminal is cut off, and the computing power container corresponding to the first user terminal is cached.
8. The video transmission method according to any one of claims 4 to 6, wherein: After the step of sending the target video to the first user terminal, the method further includes: receiving a second request sent by the first user terminal; The second request is sent to the central node, wherein the central node determines a third user terminal corresponding to the first user terminal based on the second request, and establishes a communication link between edge nodes corresponding to the first user terminal and the third user terminal respectively.
9. The video transmission method according to any one of claims 4 to 6, wherein: The video computing network further includes a gateway interface. Before receiving the first request sent by the first user terminal, the method further includes: A communication connection is established with the first user terminal, wherein the first user terminal is assigned after the central node verifies a preset login request, and the login request is received by the gateway interface and sent to the central node.
10. The video transmission method according to claim 6, wherein: Before receiving the first request sent by the first user terminal, the method further includes: receiving registration information sent by the first user terminal and storing the registration information; The registration information is sent to the sub-center node for storage, wherein the sub-center node sends the registration information to the central node for storage.
11. The video transmission method according to claim 6, wherein: After sending the target video to the first user terminal, the method further includes: receiving a logout request sent by the first user terminal, clearing user information corresponding to the first user terminal, and caching a computing power container corresponding to the first user terminal; The logout request is sent to the sub-center node to notify the sub-center node and the central node to clear the user information, and to notify the central node to update the login status of the first user terminal.
12. The video transmission method according to claim 6, wherein: Before receiving the first request sent by the first user terminal, the method further includes: The preset edge node information is sent to the sub-center node for storage, so as to establish a message channel and a service link with the sub-center node and to establish a message channel and a service link between the sub-center node and the center node.
13. The video transmission method according to claim 6, wherein: Before receiving the first request sent by the first user terminal, the method further includes: The computing power information is sent to the sub-center node to generate the sub-center computing power information and construct a computing power container.
14. A video computing network, wherein: The video computing network includes: a plurality of edge nodes and a central node, wherein the central node is connected to the plurality of edge nodes respectively, and any two edge nodes among the plurality of edge nodes are connected; The edge node is configured to establish a communication connection with a first user terminal, receive a first request sent by the first user terminal and determine a video adjustment parameter included in the first request, obtain initial video information corresponding to the first request, process the initial video information based on the video adjustment parameter to generate a target video, and send the target video to the first user terminal; The central node is configured to process the source video information injected by the second user terminal to obtain the initial video information, and send the initial video information to the edge node upon receiving the video acquisition request reported by the edge node.
15. The video computing network according to claim 14, wherein: The video computing network further includes: a plurality of sub-center nodes, wherein the central node is respectively connected to a plurality of the sub-center nodes, and the plurality of the sub-center nodes are respectively connected to a plurality of the edge nodes; The sub-center node is configured to receive the video acquisition request reported by the edge node, forward the video acquisition request to the central node to acquire the initial video information, and send the initial video information to the edge node.
16. A terminal device, wherein: The terminal device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the video transmission method according to any one of claims 1 to 13.
17. A storage medium, wherein: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the video transmission method according to any one of claims 1 to 13 are implemented.
Citation Information
Patent Citations
Business processing method and device based on edge node, node and storage medium
CN112672227A
Live broadcast control system, method and device, medium and equipment
CN113473165A
Panoramic video distribution method, apparatus and device, and computer storage medium
CN115278193A
Video stream transmission method and device applied to virtual reality VR scene
CN115314730A
Split thin-film probe card and elastic module thereof
KR102336025B1