Video transmission method, video computing power network, terminal equipment and storage medium
By using edge nodes to process video adjustment parameters in the video computing power network, and generating position-matched video images, the problem that the CDN network cannot distribute different video content is solved, and personalized video distribution in virtual reality experience is realized.
Patent Information
- Application Number
- CN202310784091.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-28
- Publication Date
- 2024-12-31
AI Technical Summary
In a virtual reality experience scenario, when multiple users watch the same target object at the same time, each user should receive a different video picture due to different locations, but the existing CDN network architecture can only distribute the same content, resulting in different users being in the When observing the same target object at different locations, the same video screen is received.
By using edge nodes in the video computing power network to connect with the user terminal, receive video adjustment parameters, obtain initial video information and process it based on these parameters to generate the target video to ensure that each user receives a video picture matching its position.
Different user terminals are implemented to distribute video information of different content, so that different users can receive target videos corresponding to their own perspectives when observing the same target object at different locations, improving the personalization and authenticity of the virtual reality experience.
Smart Images

Figure CN119232970A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of Internet communication technology, and in particular to a video transmission method, a video computing network, a terminal device and a storage medium. Background Art
[0002] With the continuous development of 5G network technology and new spatial video technology, virtual reality experience scenarios are becoming more and more mature. In virtual reality experience scenarios, multiple users can watch the same target object at the same time. When multiple users watch the same target object at the same time, due to the different positions of each user, the corresponding perspective and the received video images of each user should also be different. However, the CDN (Content Delivery Network) network architecture used in related technologies can only distribute the video images of the same content to different users, which ultimately results in different users in different positions observing the same target object, and can only receive the same video images. Summary of the invention
[0003] The main purpose of this application is to provide a video transmission method, a video computing network, a terminal device and a storage medium, so that different users can receive target videos corresponding to their respective perspectives when observing the same target object at different positions.
[0004] To achieve the above object, an embodiment of the present application provides a video transmission method, which is applied to any edge node in a video computing network, and the edge node is communicatively connected with a first user terminal, and the method includes:
[0005] Receiving a first request sent by a first user terminal, and determining a video adjustment parameter included in the first request;
[0006] Acquire initial video information corresponding to the first request, and process the initial video information based on the video adjustment parameter to generate a target video;
[0007] The target video is sent to the first user terminal.
[0008] In addition, an embodiment of the present application further provides a video computing network, the video computing network comprising: a plurality of edge nodes and a central node, wherein the central node is respectively connected to the plurality of edge nodes, and any two edge nodes among the plurality of edge nodes are connected;
[0009] The edge node is configured to establish a communication connection with the first user terminal, receive a first request sent by the first user terminal and determine a video adjustment parameter included in the first request, obtain initial video information corresponding to the first request, process the initial video information based on the video adjustment parameter to generate a target video, and send the target video to the first user terminal;
[0010] The central node is configured to process the source video information injected by the second user terminal to obtain initial video information, and send the initial video information to the edge node upon receiving a video acquisition request reported by the edge node.
[0011] In addition, an embodiment of the present application further provides a terminal device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the video transmission method described above.
[0012] In addition, an embodiment of the present application further provides a storage medium, which is a computer-readable storage medium. A computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the video transmission method described above are implemented.
[0013] The embodiments of the present application disclose a video transmission method, a video computing network, a terminal device and a storage medium, which are applied to any edge node in the video computing network, and the edge node is communicated with a first user terminal. The method includes: receiving a first request sent by the first user terminal, and determining a video adjustment parameter contained in the first request; obtaining initial video information corresponding to the first request, and processing the initial video information based on the video adjustment parameter to generate a target video; and sending the target video to the first user terminal.
[0014] Therefore, the embodiment of the present application first obtains the first request sent by the first user terminal through any edge node included in the video computing network, and determines the video adjustment parameters corresponding to the first user terminal according to the first request. After that, the edge node obtains the initial video information specified by the first request in the video computing network, and calls the computing container to process the initial video information based on the video adjustment parameters to generate a target video. Finally, the edge node sends the generated target video to the first user terminal so that the first user terminal can play the target video.
[0015] In this way, compared with the CDN network structure adopted by the related technology, the embodiment of the present application can distribute video information of different contents to different user terminals, thereby achieving the technical effect of enabling different users in different positions to receive the target video corresponding to their respective perspectives when observing the same target object. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 It is a schematic diagram of the structure of a terminal device in the hardware operating environment involved in the embodiment of the present application;
[0017] Figure 2A schematic diagram of the steps of the first embodiment of the video transmission method provided in the embodiment of the present application;
[0018] Figure 3 A schematic diagram of a CDN network structure involved in an embodiment of a video transmission method provided in an embodiment of the present application;
[0019] Figure 4 A schematic diagram of a VCN network structure involved in an embodiment of a video transmission method provided in an embodiment of the present application;
[0020] Figure 5 A schematic diagram of another VCN network structure involved in an embodiment of a video transmission method provided in an embodiment of the present application;
[0021] Figure 6 A schematic diagram of the functional modules of each node in the VCN network involved in an embodiment of the video transmission method provided in the embodiment of the present application;
[0022] Figure 7 A schematic diagram of the initialization process of network nodes and computing power services involved in an embodiment of a video transmission method provided in an embodiment of the present application;
[0023] Figure 8 A schematic diagram of a user registration and logout process involved in an embodiment of a video transmission method provided in an embodiment of the present application;
[0024] Fig. 9 A schematic diagram of a video content injection and distribution process involved in an embodiment of a video transmission method provided in an embodiment of the present application;
[0025] Fig.10 This is a schematic diagram of the user viewing and interaction process involved in an embodiment of the video transmission method provided in the embodiment of the present application.
[0026] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0027] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0028] Reference Figure 1 , Figure 1 This is a schematic diagram of the terminal device structure of the hardware operating environment involved in the embodiment of the present application.
[0029] In this embodiment, the terminal device of the hardware operating environment involved in the embodiment of the present application may be a terminal device that has a VCN (Video Computing Network-personalized video computing power) network integrated inside, and can send different target videos and interactive information to each user terminal by controlling the VCN network. Alternatively, the terminal device involved in the embodiment of the present application may also be a data storage control terminal, mobile terminal, PC or other terminal connected to the above-mentioned VCN network.
[0030] like Figure 1 As shown, the terminal device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WIreless-FIdelity, WI-FI) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.
[0031] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the terminal device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0032] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating system, a data storage module, a network communication module, a user interface module and a computer program.
[0033] exist Figure 1 In the terminal device shown, the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the terminal device of the present application can be set in the terminal device, and the terminal device calls the computer program stored in the memory 1005 through the processor 1001 and executes the various embodiments of the video transmission method of the present application
[0034] The following operations:
[0035] receiving a first request sent by the first user terminal, and determining a video adjustment parameter included in the first request;
[0036] Acquire initial video information corresponding to the first request, and process the initial video information based on the video adjustment parameter to generate a target video;
[0037] The target video is sent to the first user terminal.
[0038] Exemplarily, when a computing power container is cached in the edge node, the processor 1001 may call a computer program stored in the memory 1005, and further perform the following operations:
[0039] The computing power container is called to process the initial video information based on the video adjustment parameters to generate a target video.
[0040] Exemplarily, the initial video information includes first initial video information, and the processor 1001 may call a computer program stored in the memory 1005, and further perform the following operations:
[0041] In a case where the initial video information corresponding to the first request is cached in the edge node, the cache is read to obtain the first initial video information.
[0042] Exemplarily, the video computing network further includes a central node, the central node is connected to the edge node, and when there is no cache computing container in the edge node, the processor 1001 can call the computer program stored in the memory 1005, and further perform the following operations:
[0043] A computing power call application is sent to the central node, and a computing power container allocated by the central node based on the computing power call application is received, and the computing power container is called to process the initial video information based on the video adjustment parameters to generate a target video.
[0044] Exemplarily, the initial video information includes second initial video information, and the processor 1001 may call a computer program stored in the memory 1005, and further perform the following operations:
[0045] When the edge node does not cache the initial video information corresponding to the first request, sending a video acquisition request to the central node;
[0046] The second initial video information is received, which is sent by the central node based on the video acquisition request, wherein the second initial video information is obtained by the central node processing the source video information injected by the second user terminal.
[0047] Exemplarily, the video computing network further includes a sub-center node, the central node and the edge node are communicatively connected through the sub-center node, and the processor 1001 can call the computer program stored in the memory 1005, and further perform the following operations:
[0048] When the initial video information is not cached in the edge node, sending the video acquisition request to the sub-center node;
[0049] Receive the third initial video information sent by the sub-center node based on the video acquisition request, wherein the third initial video information is sent to the sub-center node by the central node based on the video acquisition request forwarded by the sub-center node.
[0050] Exemplarily, the processor 1001 may call a computer program stored in the memory 1005, and after executing the operation of receiving the first request sent by the first user terminal, further perform the following operations:
[0051] Sending heartbeat information to the first user terminal, and determining an activity state corresponding to the first user terminal based on the heartbeat information;
[0052] If it is determined that the active state corresponding to the first user terminal is inactive, the communication connection with the first user terminal is cut off, and the computing power container corresponding to the first user terminal is cached.
[0053] Exemplarily, the processor 1001 may call a computer program stored in the memory 1005, and after executing the operation of sending the target video to the first user terminal, further perform the following operations:
[0054] receiving a second request sent by the first user terminal;
[0055] The second request is sent to the central node, wherein the central node determines a third user terminal corresponding to the first user terminal based on the second request, and establishes a communication link between edge nodes corresponding to the first user terminal and the third user terminal respectively.
[0056] Exemplarily, the video computing network further includes a gateway interface, and the processor 1001 may call a computer program stored in the memory 1005, and before executing the operation of receiving the first request sent by the first user terminal, further perform the following operations:
[0057] A communication connection is established with the first user terminal, wherein the first user terminal is assigned after the central node verifies a preset login request, and the login request is received by the gateway interface and sent to the central node.
[0058] Exemplarily, the processor 1001 may call a computer program stored in the memory 1005, and before executing the operation of receiving the first request sent by the first user terminal, further perform the following operations:
[0059] receiving registration information sent by the first user terminal and storing the registration information;
[0060] The registration information is sent to the sub-center node for storage, wherein the sub-center node sends the registration information to the central node for storage.
[0061] Exemplarily, the processor 1001 may call a computer program stored in the memory 1005, and after executing the operation of sending the target video to the first user terminal, further perform the following operations:
[0062] receiving a logout request sent by the first user terminal, clearing user information corresponding to the first user terminal, and caching a computing power container corresponding to the first user terminal;
[0063] The logout request is sent to the sub-center node to notify the sub-center node and the central node to clear the user information, and to notify the central node to update the login status of the first user terminal.
[0064] Exemplarily, the processor 1001 may call a computer program stored in the memory 1005, and before executing the operation of receiving the first request sent by the first user terminal, further perform the following operations:
[0065] The preset edge node information is sent to the sub-center node for storage, so as to establish a message channel and a service link with the sub-center node and to establish a message channel and a service link between the sub-center node and the center node.
[0066] Exemplarily, the processor 1001 may call a computer program stored in the memory 1005, and before executing the operation of receiving the first request sent by the first user terminal, further perform the following operations:
[0067] The computing power information is sent to the sub-center node to generate the sub-center computing power information and construct a computing power container.
[0068] Based on the terminal device structure of the hardware operating environment involved in the above-mentioned embodiment of the present application, the overall concept of the video transmission method provided by the embodiment of the present application is first proposed.
[0069] When multiple users simultaneously view the same target object in a virtual reality scene, due to the different positions of each user, the corresponding perspective and the received video images of each user should also be different. However, please refer to Figure 3 , Figure 3 This is a schematic diagram of the CDN network structure involved in an embodiment of the video transmission method provided in the embodiment of the present application, such as Figure 3 As shown, the CDN network architecture used in the related technology is a top-down tree-type architecture, that is, it only supports one-way media transmission and distribution from top to bottom. In this way, the CDN network can only distribute video images of the same content to different users, which ultimately results in different users in different locations observing the same target object and still only receiving the same video images.
[0070] In response to the above phenomenon, the embodiment of the present application proposes a video transmission method, which receives a first request sent by a first user terminal and determines the video adjustment parameters contained in the first request; obtains initial video information corresponding to the first request, and processes the initial video information based on the video adjustment parameters to generate a target video; and sends the target video to the first user terminal.
[0071] In this way, compared with the CDN network structure adopted by the related technology, the embodiment of the present application can distribute video information of different contents to different user terminals, thereby achieving the technical effect of enabling different users in different positions to receive the target video corresponding to their respective perspectives when observing the same target object.
[0072] Based on the overall concept of the video transmission method provided by the above-mentioned embodiment scheme of the present application, various embodiments of the video transmission method of the present application are proposed.
[0073] It should be noted that the video transmission method of the present application is applied to the above-mentioned terminal device, which can be a terminal device with a VCN network integrated inside and capable of sending different target videos and interactive information to each user terminal by controlling the VCN network. It should be understood that based on different design requirements of actual applications, in different feasible embodiments, the video transmission method of the present application can of course also be applied to other terminal devices, and in order to facilitate understanding and explanation of the technical solution, the following text will use the terminal device with a VCN network integrated inside as the execution subject of the solution implementation to explain the video transmission method of the present application.
[0074] Please refer to Figure 2 , Figure 2This is a schematic diagram of the steps of the first embodiment of the video transmission method of the present application. It should be noted that although the logical order is shown in the flowchart, in some cases, the video transmission method of the present application can of course perform the steps shown or described in a different order than here.
[0075] like Figure 2 As shown, in the first embodiment of the video transmission method of the present application, the video transmission method provided by the present application is applied to any edge node in the video computing network, and the edge node is connected to the first user terminal for communication, and may include the following steps:
[0076] Step S10, receiving a first request sent by the first user terminal, and determining a video adjustment parameter included in the first request;
[0077] It should be noted that, in this embodiment, the first request is a viewing request generated by the first user terminal when the user enters a virtual reality space with a real-time interactive function through the first user terminal to watch a video.
[0078] The video adjustment parameters are adjustment parameters generated by the first user terminal based on the relative position information of the user and the target when the user views any target in the virtual reality space. It can be understood that the video adjustment parameters include but are not limited to parameter information such as the viewing angle and viewing position corresponding to the user.
[0079] When a user enters a virtual reality space with a real-time interactive function through a first user terminal, the first user terminal is connected to a terminal device with a VCN network integrated inside. The VCN network assigns the first user terminal to any edge node in the network. The first user terminal then sends a viewing request to the edge node. When the edge node receives the viewing request, it parses the viewing request to obtain the video adjustment parameters contained in the viewing request.
[0080] For example, see Fig.10 , Fig.10 This is a schematic diagram of the user viewing and interaction process involved in an embodiment of the video transmission method provided in the embodiment of the present application, such as Fig.10 As shown in step S500, when a user uses a VR device to enter a virtual reality space to watch real-time live content, the user controls the first VR device to access any edge node in the VCN network and logs in, and the VCN network performs login authentication on the user. Afterwards, when the VCN network completes the login authentication, in order to allow the user to obtain real-time live content in the virtual reality space through the first VR device, the first VR device generates a viewing request with video adjustment parameters such as viewing angle and viewing position based on the position of the virtual character corresponding to the user in the virtual reality space, and Fig.10As described in step S501, the viewing request is sent to the edge node, and the edge node receives the viewing request through the internally configured access and communication module, and parses the viewing request through the internally configured business module to obtain the video adjustment parameters such as the viewing angle and viewing position contained in the viewing request.
[0081] In addition, in this embodiment, please refer to Figure 6 , Figure 6 This is a schematic diagram of the functional modules of each node in the VCN network involved in an embodiment of the video transmission method provided in the embodiment of the present application, such as Figure 6 As shown, the edge node is configured with an access and communication module, a computing power module, a storage module, a business module, a message module and an audio processing module, wherein the access and communication module is mainly configured to be responsible for the access of user terminals, to communicate with the dispatching center of the central node in the VCN network through the sub-center, to record the registration information of all users, to record the link information between nodes at the same layer, to be responsible for the adaptation of the underlying network communication protocol of this node and the communication processing with the upper and lower layers. Similarly, the business module is configured to be responsible for the business process processing of this node and the business docking of the upper and lower layers. Similarly, the storage module is configured to cache video content. Similarly, the audio and video processing module is configured to be responsible for the processing of media streams of media content, such as protocol conversion, multi-bitrate adaptation, transcoding, image quality enhancement and other processing. Similarly, the message module is configured to be responsible for the message synchronization, forwarding and processing between this node and the upper and lower layers. Similarly, the computing power module is configured to be responsible for the resource management of the video computing power pool of this node.
[0082] Step S20, acquiring initial video information corresponding to the first request, and processing the initial video information based on the video adjustment parameter to generate a target video;
[0083] In this embodiment, when the edge node parses the viewing request, it determines the video content specified by the viewing request, and the edge node obtains the initial video information corresponding to the video content in the VCN network. The edge node then calls the computing power module to process the initial video information in real time according to the video adjustment parameters obtained by the analysis to generate the target video.
[0084] For example, when the edge node parses the viewing request, it determines the video playback content specified in the viewing request based on the parsed result, such as Fig.10 As described in step S502 to step S504, the edge node obtains the initial video information corresponding to the video playback content in the storage module configured in the node, or at the corresponding sub-center node and central node in the VCN network. After obtaining the initial video information, Fig.10As shown in steps S505 to S507, the edge node then performs real-time rendering processing such as protocol conversion, multi-bitrate adaptation, transcoding, and image quality enhancement on the initial video information according to the viewing angle and viewing position included in the video adjustment parameters through the internally configured computing module, thereby generating a target video that meets the viewing angle and viewing position.
[0085] Step S30, sending the target video to the first user terminal;
[0086] In this embodiment, the edge node sends the generated target video information to the first user terminal, so that the first user terminal plays the target video to the user through the display module configured internally.
[0087] For example, for example, Fig.10 As shown in steps S508 to S509, after the edge node generates the target video information, it sends the target video information to the first VR device used by the user through the access and communication module, and the first VR device displays the target video corresponding to the user's position in the virtual reality space where the user is located. In this way, after the edge node processes the initial video information in real time based on the video adjustment parameters to obtain the target video, the video content contained in the target video played to the user by the first user terminal is the video screen that matches the corresponding viewing angle and viewing position of the user in the virtual reality space.
[0088] In this way, compared with the related art that uses the CDN network architecture to distribute video images of the same content only to different users in different viewing positions, which ultimately results in different users in different positions only receiving the same video images when observing the same target object, the video transmission method of the present application is because each edge node in the VCN network processes the video information in real time based on the user's viewing angle and viewing position in the virtual reality space to generate personalized video information, thereby distributing video information of different contents to different user terminals, so that different users in different positions can receive personalized videos corresponding to their respective perspectives when observing the same target object.
[0089] Optionally, in some feasible embodiments of the video transmission method of the present application, when a computing power container is cached in the edge node, the above-mentioned operation of "processing the initial video information based on the video adjustment parameter to generate a target video" may include:
[0090] The computing power container is called to process the initial video information based on the video adjustment parameters to generate a target video.
[0091] Computing power refers to the computing ability to achieve the target output by processing information data. In the new target video application, computing resources such as central processing unit (CPU), memory, hard disk, graphics card (GPU) are combined through cloud computing and software-defined to form a virtual and infinitely scalable "computing resource pool", which is the computing power container.
[0092] In this embodiment, the edge node determines whether a computing power container is cached in the local computing power module. If the edge node determines that a computing power container is cached in the local computing power module, the computing power module allocates the computing power resources contained in the computing power container to the internally configured audio and video processing module, and the audio and video processing module processes the initial video information in real time based on the video adjustment parameters to generate target video information that matches the video adjustment parameters.
[0093] For example, for example, Fig.10 As shown in step S505, after obtaining the initial video information corresponding to the playback request, the edge node first reads the local computing power module and determines whether the computing power module has a computing power container cached. Then, if the edge node determines that the computing power module has a computing power container cached inside, Fig.10 As shown in step S507, the computing power module is controlled to allocate computing power resources to the audio and video processing module, so that the audio and video processing module performs real-time processing and rendering of the initial video information to be played based on the viewing position and viewing angle contained in the video adjustment parameters, so that the initial video information is more matched with the user's corresponding viewing position and viewing angle, and then the corresponding target video information is generated.
[0094] It should be noted that, in this embodiment, the computing power resources contained in the computing power container can be reused for the same video source, that is, when different real-time processing and rendering are performed on the same initial video information, the local audio and video processing module of the edge node can keep the computing power resources unchanged, thereby only processing the video information based on the changes in the video adjustment parameters to generate different target videos.
[0095] Furthermore, in another embodiment, Fig.10 As shown in step S506, when the edge node is reading the computing power module, if it is determined that there is a computing power container cached in the computing power module, but the computing power resources contained in the computing power container are insufficient to process the initial video information in real time, the edge node generates a computing power call application, and sends the computing power call application to the central node in the VCN network through the access and communication module, so that the central node allocates additional computing power resources to the edge node, so that the edge node can process the initial video information in real time and render to generate target video information.
[0096] In this way, the edge node can process the initial video information in real time more quickly and generate target video information by calling the computing power of the entire network according to the video adjustment parameters, thereby enabling users to experience a low-latency playback experience in the virtual reality space.
[0097] Optionally, the initial video information includes first initial video information. In some feasible embodiments of the video transmission method of the present application, the operation of “obtaining initial video information corresponding to the first request” may include:
[0098] In a case where the initial video information corresponding to the first request is cached in the edge node, the cache is read to obtain the first initial video information.
[0099] In this embodiment, the edge node parses the obtained viewing request to obtain the video picture to be played, and determines the first initial video information corresponding to the video picture, such as Fig.10 As shown in step S502, the edge node reads the local storage module and determines whether the first initial video information is cached in the storage module. If the edge node determines that the local storage module caches the first initial video information, it directly reads the storage module to obtain the first initial video information.
[0100] In this way, when the edge node directly caches the video images that need to be played in the local storage module, it can directly read the storage module to obtain the video images and perform real-time processing and rendering of the video images, thereby generating target video information faster, allowing users to experience a low-latency playback experience in a virtual reality environment.
[0101] Optionally, in some feasible embodiments of the video transmission method of the present application, when there is no cache computing power container in the edge node, the above-mentioned operation of "processing the initial video information based on the video adjustment parameter to generate a target video" may include:
[0102] A computing power call application is sent to the central node, and a computing power container allocated by the central node based on the computing power call application is received, and the computing power container is called to process the initial video information based on the video adjustment parameters to generate a target video.
[0103] In this embodiment, the edge node determines whether there is a computing power container cached in the local computing power module. If the edge node determines that there is no computing power container cached in the local computing power module, a computing power call application is generated, and the edge node sends the computing power call application to the central node in the VCN network. When the central node receives the computing power call application, it parses the computing power call application to determine the computing power resources required by the edge node, and allocates the computing power container to the edge node based on the computing power resources. After obtaining the computing power container allocated by the central node, the edge node allocates computing power resources to the local audio and video processing module through the computing power module, so that the audio and video processing module processes the initial video information according to the video adjustment parameters to generate the target video.
[0104] For example, for example, Fig.10 As shown in step S506, if the edge node determines that the local computing power module does not have a cached computing power container, a computing power call application is generated, and the computing power call application is sent to the central node in the VCN network through the local business module. After receiving the computing power call application, the computing power management center in the central node parses the computing power call application to determine the computing power resources required by the edge node, and allocates a computing power container to the edge node. After that, the local audio processing module of the edge node calls the computing power resources contained in the computing power container, and processes the initialized video information according to the viewing angle and viewing position contained in the video adjustment parameters to generate the target video.
[0105] Please note that, please refer to Figure 6 ,like Figure 6 As shown, the central node in the VCN network is equipped with a unified dispatching center, a message center, a communication module, an audio and video processing module, a computing power management center, a business management center, an operation management center and a storage center. The functions of the message center, the communication module, the audio and video processing module, the computing power management center, the business management center and the storage center are basically the same as those of the modules configured in the above-mentioned edge nodes, and will not be repeated here. The unified dispatching center in the VCN network is configured to be responsible for the management of the scheduling strategy of the entire network, manage user access and calculate the scheduling path, and dispatch users to the nearest edge node for service, while the operation management center is configured to be responsible for the operation management of the business and report business data.
[0106] In this way, when there is no local cache computing container at the edge node, the VCN network can control the central node to call computing resources to the edge node so that the edge node can process the video in real time, thereby generating target video information faster and allowing users to experience low-latency playback in a virtual reality environment.
[0107] Optionally, the initial video information includes second initial video information. In some feasible embodiments of the video transmission method of the present application, the above operation of "obtaining initial video information corresponding to the first request" may also include:
[0108] When the edge node does not cache the initial video information corresponding to the first request, sending a video acquisition request to the central node;
[0109] The second initial video information is received, which is sent by the central node based on the video acquisition request, wherein the second initial video information is obtained by the central node processing the source video information injected by the second user terminal.
[0110] In this embodiment, if the edge node determines that the local storage module does not cache the initial video information, it generates a video acquisition request and sends the video acquisition request to the central node in the VCN network. After that, the central node reads the storage center to obtain the source video information injected into the central node by the second user terminal through the connected edge node, and processes the source video information to generate second initial video information corresponding to the video acquisition request. The central node then sends the second initial video information to the edge node.
[0111] For example, for example, Fig.10 As shown in steps S502 to S504, if the edge node determines that the initial video information is not stored in the local storage module, it controls the business module to generate a video acquisition request, and sends the video acquisition request to the central node in the VCN network through the access and communication module. When the business management center in the central node receives the video acquisition request, it reads the storage center based on the video acquisition request to obtain the second initial video information generated by processing the source video information injected by the second user terminal through the connected second edge node in the storage center, and then sends the second initial video information to the edge node through the communication module.
[0112] It can be understood that the first initial video information and the second initial video information are initial video information corresponding to the same playback screen. Fig. 9 , Fig. 9 FIG. 1 is a schematic diagram of a video content injection and distribution process involved in an embodiment of a video transmission method provided in an embodiment of the present application. Fig. 9 As shown in steps S310 to S316, in this embodiment and other embodiments, when the second user terminal is used as a terminal for publishing video images (ie Fig. 9The source video information to be released can be injected into the edge node connected to the VCN network, and then the edge node connected to the second user terminal processes and caches the source video information and uploads it to the corresponding sub-center node, so that the acquired video information can be processed and cached by the sub-center node and uploaded to the central node. Finally, the central node further processes the video information through the audio and video processing module, such as protocol conversion, multi-bitrate adaptation, transcoding, and image quality enhancement, to obtain the second initial video information, and stores the second initial video information in the storage center. It should be noted that, if Fig. 9 As shown in steps S301 to S303, in this embodiment and other embodiments, in addition to injecting source video information into the central node through the connected edge node, when the second user terminal acts as a content provider CP (Content Provider), the second user terminal can be directly connected to the central node in the VCN network, thereby directly injecting the source video information into the central node.
[0113] In this way, when the edge node does not store the initial video information corresponding to the viewing request in the local storage module of the node, the VCN network can control the central node to send the stored initial video information to the edge node for the edge node to process the initial information, so that the edge node can obtain the initial video information in time and generate the target video faster. At the same time, by controlling the central node to send the initial video to the edge node, the VCN network can also be compatible with the CDN network adopted by the relevant technology during use.
[0114] Optionally, in some feasible embodiments of the video transmission method of the present application, the video computing network further includes a sub-center node, and the central node and the edge node are communicatively connected through the sub-center node. The above-mentioned operation of "obtaining initial video information corresponding to the first request" may also include:
[0115] When the initial video information is not cached in the edge node, sending the video acquisition request to the sub-center node;
[0116] Receive the third initial video information sent by the sub-center node based on the video acquisition request, wherein the third initial video information is sent to the sub-center node by the central node based on the video acquisition request forwarded by the sub-center node.
[0117] In this embodiment, if the edge node determines that the local storage module does not cache the initial video information, it generates a video acquisition request and sends the video acquisition request to the sub-center node connected to the edge node in the VCN network. After that, the sub-center node reads the local storage module and determines whether the local storage module caches the initial video information corresponding to the video acquisition request. If the sub-center node determines that the local storage module does not cache the initial video information, it forwards the video acquisition request to the central node. The central node reads the storage center to obtain the initial video information injected by the second user terminal, and sends the initial video information to the sub-center node. The sub-center node then sends the initial video information to the edge node.
[0118] Exemplarily, for example, if the edge node determines that the initial video information is not stored in the local storage module, the business module in the edge node generates a video acquisition request, and sends the video acquisition request to the sub-center node connected to the edge node in the VCN network through the access and communication module. At this time, the sub-center node checks the local storage module and determines whether the storage module stores the initial video information corresponding to the video acquisition request. Afterwards, if the sub-center node determines that the storage module does not store the third initial video information, the video acquisition request is forwarded to the central node through the business module. When the central node receives the video acquisition request through the business management center, it reads the storage center based on the video acquisition request to obtain the source video information injected by the second user terminal in the storage center, and processes the source video information through the audio and video processing module to generate initial video information. The central node then sends the initial video information to the sub-center node through the communication module, and the sub-center node sends the initial video to the edge node.
[0119] It should be noted that, in this embodiment and other embodiments, if the edge node determines that the initial video information is stored in the local storage module, the initial video information is directly obtained in the storage module, and the initial video information is distributed to the edge node. In this way, when the edge node does not store the initial video information corresponding to the viewing request in the local storage module of the node, the VCN network can control the sub-center node connected to the edge node to obtain the initial video information at the node or the center node, and send the initial video information to the edge node for the edge node to process the initial information, so that the edge node can obtain the initial video information in time and generate the target video faster.
[0120] In addition, if Figure 6 As shown, the minute core node is configured with an access and communication module, a computing power module, a storage module, a business module, a message module and an audio processing module, wherein the functions of each module are basically the same as those of the modules in the above-mentioned edge nodes, and therefore will not be repeated here.
[0121] Optionally, in some feasible embodiments of the video transmission method of the present application, the terminal device can control the VCN network to process the video information in real time to generate the target video, and can also detect the activity of the connected user terminal. That is, after the above-mentioned operation of "receiving the first request sent by the first user terminal", the video transmission method of the present application can also include:
[0122] Sending heartbeat information to the first user terminal, and determining an activity state corresponding to the first user terminal based on the heartbeat information;
[0123] If it is determined that the active state corresponding to the first user terminal is inactive, the communication connection with the first user terminal is cut off, and the computing power container corresponding to the first user terminal is cached.
[0124] In this embodiment, after receiving the viewing request sent by the first user terminal, the edge node calls the business module to generate heartbeat information, and sends the heartbeat information to the first user terminal through the access and communication module to determine whether the first user terminal is in an active state. Afterwards, if the edge node determines that the first user terminal is in an inactive state based on the heartbeat information, the access and communication module cuts off the communication connection with the first user terminal, and calls the computing power module to cache the computing power container corresponding to the first user terminal.
[0125] For example, see Figure 8 , Figure 8 This is a schematic diagram of the user registration and logout process involved in an embodiment of the video transmission method provided in the embodiment of the present application, such as Figure 8As shown in step S209, after receiving the viewing request sent by the first VR device, the edge node calls the business module to generate a heartbeat signal, and sends the heartbeat signal to the first VR device through the access and communication module according to the preset transmission frequency. When the first VR device is playing the video screen, or communicating and interacting with other VR devices in the virtual reality space, a response signal corresponding to the received heartbeat signal is generated, and the response signal is sent to the edge node. The edge node determines that the first VR device is in an active state when receiving the response signal; and when the user chooses to hang up, that is, the first VR device pauses or stops playing the video screen, or does not interact with other VR devices, the first VR device does not generate a corresponding response signal when receiving the heartbeat signal. The edge node then determines that the first VR device is in an inactive state when it does not receive a response signal sent by the first VR device within a period of time after transmitting the heartbeat signal, thereby controlling the access and communication module to cut off the connection with the first VR device, and controlling the computing power module to cache the computing power container corresponding to the first VR device. In this way, the edge node detects the activity of the user terminal and promptly cuts off the connection between the user terminal and the VCN network when it detects that the user terminal is in an inactive state, thereby avoiding the occupation of network resources and computing resources, thereby releasing network and computing resources to other edge nodes when the user is offline to ensure the user experience of other users in the network.
[0126] Furthermore, based on the above-mentioned first embodiment of the video transmission method of the present application, a second embodiment of the video transmission method of the present application is proposed.
[0127] In the second embodiment of the video transmission method of the present application, after the above operation of "sending the target video to the first user terminal", the following may also be included:
[0128] receiving a second request sent by the first user terminal;
[0129] The second request is sent to the central node, wherein the central node determines a third user terminal corresponding to the first user terminal based on the second request, and establishes a communication link between edge nodes corresponding to the first user terminal and the third user terminal respectively.
[0130] It should be noted that, in this embodiment, the second request is an interaction request generated by the first user terminal based on an interactive operation when the user performs interactive operations such as commenting and interacting with any other virtual character in a virtual reality space with interactive functions through the first user terminal.
[0131] When the user is watching the target video information, he can select any other virtual character in the above-mentioned virtual reality scene to initiate an interactive operation. The first user terminal generates an interactive request based on the interactive operation and sends the interactive request to the edge node. After receiving the interactive request, the edge node forwards the interactive request to the central node through the local business module. The central node determines the third user terminal corresponding to the first user terminal and the address information corresponding to the third user terminal based on the interactive request. The central node queries the multiple connected sub-center nodes based on the address information, thereby determining the target sub-center node connected to the third user terminal in the multiple sub-center nodes, and then determines to establish a communication link connected to the third user terminal based on the target sub-center node, and sends the interactive request to the second edge node. The second edge node sends the interactive request to the third user terminal. The third user terminal determines the interactive operation included in the interactive request. Afterwards, when the first user terminal and the third user terminal interact with each other, the interactive operation can be completed through the established communication link.
[0132] For example, for example, Fig.10 As shown in steps S510 to S515, when the user (ie Fig.10 User A in the video watches the host (i.e. Fig.10 When user B) in the video initiates a live broadcast activity in a virtual reality scene through a third VR device, the user can comment or interact with the anchor character through the first VR device, and select the third VR device corresponding to the anchor as the interaction object. The first VR device then generates an interaction request based on the interaction, and sends the interaction request to the first edge node connected in the VCN network. After that, the first edge node forwards the interaction request to the central node in the VCN network. The central node parses the interaction request to determine the third VR device corresponding to the first VR device and the address information of the third VR device (i.e., step S512 in the figure). When the edge node determines that the first VR device and the third VR device are both under the local node, a connection is directly established between the first VR device and the third VR device. Communication link, and when the edge node determines that the first VR device and the third VR device are not under the local node, the edge node reports the interaction request to the central node, and the central node determines the second edge node connected to the third VR device in the VCN network based on the address information. The central node then builds a communication link between the edge nodes corresponding to the first VR device and the third VR device, and sends the received interaction request to the second edge node through the access and communication module, and then the second edge node forwards the interaction request to the third VR device, so that the anchor receives the interactive operation initiated by the user through the third VR device. After that, when the user interacts with the anchor, the first VR device and the second VR device can directly complete the transmission of the interaction instructions through the communication link built by the central node.
[0133] In this way, compared with the related technology in which the edge nodes in the CDN network cannot interact with each other, the method of building communication links between multiple edge nodes in the VCN network through the central node can enable multiple user terminals in the network to interact directly with each other with low latency, so that the overall network structure can be applied to highly interactive virtual reality scenarios such as live broadcasts.
[0134] Optionally, in some feasible embodiments of the video transmission method of the present application, the video computing network further includes a gateway interface, and before the above-mentioned operation of “receiving the first request sent by the first user terminal”, the following may also be included:
[0135] A communication connection is established with the first user terminal, wherein the first user terminal is assigned after the central node verifies a preset login request, and the login request is received by the gateway interface and sent to the central node.
[0136] In this embodiment, before the first user terminal sends a viewing request to the edge node, the first user terminal needs to send an access request to the VCN network through the gateway interface. The unified scheduling center in the central node obtains the location information of the first user terminal based on the access request, and then calculates the scheduling path based on the location information, and determines the first edge node among the multiple edge nodes included in the VCN network based on the scheduling path, and then assigns the first user terminal to the first edge node, thereby establishing a communication connection between the edge node and the first user.
[0137] For example, for example, Figure 8 As shown in steps S201 to S204, before the user enters the virtual reality space through the first VR device to watch the live video, the user first controls the first VR device to generate an access request and sends the access request to the gateway interface in the VCN network. When the gateway interface receives the access request, it sends the access request to the central node in the VCN network. Thereafter, the central node parses the access request to obtain the IP address carried in the access request. The unified scheduling center in the central node then calculates the scheduling path based on the IP address and the computing power corresponding to each edge node, so as to determine the first edge node matching the first VR device among the multiple edge nodes contained in the network, and then establish a communication connection between the first VR device and the first edge node.
[0138] In this way, the central node can allocate the user terminal to an edge node with sufficient computing power and smooth communication by allocating a suitable edge node to the user terminal based on the computing power distribution in the network and the location information of the user terminal. This avoids the situation in the related technology where the CDN network allocates user terminals only based on distance information, and easily allocates the user terminal to a node that is close to the user terminal but has poor communication.
[0139] Optionally, in some feasible embodiments of the video transmission method of the present application, before the above-mentioned operation of “receiving the first request sent by the first user terminal”, the following steps may also be included:
[0140] receiving registration information sent by the first user terminal and storing the registration information;
[0141] The registration information is sent to the sub-center node for storage, wherein the sub-center node sends the registration information to the central node for storage.
[0142] In this embodiment, if Figure 8 As shown in step S205 to step S208, before receiving the viewing request sent by the first user terminal, the VCN network needs to register the first user terminal connected to the VCN network. During the registration, the user needs to enter the registration information into the first user terminal, and the first user terminal then sends the registration information to the connected edge node. After receiving the registration information, the edge node stores the registration information in the local storage module and reports the registration information to the sub-center node connected to the edge node in the VCN network. The sub-center node stores the registration information in the corresponding storage module. At the same time, the sub-center node reports the registration information to the central node, and the central node stores the registration information. In this way, when the user terminal subsequently accesses the VCN network, the VCN network can call the central node to perform login verification on the user terminal based on the stored registration information to ensure the security of the VCN network.
[0143] Optionally, in some feasible embodiments of the video transmission method of the present application, after the above operation of “sending the target video to the first user terminal”, the following may also be included:
[0144] receiving a logout request sent by the first user terminal, clearing user information corresponding to the first user terminal, and caching a computing power container corresponding to the first user terminal;
[0145] The logout request is sent to the sub-center node to notify the sub-center node and the central node to clear the user information, and to notify the central node to update the login status of the first user terminal.
[0146] In this embodiment, when the user finishes watching the video or exits the live broadcast room, the first user terminal is controlled to generate an exit request, and the first user terminal sends the exit request to the VCN network. When the edge node in the VCN network receives the exit request, the user information corresponding to the first user terminal is cleared in the local storage module of the edge node, and the computing power module is controlled to cache the computing power container used by the edge node during the login of the first user terminal. At the same time, the edge node forwards the exit request to the connected sub-center node, and the sub-center node further clears the user information corresponding to the first user terminal in the local storage module, and reports the user information to the central node. When the central node receives the exit request, the business center updates the login status corresponding to the first user terminal to an offline status.
[0147] For example, for example, Figure 8 As shown in steps S210 to S215, when the user watches the live broadcast and actively exits the virtual reality space, the first VR device generates an exit request and sends the exit request to the connected edge node. When the edge node receives the exit request, it cleans up the registration information uploaded by the first VR device stored in the local storage module, the established message link and other user information. At the same time, the edge node controls the computing power module to cache the computing power container called by the edge node during the login of the first VR device according to the preset cache period. After that, the edge node synchronizes the exit request to the adjacent sub-center node in the VCN network. The sub-center node then cleans up the user information uploaded by the first VR device in the local storage module, and synchronizes the exit request to the central node in the VCN network. The central node then calls the business center to update the login status corresponding to the first VR device to an offline status.
[0148] In this embodiment and another embodiment, when a user is watching a video or live broadcast in a virtual reality space, if the user is forced to exit due to network disconnection, power outage, etc., that is, the first VR device cuts off the communication connection with the edge node without issuing an exit request, the edge node also controls the computing power module to cache the computing power container called by the edge node during the login to the first VR device according to a preset cache period, and generates abnormal disconnection information, uploads the abnormal disconnection information to the sub-center node, and the sub-center node synchronizes the abnormal disconnection information to the central node, and the central node then updates the login status of the first VR device to an offline status.
[0149] In this way, the VCN network can update the user's login status in time when the user logs out, and cache the computing power container corresponding to the user terminal according to the preset caching rules. When the user reconnects to the VCN network within the caching period, the edge node can directly call the computing power container to process the video information, so as to generate the target video information faster.
[0150] Optionally, in some feasible embodiments of the video transmission method of the present application, before the above-mentioned operation of “receiving the first request sent by the first user terminal”, the following steps may also be included:
[0151] The preset edge node information is sent to the sub-center node for storage, so as to establish a message channel and a service link with the sub-center node and to establish a message channel and a service link between the sub-center node and the center node.
[0152] In this embodiment, during the construction of the VCN network, it is necessary to configure the corresponding node information for each edge node, each sub-center node and the central node contained in the VCN network. Afterwards, when the VCN network is completed, the nodes contained in the network are initialized. During the process of initializing the nodes, the edge node sends the edge node information to the corresponding sub-center node through the access and communication module. The sub-center node stores the received edge node information in the storage module, and builds a communication link and a message channel between the sub-center node and the corresponding edge node center through the internal access and communication module. At the same time, the sub-center node reports the sub-center node information corresponding to the sub-center node to the central node in the network through the local access and communication module. After that, the central node records the received sub-center node information corresponding to each sub-center node in the storage center, and establishes a business communication link and a message channel with each sub-center node through the scheduling center.
[0153] For example, see Figure 7 , Figure 7 This is a schematic diagram of the network node and computing service initialization process involved in an embodiment of the video transmission method provided in the embodiment of the present application, such as Figure 7As shown in step S100-1 to step S102-2, in the process of constructing a VCN network by deploying a central node, multiple sub-center nodes and multiple edge nodes based on a physical network, configuring various hardware devices and configuring the underlying network links, the VCN network is initialized as a whole after node attribute information such as node ID, node type and node IP is configured for each of the central node, multiple sub-center nodes and multiple edge nodes. In the process of initializing the VCN network as a whole, multiple edge nodes send their corresponding edge node information such as node ID, node type and node IP to their corresponding sub-center nodes through access and communication modules. Each sub-center node stores the received edge node information in a local storage module, and builds communication links and message channels with the corresponding multiple edge nodes through their respective access and communication modules. After that, the multiple sub-center nodes report the sub-center node information including their respective node ID, node type and node IP information to the central node. The unified dispatching center in the central node records the sub-center node information corresponding to each sub-center node, and builds business communication links and message channels with the multiple sub-center nodes. In this way, after the VCN network is built, it can initialize each node in the network so that the VCN network can run normally, avoiding the need to temporarily build communication links during business operations, which would waste time and cause high latency.
[0154] Optionally, in some feasible embodiments of the video transmission method of the present application, before the above-mentioned operation of “receiving the first request sent by the first user terminal”, the following steps may also be included:
[0155] The computing power information is sent to the sub-center node to generate the sub-center computing power information and construct a computing power container.
[0156] In this embodiment, if Figure 7 As shown in step S104 to step S108, when the VCN network is completed, computing power services are deployed for each node contained in the network. In the process of deploying computing power services, multiple edge nodes in the VCN network each call the local computing power module to calculate the computing power information corresponding to the node, and report the computing power information to the sub-center nodes connected to each other. The computing power module in the sub-center node records the computing power information corresponding to each edge node, and registers in the local computing power module to obtain the sub-center computing power information. Each sub-center node reports its corresponding sub-center computing power information to the central node, and the computing power management center in the central node summarizes the computing power information of each sub-center to construct a computing power container. In this way, after the VCN network is completed, it can timely collect the computing power resources corresponding to each node in the network, and then allocate computing power containers to each node based on the computing power resources.
[0157] In addition, an embodiment of the present application also provides a video computing network. The video computing network of the present application is also applied to the terminal device as described above.
[0158] The video computing network of the present application may include: a plurality of edge nodes and a central node, wherein the central node is respectively connected to the plurality of edge nodes, and any two edge nodes among the plurality of edge nodes are connected;
[0159] The edge node is configured to establish a communication connection with a first user terminal, receive a first request sent by the first user terminal and determine a video adjustment parameter included in the first request, obtain initial video information corresponding to the first request, process the initial video information based on the video adjustment parameter to generate a target video, and send the target video to the first user terminal;
[0160] The central node is configured to process the source video information injected by the second user terminal to obtain the initial video information, and send the initial video information to the edge node upon receiving the video acquisition request reported by the edge node.
[0161] In this embodiment, please refer to Figure 4 , Figure 4 This is a schematic diagram of a VCN network structure involved in an embodiment of a video transmission method provided in an embodiment of the present application, such as Figure 4As shown, the VCN network includes multiple edge nodes and central nodes. The edge nodes are directly connected to the VCN central node. The edge nodes can be interconnected. When a user enters a virtual reality space with a real-time interactive function through a first user terminal, the first user terminal is connected to a terminal device with a VCN network integrated therein. The VCN network assigns the first user terminal to any edge node in the network. The first user terminal then sends a viewing request to the edge node. When the edge node receives the viewing request, it parses the viewing request to obtain the video adjustment parameters contained in the viewing request. At the same time, when parsing the viewing request, the edge node determines the video content specified by the viewing request. After that, the edge node performs Read and determine whether the local storage module of the node stores the initial video information corresponding to the video content. If the edge node determines that the local storage module does not cache the initial video information, it generates a video acquisition request and sends the video acquisition request to the central node in the VCN network. After that, the central node reads the storage center to obtain the source video information injected into the central node by the second user terminal through the connected edge node, and processes the source video information to generate the initial video information corresponding to the video acquisition request. The central node then sends the initial video information to the edge node. When acquiring the initial video information, the edge node calls the computing power module to process the initial video information in real time according to the video adjustment parameters obtained by parsing to generate the target video.
[0162] It can be understood that in this embodiment and other embodiments, the process in which the second user terminal serves as a terminal for publishing video images and injects source video information into the VCN network is basically the same as the above embodiment, so it will not be repeated here.
[0163] Optionally, in some feasible embodiments of the video computing network of the present application, the video computing network further includes: a plurality of sub-center nodes, wherein the central node is respectively connected to a plurality of the sub-center nodes, and the plurality of the sub-center nodes are respectively connected to a plurality of the edge nodes;
[0164] The sub-center node is configured to receive the video acquisition request reported by the edge node, forward the video acquisition request to the central node to acquire the initial video information, and send the initial video information to the edge node.
[0165] In this embodiment, please refer to Figure 5 , Figure 5 This is another VCN network structure diagram involved in an embodiment of the video transmission method provided in the embodiment of the present application. When the VCN network needs to process services exceeding a certain scale, a layer of sub-center nodes can be added to the VCN network, such as Figure 5As shown, the VCN network includes a first-level sub-center layer, which includes three sub-center nodes. The three sub-center nodes can communicate with each other. Each sub-center node has several edge nodes and the edge nodes can communicate with each other. The edge nodes between sub-centers can forward communication through the sub-centers to which they belong; if the edge node determines that the local storage module does not cache the initial video information, it generates a video acquisition request and sends the video acquisition request to the sub-center node connected to the edge node in the VCN network. The sub-center node reads the local storage module and determines whether the local storage module caches the initial video information corresponding to the video acquisition request. If the sub-center node determines that the local storage module does not cache the initial video information, it forwards the video acquisition request to the central node, and the central node reads the storage center to obtain the initial video information injected by the second user terminal, and sends the initial video information to the sub-center node, and the sub-center node further sends the initial video information to the edge node.
[0166] In addition, an embodiment of the present application also provides a terminal device, which includes: the video transmission device as described above, a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the video transmission method as described above.
[0167] In addition, an embodiment of the present application further provides a storage medium, which is a computer-readable storage medium. A computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the video transmission method described above are implemented.
[0168] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.
[0169] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment method can be implemented by means of software plus the necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application can be essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM / RAM, disk, CD) as described above, including a number of instructions to enable a terminal device (which can be a terminal device with an internally integrated VCN (Video Computing Network-personalized video computing power) network, and can send different personalized video information and interactive information to each user terminal by controlling the VCN network, or the terminal device involved in the embodiment of the present application can also be a data storage control terminal, mobile terminal, PC and other terminals connected to the above-mentioned VCN network) to execute the methods described in each embodiment of the present application.
[0170] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A video transmission method, characterized in that: Applied to any edge node in a video computing network, the edge node is communicatively connected to a first user terminal, and the method includes: receiving a first request sent by the first user terminal, and determining a video adjustment parameter included in the first request; Acquire initial video information corresponding to the first request, and process the initial video information based on the video adjustment parameter to generate a target video; The target video is sent to the first user terminal.
2. The video transmission method according to claim 1, characterized in that: In the case where a computing power container is cached in the edge node, the initial video information is processed based on the video adjustment parameter to generate a target video, including: The computing power container is called to process the initial video information based on the video adjustment parameters to generate a target video.
3. The video transmission method according to claim 1, characterized in that: The initial video information includes first initial video information, and obtaining the initial video information corresponding to the first request includes: In a case where the initial video information corresponding to the first request is cached in the edge node, the cache is read to obtain the first initial video information.
4. The video transmission method according to claim 1, characterized in that: The video computing network further includes a central node, the central node is connected to the edge node, and when there is no cache computing container in the edge node, the initial video information is processed based on the video adjustment parameter to generate a target video, including: A computing power call application is sent to the central node, and a computing power container allocated by the central node based on the computing power call application is received, and the computing power container is called to process the initial video information based on the video adjustment parameters to generate a target video.
5. The video transmission method according to claim 4, characterized in that: The initial video information includes second initial video information, and obtaining the initial video information corresponding to the first request further includes: When the edge node does not cache the initial video information corresponding to the first request, sending a video acquisition request to the central node; The second initial video information sent by the central node based on the video acquisition request is received, wherein the second initial video information is obtained by the central node processing the source video information injected by the second user terminal.
6. The video transmission method according to claim 5, characterized in that: The video computing network further includes a sub-center node, and the central node and the edge node are communicatively connected through the sub-center node; The initial video information includes third initial video information, and obtaining the initial video information corresponding to the first request further includes: When the initial video information is not cached in the edge node, sending the video acquisition request to the sub-center node; Receive the third initial video information sent by the sub-center node based on the video acquisition request, wherein the third initial video information is sent to the sub-center node by the central node based on the video acquisition request forwarded by the sub-center node.
7. The video transmission method according to any one of claims 1 to 6, characterized in that: After receiving the first request sent by the first user terminal, the method further includes: Sending heartbeat information to the first user terminal, and determining an activity state corresponding to the first user terminal based on the heartbeat information; If it is determined that the active state corresponding to the first user terminal is inactive, the communication connection with the first user terminal is cut off, and the computing power container corresponding to the first user terminal is cached.
8. The video transmission method according to any one of claims 4 to 6, characterized in that: After the step of sending the target video to the first user terminal, the method further includes: receiving a second request sent by the first user terminal; The second request is sent to the central node, wherein the central node determines a third user terminal corresponding to the first user terminal based on the second request, and establishes a communication link between edge nodes corresponding to the first user terminal and the third user terminal respectively.
9. The video transmission method according to any one of claims 4 to 6, characterized in that: The video computing network further includes a gateway interface. Before receiving the first request sent by the first user terminal, the method further includes: A communication connection is established with the first user terminal, wherein the first user terminal is assigned after the central node verifies a preset login request, and the login request is received by the gateway interface and sent to the central node.
10. The video transmission method according to claim 6, characterized in that: Before receiving the first request sent by the first user terminal, the method further includes: receiving registration information sent by the first user terminal and storing the registration information; The registration information is sent to the sub-center node for storage, wherein the sub-center node sends the registration information to the central node for storage.
11. The video transmission method according to claim 6, characterized in that: After sending the target video to the first user terminal, the method further includes: receiving a logout request sent by the first user terminal, clearing user information corresponding to the first user terminal, and caching a computing power container corresponding to the first user terminal; The logout request is sent to the sub-center node to notify the sub-center node and the central node to clear the user information, and to notify the central node to update the login status of the first user terminal.
12. The video transmission method according to claim 6, characterized in that: Before receiving the first request sent by the first user terminal, the method further includes: The preset edge node information is sent to the sub-center node for storage, so as to establish a message channel and a service link with the sub-center node and to establish a message channel and a service link between the sub-center node and the center node.
13. The video transmission method according to claim 6, characterized in that: Before receiving the first request sent by the first user terminal, the method further includes: The computing power information is sent to the sub-center node to generate the sub-center computing power information and construct a computing power container.
14. A video computing network, characterized in that: The video computing network includes: a plurality of edge nodes and a central node, wherein the central node is connected to the plurality of edge nodes respectively, and any two edge nodes among the plurality of edge nodes are connected; The edge node is configured to establish a communication connection with a first user terminal, receive a first request sent by the first user terminal and determine a video adjustment parameter included in the first request, obtain initial video information corresponding to the first request, process the initial video information based on the video adjustment parameter to generate a target video, and send the target video to the first user terminal; The central node is configured to process the source video information injected by the second user terminal to obtain the initial video information, and send the initial video information to the edge node upon receiving the video acquisition request reported by the edge node.
15. The video computing network according to claim 14, characterized in that: The video computing network also includes: a plurality of sub-center nodes, wherein the central node is connected to a plurality of the sub-center nodes respectively, and the plurality of the sub-center nodes are respectively connected to a plurality of the edge nodes; The sub-center node is configured to receive the video acquisition request reported by the edge node, forward the video acquisition request to the central node to acquire the initial video information, and send the initial video information to the edge node.
16. A terminal device, characterized in that: The terminal device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the video transmission method according to any one of claims 1 to 13.
17. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the video transmission method according to any one of claims 1 to 13 are implemented.
Citation Information
Patent Citations
Free viewpoint video transmission method and related equipment
CN113473156A
Video stream transmission method and device applied to virtual reality VR scene
CN115314730A
Media stream transmission method, device and system
CN115623074A
Bandwidth efficient video surveillance system
US20170078626A1
