Dynamic video generation method and electronic equipment

By responding to the call request and audio and video negotiation information of the user terminal, obtaining and jumping the video page, performing screenshot operations, and generating target video streams, solving the problem of single content of video materials in IVVR video applications, realizing dynamic video generation and user interaction Improved flexibility.

CN119316400APending Publication Date: 2025-01-14ZTE CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310868652.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-07-14
Publication Date
2025-01-14

AI Technical Summary

Technical Problem

In the existing IVVR video applications, the content of the video material is single, the user interaction is not flexible, and it is impossible to generate customized video streams in real time based on user operations.

Method used

By responding to the call request from the user terminal, determine the audio and video negotiation information, obtain the operation instructions of the video page, jump to the second video page, and perform screenshot operations within the preset time period, convert the page screenshot into the target video stream, and send Go to the user terminal to realize dynamic video generation.

Benefits of technology

It improves the flexibility of video interaction, supports instantly generated customized video streams, and can display query results and other content that cannot be produced in advance based on user operations, improving user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119316400A_ABST
    Figure CN119316400A_ABST
Patent Text Reader

Abstract

The invention discloses a dynamic video generation method and electronic equipment, and belongs to the technical field of communication. The method comprises the following steps: in response to a call request initiated by a user terminal, determining audio and video negotiation information matched with the user terminal; obtaining an operation instruction deployed in the first video page in advance, and skipping to a second video page according to the operation instruction when it is determined that interaction of the operation instruction is completed; performing screenshot operation on the second video page within a preset time period to obtain a plurality of page screenshots corresponding to the second video page, and converting the plurality of page screenshots into a target video stream according to the audio and video negotiation information; and sending the target video stream to the user terminal. Through the mode, the playing of the pre-stored static video file can be supported, the dynamic generation of the video material is supported, and the instantly generated video stream is played for the user terminal, so that the flexibility of video interaction can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of communication technology, and in particular to a dynamic video generation method and electronic device. Background Art

[0002] IVVR (Interactive Voice and Video Response) is a new telecommunications value-added service that allows users to dial a designated number through their mobile phones to obtain the required information or participate in interactive services. Compared with the traditional contact center IVR service, IVVR has better technology and service models, more diversified services, and can maximize the efficiency and breadth of contact with customers, and better improve the efficiency of one-time problem solving.

[0003] However, the current common IVVR video applications can only play video content to users, such as video menus, video display data query results and other scenarios. The video materials are recorded in advance and stored on the media server. The content of the video materials is single and the flexibility of interaction with users is not high. Summary of the invention

[0004] The embodiments of the present application provide a dynamic video generation method and an electronic device to at least solve the problem that in existing video interaction scenarios, the video material content is single and the flexibility of interaction with users is not high.

[0005] In order to solve the above technical problems, this application is implemented as follows:

[0006] In a first aspect, an embodiment of the present application provides a method for generating a dynamic video, comprising:

[0007] In response to a call request initiated by a user terminal, determining audio and video negotiation information matching the user terminal;

[0008] Obtain an operation instruction pre-deployed on the first video page, and when it is determined that the operation instruction has completed the interaction, jump to the second video page according to the operation instruction;

[0009] Performing a screenshot operation on the second video page within a preset time period to obtain multiple page screenshots corresponding to the second video page, and converting the multiple page screenshots into a target video stream according to the audio and video negotiation information;

[0010] The target video stream is sent to the user terminal.

[0011] In a second aspect, an embodiment of the present application provides an electronic device, characterized in that it includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect above are implemented.

[0012] In a third aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0013] The dynamic video generation method provided in the embodiment of the present application determines, in response to a call request initiated by a user terminal, audio and video negotiation information matching the user terminal; obtains an operation instruction pre-deployed on a first video page, and when it is determined that the operation instruction has completed the interaction, jumps to the second video page according to the operation instruction; performs a screenshot operation on the second video page within a preset time period to obtain multiple page screenshots corresponding to the second video page, and converts the multiple page screenshots into a target video stream according to the audio and video negotiation information; and sends the target video stream to the user terminal.

[0014] Through the above method, since the interaction completion status of the operation instructions of the first video page is based on the jump to the corresponding second video page, and the multiple page screenshots corresponding to the second video page are converted into the target video stream according to the audio and video negotiation protocol matching the user terminal, in this way, a customized video stream can be generated according to the user operation, and dynamic generation of video materials can be supported to play the instantly generated video stream to the user terminal. For example, according to the query information entered by the user, the corresponding query results and other content that cannot be produced in advance are displayed on the video page, thereby improving the flexibility of video interaction.

[0015] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0017] Figure 1 A schematic diagram of a process flow of a dynamic video generation method provided in an embodiment of the present application is shown;

[0018] Figure 2 A schematic diagram of a process for determining audio and video negotiation information provided by an embodiment of the present application is shown;

[0019] Figure 3 A schematic diagram showing a flow chart of a method for obtaining an operation instruction provided in an embodiment of the present application is shown;

[0020] Figure 4 A schematic diagram of the structure of the contact center IVVR video interaction system provided in an embodiment of the present application is shown;

[0021] Figure 5 A schematic flow chart of a dynamic video generation method based on a contact center IVVR video interaction system provided in an embodiment of the present application is shown;

[0022] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0023] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0024] Figure 1 The flowchart of the dynamic video generation method provided by the embodiment of the present application is shown. The execution subject of the method can be a server, wherein the server can be an independent server or a server cluster composed of multiple servers. Moreover, the server can be a background server of a certain business or a background server of a certain system (for example, a contact center IVVR video interaction system, a multimedia conference system, etc.). In the embodiment of the present application, the execution subject is taken as an example to illustrate. As shown in the figure, the dynamic video generation method 100 can specifically include the following steps:

[0025] S101: In response to a call request initiated by a user terminal, determine audio and video negotiation information matching the user terminal;

[0026] S102: Acquire an operation instruction pre-deployed on the first video page, and when it is determined that the operation instruction has completed the interaction, jump to the second video page according to the operation instruction;

[0027] S103: performing a screenshot operation on the second video page within a preset time period to obtain a plurality of page screenshots corresponding to the second video page, and converting the plurality of page screenshots into a target video stream according to the audio and video negotiation information;

[0028] S104: Send the target video stream to the user terminal.

[0029] In a specific implementation, when the server receives a call request initiated by a user terminal, it determines an audio and video negotiation protocol that matches the user terminal to generate a video in an audio and video encoding format that is compatible with the user terminal. An operation instruction pre-deployed on the first video page is obtained. Here, the first video page can be an H5 homepage, which is a page that welcomes users by default, or other specified video pages.

[0030] When it is determined that the operation instruction of the first video interface has completed the interaction, jump to the second video page according to the operation instruction. Operation instructions include playback, playing fixed video materials, buttons, voice recognition, etc. The operation instruction that has completed the interaction can be understood as playback completion, video playback completion, button results, voice recognition results, etc. In actual applications, the media server can be notified to perform media interaction operations. After the media interaction is completed, a notification message is obtained to characterize that the operation instruction has completed the interaction. Then jump to the second video page according to the operation instruction. Since the second video page is determined based on the operation instruction that the user has completed the interaction, customized video materials can be generated according to the user's operation. For example, for each button entered by the user, real-time echo is performed on the video page, or query information related to the content is displayed according to the query content entered by the user, and voice recognition results are obtained and displayed, etc.

[0031] Then, a screenshot operation is performed on the second video webpage within a preset time period to obtain multiple page screenshots corresponding to the second video page. For example, the screenshot time can be set to 1 second. Figure 5 The captured multiple page screenshots are converted into a target video stream according to the audio and video negotiation information; and the target video stream is sent to the user terminal.

[0032] Through the above steps, according to the completion of the interaction of the operation instructions of the first video page, jump to the corresponding second video page, and convert the multiple page screenshots corresponding to the second video page into the target video stream according to the audio and video negotiation protocol matching the user terminal. In this way, customized video streams can be generated according to user operations, dynamic generation of video materials can be supported, and instantly generated video streams can be played to user terminals, thereby improving the flexibility of interaction with users.

[0033] In a possible implementation, Figure 2 As shown, in the above step S101, determining the audio and video negotiation information matching the user terminal includes:

[0034] Step 1011: performing media negotiation with the user terminal in the access network according to the call request, and reserving target media resources in the access network according to the media negotiation result;

[0035] Step 1012: When it is determined that the reservation of the target media resource is completed, a video conference is established with the user terminal, and audio and video negotiation information matching the user terminal is determined.

[0036] In a specific implementation, if a user terminal accesses a video server through a VoLTE (Voice over Long-Term Evolution) call, before the video interaction, the VoLTE network resource reservation process is negotiated, and target media resources are reserved in the access network according to the negotiation results, such as voice resource reservation, video resource reservation, etc. When it is determined that the target media resource reservation is completed, a video conference is established with the user terminal, and audio and video negotiation information matching the user terminal is determined. The audio and video negotiation information includes audio and video SDP parameters, media transmission ports, etc.

[0037] Among them, in step 1011, reserving target media resources in the access network according to the media negotiation result includes:

[0038] Reserving, in the access network, a first media resource corresponding to the call request according to the media negotiation result;

[0039] In a case where it is determined that the first media resource reservation satisfies the target resource reservation, determining the first media resource reservation as the target media resource reservation;

[0040] When it is determined that the first media resource reservation cannot satisfy the target resource reservation, the call request is converted into a target call request, a second media resource reservation is performed in the access network, and the second media resource reservation is determined to be the target media resource reservation.

[0041] In the specific implementation, since the video channel and the voice channel are independent of each other, when the user calls in, during the voice interaction with the user, the video URL is sent to the user, and the user opens the video URL to achieve video interaction. Therefore, the existing method still cannot simultaneously meet the interactive scenarios of audio and video fusion and the call function of audio and video switching. If the integration of audio and video channels cannot be achieved, not only will it be impossible to provide customers with a complete and agreed video experience, but it will also cause problems in system construction and human resources.

[0042] In the embodiment of the present application, a first media resource reservation corresponding to the call request is reserved in the access network according to the media negotiation result; when it is determined that the first media resource reservation satisfies the target resource reservation, the first media resource reservation is determined to be the target media resource reservation. For example, if the user terminal initiates a video call, the video resource reservation negotiation is completed;

[0043] When it is determined that the first media resource reservation cannot meet the target resource reservation, the call request is converted into a target call request, and a second media resource reservation is performed in the access network. The second media resource reservation is determined to be the target media resource reservation. For example, if the user terminal initiates a voice call, the voice resource reservation negotiation is completed and it is unilaterally upgraded to a video call to complete the video resource reservation negotiation.

[0044] In this way, when a user uses a terminal to initiate a call (including a voice call or a video call), the function of audio and video fusion can be provided according to the needs of the business scenario to meet the prerequisites for video interaction with the user terminal, which may include: (1) one-way upgrade of an audio call to a video call; (2) the video call falls back to a voice call; (3) switching between audio and video calls during a video call.

[0045] In a possible implementation, Figure 3 As shown, in the above step S102, obtaining the operation instruction pre-deployed on the first video page includes:

[0046] Step 1021: Obtain the webpage address corresponding to the call request;

[0047] Step 1022: Displaying a first video page corresponding to the webpage address on the user terminal;

[0048] Step 1023: Determine the operation instructions deployed on the first video page according to the interactive business process node corresponding to the first video page.

[0049] In a specific implementation, a URL (Uniform Universal Resource Locator) address corresponding to the call request is obtained. The URL address is the address of a standard resource on the Internet, also known as a web page address. The first video page corresponding to the web page address is displayed on the user terminal, and the operation instructions deployed on the first video page are determined according to the interactive service process node corresponding to the first video page, so as to notify the media server to perform media interactive operations and realize video interaction with the user.

[0050] Wherein, in step 1022, the user terminal displays the first video page corresponding to the page address, including:

[0051] Establish a session connection with the target browser;

[0052] A command message is sent to the target browser, the first video page is opened through the target browser, and the first video page is displayed on the user terminal; the command message includes a page address.

[0053] In the specific implementation, by calling the method provided by the built-in Linux version Headless Chromium browser Devtools protocol, a WebSocket connection is established with the Chromium browser server. After the session is generated, the command message for opening the page provided by the Devtools protocol is sent to open the first video page deployed on the WebServer business system.

[0054] In a possible implementation, determining in the above step S102 that the operation instruction has completed the interaction includes:

[0055] In response to a media interaction operation of the target user with respect to the operation instruction through the user terminal, it is determined that the operation instruction has completed the interaction.

[0056] In a specific implementation, the user's media interaction operations on the user terminal for operation instructions are received, such as playing sound, playing fixed video materials, pressing buttons, voice recognition, etc., and it is detected whether the operation instructions have completed the interaction. If the operation instructions have completed the interaction, jump to the second video page according to the operation instructions, for example, obtain the account and password information entered by the user, complete the real-time echo of the user's key input, or jump to the video page of other business processes for display, etc.

[0057] In a possible implementation, the audio and video negotiation information includes audio and video SDP parameters; in the above step S103, converting the multiple page screenshots into a target video stream according to the audio and video negotiation information includes:

[0058] According to the audio and video SDP parameters, the multiple page screenshots are encoded to generate the target video stream.

[0059] In a specific implementation, the audio and video SDP parameters include video encoding format, audio encoding format, media transmission mode, etc. According to the audio and video SDP parameters, multiple page screenshots are encoded to obtain a target video stream adapted to the user terminal.

[0060] In a possible implementation manner, the audio and video negotiation information includes a media transmission port; in the above step S104, sending the target video stream to the user terminal includes:

[0061] The target video stream is sent to the user terminal according to the media transmission interface.

[0062] In a specific implementation, the media transmission port includes the user terminal audio / video upstream and downstream ports and the video player video downstream port (video only sends and does not receive sendonly mode), and sends the target video stream to the user terminal according to the media transmission interface.

[0063] The dynamic video generation method provided in the embodiment of the present application can be applied to the contact center IVVR video interaction system, supports voice calls or video calls initiated by user terminals, and provides video IVVR interaction services for users. The following is a specific description of the contact center IVVR video interaction system:

[0064] Figure 4 The structure diagram of the contact center IVVR video interaction system provided by the embodiment of the present application is shown. As shown in the figure, the system includes an IMS core network, a SIPPROXY device, a video customer service platform, an MS10 media server, a VDC component and a WebServer business system, wherein:

[0065] 4.1: SIPPROXY device, used to complete SIP signaling distribution according to policy configuration, including:

[0066] (1) The user terminal initiates a VoLTE call through the network, and the call signaling is sent to the CSCF device of the IMS network through the bearer channel;

[0067] (2) The IMS core network sends the call SIP signaling to the SIPPROXY device;

[0068] (3) SIPPROXY distributes the call to the video customer service platform.

[0069] 4.2: Video customer service platform, used to provide IVVR services in a standard framework, does not control IVVR interaction processes and business logic, specifically including:

[0070] (1) Notify the user terminal, MS10 media server, and VDC component of SIP signaling negotiation, including: negotiation of audio and video resource reservation process; negotiation of audio and video encoding formats adapted to user terminal playback, used to dynamically generate video stream encoding.

[0071] (2) Provide HTTP interface to interact with VDC components and H5 pages, including: notify VDC components to open the H5 homepage page with the specified URL address; receive operation instructions from the H5 page, such as playing audio, playing fixed video materials, pressing keys, voice recognition, etc.; notify the media server to complete media operations such as playing audio, playing fixed video materials, pressing keys, voice recognition, etc. for the user terminal; notify the H5 page of the operation results through the HTTP interface, such as playback completion notification, key results, voice recognition results, etc.

[0072] 4.3: MS10 media server, used to complete the following functions:

[0073] (1) Add the user terminal and VDC component to the conference and complete the SIP negotiation between the two parties, including: the ports of the user terminal and VDC component's upstream and downstream audio and video streams; audio encoding format; video encoding format;

[0074] (2) Forwarding the video stream dynamically generated by the VDC to the user terminal for playback;

[0075] (3) Complete media operations of the IVVR service of the video customer service platform, including playing audio, playing fixed video materials, pressing buttons, and voice recognition on user terminals;

[0076] (4) Analyze the keystroke results and voice recognition results of the user terminal and report them to the IVVR service for use in the H5 page for business logic or process control, or for dynamic display.

[0077] 4.4: VDC components include SIP protocol stack, HTTP service, virtual browser, video page and other modules, which are used to complete the interaction with the video customer service platform, WebServer business system and MS10 media server. Specifically:

[0078] (1) The SIP protocol stack provides signaling negotiation capabilities;

[0079] The IVVR service of the video customer service platform adds the VDC component and the user terminal to the conference provided by MS10 to complete the signaling negotiation; after the negotiation, the VDC component obtains the video encoding format required to generate the video stream, such as H.264 / H.265 codec, 4CIF / VGA / 720P / 1080P resolution and other information; the VDC component is in the sendonly mode of the video and only sends the video stream; VDC only generates and sends the video stream, and media operations such as playback, playing fixed video materials, buttons, and voice recognition are completed by notifying the MS10 media server of the IVVR service of the video customer service platform.

[0080] (2) Virtual browsers and video pages provide media capabilities;

[0081] Built-in Linux version headless Chromium browser, which meets the IVVR interaction process, the scene without desktop and physical browser, and completes the operation of opening the browser and taking screenshots. Through performance testing, it can also meet the requirements of web page loading and parsing efficiency;

[0082] Through the Devtools protocol provided by Chromium, this protocol allows Chromium to act as a server. You can use the command line to start the listening port and establish a WebSocket connection, send control commands to the Chromium browser, and receive screenshot data;

[0083] After receiving the notification that the IVVR service opens the homepage of the specified URL, the Chromium browser is notified to open the H5 page deployed on the WebServer service system by sending an open page message;

[0084] Send a screenshot message to the Chromium browser, obtain the screenshot data in a memory-sharing manner, convert it into a video stream in real time, adapt to the resolution and encoding requirements negotiated by SIP, and send it to the user terminal for playback through the port negotiated by the MS10 media server.

[0085] (3) HTTP service provides the ability to interact with the IVVR service of the video customer service platform and the H5 page interface;

[0086] The VDC component interacts with the IVVR service through the HTTP JSON interface to obtain the URL address of the H5 page that the IVVR service needs to open, the user interaction recognition results, and other parameters that need to be used on the H5 page.

[0087] The VDC component interacts with the H5 business by sending messages through WebSocket using the Devtools protocol provided by the Chromium browser, such as opening the H5 page, notifying the screenshot and obtaining the screenshot data, and notifying the H5 page of the user terminal operation results (playback completion, video playback completion).

[0088] 4.5: WebServer business system, deploys the developed H5 page to complete IVVR video interface display and control, business logic control, session management, and IVVR interactive control functions;

[0089] Through the HTTP interface service provided by the IVVR service of the video customer service platform, the IVVR service is notified to play audio, play fixed-format video files, receive numbers by pressing keys, perform voice recognition, and transfer to external numbers;

[0090] The IVVR service transmits the results of the interaction with the user to the H5 page through the virtual browser WebSocket interface, including information such as completion of audio playback, completion of video playback, key results, and voice recognition results. For example, it obtains the account and password information entered by the user, completes the real-time echo of the user's key input, and jumps to the H5 page of other business processes for display.

[0091] like Figure 5 As shown, based on the above-mentioned contact center IVVR video interaction system, the dynamic video generation method may specifically include the following steps:

[0092] S1: User terminal calls to access the video customer service platform;

[0093] The user terminal initiates a call through the network, and the SIP (Session Initiation Protocol) call signaling is forwarded to the SIPPROXY device through the IMS core network, and the SIP signaling is distributed to the video customer service platform;

[0094] S2: VoLTE call signaling negotiation;

[0095] If the user terminal accesses the video customer service platform through a VoLTE call, the VoLTE network resource reservation process negotiation is performed before providing the video IVVR interactive service; if the user terminal initiates a voice call, the voice resource reservation negotiation is completed and the call is upgraded to a video call in one direction; if the user terminal initiates a video call, the video resource reservation negotiation is completed.

[0096] S3: Audio and video media coding signaling negotiation. The negotiation results include: user terminal audio / video upstream and downstream ports, VDC component video downstream port (video only sends but not receives sendonly mode), video coding format, audio coding format, etc.

[0097] The IVVR service of the video customer service platform notifies the MS10 media server to create a video conference, and after the user terminal joins the conference, calls the VDC component and joins the conference. The SIP protocol stack module of the VDC component adapts the SDP on the user terminal side and completes the negotiation of SDP parameters such as audio and video encoding.

[0098] S4: The built-in browser of the VDC component opens the H5 page;

[0099] The IVVR service of the video customer service platform calls the HTTP JSON interface provided by the VDC component, and the input parameters include the URL address of the H5 page. The VDC component calls the method provided by the Devtools protocol of the built-in Linux version of the Headless Chromium browser to establish a WebSocket connection with the Chromium browser server. After the session is generated, it sends the command message of opening the page provided by the Devtools protocol to open the H5 page deployed on the WebServer business system, which is the welcome portal page by default.

[0100] S5: The VDC component video page dynamically generates video content;

[0101] After opening the H5 video page, the VDC component periodically sends the screenshot command message provided by the Devtools protocol to the specified session of the Chromium browser server. The default is 1 second screenshot. Figure 5The screenshot data can be obtained through memory sharing, and encoded into an H264 video stream according to the SDP negotiated with the user terminal and sent to the video downstream designated port negotiated in step S3;

[0102] In this way, by sending screenshot command messages and obtaining screenshot data through shared memory instead of transmitting through websocket, the performance and efficiency requirements of IVVR interactive commercial use can be met.

[0103] S6: MS10 media server forwards the video stream of the VDC component;

[0104] After receiving the H264 video stream from the VDC component, the MS10 media server forwards the H264 video stream to the user terminal for playback according to the address and port of the video on the user terminal side negotiated in step S3. By default, the MS10 media server is only responsible for forwarding the video stream and does not encode it.

[0105] S7: H5 page notifies the video customer service platform of IVVR business interaction operation instructions;

[0106] The VDC component only takes a screenshot of the opened H5 page and generates a video stream. The media operations involved in the IVVR interaction process, such as playing voice, collecting numbers, and voice recognition, are completed by the standard framework IVVR business of the video customer service platform. After opening the H5 page, according to the interactive business process developed on the page, the HTTP interface service provided by the video customer service platform is used to notify the IVVR business to complete the corresponding operation instructions, including: playing sound, playing fixed video materials, pressing buttons, voice recognition, etc.

[0107] S8: The video customer service platform IVVR service notifies the MS10 media server to complete the media operation;

[0108] After receiving the operation instructions from the H5 page, including: playing, playing fixed video materials, pressing keys, and voice recognition, the IVVR service notifies the MS10 media server to perform media interaction operations. After completion, it notifies the IVVR service of the operation results, including: playback completion, video playback completion, key results, and voice recognition results.

[0109] S9: The video customer service platform notifies the H5 page of the completion result of the command;

[0110] After the MS10 media server completes the operation, it reports information such as the completion of IVVR service playback, completion of video playback, key press results, and voice recognition results;

[0111] The IVVR service of the video customer service platform calls the HTTP JSON interface provided by the VDC component. The input parameters include the command operation results reported by MS10. The VDC component sends a notification result command message to the H5 page of the specified session through the Chromium browser server.

[0112] S10: H5 page processing instruction operation results;

[0113] After the H5 page obtains the command operation results, including information such as completion of audio playback, completion of video playback, key results, and voice recognition results, the next step is performed according to the customized business process and business logic of the H5 page, including: jumping to other H5 pages, displaying the operation result information on the current page, etc. For example: every key input by the user is echoed in real time on the H5 page; or relevant information is queried and displayed based on the content input by the user.

[0114] Through the above steps, since the Chromium browser meets the IVVR interaction process, the scenario without a desktop and a physical browser, the VDC component sends a screenshot command message to the Chromium browser to specify the session and obtains the screenshot data at a fixed time, which can screenshot the H5 page content in real time and encode it into an H264 video stream, and forward it to the user terminal for playback through the MS10 media server. In this way, customized video streams can be generated according to user operations to realize visual voice navigation and IVR, biometrics, multimedia fusion interaction and other functions; business control is migrated from the IVR device to the HTTP-based WEB business system, and video menus and dynamic queries are realized through the H5 page, and can be dynamically converted to H264 video streams for playback on the user terminal; in addition, video material content can be dynamically generated according to user operations, which meets the IVVR interaction process, the scenario without a desktop and a physical browser, and meets the user's requirements for video interaction performance and efficiency.

[0115] Figure 6 A schematic diagram of the hardware structure of an electronic device that implements the embodiment of the present application is shown. Referring to the figure, at the hardware level, the electronic device includes a processor, and optionally, an internal bus, a network interface, and a memory. Among them, the memory may include a memory, such as a high-speed random access memory (Random-Access Memory, RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage, etc. Of course, the electronic device may also include hardware required for other services.

[0116] The processor, the network interface and the memory may be interconnected through an internal bus, which may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one bidirectional arrow is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0117] The memory stores the program. Specifically, the program may include a program code, and the program code includes a computer operation instruction. The memory may include a memory and a non-volatile memory, and provides instructions and data to the processor.

[0118] The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs it, forming a device for locating the target user at the logical level. The processor executes the program stored in the memory and specifically performs: Figure 1 , Figure 2 or Figure 3 The method disclosed in the illustrated embodiment realizes the functions and beneficial effects of each method described in the foregoing method embodiments, which will not be described in detail here.

[0119] The above application Figure 1 , Figure 2 or Figure 3The method disclosed in the illustrated embodiment may be implemented in a processor or by a processor. The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor or by instructions in the form of software. The above processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application may be implemented or executed. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present application may be directly embodied as being executed by a hardware decoding processor, or may be executed by a combination of hardware and software modules in a decoding processor. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0120] The computer device can also execute the methods described in the foregoing method embodiments, and realize the functions and beneficial effects of the methods described in the foregoing method embodiments, which will not be repeated here.

[0121] Of course, in addition to software implementation methods, the electronic device of the present application does not exclude other implementation methods, such as logic devices or a combination of software and hardware, etc. That is to say, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.

[0122] The embodiment of the present application also provides a computer-readable storage medium, wherein the computer-readable medium stores one or more programs, and when the one or more programs are executed by an electronic device including multiple application programs, the electronic device executes Figure 1 , Figure 2 or Figure 3 The method disclosed in the illustrated embodiment realizes the functions and beneficial effects of each method described in the foregoing method embodiments, which will not be described in detail here.

[0123] The computer-readable storage medium includes a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0124] Furthermore, an embodiment of the present application also provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions, and when the program instructions are executed by a computer, the following process is implemented: Figure 1 , Figure 2 or Figure 3 The method disclosed in the illustrated embodiment realizes the functions and beneficial effects of each method described in the foregoing method embodiments, which will not be described in detail here.

[0125] In short, the above is only a preferred embodiment of the present application and does not limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

[0126] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0127] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0128] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0129] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

Claims

1. A method for generating a dynamic video, characterized in that: include: In response to a call request initiated by a user terminal, determining audio and video negotiation information matching the user terminal; Obtain an operation instruction pre-deployed on the first video page, and when it is determined that the operation instruction has completed the interaction, jump to the second video page according to the operation instruction; Performing a screenshot operation on the second video page within a preset time period to obtain multiple page screenshots corresponding to the second video page, and converting the multiple page screenshots into a target video stream according to the audio and video negotiation information; The target video stream is sent to the user terminal.

2. The method according to claim 1, characterized in that The determining of the audio and video negotiation information matching the user terminal includes: Performing media negotiation with the user terminal in the access network according to the call request, and reserving target media resources in the access network according to the media negotiation result; When it is determined that the reservation of the target media resource is completed, a video conference is established with the user terminal, and audio and video negotiation information matching the user terminal is determined.

3. The method according to claim 2, characterized in that The reserving target media resources in the access network according to the media negotiation result includes: Reserving, in the access network, a first media resource corresponding to the call request according to the media negotiation result; In a case where it is determined that the first media resource reservation satisfies the target resource reservation, determining the first media resource reservation as the target media resource reservation; When it is determined that the first media resource reservation cannot satisfy the target resource reservation, the call request is converted into a target call request, a second media resource reservation is performed in the access network, and the second media resource reservation is determined to be the target media resource reservation.

4. The method according to claim 1, characterized in that: The obtaining of the operation instruction pre-deployed on the first video page includes: Obtaining a webpage address corresponding to the call request; Displaying a first video page corresponding to the webpage address on the user terminal; According to the interactive business process node corresponding to the first video page, an operation instruction deployed on the first video page is determined.

5. The method according to claim 4, characterized in that The step of displaying the first video page corresponding to the page address on the user terminal includes: Establish a session connection with the target browser; A command message is sent to the target browser, the first video page is opened through the target browser, and the first video page is displayed on the user terminal; the command message includes a page address.

6. The method according to claim 1, characterized in that The step of determining that the operation instruction has completed the interaction includes: In response to a media interaction operation of the target user with respect to the operation instruction through the user terminal, it is determined that the operation instruction has completed the interaction.

7. The method according to claim 1, characterized in that The step of jumping to the second video page according to the operation instruction includes: The second video page to be jumped to is determined according to the page customization business logic corresponding to the operation instruction.

8. The method according to claim 1, characterized in that The audio and video negotiation information includes audio and video SDP parameters; and converting the plurality of page screenshots into a target video stream according to the audio and video negotiation information includes: According to the audio and video SDP parameters, the multiple page screenshots are encoded to generate the target video stream.

9. The method according to claim 1, characterized in that: The audio and video negotiation information includes a media transmission port; and the sending the target video stream to the user terminal includes: The target video stream is sent to the user terminal according to the media transmission interface.

10. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 1 to 9 are implemented.

11. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.