Same-screen sharing method and device, electronic equipment and storage medium
By converting the operation screen of the H5 page into a real-time video stream and subscribing in the video room, the problem of difficulty and cost of sharing the same screen on the H5 page is solved, and efficient sharing and flexible business expansion is achieved.
Patent Information
- Application Number
- CN202310826219.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-06
- Publication Date
- 2025-01-07
AI Technical Summary
Due to security considerations, H5 pages cannot be shared on the same screen, which makes it difficult to achieve efficient and accurate communication assistance in remote customer service assistance. The existing technology requires the integration of two service systems, which leads to high integration difficulty and high application cost.
By converting the operation screen of the H5 page into a real-time video stream and transmitting it to a pre-created video room, the real-time video stream is subscribed in the video room, thus realizing the same-screen sharing of the operation screen of the H5 page, reducing the real-time The integration requirements of audio and video communication technology and video stream generation technology.
The same-screen sharing of H5 pages is realized, which reduces the implementation difficulty and application service deployment costs, provides more flexible business expansion capabilities and unified video stream management, and avoids the need to increase server resources.
Smart Images

Figure CN119277146A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present disclosure relate to the technical field of audio and video processing, and in particular to a same-screen sharing method and device, electronic device, and storage medium. Background Art
[0002] With the widespread application of mobile Internet, people are generally accustomed to handling various types of business through mobile phones. When encountering business operations or related problems during the process of handling business, they hope to get timely help from remote customer service personnel. During the remote guidance of customer service, if users can let customer service personnel see by sharing the screen, it will be an efficient and accurate communication assistance method.
[0003] Among many mobile terminal applications, H5 (Hypertext Markup Language) light applications are widely used. However, due to security considerations, H5 has technical limitations and cannot realize the same-screen sharing technology of the terminal screen, resulting in the inability to provide remote same-screen auxiliary services on H5. Summary of the invention
[0004] The present disclosure provides a same-screen sharing method and its device, electronic device, and storage medium, which can realize H5 page same-screen sharing in a simple manner and save application service deployment costs.
[0005] In a first aspect, the present disclosure provides a same-screen sharing method, which is applied to a video stream publishing terminal. The method may include:
[0006] Convert the operation screen of the Hypertext Markup Language H5 page into a real-time video stream;
[0007] The real-time video stream is transmitted to a pre-created video room so that the real-time video stream is subscribed in the video room, thereby realizing the same-screen sharing of the operation screen of the H5 page.
[0008] In a second aspect, the present disclosure provides a same-screen sharing method, which is applied to a video stream subscription terminal, and the method may include:
[0009] Receive the room number sent by the video stream publisher;
[0010] Access the video room corresponding to the room number;
[0011] Subscribe to the real-time video stream sent by the designated video stream publisher to realize the same-screen sharing of the operation screen of the H5 page of the video stream publisher; the real-time video stream is the video stream that the video stream publisher converts the operation screen of the hypertext markup language H5 page into in real time.
[0012] In a third aspect, the present disclosure provides a same-screen sharing device, which is applied to a video stream publishing terminal, including:
[0013] A conversion module, used to convert the operation screen of the hypertext markup language H5 page into a real-time video stream;
[0014] The transmission module is used to transmit the real-time video stream to a pre-created video room so that the real-time video stream is subscribed in the video room to achieve the same-screen sharing of the operation screen of the H5 page.
[0015] In a fourth aspect, the present disclosure provides a same-screen sharing device, which is applied to a video stream subscription terminal, including:
[0016] A receiving module, used to receive the room number sent by the video stream publishing end;
[0017] An access module, used for accessing the video room corresponding to the room number;
[0018] The subscription module is used to subscribe to the real-time video stream sent by the specified video stream publishing end, so as to realize the same-screen sharing of the operation screen of the H5 page of the video stream publishing end; the real-time video stream is the video stream converted by the video stream publishing end into the operation screen of the hypertext markup language H5 page in real time.
[0019] In a fifth aspect, the present disclosure provides an electronic device, which may include:
[0020] at least one processor; and
[0021] a memory communicatively connected to the at least one processor; wherein,
[0022] The memory stores one or more computer programs that can be executed by the at least one processor, and the one or more computer programs are executed by the at least one processor so that the at least one processor can execute the same-screen sharing method described in the first aspect or the second aspect.
[0023] In a sixth aspect, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the same-screen sharing method described in the first aspect or the second aspect.
[0024] In the embodiments provided by the present disclosure, the operation screen of the H5 page is converted into a real-time video stream at the video stream publishing end, so that the operation screen of the H5 page is converted into a video form that is easy to transmit, and can be directly transmitted through real-time audio and video transmission technology. There is no need to integrate real-time audio and video communication technology with real-time video stream generation technology, which reduces the difficulty of achieving same-screen sharing of the H5 page. Accordingly, there is no need to adopt two sets of application service systems, which greatly reduces the application service deployment cost; by transmitting the real-time video stream to a pre-created video room, the real-time video stream can be subscribed to in the video room, thereby achieving the purpose of sharing the operation screen of the H5 page with the video stream subscription end on the same screen.
[0025] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] The accompanying drawings are used to provide a further understanding of the present disclosure and constitute a part of the specification. Together with the embodiments of the present disclosure, they are used to explain the present disclosure and do not constitute a limitation of the present disclosure. The above and other features and advantages will become more apparent to those skilled in the art by describing detailed example embodiments with reference to the accompanying drawings, in which:
[0027] Figure 1 A flow chart of a same-screen sharing method applied to a video stream publishing terminal provided in an embodiment of the present disclosure;
[0028] Figure 2 A flow chart of a method for converting an operation screen of an H5 page into a real-time video stream provided in an embodiment of the present disclosure;
[0029] Figure 3 A flow chart of a same-screen sharing method applied to a video stream subscriber provided in an embodiment of the present disclosure;
[0030] Figure 4 A schematic diagram of the connection structure of a video stream publishing terminal and a video stream subscription terminal provided in an embodiment of the present disclosure;
[0031] Figure 5 A block diagram of a screen sharing device provided by an embodiment of the present disclosure;
[0032] Figure 6 A block diagram of another screen sharing device provided by an embodiment of the present disclosure;
[0033] Figure 7 A block diagram of the composition of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0034] In order to enable those skilled in the art to better understand the technical solutions of the present disclosure, the exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, those of ordinary skill in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.
[0035] In the absence of conflict, the various embodiments of the present disclosure and the various features therein may be combined with each other.
[0036] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.
[0037] The terms used herein are only used to describe specific embodiments and are not intended to limit the present disclosure. As used herein, the singular forms "a" and "the" are also intended to include plural forms, unless the context clearly indicates otherwise. It will also be understood that when the terms "including" and / or "made of" are used in this specification, the presence of the features, wholes, steps, operations, elements and / or components is specified, but the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups thereof is not excluded. "Connected" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect.
[0038] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by those of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and the present disclosure, and will not be interpreted as having an idealized or overly formal meaning unless explicitly defined as such herein.
[0039] Due to security considerations for the current H5 (Hypertext Markup Language) page, the technology of sharing the same screen through screen recording is limited. In order to provide remote screen sharing auxiliary services, the assisted party (e.g., customer) and the assistant (e.g., customer service staff) both open the same business screen. After one party executes a certain operation instruction, the other party repeats the operation instruction to achieve the purpose of synchronously reproducing the operation screen of the H5 page, thereby achieving the effect of simulating the same screen display. This process is actually the process of recording the important information of each step in the operation screen process, and sending the important information of each step (e.g., operation instructions) to the other party through real-time audio and video communication technology, and playing back the screen on the other party's related operation interface based on this important information.
[0040] A detailed implementation example of the above scheme is given below. For example, both the M and N terminals open the same H5 page, and a communication channel is established between the M and N terminals. When the M terminal operates on the H5 page, it simultaneously sends the operation instruction to the N terminal. When the N terminal receives the operation instruction, it repeats the operation instruction to achieve the effect of synchronous display of the M and N terminals.
[0041] The current H5 page same-screen sharing technology has the following defects:
[0042] 1. Difficulty in integration: The collection and playback of important information in the same-screen auxiliary scene is a mature and complete service system. This system needs to use real-time audio and video communication technology to transmit these important information. However, real-time audio and video communication is also a mature and complete service system. In order to realize the same-screen sharing of H5 pages, the two service systems need to interact continuously. Therefore, the two service systems need to be well integrated. However, the integration of these two service systems is difficult. If the integration effect is not good, it will seriously affect the same-screen sharing effect of H5 pages.
[0043] 2. The application cost is high. Due to the use of two service systems (important information collection and playback service system and real-time audio and video communication service system), more server resources are required when deploying application services, resulting in relatively high application service deployment costs.
[0044] In the embodiments provided by the present disclosure, the operation screen of the H5 page is converted into a real-time video stream at the video stream publishing end, so that the operation screen of the H5 page is converted into a video form that is easy to transmit, and can be directly transmitted through real-time audio and video transmission technology, without the need to integrate real-time audio and video communication technology with real-time video stream generation technology, thereby reducing the difficulty of achieving same-screen sharing of the H5 page, and accordingly, there is no need to adopt two sets of application service systems, which greatly reduces the application service deployment cost; by transmitting the real-time video stream to a pre-created video room, the real-time video stream can be subscribed to in the video room, thereby achieving the purpose of sharing the operation screen of the H5 page with the video stream subscription end on the same screen. The following is a detailed description of the embodiment scheme of the present disclosure.
[0045] The intention word recognition method of the embodiment of the present disclosure can be executed by an electronic device such as a terminal device or a server. The terminal device can be a vehicle-mounted device, a user equipment (User Equipment, UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (Personal Digital Assistant, PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. The voice detection method can be implemented by a processor calling a computer-readable program instruction stored in a memory. Alternatively, the voice detection method can be executed by a server.
[0046] Figure 1 The flowchart of a same-screen sharing method provided by the embodiment of the present disclosure is applied to the video stream publishing terminal A. Figure 1 , the method may include steps S11-S12:
[0047] S11. Convert the operation screen of the H5 page into a real-time video stream.
[0048] S12. The real-time video stream is transmitted to a pre-created video room, so that the real-time video stream is subscribed in the video room, and the operation screen of the H5 page is shared on the same screen.
[0049] In the disclosed embodiment, the operation screen of the H5 page can be converted into a real-time video stream based on real-time audio and video communication technology.
[0050] In the embodiments of the present disclosure, Figure 2 As shown, converting the operation screen of the H5 page into a real-time video stream may include steps S21-S22:
[0051] S21. Convert the operation screen of the H5 page into a picture.
[0052] In the embodiment of the present disclosure, converting the operation screen of the H5 page into a picture may include:
[0053] Read the document object model DOM element of the operation screen in the H5 page;
[0054] Draw the DOM element through the canvas to obtain the canvas image;
[0055] Save the canvas image in the preset format to get the image converted into the H5 page.
[0056] In the disclosed embodiments, DOM (Document Object Model) is translated as Document Object Model, which is a programming interface for HTML (HyperText Markup Language) and XML (Extensible Markup Language) documents. HTML DOM defines a standard method for accessing and manipulating HTML documents, and DOM expresses HTML documents in a tree structure.
[0057] In the disclosed embodiment, the process of converting the operation screen of the H5 page into a picture can be achieved through the html2canvas [HTML code converted into Canvas picture] technology. html2canvas can realize direct screenshots of the entire or part of the page on the browser side of the assisted person. This html2canvas script renders the H5 page into a canvas picture (i.e., canvas picture), which can be achieved by reading DOM elements and applying different styles to these DOM elements. The canvas picture does not require any rendering from the server, and the entire canvas picture is created on the browser of the assisted person. The generated canvas picture can be converted into Base64 format to obtain the picture converted by the H5 page.
[0058] S22: Generate a real-time video stream according to the image.
[0059] In the embodiment of the present disclosure, generating a real-time video stream according to a picture may include:
[0060] Through the preset timed tasks, pictures are extracted from the canvas according to the preset extraction frequency and the number of extractions each time;
[0061] Generate a real-time video stream from continuously extracted images.
[0062] In the disclosed embodiment, the extraction frequency may include but is not limited to: 80 milliseconds-150 milliseconds, and the number of extractions each time may include but is not limited to 1-2 frames; for example, after converting the H5 page into a picture through html2canvas, a scheduled task is used to extract 1 frame of the picture from the canvas every 100 milliseconds, and the extracted picture is transcoded into a real-time video stream (the basic parameters of the video stream are: 8-10 frames / second).
[0063] In the embodiment of the present disclosure, transmitting a real-time video stream to a pre-created video room C may include:
[0064] The real-time video stream is transmitted to the video room C based on the real-time audio and video communication method.
[0065] In the embodiment of the present disclosure, the video room C refers to an audio and video service room, and the video stream publishing end publishes the generated real-time video stream to the audio and video service room through real-time audio and video communication technology.
[0066] In the disclosed embodiment, the audio and video service room is a video conference room and a video publishing and subscription center. Different access terminals can push their own video streams to the audio and video service room, and can also subscribe to the video streams they need in the audio and video service room. That is, any access terminal in the audio and video service room can publish video streams and subscribe to specified video streams.
[0067] In the embodiment of the present disclosure, before converting the operation screen of the H5 page into a real-time video stream, the method further includes:
[0068] Create video room C;
[0069] Generate the room number of video room C;
[0070] Send the room number to the video stream subscriber.
[0071] In the disclosed embodiment, before sending the video stream, the video stream publisher needs to first create a video room C (i.e., an audio and video service room). The room number is temporarily generated, and the generated room number can be sent to the video stream subscriber via websocket.
[0072] The websocket protocol is a new network protocol based on TCP (Transmission Control Protocol), which implements full-duplex communication between browsers and servers, allowing servers to actively send information to clients.
[0073] In the disclosed embodiment, the video room C is a public room that any terminal can join. A joining password can also be set to restrict the joining of unrelated parties.
[0074] Figure 3 The flowchart of a same-screen sharing method provided by an embodiment of the present disclosure is applied to a video stream subscriber B. Figure 3 , the method may include steps S31-S33:
[0075] S31, receiving the room number sent by the video stream publishing end;
[0076] S32, access the video room C corresponding to the room number;
[0077] S33, subscribe to and display the real-time video stream sent by the specified video stream publisher, and realize the same-screen sharing of the operation screen of the H5 page of the video stream publisher; the real-time video stream is the video stream that the video stream publisher converts the operation screen of the H5 page into in real time.
[0078] In the disclosed embodiment, the video stream subscriber enters the corresponding video room C (i.e., the audio and video service room) according to the room number, subscribes to the specified real-time video stream in the video room C, and displays the subscribed real-time video stream in real time, thereby realizing the same-screen sharing of the operation screen of the H5 page.
[0079] Since the current H5 page same-screen sharing solution is not based on real-time video streaming, it is unable to meet the requirements of related scenarios such as real-time video synthesis, custom synthesis layout, and video monitoring. It has poor business expansion capabilities and it is difficult to achieve unified management of videos related to the same business.
[0080] In the disclosed embodiments, H5 page same-screen sharing is achieved based on real-time video streaming, business expansion can be achieved by expanding the real-time video streaming, and unified management of videos related to the same business is achieved by managing the real-time video streaming of the same business.
[0081] In the embodiments of the present disclosure, a certain service can be expanded by adding real-time video streams, and different service scenarios can be expanded by changing the content of real-time video streams. The real-time video streams of the same service can be uniformly saved and managed through a preset audio and video recording synthesis server, thereby achieving unified management of the service.
[0082] In the embodiments of the present disclosure, Figure 4 As shown, the video stream subscription end B may include: an assistant end B1; the designated video stream publishing end A includes: an assisted end A1;
[0083] In the disclosed embodiment, the assistant end B2 (e.g., the client end) can share the H5 page on the same screen with the assisted end A1 (e.g., the client end) by subscribing to the actual video stream published by the assisted end A1 (e.g., the client end), so that the assistant can assist the assisted end to better complete related business.
[0084] In the embodiments of the present disclosure, Figure 4 As shown, the video stream subscription end B may also include: an audio and video recording and synthesis server B2; the designated video stream publishing end includes: all video stream publishing ends;
[0085] The same-screen sharing method of the disclosed embodiment also includes: saving, through the audio and video recording and synthesis server B2, all real-time video streams subscribed to by the audio and video recording and synthesis server B2.
[0086] In the disclosed embodiment, although the H5 page is shared on the same screen based on the real-time video stream, the real-time audio and video communication technology realizes the real-time video communication transmission, but does not record and save the real-time audio and video. However, in the financial scenario, when it comes to video business processing, it is necessary to record and save the video for compliance inspection.
[0087] In the disclosed embodiment, the audio and video recording and synthesis server can record multiple audio and video streams in the connected video room, and synthesize the recorded multiple audio and video streams into one video file according to the specified layout.
[0088] In the embodiments of the present disclosure, multiple audio and video streams may include but are not limited to: the screen stream of the assisted person (for example, the real-time video stream of the H5 page), the camera stream of the assisted person (for example, the captured face video), the voice stream of the assisted person, the camera stream of the seat, the voice stream of the seat, etc.
[0089] In the disclosed embodiment, multiple audio and video streams are combined into one video file through the audio and video recording synthesis server, so that the relevant audio and video of the same business stakeholders completing the business together can be saved in a unified manner, and it is convenient to clearly view the business processing status at that time later.
[0090] In the embodiments of the present disclosure, at least the following advantages are included:
[0091] 1. Reduced the difficulty of H5 page screen sharing.
[0092] In the audio and video business system, by converting the H5 page into a real-time video stream and then using the real-time audio and video communication capabilities, the screen sharing function is relatively simple to implement, reducing the difficulty of implementing H5 page screen sharing.
[0093] 2. No increase in server resources.
[0094] In an audio and video service system, by adopting the embodiment of the present disclosure, a same-screen auxiliary scenario can be realized without adding additional server resources.
[0095] 3. Flexible business expansion facilitates unified management of related audio and video streams of the same business.
[0096] The embodiment of the present disclosure converts the H5 page into a video stream and publishes it to a video room, which can easily expand various scenarios of real-time audio and video communication.
[0097] like Figure 5 As shown, it is a block diagram of a same-screen sharing device 100 provided in an embodiment of the present disclosure.
[0098] Reference Figure 5 The embodiment of the present disclosure provides a same-screen sharing device 100, which is applied to a video stream publishing end and may include:
[0099] The conversion module 101 is used to convert the operation screen of the hypertext markup language H5 page into a real-time video stream;
[0100] The transmission module 102 is used to transmit the real-time video stream to a pre-created video room so that the real-time video stream is subscribed in the video room to achieve the same-screen sharing of the operation screen of the H5 page.
[0101] like Figure 6As shown, it is a block diagram of another screen sharing device 200 provided in an embodiment of the present disclosure.
[0102] Reference Figure 6 The present disclosure provides a same-screen sharing device 200, which is applied to a video stream subscription terminal, including:
[0103] Receiving module 201, used for receiving the room number sent by the video stream publishing end;
[0104] Access module 202, used to access the video room corresponding to the room number;
[0105] The subscription module 203 is used to subscribe to the real-time video stream sent by the specified video stream publishing end, so as to realize the same-screen sharing of the operation screen of the H5 page of the video stream publishing end; the real-time video stream is the video stream converted by the video stream publishing end into the operation screen of the hypertext markup language H5 page in real time.
[0106] like Figure 7 , which is a block diagram of a composition of an electronic device provided by an embodiment of the present disclosure.
[0107] Reference Figure 7 , an embodiment of the present disclosure provides an electronic device 300, the electronic device 300 includes: at least one processor 301; and
[0108] A memory 302 is communicatively connected to at least one processor 301; wherein,
[0109] The memory 302 stores one or more computer programs that can be executed by at least one processor 301. The one or more computer programs are executed by at least one processor 301 so that the at least one processor 301 can execute the above-mentioned same-screen sharing method.
[0110] In the embodiment of the present disclosure, the electronic device 300 may further include: one or more I / O (input / output) interfaces 303 connected between the processor 301 and the memory 302 .
[0111] The present disclosure also provides a computer-readable storage medium on which a computer program is stored, wherein the computer program implements the above-mentioned same-screen sharing method when executed by a processor. The computer-readable storage medium may be a volatile or non-volatile computer-readable storage medium.
[0112] The embodiments of the present disclosure also provide a computer program product, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above-mentioned same-screen sharing method.
[0113] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In a hardware implementation, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or may be implemented as hardware, or may be implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable storage medium, which may include a computer storage medium (or a non-transitory medium) and a communication medium (or a temporary medium).
[0114] As is known to those of ordinary skill in the art, the term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable program instructions, data structures, program modules or other data). Computer storage media include, but are not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), static random access memory (SRAM), flash memory or other memory technology, portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. In addition, it is known to those of ordinary skill in the art that communication media typically contain computer-readable program instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and may include any information delivery medium.
[0115] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.
[0116] The computer program instructions for performing the operation of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be customized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present disclosure.
[0117] The computer program product described herein may be implemented in hardware, software, or a combination thereof. In one optional embodiment, the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (SDK), etc.
[0118] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.
[0119] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0120] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0121] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of special hardware and computer instructions.
[0122] Example embodiments have been disclosed herein, and although specific terms are employed, they are used and should be interpreted only in a general illustrative sense and not for limiting purposes. In some instances, it will be apparent to those skilled in the art that, unless otherwise expressly noted, features, characteristics, and / or elements described in conjunction with a particular embodiment may be used alone or in combination with features, characteristics, and / or elements described in conjunction with other embodiments. Therefore, those skilled in the art will appreciate that various changes in form and detail may be made without departing from the scope of the present disclosure as set forth in the appended claims.
Claims
1. A same-screen sharing method, characterized in that: Applied to a video stream publishing terminal, the method comprises: Convert the operation screen of the Hypertext Markup Language H5 page into a real-time video stream; The real-time video stream is transmitted to a pre-created video room so that the real-time video stream is subscribed in the video room, thereby realizing the same-screen sharing of the operation screen of the H5 page.
2. The same-screen sharing method according to claim 1, characterized in that: The step of converting the operation screen of the hypertext markup language H5 page into a real-time video stream includes: Convert the operation screen of the H5 page into a picture; The real-time video stream is generated according to the picture.
3. The same-screen sharing method according to claim 2, characterized in that: The step of converting the operation screen of the H5 page into a picture includes: Reading the document object model DOM element of the operation screen in the H5 page; Draw the DOM element through the canvas to obtain the canvas image; The canvas image is saved in a preset format to obtain the image converted from the H5 page.
4. The same-screen sharing method according to claim 2, characterized in that: The generating the real-time video stream according to the picture includes: Extracting the picture from the canvas according to a preset extraction frequency and a preset extraction quantity each time through a preset timed task; The real-time video stream is generated by continuously extracting the pictures.
5. The same-screen sharing method according to claim 1, characterized in that: The transmitting the real-time video stream to a pre-created video room comprises: The real-time video stream is transmitted to the video room based on a real-time audio and video communication method.
6. The same-screen sharing method according to any one of claims 1 to 5, characterized in that: Before converting the operation screen of the hypertext markup language H5 page into a real-time video stream, the method further includes: Creating the video room; Generate a room number of the video room; The room number is sent to the video stream subscriber.
7. A same-screen sharing method, characterized in that: Applied to a video stream subscription terminal, the method comprises: Receive the room number sent by the video stream publisher; Access the video room corresponding to the room number; Subscribe to and display the real-time video stream sent by the specified video stream publisher, and realize the same-screen sharing of the operation screen of the hypertext markup language H5 page of the video stream publisher; the real-time video stream is the video stream that the video stream publisher converts the operation screen of the H5 page into in real time.
8. The same-screen sharing method according to claim 7, characterized in that: The video stream subscription end includes: an audio and video recording and synthesis service end; the designated video stream publishing end includes: all the video stream publishing ends; The method further comprises: saving, through the audio and video recording and synthesis server, all real-time video streams subscribed by the audio and video recording and synthesis server.
9. A screen sharing device, characterized in that: Applied to the video stream publishing end, including: A conversion module, used to convert the operation screen of the hypertext markup language H5 page into a real-time video stream; The transmission module is used to transmit the real-time video stream to a pre-created video room so that the real-time video stream is subscribed in the video room to achieve the same-screen sharing of the operation screen of the H5 page.
10. A screen sharing device, characterized in that: Applicable to video stream subscription end, including: A receiving module, used to receive the room number sent by the video stream publishing end; An access module, used for accessing the video room corresponding to the room number; The subscription module is used to subscribe to and display the real-time video stream sent by the specified video stream publishing end, so as to realize the same-screen sharing of the operation screen of the hypertext markup language H5 page of the video stream publishing end; the real-time video stream is the video stream converted by the video stream publishing end into the operation screen of the H5 page in real time.
11. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores one or more computer programs that can be executed by the at least one processor, and the one or more computer programs are executed by the at least one processor so that the at least one processor can execute the same-screen sharing method as described in any one of claims 1-6, or the same-screen sharing method as described in any one of claims 7 or 8.
12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the computer program implements the same-screen sharing method as described in any one of claims 1 to 6, or the same-screen sharing method as described in any one of claims 7 or 8.