Off-line audio and video calling method and device and related components

By establishing P2P signaling communication services between the calling end and the called end, audio and video calls are directly realized, and the complexity of the call system architecture in the local area network environment in the prior art is solved, and system stability and user experience are improved.

CN119094685APending Publication Date: 2024-12-06SHENZHEN NUBOMED EQUIP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411192490.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-28
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

The existing call voice and video systems are complex in the LAN environment, which makes it difficult to develop, deploy and maintain, affecting user experience and service quality.

Method used

Using offline audio and video calling method, by obtaining the device information of the called end and cache it to the local area, establishing P2P signaling communication services, collecting audio and video data and creating a real-time communication connection interface, directly establishing connections and sending data with the called end to avoid dependence. server.

Benefits of technology

Simplifies the system architecture, improves stability and response speed, reduces development and maintenance difficulties, and improves user experience and communication efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119094685A_ABST
    Figure CN119094685A_ABST
Patent Text Reader

Abstract

The invention discloses an off-line audio and video calling method and device and a related component, and the method comprises the steps: obtaining the equipment information of a called end, and caching the equipment information to the local; a P2P signaling communication service is established between the calling terminal and the called terminal; collecting audio and video data, creating a real-time communication connection interface, and binding the audio and video data with the real-time communication connection interface; establishing connection with the called end through the real-time communication connection interface based on the equipment information of the called end; and sending the audio and video data to the called end through a real-time communication connection interface. According to the invention, the P2P signaling communication service is established between the calling end and the called end, so that the audio and video call can be realized between the calling end and the called end without depending on a server, the system architecture is simplified, the stability is improved, and the development, deployment and maintenance difficulty is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of communications, and in particular to an offline audio and video calling method, device and related components. Background Art

[0002] In modern society, with the rapid development of industries such as medical care, transportation, and elderly care, hospitals, stations, nursing homes, and other care facilities are increasingly in need of real-time and efficient call systems. These places usually have complex LAN environments and a large number of call devices, which places extremely high demands on the stability and response speed of the system. However, most of the widely used call voice and video systems on the market are based on online solutions such as SIP (Session Initiation Protocol) or WebRTC (Web Real-Time Communication), which face many challenges in practical applications.

[0003] Both SIP and WebRTC online solutions are highly dependent on server stability and network bandwidth quality. In a LAN environment, especially in hospitals, stations, nursing homes and other places, due to the large number of call devices and complex network environment, it is very easy to cause call delays, blockages or even interruptions, seriously affecting user experience and service quality.

[0004] Although WebRTC performs well in audio encoding, decoding and control, its communication architecture is relatively complex. The WebRTC system consists of two WebRTC terminals, a signaling server, a relay server (STUN / TURN) and two NAT (Network Address Translation) devices. This architecture requires complex exchanges of information such as Offer (initiator's session description protocol information), Answer (receiver's session description protocol information), and Candidate (network address information) through the signaling server before implementing audio and video calls, which increases the complexity of the system and the difficulty of maintenance.

[0005] Due to the complexity of the communication architecture of online solutions, the development, deployment and maintenance costs of the system are high. This undoubtedly increases the operational burden for places such as hospitals and stations that require rapid response and stable operation. Summary of the invention

[0006] The purpose of the present invention is to provide an offline audio and video calling method, device and related components, aiming to solve the problems of the existing calling voice and video system in a local area network environment, such as complex overall architecture, difficulty in development, deployment and maintenance.

[0007] In a first aspect, an embodiment of the present invention provides an offline audio and video calling method, which is applied to a calling end and includes:

[0008] Obtaining device information of the called party and caching the device information locally;

[0009] Establishing a P2P signaling communication service with the called end;

[0010] Collecting audio and video data, creating a real-time communication connection interface, and binding the audio and video data to the real-time communication connection interface;

[0011] Based on the device information of the called end, establishing a connection with the called end through the real-time communication connection interface;

[0012] The audio and video data are sent to the called end through a real-time communication connection interface.

[0013] In a second aspect, an embodiment of the present invention provides an offline audio and video calling device, which is applied to a calling end and includes:

[0014] An acquisition unit, used for acquiring device information of the called end, and caching the device information locally;

[0015] A service establishing unit, configured to establish a P2P signaling communication service with the called end;

[0016] A binding unit, used to collect audio and video data, create a real-time communication connection interface, and bind the audio and video data to the real-time communication connection interface;

[0017] A connection establishing unit, configured to establish a connection with the called end through the real-time communication connection interface based on the device information of the called end;

[0018] The sending unit is used to send the audio and video data to the called end through the real-time communication connection interface.

[0019] In a third aspect, an embodiment of the present invention further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the offline audio and video call method described in the first aspect when executing the computer program.

[0020] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the offline audio and video call method described in the first aspect is implemented.

[0021] The present invention discloses an offline audio and video call method, device and related components, the method comprising: obtaining the device information of the called end, and caching the device information locally; establishing a P2P signaling communication service with the called end; collecting audio and video data, creating a real-time communication connection interface, and binding the audio and video data to the real-time communication connection interface; establishing a connection with the called end through the real-time communication connection interface based on the device information of the called end; sending the audio and video data to the called end through the real-time communication connection interface. The present invention establishes a P2P (point-to-point) signaling communication service between the calling end and the called end, so that the calling end and the called end can realize audio and video calls without relying on a server, simplifying the system architecture, improving stability, and reducing the difficulty of development, deployment and maintenance. The embodiment of the present invention also provides an offline audio and video call device, a computer-readable storage medium and a computer device, which have the above-mentioned beneficial effects and are not repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying any creative work.

[0023] Figure 1 This is a schematic diagram of the structure of traditional WebRTC communication;

[0024] Figure 2 This is a flow chart of the offline audio and video calling method of this embodiment;

[0025] Figure 3 A schematic diagram of the structure between the device and the device management service;

[0026] Figure 4 This is a sub-flow chart of the offline audio and video calling method of this embodiment;

[0027] Figure 5 is another sub-flow chart of the offline audio and video calling method of this embodiment;

[0028] Figure 6 FIG. 4 is a schematic block diagram of an offline audio and video calling device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0030] It should be understood that when used in this specification and the appended claims, the terms "include" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.

[0031] It should also be understood that the terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the appended claims, the singular forms "a", "an" and "the" are intended to include plural forms unless the context clearly indicates otherwise.

[0032] It should be further understood that the term "and / or" used in the present description and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0033] See also Figure 1 , WebRTC consists of four parts, namely two WebRTC terminals, a signaling server, a relay server (STUN / TURN) and two NATs. The overall architecture and process of WebRTC one-to-one communication are as follows:

[0034] Initialize device detection (step 1): First, call the audio and video device detection module to confirm whether the terminal has available audio and video input devices. This step is the basis for ensuring that subsequent operations can proceed smoothly.

[0035] Audio and video data acquisition (step 2): After confirming that the device is available, the system immediately calls the audio and video acquisition module to collect audio and video data from the detected device in real time. This is the starting point of data transmission.

[0036] Recording start (optional) (step 3): If the user or system configures the recording function to be turned on, the recording process is started while data is being collected to save the audio and video content during the communication process.

[0037] Signaling connection establishment (step 4): After completing the data collection preparation, the system establishes a connection with the signaling server through the signaling module. This step provides a channel for the subsequent exchange of communication control information (such as connection establishment, disconnection, etc.).

[0038] RTCPeerConnection (real-time communication connection interface) initialization and data binding (step 5): Next, the system creates an RTCPeerConnection object, which is the core component of WebRTC communication. Then, the previously collected audio and video data is bound to the RTCPeerConnection object to ensure that RTCPeerConnection can accurately obtain the data source to be sent.

[0039] Request sending (step 6): RTCPeerConnection sends a request to the STUN / TURN server. After receiving the request from Call, the STUN / TURN server returns the external IP address and port number of Call as a response message.

[0040] Exchange connection information (step 7): After the STUN / TURN server responds, the terminal sends the connection information (IP address and port number) of the other party to the other party (Called) through the signaling server. At the same time, the Called party also performs a similar process and sends its own information (IP address and port number) to the Calling party. This process ensures that both parties can obtain the communication address of the other party.

[0041] Socket connection establishment (step 8): After both parties obtain each other's connection information, RTCPeerConnection uses this information to establish a direct socket connection. The establishment of this connection means that both parties can start real-time audio and video data transmission.

[0042] Data transmission (step 9): After the Socket connection is established, RTCPeerConnection begins to send the collected and processed audio and video data to the other end through the connection, realizing real-time one-to-one communication.

[0043] It can be seen that WebRTC relies on signaling servers and relay servers (STUN / TURN) to implement audio and video communication, which makes the overall architecture complicated when used in a local area network environment, increasing the difficulty of development, deployment and maintenance. In order to solve the problem that the overall architecture becomes complicated when WebRTC is used in a local area network environment, increasing the difficulty of development, deployment and maintenance, this embodiment provides an offline audio and video call method, which is as follows:

[0044] See also Figure 2 This embodiment provides an offline audio and video calling method, which is applied to a calling end and includes:

[0045] S101: Acquire device information of the called party and cache the device information locally;

[0046] In this embodiment, there are two ways to obtain the device information of the called party and cache the device information locally. One is to obtain the device list information through the external network when registering the device before the call, and the other is to register the calling party before the call and the P2P direct connection during the call through the local area network.

[0047] Among them, the device list information is obtained through the external network when registering the device before the call, and the local area network P2P direct connection is only used during the call. The specific content is to obtain the device information of the called party and cache the device information locally, including: registering its own device information to the device management service through an external registration server; then obtaining the device list information through the device management service; the device list information contains all the device information of the called party; and then caching the device list information locally.

[0048] For example, see Figure 3 When device 3 needs to obtain the device information of the called party and cache the device information locally, it needs to register its own device information to the device management service through the external registration server, and then obtain the device list information (that is, the device information of device 1, device 2, and device 4-device n) through the device management service, and then cache the device list information locally.

[0049] This embodiment can obtain the device information of the called party and cache the device information locally through the above method. Since the calling party is registered before the call, it does not involve a specific calling process and thus does not affect the network quality and server performance during the call. In addition, the device list information is obtained by registering the server, and the one-to-many star network structure is relatively simple and stable.

[0050] The device information includes: IP (Internet Protocol), subnet mask, gateway, DNS (Domain Name System), and device unique identification name.

[0051] In this embodiment, the caller registration before the call and the P2P direct connection during the call are both implemented through the local area network in three ways.

[0052] The first method is: obtaining the device information of the called party and caching the device information locally, including: configuring its own device information on the LAN gateway; obtaining the device list information through the LAN gateway; the device list information includes all the device information of the called party; caching the device list information locally.

[0053] When communicating via a LAN, the data packet transmission path is short, which reduces network delays and makes call establishment and communication processes faster. At the same time, communicating via a LAN can make calls without relying on the external network, reducing the risk of external network attacks and improving the security of data transmission.

[0054] The second method is: obtaining the device information of the called end and caching the device information locally, including: configuring its own device information to one of the called ends; one of the called ends is used to broadcast the device list information, wherein the device list information includes the device information of all the called ends; then receiving the device list information broadcasted by one of the called ends; and then caching the device list information locally.

[0055] This method only requires the selection of client devices with broadcasting functions, without the need to configure a gateway. This simplifies communication and information sharing between devices and improves efficiency.

[0056] It should be noted that the second method can also be to obtain the device information of the called end and cache the device information locally, including: configuring its own device information locally; the calling end is used to broadcast the device list information, wherein the device list information includes the device information of all the called ends; then receiving the device list information broadcasted by all the called ends; and then caching the device list information locally.

[0057] The third method is: obtaining the device information of the called party and caching the device information locally, including: setting up a dedicated registration device in the local area network; the dedicated registration device is used to broadcast the device list information; then configuring its own device information into the dedicated registration device; then receiving the device list information broadcast by the dedicated registration device; and then caching the device list information locally.

[0058] This method only requires the selection of client devices with broadcasting functions, without the need to configure a gateway. This simplifies communication and information sharing between devices and improves efficiency.

[0059] It should be noted that in order to verify the device information with the calling end so as to achieve a quick connection between the calling end and the called end, the called end also needs to store the device information of other called ends and the calling end locally.

[0060] S102: Establishing a P2P signaling communication service with the called party;

[0061] Specifically, establishing a P2P signaling communication service with the called end includes: when a call is initiated, a call message is sent to the called end, so that the called end sets its own state to the answering state according to the received call message; and exchanging the initiator's session description protocol information, the receiver's session description protocol information, and the network address information with the called end.

[0062] By directly establishing a P2P (point-to-point) signaling communication service with the called party when initiating a call, the processing time and load of the intermediate server are reduced, thereby speeding up the call establishment. After the user initiates a call, the called party can immediately receive the call message and set the answering status. This instant feedback mechanism reduces the user's waiting time and improves the immediacy and satisfaction of communication.

[0063] In some embodiments, GRPC technology is used on the calling end and the called end to establish a P2P communication service, and call state events are defined: start, accept, stream_running, end, failed, error, closed, and their corresponding call state event descriptions are shown in Table 1:

[0064] Table 1

[0065] event illustrate start Initiate accept Answer stream_running Connect audio and video end Finish failed Call failed error Error Status

[0066] See also Figure 4 When a call is initiated between the calling end (i.e., device A) and the called end (i.e., device B), the process of various call status event changes is as follows:

[0067] When the calling end initiates a call, the calling end state is set to the initiating state (start), and it is determined whether the corresponding called end receives the initiating signal;

[0068] If the called end does not receive the initiation signal, it is determined to be in an error state (error); if the called end receives the initiation signal, the state of the called end is set to the initiation state, and it is determined whether the called end answers the call;

[0069] If the called end does not answer the call, it is determined to be ended (end); if the called end answers the call, the state of the called end is set to the answering state (accept), and it is determined whether the initiator's session description protocol information, the receiver's session description protocol information, and the network address information are exchanged between the two calling devices;

[0070] If the two calling devices have completed the exchange of the initiator's session description protocol information, the receiver's session description protocol information, and the network address information, the status of the two calling devices is set to the audio and video connected status (stream_running); if the two calling devices have not completed the exchange of the initiator's session description protocol information, the receiver's session description protocol information, and the network address information, the call is judged to be in the failed status (failed).

[0071] By setting the change process of various call status events when initiating a call between the calling and called parties, the smoothness of the communication process, the timeliness of error handling, the intuitiveness of user interaction and the refined management of the communication status can be ensured, thereby improving the efficiency of communication and user experience.

[0072] In this embodiment, GRPC technology is used on the calling end and the called end to establish a P2P communication service, including: defining a .proto file to describe the service and message type. This includes defining the methods, parameters and return types of the service interface. Then use the protoc tool and the corresponding language plug-in to convert the .proto file into a data structure, a called end interface and a calling end stub in a specific language. Then implement the specific service logic according to the definition in the .proto file. Then create a gRPC server instance and bind the implemented service to the called end. Then send a request through the calling end stub and wait for the response from the called end. The called end receives the request, returns a response after processing, thereby establishing a P2P communication service between the calling end and the called end.

[0073] Using gRPC technology to establish P2P communication services on the calling and called ends, and defining a .proto file to describe the service and message types is an efficient, reliable, flexible and easy-to-maintain communication method. It can not only improve development efficiency, but also promote cross-language collaboration, provide high-performance communication services, and have good scalability and security.

[0074] In some embodiments, in real life, there are many devices in a local area network environment, covering multiple platforms, including Android, Linux, Windows, and iOS. However, the voice and video call systems currently on the market can usually only run on specific devices or in the same system environment, and cannot achieve cross-platform compatibility. Due to the different hardware and software environments adopted by different platforms, the audio and video codec formats they can support are also different. To this end, a P2P signaling communication service can be established between the calling end and the called end in different platforms. Specifically, a P2P signaling communication service is established with the called end, including: establishing a P2P signaling communication service with the called end in different platforms. This enables the calling end and the called end to communicate in different system environments.

[0075] When the calling and called parties on different platforms are ready to communicate, first, the two parties systematically complete the negotiation and confirmation of key parameters such as network configuration information and transmission protocols through the exchange mechanism of Offer and Answer. Then, the communication process enters the Candidate interaction stage. In this stage, each party lists in detail all the audio and video codec protocols supported by its equipment to form a comprehensive Candidate list. Subsequently, the two parties conduct in-depth comparison and analysis based on the information in the Candidate list, aiming to find the most suitable video codec protocol for both parties to use. This selection process not only takes into account the codec efficiency and compatibility, but also takes into account the adaptability of call quality and network conditions, ensuring that the final selected protocol can meet the needs of both parties to the greatest extent.

[0076] S103: Collecting audio and video data, creating a real-time communication connection interface, and binding the audio and video data to the real-time communication connection interface;

[0077] See also Figure 5 After the P2P signaling communication service is established between the calling end and the called end through step S102, the P2P signaling communication service between the calling end and the called end can be used to directly send and receive Offer, Answer, and Candidate information between the calling end and the called end. When the calling end and the called end complete the exchange of Offer, Answer, and Candidate information, an audio and video call can be realized.

[0078] Specifically, step 1: calling the audio and video device detection module to confirm whether the terminal has available audio and video input devices.

[0079] Step 2: After confirming that the device is available, the audio and video acquisition module is called to collect audio and video data from the detected device in real time.

[0080] Step 3: When data collection is ready, create an RTCPeerConnection (real-time communication connection interface) object. After RTCPeerConnection is created, bind it to the previously collected audio and video data. After binding, RTCPeerConnection knows where to get the data to be sent.

[0081] It should be noted that if the user or system configures the recording function to be turned on, a step needs to be added between step 2 and step 3, which is to start the recording process while collecting data to save the audio and video content during the communication process.

[0082] After step 3 is executed, step S104 is then executed.

[0083] S104: establishing a connection with the called end through the real-time communication connection interface based on the device information of the called end;

[0084] Specifically, based on the device information of the called end, a connection is established with the called end through a real-time communication connection interface, including: based on its own device information and the device information of the called end, a socket connection is established with the real-time communication connection interface of the called end through its own real-time communication connection interface.

[0085] Socket connection achieves a high degree of cross-platform compatibility and flexibility. At the same time, the socket-based connection method makes the communication between the calling end and the called end relatively independent, reducing the coupling between the components of the system. This low coupling makes the system easier to maintain and expand. When a component changes, it has less impact on other components.

[0086] Furthermore, based on the device information of the called end, the calling end can obtain the IP and port information of the called end, and the called end can obtain the IP and port information of the calling end from the locally stored device information of the calling end. The calling end and the called end establish a socket connection based on knowing the IP and port information of the other party.

[0087] By directly obtaining the other party's IP and port information, the calling and called parties can establish a direct socket connection without forwarding data through an intermediate server. This direct P2P (peer-to-peer) communication method can significantly reduce latency, improve data transmission efficiency, and reduce server load.

[0088] S105: Sending the audio and video data to the called end through a real-time communication connection interface.

[0089] After the calling end and the called end establish a socket connection, the calling end can send audio and video data to the called end through the real-time communication connection interface, and then the called end can send audio and video data to the calling end through the real-time communication connection interface, thereby realizing one-to-one communication between the calling end and the called end.

[0090] See also Figure 6 This embodiment provides an offline audio and video calling device 600, which is applied to a calling end and includes:

[0091] An acquisition unit 601 is used to acquire device information of a called terminal and cache the device information locally;

[0092] A service establishing unit 602, configured to establish a P2P signaling communication service with the called end;

[0093] A binding unit 603 is used to collect audio and video data, create a real-time communication connection interface, and bind the audio and video data to the real-time communication connection interface;

[0094] A connection establishing unit 604, configured to establish a connection with the called end through the real-time communication connection interface based on the device information of the called end;

[0095] The sending unit 605 is used to send the audio and video data to the called end through the real-time communication connection interface.

[0096] Furthermore, the acquisition unit 601 includes:

[0097] A registration subunit, used to register its own device information to the device management service through an external registration server;

[0098] A first information acquisition subunit is used to acquire device list information through the device management service; the device list information includes device information of all called terminals;

[0099] The first cache subunit is used to cache the device list information locally.

[0100] Furthermore, the acquisition unit 601 includes:

[0101] The first configuration subunit is used to configure its own device information to the local area network gateway;

[0102] The second information acquisition subunit is used to acquire device list information through the local area network gateway; the device list information includes all device information of the called end;

[0103] The second cache subunit is used to cache the device list information locally.

[0104] Furthermore, the acquisition unit 601 includes:

[0105] A second configuration subunit is used to configure its own device information to one of the called terminals; the one of the called terminals is used to broadcast device list information, wherein the device list information includes device information of all called terminals;

[0106] A receiving subunit, configured to receive device list information broadcasted by one of the called terminals;

[0107] A third cache subunit, used for caching the device list information locally;

[0108] Alternatively, the acquiring device information of the called end and caching the device information locally includes:

[0109] A setting subunit is used to set a dedicated registration device in the local area network; the dedicated registration device is used to broadcast device list information;

[0110] A third configuration subunit is used to configure its own device information into the dedicated registration device;

[0111] An information receiving subunit, used for receiving the device list information broadcasted by the dedicated registration device;

[0112] The fourth cache subunit is used to cache the device list information locally.

[0113] Furthermore, the service establishing unit 602 includes:

[0114] The state setting subunit is used to send a call message to the called end when initiating a call, so that the called end sets its own state to a listening state according to the received call message;

[0115] The information exchange subunit is used to exchange the initiator's session description protocol information, the receiver's session description protocol information, and the network address information with the called end.

[0116] Further, the connection establishing unit 604 includes:

[0117] The socket connection establishment subunit is used to establish a socket connection with the real-time communication connection interface of the called end through its own real-time communication connection interface based on its own device information and the device information of the called end.

[0118] Furthermore, the service establishing unit 602 further includes:

[0119] The communication service establishment subunit is used to establish a P2P signaling communication service with the called party in different platforms.

[0120] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-mentioned devices and units can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0121] The present invention also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed, the method provided in the above embodiment can be implemented. The storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0122] The present invention also provides a computer device, which may include a memory and a processor, wherein a computer program is stored in the memory, and when the processor calls the computer program in the memory, the method provided in the above embodiment can be implemented. Of course, the computer device may also include various network interfaces, power supplies and other components.

[0123] The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the various embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description. It should be pointed out that for ordinary technicians in this technical field, without departing from the principle of the present invention, several improvements and modifications can be made to the present invention, and these improvements and modifications also fall within the scope of protection of the claims of the present invention.

[0124] It should also be noted that, in this specification, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprises", or any other variations thereof are intended to cover non-exclusive.

[0125] Inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of more restrictions, the elements defined by the sentence "including a..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

Claims

1. An offline audio and video calling method, applied to a calling end, characterized in that: include: Obtaining device information of the called party and caching the device information locally; Establishing a P2P signaling communication service with the called end; Collecting audio and video data, creating a real-time communication connection interface, and binding the audio and video data to the real-time communication connection interface; Based on the device information of the called end, establishing a connection with the called end through the real-time communication connection interface; The audio and video data are sent to the called end through a real-time communication connection interface.

2. The offline audio and video calling method according to claim 1, characterized in that: The step of obtaining device information of the called end and caching the device information locally includes: Register your own device information to the device management service through an external registration server; Obtain device list information through the device management service; the device list information includes all device information of the called end; The device list information is cached locally.

3. The offline audio and video calling method according to claim 1, characterized in that: The step of obtaining device information of the called end and caching the device information locally includes: Configure your own device information to the LAN gateway; Obtaining device list information through the local area network gateway; the device list information includes all device information of the called end; The device list information is cached locally.

4. The offline audio and video calling method according to claim 1, characterized in that: The step of obtaining device information of the called end and caching the device information locally includes: Configure its own device information to one of the called terminals; the one of the called terminals is used to broadcast device list information, wherein the device list information includes device information of all the called terminals; Receiving device list information broadcasted by one of the called terminals; Cache the device list information locally; Alternatively, the acquiring device information of the called end and caching the device information locally includes: A dedicated registration device is set up in the local area network; the dedicated registration device is used to broadcast the device list information; Configure its own device information into the dedicated registration device; Receiving device list information broadcasted by the dedicated registration device; The device list information is cached locally.

5. The offline audio and video calling method according to claim 1, characterized in that: The establishing of a P2P signaling communication service with the called end includes: When a call is initiated, a call message is sent to the called end, so that the called end sets its own state to a listening state according to the received call message; The initiator session description protocol information, the receiver session description protocol information, and the network address information are exchanged with the called end.

6. The offline audio and video calling method according to claim 1, characterized in that: The establishing a connection with the called end through the real-time communication connection interface based on the device information of the called end includes: Based on its own device information and the device information of the called party, a socket connection is established with the real-time communication connection interface of the called party through its own real-time communication connection interface.

7. The offline audio and video calling method according to claim 1, characterized in that: The establishing of a P2P signaling communication service with the called end includes: Establish P2P signaling communication service with the called party on different platforms.

8. An offline audio and video calling device, applied to a calling end, characterized in that: include: An acquisition unit, used for acquiring device information of the called end, and caching the device information locally; A service establishing unit, configured to establish a P2P signaling communication service with the called end; A binding unit, used to collect audio and video data, create a real-time communication connection interface, and bind the audio and video data to the real-time communication connection interface; A connection establishing unit, configured to establish a connection with the called end through the real-time communication connection interface based on the device information of the called end; The sending unit is used to send the audio and video data to the called end through the real-time communication connection interface.

9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the offline audio and video calling method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the offline audio and video calling method according to any one of claims 1 to 7.