Data processing method, device and equipment and readable storage medium

Abstract

The invention discloses a data processing method and device, equipment and a readable storage medium, and the method comprises the steps: obtaining a first network connection state of first terminal equipment, and if a network connected with the first terminal equipment belongs to a local area network type and service information of second terminal equipment is detected in the network, determining that the first terminal equipment is in a first network connection state; if so, forwarding streaming verification information sent by the second terminal device to the first terminal device, and obtaining a verification result; if the network indicated by the first network connection state belongs to a public network type, or service information of the second terminal equipment is not detected in the network indicated by the first network connection state, obtaining a verification result from a background server, and establishing an indirect connection relationship for performing streaming service between the first terminal device and the second terminal device through the verification result. By adopting the streaming service method and device, the streaming service is carried out between the two terminal devices of any network type, the compatibility is improved, a background server does not need to carry out data forwarding in the streaming, and the network cost is reduced.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to a data processing method and device, equipment and readable storage medium. BACKGROUND

[0002] The traditional cloud game method is based on streaming technology to transmit media files (such as audio, video, etc.) of a device to another device in real time through a network, for example, transmitting the game screen running on a device to a player device (such as a mobile phone, a computer, a smart TV, etc.) in the form of a video stream, and then transmitting the operation instructions of the player to the device running the game for processing. The existing streaming technology needs to transmit data by the background server for streaming service, so it only supports streaming between two devices of public network type, cannot be compatible with different network types, and in the specific transmission process, the device running the game needs to send the video stream data to the background server of the streaming software, the background server forwards the video stream data to the proxy server for establishing data transmission between the device running the game and the player device, the proxy server sends the video stream data to the player device, and the player device also needs to transmit the operation instructions to the background server of the streaming software, the background server forwards the operation instructions to the proxy server, and the proxy server transmits the operation instructions to the device running the game for processing, so as to realize online cloud game between different devices. However, since the background server cannot be bypassed for data transmission, multiple data forwarding through the background server is needed, which is high in network cost. SUMMARY

[0003] The embodiments of the present application provide a data processing method, device, equipment and readable storage medium, which can perform streaming service between two terminal devices of any network type, improve compatibility, and do not need the background server to perform data forwarding in streaming, thereby reducing network cost.

[0004] The embodiments of the present application provide a data processing method, device, equipment and readable storage medium, which can perform streaming service between two terminal devices of any network type, improve compatibility, and do not need the background server to perform data forwarding in streaming, thereby reducing network cost.

[0005] The proxy server acquires the first network connection state of the first terminal device;

[0006] If the network indicated by the first network connection state belongs to a local area network type, and the service information of the second terminal device is detected in the network indicated by the first network connection state, the streaming verification information is acquired based on the service information of the second terminal device, the streaming verification information is sent to the first terminal device, so that the first terminal device sends the verification result between the streaming verification information and the streaming control information to the proxy server; the streaming verification information is the account information input by the object on the second terminal device; and the streaming control information is the account information acquired by the first terminal device when starting the streaming service component.

[0007] If the network indicated by the first network connection state belongs to a public network type or the service information of the second terminal device is not detected in the network indicated by the first network connection state, an authentication request is initiated to the background server, so that the background server sends the verification result between the stream verification information and the stream control information to the proxy server according to the authentication request when the stream verification information sent by the second terminal device and the stream control information sent by the first terminal device are obtained.

[0008] If the verification result is a verification pass result, the verification result is used to instruct the proxy server to establish an indirect connection relationship for the stream service between the first terminal device and the second terminal device. The indirect connection relationship refers to a connection relationship in which data is forwarded between the second terminal device and the first terminal device through the proxy server.

[0009] The multimedia data sent by the first terminal device for the service application is obtained, and the multimedia data is forwarded to the second terminal device through the indirect connection relationship, so that the second terminal device generates object control information based on the interactive operation of the object on the multimedia data.

[0010] The object control information sent by the second terminal device is forwarded to the first terminal device through the indirect connection relationship, so that the first terminal device controls the service application in the first terminal device through the stream service component based on the object control information.

[0011] Further comprising:

[0012] The network indicated by the first network connection state is determined as a target network, the network broadcast service information of the target network is obtained, the service information detection is performed on the data request sent by the terminal device under the target network based on the network broadcast service information, and if the data request with the service information of the second terminal device is detected in the target network, it is determined that the service information of the second terminal device is detected in the network indicated by the first network connection state.

[0013] The stream verification information is obtained based on the service information of the second terminal device, comprising:

[0014] The proxy service information of the proxy server is sent to the second terminal device based on the service information of the second terminal device.

[0015] The stream verification information sent by the second terminal device through the proxy service information is obtained.

[0016] The verification result generated by the first terminal device is obtained by the first terminal device verifying the stream verification information and the stream control information when it receives the stream verification information sent by the proxy server; if the stream verification information and the stream control information are the same, the verification result is a successful verification result.

[0017] This includes sending an authentication request to the backend server, including:

[0018] The authentication request sent by the second terminal device is obtained and forwarded to the backend server. The verification result generated by the backend server is obtained by the backend server verifying the streaming verification information sent by the second terminal device and the streaming control information sent by the first terminal device according to the authentication request. If the streaming verification information and the streaming control information are the same, the verification result is a successful verification result.

[0019] The process of obtaining the authentication request sent by the second terminal device includes:

[0020] The proxy service information is sent to the backend server so that when the backend server receives the streaming verification information sent by the second terminal device, it will send the proxy service information to the second terminal device.

[0021] Obtain the authentication request sent by the second terminal device through the proxy service information.

[0022] This also includes:

[0023] Obtain the verification result;

[0024] If the verification result is successful, a first connection relationship is established between the first terminal device and the proxy server through the network indicated by the first network connection status, and a second connection relationship is established between the second terminal device and the proxy server through the network indicated by the second network connection status of the second terminal device. The first connection relationship and the second connection relationship are determined to be an indirect connection relationship.

[0025] The multimedia data includes a first data packet and a second data packet, and the method further includes:

[0026] Obtain the load status of the proxy server. If the load status meets the overload transmission condition, then forward the first data packet sent by the first terminal device to the second terminal device based on the proxy server.

[0027] The background service information of the background server is sent to the first terminal device, so that the first terminal device sends the second data packet to the background server; the second data packet is used to forward to the second terminal device through the background server; the first data packet and the second data packet are used together to form multimedia data in the second terminal device.

[0028] Further comprising:

[0029] generating M test data packets, sending the M test data packets to the first terminal device based on the indirect connection relationship, determining first network test information for the first terminal device based on first sending time and first receiving time for the M test data packets; the first sending time refers to time for the proxy server to send the M test data packets to the first terminal device, and the first receiving time refers to time for the first terminal device to return the M test data packets to the proxy server; M is a positive integer;

[0030] sending the M test data packets to the second terminal device based on the indirect connection relationship, determining second network test information for the second terminal device based on second sending time and second receiving time for the M test data packets; the second sending time refers to time for the proxy server to send the M test data packets to the second terminal device, and the second receiving time refers to time for the second terminal device to return the M test data packets to the proxy server;

[0031] adjusting the target network based on the first network test information and the second network test information; the target network includes a network connected by the first terminal device or a network connected by the second terminal device.

[0032] Further comprising:

[0033] if the first network test information does not satisfy a network transmission condition set by the streaming service component for the service application, determining the network connected by the first terminal device as the target network, and returning first network prompt information to the first terminal device; the first network prompt information is used to prompt the first terminal device to switch the connected target network to the network connected by the second terminal device;

[0034] if the second network test information does not satisfy the network transmission condition set by the streaming service component for the service application, determining the network connected by the second terminal device as the target network, and returning second network prompt information to the second terminal device; the second network prompt information is used to prompt the second terminal device to switch the connected target network to the network connected by the first terminal device.

[0035] Further comprising:

[0036] If the new first network test information and the new second network test information obtained after adjusting the target network do not satisfy the network transmission condition, data compression information of the indirect connection relationship is determined based on the new first network test information and the new second network test information, the data compression information is sent to the first terminal device, and compressed multimedia data for the service application sent by the first terminal device is received; the compressed multimedia data is obtained by data compression of the first terminal device on the multimedia data based on the data compression information.

[0037] The embodiment of the application provides another data processing method, which comprises the following steps:

[0038] The second terminal device acquires second network connection state and stream verification information; the stream verification information is account information input by an object on the second terminal device;

[0039] If the network indicated by the second network connection state belongs to a local area network type, a message probe request carrying service information of the second terminal device is broadcast in the network indicated by the second network connection state, so that when the proxy server detects the service information of the second terminal device in the network indicated by the first network connection state of the first terminal device, the proxy server acquires the stream verification information based on the service information of the second terminal device and sends the stream verification information to the first terminal device; the first terminal device is configured to send a verification result between the stream verification information and stream control information to the proxy server, and the stream control information is account information acquired by the first terminal device when starting a stream service component;

[0040] If the network indicated by the second network connection state belongs to a public network type or the proxy server does not detect the service information of the second terminal device in the network indicated by the first network connection state, the stream verification information is sent to a background server, so that when the background server acquires the proxy service information sent by the proxy server, the background server sends the proxy service information of the proxy server to the second terminal device; the proxy service information is used to instruct the second terminal device to send an authentication request to the proxy server; the authentication request is used to instruct the proxy server to acquire a verification result between the stream verification information and stream control information from the background server based on the authentication request, and the stream control information is sent by the first terminal to the background server;

[0041] If the verification result is a verification pass result, the verification result is used to instruct the proxy server to establish an indirect connection relationship for the stream service between the first terminal device and the second terminal device; the indirect connection relationship refers to a connection relationship in which data is forwarded between the second terminal device and the first terminal device through the proxy server.

[0042] The method further comprises the following steps:

[0043] The multimedia data sent by the first terminal device for the service application is acquired through the indirect connection relationship, the object manipulation information is generated based on the interactive operation of the object for the multimedia data, and the object manipulation information is sent to the first terminal device; the object manipulation information is used to control the service application in the first terminal device through the streaming service component.

[0044] The second terminal device acquires the second network connection state of the second terminal device and the streaming verification information, and the streaming verification information includes:

[0045] A network selection window is created in the streaming service component, and the second network connection state of the second terminal device is acquired in response to the network selection operation of the object in the network selection window.

[0046] An account information verification window is created, and the streaming verification information input by the object is acquired in response to the account input operation of the object in the account information verification window.

[0047] The method further includes:

[0048] The first network connection state of the first terminal device is acquired based on the indirect connection relationship, and if the network type indicated by the first network connection state is different from the network type indicated by the second network connection state, the second network prompt information is displayed in the streaming connection component; the second network prompt information is used to prompt the second terminal device to switch the connected network to the network connected by the first terminal device.

[0049] The application embodiment provides a data processing device, which includes:

[0050] The state acquisition module is configured to acquire the first network connection state of the first terminal device by the proxy server.

[0051] The LAN streaming module is configured to acquire the streaming verification information based on the service information of the second terminal device if the network indicated by the first network connection state belongs to the LAN type and the service information of the second terminal device is detected in the network indicated by the first network connection state, and send the streaming verification information to the first terminal device, so that the first terminal device sends the verification result between the streaming verification information and the streaming manipulation information to the proxy server; the streaming verification information is the account information input by the object on the second terminal device; and the streaming manipulation information is the account information acquired by the first terminal device when starting the streaming service component.

[0052] The public network streaming module is configured to, if the network indicated by the first network connection state belongs to a public network type or the service information of the second terminal device is not detected in the network indicated by the first network connection state, initiate an authentication request to the background server, so that the background server sends a verification result between the streaming verification information and the streaming control information to the proxy server according to the authentication request when the streaming verification information sent by the second terminal device and the streaming control information sent by the first terminal device are acquired.

[0053] If the verification result is a verification pass result, the verification result is used to instruct the proxy server to establish an indirect connection relationship for the streaming service between the first terminal device and the second terminal device. The indirect connection relationship refers to a connection relationship in which data is forwarded between the second terminal device and the first terminal device through the proxy server.

[0054] In a possible implementation, the state acquisition module is further configured to perform the following operation:

[0055] The multimedia data sent by the first terminal device for the service application is acquired, and the multimedia data is forwarded to the second terminal device through the indirect connection relationship, so that the second terminal device generates object control information based on the interactive operation of the object on the multimedia data.

[0056] The object control information sent by the second terminal device is forwarded to the first terminal device through the indirect connection relationship, so that the first terminal device controls the service application in the first terminal device through the streaming service component based on the object control information.

[0057] In a possible implementation, the state acquisition module is further configured to perform the following operation:

[0058] The network indicated by the first network connection state is determined as a target network, network broadcast service information of the target network is acquired, service information detection is performed on the data request sent by the terminal device under the target network based on the network broadcast service information, and if the data request with the service information of the second terminal device is detected in the target network, it is determined that the service information of the second terminal device is detected in the network indicated by the first network connection state.

[0059] In a possible implementation, the local area network streaming module is configured to, when the streaming verification information is acquired based on the service information of the second terminal device, perform the following operation:

[0060] Based on the service information of the second terminal device, the proxy service information of the proxy server is sent to the second terminal device.

[0061] The streaming verification information sent by the second terminal device through the proxy service information is acquired.

[0062] In a possible implementation, the verification result generated by the first terminal device is obtained by the first terminal device verifying the stream verification information and the stream control information when the first terminal device acquires the stream verification information sent by the proxy server; if the stream verification information is the same as the stream control information, the verification result is a verification pass result.

[0063] In a possible implementation, when the public network stream module is used to initiate an authentication request to the background server, the following operation is specifically performed:

[0064] The authentication request sent by the second terminal device is acquired, and the authentication request is forwarded to the background server; wherein the verification result generated by the background server is obtained by the background server verifying the stream verification information and the stream control information according to the authentication request when the background server acquires the stream verification information sent by the second terminal device and the stream control information sent by the first terminal device; if the stream verification information is the same as the stream control information, the verification result is a verification pass result.

[0065] In a possible implementation, when the public network stream module is used to acquire the authentication request sent by the second terminal device, the following operation is specifically performed:

[0066] The proxy service information is sent to the background server, so that the proxy service information is sent to the second terminal device by the background server when the background server acquires the stream verification information sent by the second terminal device;

[0067] The authentication request sent by the second terminal device through the proxy service information is acquired.

[0068] In a possible implementation, the state acquisition module is further used to perform the following operation:

[0069] The verification result is acquired.

[0070] If the verification result is a verification pass result, a first connection relationship between the first terminal device and the proxy server is established through the network indicated by the first network connection state, a second connection relationship between the second terminal device and the proxy server is established through the network indicated by the second network connection state of the second terminal device, and the first connection relationship and the second connection relationship are determined as an indirect connection relationship.

[0071] In a possible implementation, the multimedia data includes a first data packet and a second data packet, and the state acquisition module is further used to perform the following operation:

[0072] The load state of the proxy server is acquired, and if the load state satisfies an overload transmission condition, the first data packet sent by the first terminal device is forwarded to the second terminal device based on the proxy server;

[0073] The background service information of the background server is sent to the first terminal device, so that the first terminal device sends a second data packet to the background server; the second data packet is used for forwarding to the second terminal device through the background server; the first data packet and the second data packet are used for composing multimedia data in the second terminal device together.

[0074] In a possible implementation, the state obtaining module is further configured to perform the following operation:

[0075] M test data packets are generated, the M test data packets are sent to the first terminal device based on the indirect connection relationship, and first network test information for the first terminal device is determined based on first sending time and first receiving time for the M test data packets; the first sending time refers to time when the proxy server sends the M test data packets to the first terminal device, and the first receiving time refers to time when the first terminal device returns the M test data packets to the proxy server; M is a positive integer;

[0076] The M test data packets are sent to the second terminal device based on the indirect connection relationship, and second network test information for the second terminal device is determined based on second sending time and second receiving time for the M test data packets; the second sending time refers to time when the proxy server sends the M test data packets to the second terminal device, and the second receiving time refers to time when the second terminal device returns the M test data packets to the proxy server;

[0077] The target network is adjusted based on the first network test information and the second network test information; the target network includes a network connected by the first terminal device or a network connected by the second terminal device.

[0078] In a possible implementation, when the state obtaining module is used to adjust the target network based on the first network test information and the second network test information, the state obtaining module is specifically configured to perform the following operation:

[0079] If the first network test information does not satisfy a network transmission condition set by the streaming service component for the service application, the network connected by the first terminal device is determined as the target network, and first network prompt information is returned to the first terminal device; the first network prompt information is used to prompt the first terminal device to switch the connected target network to the network connected by the second terminal device.

[0080] If the second network test information does not satisfy the network transmission condition set by the streaming service component for the service application, the network connected by the second terminal device is determined as the target network, and second network prompt information is returned to the second terminal device; the second network prompt information is used to prompt the second terminal device to switch the connected target network to the network connected by the first terminal device.

[0081] In a possible implementation, the indirect connection relationship is used for sending multimedia data of a service application of the first terminal device to the second terminal device, and the state obtaining module is further configured to perform the following operations:

[0082] If the new first network test information and the new second network test information obtained after the adjustment of the target network do not satisfy the network transmission condition, the data compression information of the indirect connection relationship is determined based on the new first network test information and the new second network test information, the data compression information is sent to the first terminal device, and the compressed multimedia data of the service application sent by the first terminal device is received; the compressed multimedia data is obtained by performing data compression on the multimedia data by the first terminal device based on the data compression information.

[0083] The embodiment of the application provides another data processing device, which comprises:

[0084] The verification obtaining module is configured to obtain, by the second terminal device, second network connection state and stream verification information; the stream verification information is account information input by an object on the second terminal device;

[0085] The LAN processing module is configured to, if the network indicated by the second network connection state belongs to a local area network type, broadcast a message probe request carrying service information of the second terminal device in the network indicated by the second network connection state, so that the proxy server obtains the stream verification information based on the service information of the second terminal device when detecting the service information of the second terminal device in the network indicated by the first network connection state of the first terminal device, and sends the stream verification information to the first terminal device; the first terminal device is configured to send a verification result between the stream verification information and stream control information to the proxy server, and the stream control information is account information obtained by the first terminal device when starting a stream service component;

[0086] The public network processing module is configured to, if the network indicated by the second network connection state belongs to a public network type, or the proxy server does not detect the service information of the second terminal device in the network indicated by the first network connection state, send the stream verification information to a background server, so that the background server sends proxy service information of the proxy server to the second terminal device when obtaining the proxy service information sent by the proxy server; the proxy service information is used to instruct the second terminal device to send an authentication request to the proxy server; the authentication request is used to instruct the proxy server to obtain a verification result between the stream verification information and stream control information from the background server based on the authentication request, and the stream control information is sent by the first terminal device to the background server;

[0087] If the verification result is a verification pass result, the verification result is used to instruct the proxy server to establish an indirect connection relationship for the streaming service between the first terminal device and the second terminal device. The indirect connection relationship refers to a connection relationship in which data is forwarded between the second terminal device and the first terminal device through the proxy server.

[0088] In a possible implementation, the verification obtaining module is further configured to perform the following operation:

[0089] The multimedia data sent by the first terminal device for the service application is obtained through the indirect connection relationship, object manipulation information is generated based on the interactive operation of the object on the multimedia data, and the object manipulation information is sent to the first terminal device. The object manipulation information is used to control the service application in the first terminal device through the streaming service component.

[0090] In a possible implementation, when the second terminal device obtains the second network connection state of the second terminal device and the streaming verification information, the verification obtaining module is specifically configured to perform the following operation:

[0091] A network selection window is created in the streaming service component, and the second network connection state of the second terminal device is obtained in response to a network selection operation of the object on the network selection window.

[0092] An account information verification window is created, and the streaming verification information input by the object is obtained in response to an account input operation of the object on the account information verification window.

[0093] In a possible implementation, the verification obtaining module is further configured to perform the following operation:

[0094] The first network connection state of the first terminal device is obtained based on the indirect connection relationship. If the network type indicated by the first network connection state is different from the network type indicated by the second network connection state, the second network prompt information is displayed in the streaming connection component. The second network prompt information is used to prompt the second terminal device to switch the connected network to the network connected by the first terminal device.

[0095] The computer device provided in the embodiment of the present application comprises a processor, a memory and a network interface.

[0096] The processor is connected with the memory and the network interface. The network interface is used to provide a data communication function, and the memory is used to store a computer program. When the computer program is executed by the processor, the computer device executes the method provided in the embodiment of the present application.

[0097] The embodiment of the present application provides a computer readable storage medium, and the computer readable storage medium stores a computer program.

[0098] The embodiment of the present application provides a computer program product, and the computer program product comprises a computer program stored in a computer readable storage medium. A processor of a computer device reads the computer program from the computer readable storage medium, and the processor executes the computer program, so that the computer device executes the method provided by the embodiment of the present application.

[0099] The embodiment of the present application obtains the first network connection state sent by the first terminal device through the proxy server, judges the network type of the network indicated by the first network connection state, if the network indicated by the first network connection state belongs to a local area network type, and the service information of the second terminal device is detected in the network indicated by the first network connection state, the streaming verification information is obtained based on the service information of the second terminal device, the streaming verification information is sent to the first terminal device, the verification result between the streaming verification information and the streaming control information is sent to the proxy server by the first terminal device, if the network indicated by the first network connection state belongs to a public network type, or the service information of the second terminal device is not detected in the network indicated by the first network connection state, an authentication request is initiated to the background server, when the streaming verification information sent by the second terminal device and the streaming control information sent by the first terminal device are obtained, the background server sends the verification result between the streaming verification information and the streaming control information to the proxy server according to the authentication request, when the verification result is a verification pass result, the proxy server establishes an indirect connection relationship for the streaming service between the first terminal device and the second terminal device based on the verification result, so that the indirect connection relationship can be established between two terminal devices of any network type for streaming service, the compatibility of the streaming service is improved, and the background server can be bypassed in the streaming service process, and the background server does not need to forward data in the indirect connection relationship, so that the network bandwidth is saved and the network cost is reduced. BRIEF DESCRIPTION OF DRAWINGS

[0100] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0101] Figure 1 It is a network architecture schematic diagram provided by the embodiment of the present application;

[0102] Figure 2 is a data processing scenario provided by an embodiment of the present application;

[0103] Figure 3 is a flow of a data processing method provided by an embodiment of the present application Figure 1 ;

[0104] Figure 4 is a flow of a data processing method provided by an embodiment of the present application Figure 2 ;

[0105] Figure 5 is a flow of a data processing method provided by an embodiment of the present application Figure 3 ;

[0106] Figure 6 is a flow of a data processing method provided by an embodiment of the present application Figure 4 ;

[0107] Figure 7 is a flow of a data processing method provided by an embodiment of the present application Figure 5 ;

[0108] Figure 8 is a structure of a data processing apparatus provided by an embodiment of the present application Figure 1 ;

[0109] Figure 2 is a structure of a data processing apparatus provided by an embodiment of the present application Figure 2 ;

[0110] Figure 1 is a structure of a computer device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0111] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all the other embodiments obtained by those skilled in the art without any creative work fall within the scope of protection of the present application.

[0112] Please refer to Figure 1 , Figure 1 is a network architecture provided by an embodiment of the present application. As shown in Figure 1As shown, the network architecture can include a proxy server 100, a first terminal device 200, a second terminal device 300, and a background server 400. Among them, the proxy server 100 can exist in a communication connection with the first terminal device 200, the proxy server 100 can exist in a communication connection with the second terminal device 300, and the proxy server 100 can exist in a communication connection with the background server 400; the background server 400 can exist in a communication connection with the first terminal device 200, and the background server 400 can exist in a communication connection with the second terminal device 300. Among them, the above-mentioned communication connection does not limit the connection mode, and can be directly or indirectly connected through a wired communication mode, or can be directly or indirectly connected through a wireless communication mode, or can be connected through other modes, which is not limited in the present application.

[0113] It should be understood that, as Figure 2 shown, the first terminal device 200 and the second terminal device 300 can be installed with a streaming service component. The streaming service component can be a software or an application program for establishing an indirect connection relationship for streaming service. The indirect connection relationship can be a transmission control connection relationship, for example, a TCP (Transmission Control Protocol, Transmission Control Protocol) continuous data transmission relationship.

[0114] When the streaming service component runs in each terminal device, it can respectively interact with the proxy server 100 and the background server 400 as shown above. Figure 2 The first terminal device 200 can be installed with a service application. The streaming service component and the service application can both be game applications, video editing applications, social applications, instant messaging applications, live broadcast applications, short video applications, video applications, music applications, shopping applications, novel applications, payment applications, browsers, and other application clients with image and video data information functions. Among them, the application client can be an independent client, or an embedded sub-client integrated in a certain client (such as an instant messaging client, a social client, a video client, etc.), which is not limited here.

[0115] As shown in Figure 2 , an object (which can be a user or a player) can start the streaming service component on the first terminal device 200, and the first terminal device 200 can send the first network connection state corresponding to the first terminal device 200 to the proxy server 100. The first network connection state can indicate the network connected by the first terminal device 200 and the network type of the network connected by the first terminal device 200. The network type can include a local area network type and a public network type.

[0116] The proxy server 100 can determine the first network connection state of the first terminal device 200, and determine the streaming connection mode in different network states. If the network indicated by the first network connection state belongs to a local area network type, and the service information of the second terminal device 300 is detected in the network indicated by the first network connection state, the proxy server 100 can obtain the streaming verification information based on the service information of the second terminal device 300. The streaming verification information can be account information input by the object on the second terminal device 300.

[0117] The proxy server 100 can send the streaming verification information to the first terminal device 200. The first terminal device 200 can send the verification result between the streaming verification information and the streaming control information to the proxy server 100. The streaming control information can be account information registered and generated by the object when the streaming service component is started for the first time.

[0118] If the network indicated by the first network connection state belongs to a public network type, or the service information of the second terminal device 300 is not detected in the network indicated by the first network connection state, the proxy server 100 can initiate an authentication request to the background server 400. When the streaming verification information sent by the second terminal device 300 and the streaming control information sent by the first terminal device 200 are obtained, the background server 400 can send the verification result between the streaming verification information and the streaming control information to the proxy server 100 through the authentication request.

[0119] At this time, whether the proxy server 100 obtains the verification result from the first terminal device 200 or the background server 400, the verification result can be identified. If it is identified that the verification result is a verification pass result, the proxy server 100 can establish an indirect connection relationship for the streaming service between the first terminal device and the second terminal device based on the verification result. The indirect connection relationship can refer to a connection relationship in which data is forwarded between the second terminal device and the first terminal device through the proxy server. The verification pass result can indicate that the streaming ID and the streaming password corresponding to the streaming verification information and the streaming control information are the same.

[0120] The first terminal device 200 can run the business application in the streaming service component after the indirect connection relationship is successfully established. The first terminal device 200 can generate multimedia data for the business application, and send the multimedia data to the proxy server 100 through the indirect connection relationship. The multimedia data can be a combination of multiple types of media information, and can include text data, image data, audio data, video data, etc.

[0121] The proxy server 100 can forward the multimedia data to the second terminal device 300 through the indirect connection relationship, and the second terminal device 300 can perform data analysis on the acquired multimedia data, and display the picture and music of the service application corresponding to the multimedia data in the streaming service component of the second terminal device 300. The object can perform interactive operation in the streaming service component based on the picture and music of the service application, and the second terminal device 300 can generate object control information based on the interactive operation of the object on the multimedia data, and send the object control information to the proxy server 100. The object control information can be a control instruction for the service application.

[0122] The proxy server 100 can forward the object control information sent by the second terminal device 300 to the first terminal device 200 through the indirect connection relationship, and the first terminal device 200 can control the service application in the first terminal device 200 through the streaming service component based on the object control information, and execute the interactive operation corresponding to the object control information through the service application, thereby generating new multimedia data. The first terminal device 200 can send the new multimedia data to the proxy server 100, and the proxy server 100 forwards the new multimedia data to the second terminal device 300 through the indirect connection relationship. The second terminal device 300 can generate new object control information based on the new multimedia data, thereby realizing the streaming service between the first terminal device 200 and the second terminal device.

[0123] It can be understood that in the specific embodiments of the present application, the user (object or player) data involved needs to obtain the permission or consent of the user, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards in the relevant region when the above and below embodiments of the present application are applied to specific products or technologies.

[0124] If the object (such as a user) data needs to be collected in the present application, a prompt interface or pop-up window is displayed before and during collection. The prompt interface or pop-up window is used to prompt the user that some data is currently being collected. Only after obtaining the confirmation operation of the user on the prompt interface or pop-up window, the relevant steps of data acquisition are started, otherwise it is ended. Moreover, the user data obtained will be used in reasonable and legal scenarios or purposes. Optionally, in some scenarios where user data needs to be used but has not been authorized by the user, the user can also be requested for authorization, and the user data can be used again when the authorization is passed.

[0125] The embodiment of the present application obtains the first network connection state sent by the first terminal device through the proxy server, judges the network type of the network indicated by the first network connection state, if the network indicated by the first network connection state belongs to the local area network type, and the service information of the second terminal device is detected in the network indicated by the first network connection state, the streaming verification information is obtained based on the service information of the second terminal device, the streaming verification information is sent to the first terminal device, the verification result between the streaming verification information and the streaming control information is sent to the proxy server by the first terminal device, if the network indicated by the first network connection state belongs to the public network type, or the service information of the second terminal device is not detected in the network indicated by the first network connection state, the authentication request is initiated to the background server, when the streaming verification information sent by the second terminal device and the streaming control information sent by the first terminal device are obtained, the background server sends the verification result between the streaming verification information and the streaming control information to the proxy server according to the authentication request, when the verification result is the verification pass result, the proxy server establishes the indirect connection relationship for the streaming service between the first terminal device and the second terminal device based on the verification result, so that the indirect connection relationship can be established between two terminal devices of any network type for streaming service, the compatibility of implementing the streaming service is improved, and the background server can be bypassed in the streaming service process, and the background server does not need to forward data in the indirect connection relationship, the network bandwidth is saved, and the network cost is reduced.

[0126] Please refer to Figure 3 , Figure 3 is a scene diagram of data processing provided by the embodiment of the present application. As shown in Figure 1 , in the business scene 201, the object (which can be a user or a player) can start the streaming service component on the first terminal device 200, the streaming service component can display the streaming control information generated or registered in advance, the streaming control information can include streaming control information A and streaming control information B, the streaming control information can be the account information registered and generated by the object when starting the streaming service component for the first time, for example, the streaming control information A can be the streaming ID (account number), and the streaming control information B can be the streaming password.

[0127] After the object clicks the "start streaming function", the first terminal device 200 can send the first network connection state corresponding to the first terminal device 200 to the proxy server 100. The first network connection state can indicate the network to which the first terminal device 200 is connected and the network type of the network to which the first terminal device 200 is connected, and the network type can include a local area network type and a public network type. For example, the first terminal device 200 can be connected to a local area network type network E. The object can input the network broadcast service information corresponding to the local area network streaming and the service information of the second terminal device when registering or generating the streaming control information, and send the network broadcast service information and the service information of the second terminal device to the proxy server, for example, the network broadcast service information can be the management account and password of the network E, and the service information of the second terminal device can include the port number, address, etc. of the second terminal device.

[0128] The object can start the streaming service component in the second terminal device 300. In the business scenario 301, the second terminal device 300 can create a network selection window in the streaming service component, and the object can select the network type for streaming with the first terminal device 200 in the streaming service component, which can include public network streaming and local area network streaming. The streaming service component can also directly obtain the second network connection state of the second terminal device object, and the present application embodiment does not limit this.

[0129] For ease of understanding, it is assumed that the object selects the local area network streaming or the network type of the network to which the second terminal device 300 is connected in the network selection window of the business scenario 301 is a local area network. In the business scenario 302, the second terminal device 300 can create an account information verification window in the streaming service component, and the object can input streaming verification information, which can include streaming verification information C and streaming verification information D. The streaming verification information can be the account information input by the object on the streaming service component of the second terminal device 300, for example, it can be the streaming ID (account) and streaming password of the device that provides streaming service with the second terminal device 300. After the object clicks "connect immediately", the second terminal device 300 can broadcast a message probe request in the network E, and the message probe request can carry the service information of the second terminal device 300.

[0130] The proxy server 100 judges the first network connection state of the first terminal device 200 after obtaining the first network connection state sent by the first terminal device 200, thereby determining the streaming connection mode of different network states. If the network indicated by the first network connection state belongs to a local area network type, the proxy server 100 can perform network detection in the network E indicated by the first network connection state based on the network broadcast service information. The network detection can be detection of service information of each data request in the network E. When the proxy server 100 detects a message probe request carrying service information of the second terminal device 300 in the network E, the proxy server 100 can determine that the network connected by the first terminal device and the second terminal device is network E. The proxy server 100 obtains the service information of the second terminal device 300, and sends the proxy service information (which can include the port number and address of the proxy server) of the proxy server to the second terminal device 300 based on the service information of the second terminal device 300. The second terminal device 300 can send the streaming verification information corresponding to the second terminal device 300 to the proxy server 100 based on the proxy service information. The second network connection state can indicate the network connected by the second terminal device 300 and the network type of the network connected by the second terminal device 300. The streaming verification information can be account information input by the user on the second terminal device 300.

[0131] The proxy server 100 can send the streaming verification information to the first terminal device 200, and the first terminal device 200 can verify the streaming verification information and the streaming control information. The verification can be a comparison of whether the streaming ID and the streaming password corresponding to the streaming verification information and the streaming control information are the same. If the streaming ID and the streaming password are the same, the first terminal device 200 can send a verification pass result to the proxy server 100.

[0132] If the network indicated by the first network connection state belongs to a public network type, or the service information of the second terminal device 300 is not detected in the network indicated by the first network connection state, the proxy server 100 can send the proxy service information to the background server.

[0133] The second terminal device 300 can send the streaming verification information to the background server 400 when the network indicated by the second network connection state belongs to a public network type, or when the waiting time length for obtaining the proxy service information reaches a waiting threshold. The waiting time length can be the time length for the second terminal device to wait for the proxy server 100 to return the proxy service information from the broadcast message probe request. When the waiting time length reaches the waiting threshold, it means that the network connected by the second terminal device 300 is different from the network indicated by the first network connection state.

[0134] The background server 400 can send the proxy service information to the second terminal device 300 when the stream verification information sent by the second terminal device 300 is acquired. The second terminal device 300 can send an authentication request to the proxy server 100 based on the proxy service information. The proxy server 100 can forward the authentication request to the background server 400. The background server 400 can verify the stream verification information and the stream control information based on the authentication request. The verification can be to compare whether the stream IDs and the stream passwords corresponding to the stream verification information and the stream control information are the same. If the stream IDs and the stream passwords are the same, the background server 400 can send a verification pass result to the proxy server 100. The first terminal device 200 can send the stream control information to the background server 400 when starting the stream service component.

[0135] At this time, whether the proxy server 100 acquires the verification result from the first terminal device 200 or the background server 400, the verification result can be identified. If the verification result is a verification pass result, the proxy server 100 can establish a first connection relationship corresponding to the first terminal device 200 and a second connection relationship corresponding to the second terminal device 300 based on the verification result. The proxy server 100 can determine the first connection relationship and the second connection relationship as an indirect connection relationship between the first terminal device 200 and the second terminal device 300. The indirect connection relationship can mean a connection relationship in which the first terminal device 200 and the second terminal device 300 perform data forwarding through the proxy server 100. The first connection relationship and the second connection relationship can each be a transmission control connection relationship, for example, a TCP continuous data transmission relationship.

[0136] As shown in the business scenario 202, the first terminal device 200 can operate a business application in the stream service component after the indirect connection relationship is successfully established. The stream service component can display a stream device (i.e., the second terminal device 300) and a stream duration for the stream service of the first terminal device 200. The first terminal device 200 can generate multimedia data for the business application and send the multimedia data to the proxy server 100 through the first connection relationship. The multimedia data can be a combination of various types of media information of the business application, which can include text data, image data, audio data, video data, and the like.

[0137] The proxy server 100 can forward the multimedia data to the second terminal device 300 through the second connection relationship. The second terminal device 300 can perform data analysis on the acquired multimedia data. As shown in the service scenario 303, the second terminal device 300 can display the picture and music of the service application corresponding to the multimedia data in the streaming service component. The object can perform interactive operations in the streaming service component based on the picture and music of the service application. The second terminal device 300 can generate object control information based on the interactive operations of the object on the multimedia data, and send the object control information to the proxy server 100 through the second connection relationship. The object control information can be a control instruction for the service application.

[0138] The proxy server 100 can forward the object control information sent by the second terminal device 300 to the first terminal device 200 through the first connection relationship. The first terminal device 200 can control the service application in the first terminal device 200 through the streaming service component based on the object control information, and perform interactive operations corresponding to the object control information through the service application, thereby generating new multimedia data. The first terminal device 200 can send the new multimedia data to the proxy server 100 through the first connection relationship. The proxy server 100 forwards the new multimedia data to the second terminal device 300 through the second connection relationship. The second terminal device 300 can generate new object control information based on the new multimedia data, thereby realizing the streaming service between the first terminal device 200 and the second terminal device.

[0139] It can be understood that the embodiments of the present application can transmit multimedia data corresponding to the service application and object control information of the object through an indirect connection relationship, thereby realizing the streaming service between the first terminal device 200 and the second terminal device 300. The object can remotely control the service application in the first terminal device 200 through the second terminal device 300, which can be applied to multiple fields and reduce the network cost of the streaming service. When the service application is office software, remote office with multi-platform interaction can be realized, the platform threshold of work equipment is reduced, multi-platform collaboration is realized, and work efficiency is improved. When the service application is game software, the first terminal device 200 can provide a high-performance virtual game environment for the second terminal device 300, which can break through the limitation of device platforms and play large games on low-configuration devices. When the service application is programming development software, a powerful development environment and tool can be provided to support multi-platform development and collaboration. When the service application is video editing software, high-performance graphics processing capability and storage space can be provided to support large video editing projects, provide a safe, flexible, and extensible data center solution, reduce storage costs, and improve work efficiency.

[0140] This application embodiment can determine the network connection status of the first terminal device and the second terminal device based on the selected streaming method. It can establish an indirect connection between two terminal devices of any network type for streaming services, improving the compatibility of streaming services. Furthermore, it can bypass the backend server during streaming, eliminating the need for the backend server to forward data in the indirect connection, saving network bandwidth, reducing network costs, and lowering network latency. In local area network (LAN) streaming, the first terminal device verifies the streaming verification and control information, eliminating the need to transmit these information to the backend server for verification. This avoids exposing streaming control information on the network, ensuring its privacy and security. In public network streaming, the backend server can verify the streaming verification and control information, avoiding multiple transmissions and improving account verification security.

[0141] Please see Figure 1 , Figure 1 This is a flowchart illustrating a data processing method provided in an embodiment of this application. Figure 1 This data processing method involves interaction between the proxy server and the first terminal device and the second terminal device. The first terminal device can be, for example, […]. Figure 4 The first terminal device 200 shown, the second terminal device can be as follows: Figure 4 The first terminal device 200 shown can have a proxy server as follows: Figure 2 The proxy server 100 shown. The data processing method may include at least the following steps S101-S103:

[0142] Step S101: The proxy server obtains the first network connection status of the first terminal device;

[0143] Specifically, an object (which can be a user or a player) can start a streaming service component on a first terminal device. After the streaming service component is started, it can read streaming control information from the corresponding storage space of the first terminal device. The streaming control information can be the account information registered and generated when the object first starts the streaming service component. The first terminal device can send the first network connection status to the proxy server.

[0144] The stream service component can be a software or an application for establishing an indirect connection relationship for stream service. The stream control information is account information obtained by the first terminal device when starting the stream service component. The stream control information can include a stream ID (account number) and a stream password. The first network connection state can indicate a network to which the first terminal device is connected and a network type of the network to which the first terminal device is connected. The network type can include a local area network type and a public network type.

[0145] It can be understood that the object can input network broadcast service information corresponding to the local area network stream and service information of the second terminal device when registering or generating the stream control information, and send the network broadcast service information and the service information of the second terminal device to the proxy server. For example, the network broadcast service information can be a management account and a password of the network indicated by the first network connection state, and the service information of the second terminal device can include a port number, an address, and the like of the second terminal device.

[0146] The object can start the stream service component in the second terminal device and input stream verification information. The stream verification information can be account information input by the object on the stream service component of the second terminal device, for example, a stream ID (account number) and a stream password of a device performing stream service with the second terminal device. The stream service component can directly obtain a second network connection state of the object of the second terminal device. If the network indicated by the second network connection state is of a local area network type, the second terminal device can broadcast a message probe request in the network indicated by the second network connection state after starting the stream service component. The message probe request can carry service information of the second terminal device.

[0147] In step S102, if the network indicated by the first network connection state is of a local area network type and the service information of the second terminal device is detected in the network indicated by the first network connection state, the stream verification information is obtained based on the service information of the second terminal device, and the stream verification information is sent to the first terminal device, so that the first terminal device sends a verification result between the stream verification information and the stream control information to the proxy server. The stream verification information is account information input by the object on the second terminal device. The stream control information is account information obtained by the first terminal device when starting the stream service component.

[0148] Specifically, the proxy server determines the streaming connection mode of different network states after obtaining the first network connection state sent by the first terminal device. If the network indicated by the first network connection state belongs to a local area network type, the proxy server can perform network detection in the network indicated by the first network connection state based on the network broadcast service information. The network detection can be detection of service information of each data request in the network indicated by the first network connection state. When the proxy server detects a message probe request carrying service information of the second terminal device in the network indicated by the first network connection state, the proxy server can determine that the network to which the first terminal device and the second terminal device are connected is the same. The proxy server obtains the service information of the second terminal device, sends the proxy service information (which can include the port number and address of the proxy server) of the proxy server to the second terminal device based on the service information of the second terminal device, and the second terminal device can send the streaming verification information corresponding to the second terminal device to the proxy server based on the proxy service information. The second network connection state can indicate the network to which the second terminal device is connected and the network type of the network to which the second terminal device is connected. The streaming verification information can be account information input by the object on the second terminal device.

[0149] The proxy server can send the streaming verification information to the first terminal device, and the first terminal device can verify the streaming verification information and the streaming control information. The verification can be a comparison of whether the streaming ID and the streaming password corresponding to the streaming verification information and the streaming control information are the same. If the streaming ID and the streaming password are the same, the first terminal device can send a verification pass result to the proxy server.

[0150] If the network indicated by the first network connection state belongs to a public network type or the service information of the second terminal device is not detected in the network indicated by the first network connection state, the authentication request is initiated to the background server, so that the background server sends the verification result between the streaming verification information and the streaming control information to the proxy server when the streaming verification information sent by the second terminal device and the streaming control information sent by the first terminal device are obtained.

[0151] Specifically, if the network indicated by the first network connection state belongs to a public network type or the service information of the second terminal device is not detected in the network indicated by the first network connection state, the proxy server can send the proxy service information to the background server.

[0152] The second terminal device can send the stream verification information to the background server when the network indicated by the second network connection state belongs to the public network type or when the waiting time length for obtaining the proxy service information by the second terminal device reaches a waiting threshold. The waiting time length can be the time length for the second terminal device to wait for the proxy server to return the proxy service information since the broadcast message probe request, and the waiting time length reaching the waiting threshold means that the network connected by the second terminal device is different from the network indicated by the first network connection state.

[0153] The background server can send the proxy service information to the second terminal device when the stream verification information sent by the second terminal device is obtained. The second terminal device can send an authentication request to the proxy server based on the proxy service information, and the proxy server can forward the authentication request to the background server. The background server can verify the stream verification information and the stream control information based on the authentication request, which can be to compare whether the stream ID and the stream password corresponding to the stream verification information and the stream control information are the same. If the stream ID and the stream password are the same, the background server can send a verification pass result to the proxy server. The first terminal device can send the stream control information to the background server when starting the stream service component.

[0154] At this time, whether the proxy server obtains the verification result from the first terminal device or the background server, the verification result can be identified. If the verification result is a verification pass result, the proxy server can establish a first connection relationship corresponding to the first terminal device and a second connection relationship corresponding to the second terminal device based on the verification result. The proxy server can determine the first connection relationship and the second connection relationship as an indirect connection relationship between the first terminal device and the second terminal device. The indirect connection relationship can mean a connection relationship between the first terminal device and the second terminal device through the proxy server for data forwarding. The first connection relationship and the second connection relationship can both be a transmission control connection relationship, for example, a TCP continuous data transmission relationship.

[0155] The first terminal device can run a business application in the stream service component after the indirect connection relationship is successfully established. The first terminal device can start to encode and compress multimedia data for the business application and send the multimedia data to the proxy server through the indirect connection relationship. The multimedia data can be a combination of various types of media information of the business application, which can include text data, image data, audio data, video data, etc.

[0156] The proxy server can forward the multimedia data to the second terminal device through the indirect connection relationship. The second terminal device can perform data analysis on the acquired multimedia data, perform picture rendering on the analyzed multimedia data, and display the picture and music of the service application corresponding to the multimedia data in the streaming service component of the second terminal device. The object can directly perform any interactive operation on the second terminal device. The object can perform interactive operation in the streaming service component based on the picture and music of the service application. The second terminal device can generate object control information based on the interactive operation of the object on the multimedia data, and send the object control information to the proxy server through the indirect connection relationship. The object control information can be a control instruction for the service application.

[0157] The proxy server can forward the object control information sent by the second terminal device to the first terminal device through the indirect connection relationship. The first terminal device can decode the object control information based on the object control information. The first terminal device can control the service application in the streaming service component through the decoded object control information, and perform the interactive operation corresponding to the object control information through the service application, thereby generating new multimedia data. The first terminal device can send the new multimedia data to the proxy server. The proxy server forwards the new multimedia data to the second terminal device through the indirect connection relationship. The second terminal device can generate new object control information based on the new multimedia data, thereby realizing the streaming service between the first terminal device and the second terminal device.

[0158] The embodiment of the present application obtains the first network connection state sent by the first terminal device through the proxy server, judges the network type of the network indicated by the first network connection state, if the network indicated by the first network connection state belongs to the local area network type, and the service information of the second terminal device is detected in the network indicated by the first network connection state, the streaming verification information is obtained based on the service information of the second terminal device, the streaming verification information is sent to the first terminal device, the verification result between the streaming verification information and the streaming control information is sent to the proxy server by the first terminal device, if the network indicated by the first network connection state belongs to the public network type, or the service information of the second terminal device is not detected in the network indicated by the first network connection state, the authentication request is initiated to the background server, when the streaming verification information sent by the second terminal device and the streaming control information sent by the first terminal device are obtained, the background server sends the verification result between the streaming verification information and the streaming control information to the proxy server according to the authentication request, when the verification result is the verification pass result, the proxy server establishes the indirect connection relationship for the streaming service between the first terminal device and the second terminal device based on the verification result, so that the indirect connection relationship can be established between two terminal devices of any network type for streaming service, the compatibility of implementing streaming service is improved, and the background server can be bypassed in the streaming service process, and the background server does not need to forward data in the indirect connection relationship, the network bandwidth is saved, and the network cost is reduced.

[0159] Please refer to Figure 1 , Figure 1 is a flow diagram of a data processing method provided by the embodiment of the present application Figure 1 , which is interacted by the proxy server, the first terminal device, the second terminal device and the background server. The first terminal device can be the first terminal device 200 as shown in Figure 3 , the second terminal device can be the first terminal device 200 as shown in Figure 5 , the proxy server can be the proxy server 100 as shown in Figure 5 , and the background server can be the background server 400 as shown in Figure 3 . The data processing method can at least include the following steps S201-S207:

[0160] Step S201, the proxy server obtains the first network connection state of the first terminal device;

[0161] Specifically, please refer to the specific description of step S201 of the above-mentioned Figure 1 corresponding embodiment, which will not be repeated here.

[0162] Step S202, determining the network indicated by the first network connection state as a target network, obtaining network broadcast service information of the target network, performing service information detection on data requests sent by terminal devices under the target network based on the network broadcast service information, and if a data request with service information of the second terminal device is detected in the target network, determining that the service information of the second terminal device is detected in the network indicated by the first network connection state.

[0163] Specifically, after obtaining the first network connection state sent by the first terminal device, the proxy server judges the first network connection state of the first terminal device, so as to determine the streaming connection mode of different network states. If the network indicated by the first network connection state belongs to the local area network type, the proxy server can obtain the network broadcast service information of the target network, determine the network indicated by the first network connection state as the target network, and perform service information detection on data requests sent by terminal devices under the target network based on the network broadcast service information. The service information detection can detect whether there is a data request with service information of the second terminal device under the target network, and whether the service information of the second terminal device belongs to the terminal registration set. The terminal registration set can be a set of service information of terminal devices input by the object when registering or generating streaming control information. The terminal registration set can include service information of several terminal devices.

[0164] When it is detected that there is a data request with service information of the second terminal device under the target network, and the service information of the second terminal device belongs to the terminal registration set, it is determined that the message probe request sent by the second terminal device is detected.

[0165] Step S203, based on the service information of the second terminal device, sending the proxy service information of the proxy server to the second terminal device; and obtaining the streaming verification information sent by the second terminal device through the proxy service information.

[0166] Specifically, the proxy server can send the proxy service information (which can include the port number, address, etc. of the proxy server) to the second terminal device based on the service information of the second terminal device. The second terminal device can send the streaming verification information corresponding to the second terminal device to the proxy server based on the proxy service information. The streaming verification information can be the account information input by the object on the second terminal device.

[0167] Step S204, sending the streaming verification information to the first terminal device, so that the first terminal device sends the verification result between the streaming verification information and the streaming control information to the proxy server; the streaming verification information is the account information input by the object on the second terminal device; and the streaming control information is the account information obtained by the first terminal device when starting the streaming service component.

[0168] Specifically, the proxy server can send the stream verification information to the first terminal device, and the first terminal device can verify the stream verification information and the stream control information. The verification can be a comparison of whether the stream IDs and the stream passwords corresponding to the stream verification information and the stream control information are the same. If the stream IDs and the stream passwords are the same, the first terminal device can send a verification pass result to the proxy server. The first terminal device can send the verification pass result to the proxy server.

[0169] It can be understood that the verification result generated by the first terminal device is obtained by the first terminal device verifying the stream verification information and the stream control information when the first terminal device obtains the stream verification information sent by the proxy server. If the stream verification information and the stream control information are the same, the verification result is a verification pass result. By verifying the stream verification information and the stream control information by the first terminal device, it can be unnecessary to transmit the stream control information and the stream verification information to the background server for verification, and it can avoid exposing the stream control information in the network, thereby ensuring the privacy and security of the stream control information.

[0170] In step S205, an authentication request sent by the second terminal device is obtained, and the authentication request is forwarded to the background server. The verification result generated by the background server is obtained by the background server verifying the stream verification information and the stream control information according to the authentication request when the background server obtains the stream verification information sent by the second terminal device and the stream control information sent by the first terminal device. If the stream verification information and the stream control information are the same, the verification result is a verification pass result.

[0171] Specifically, if the network indicated by the first network connection state belongs to a public network type or the service information of the second terminal device is not detected in the network indicated by the first network connection state, the proxy server can send the proxy service information to the background server.

[0172] The second terminal device can send the stream verification information to the background server when the network indicated by the second network connection state belongs to a public network type or the waiting time length of the second terminal device obtaining the proxy service information reaches a waiting threshold. The waiting time length can be the time length of the second terminal device waiting for the proxy server to return the proxy service information from the broadcast message probe request. The waiting time length reaching the waiting threshold means that the network connected by the second terminal device is different from the network indicated by the first network connection state.

[0173] It can be understood that the service information of the second terminal device is not detected in the network indicated by the first network connection state, which means that the second terminal device does not broadcast a message probe request in the network indicated by the first network connection state, i.e., the network connected by the first terminal device is different from the network connected by the second terminal device, and the network indicated by the second network connection state can be a network belonging to a public network type. The second terminal device can send stream verification information to the background server when the waiting time reaches the waiting threshold.

[0174] After the background server obtains the stream verification information, the proxy service information can be sent to the second terminal device, and the authentication request sent by the second terminal device through the proxy service information can be obtained. The authentication request can be a request for checking the stream verification information and a request for serial service. The proxy server can forward the authentication request to the background server, and the background server can verify the stream verification information and the stream control information, which can be comparing whether the stream ID and the stream password corresponding to the stream verification information and the stream control information are the same. If the stream ID and the stream password are the same, the background server can send a verification pass result to the proxy server. The first terminal device can send the stream control information to the background server when starting the stream service component.

[0175] In step S206, the verification result is obtained. If the verification result is a verification pass result, a first connection relationship between the first terminal device and the proxy server is established through the network indicated by the first network connection state, a second connection relationship between the second terminal device and the proxy server is established through the network indicated by the second network connection state of the second terminal device, and the first connection relationship and the second connection relationship are determined as an indirect connection relationship.

[0176] Specifically, at this time, whether the proxy server obtains the verification result from the first terminal device or the background server, the verification result can be identified. If the verification result is a verification pass result, the proxy server can establish a first connection relationship corresponding to the first terminal device and a second connection relationship corresponding to the second terminal device based on the verification result, and the proxy server can determine the first connection relationship and the second connection relationship as an indirect connection relationship between the first terminal device and the second terminal device. The indirect connection relationship can mean a connection relationship between the first terminal device and the second terminal device through the proxy server for data forwarding. The first connection relationship and the second connection relationship can both be a transmission control connection relationship, for example, a TCP continuous data transmission relationship.

[0177] Step S207, the multimedia data for the service application sent by the first terminal device is acquired, the multimedia data is forwarded to the second terminal device through the indirect connection relationship, so that the second terminal device generates object control information based on the interactive operation of the object on the multimedia data; the object control information sent by the second terminal device is forwarded to the first terminal device through the indirect connection relationship, so that the first terminal device controls the service application in the first terminal device through the streaming service component based on the object control information.

[0178] Specifically, the first terminal device can run the service application in the streaming service component after the indirect connection relationship is successfully established. The first terminal device can start encoding and compressing to generate multimedia data for the service application, and send the multimedia data to the proxy server through the indirect connection relationship. The multimedia data can be a combination of various types of media information of the service application, and can include text data, image data, audio data, video data, etc.

[0179] The proxy server can forward the multimedia data to the second terminal device through the indirect connection relationship. The second terminal device can perform data analysis on the acquired multimedia data, perform picture rendering on the analyzed multimedia data, and display the picture and music of the service application corresponding to the multimedia data in the streaming service component of the second terminal device. The object can directly perform any interactive operation on the second terminal device. The object can perform interactive operation in the streaming service component based on the picture and music of the service application. The second terminal device can generate object control information based on the interactive operation of the object on the multimedia data, and send the object control information to the proxy server through the indirect connection relationship. The object control information can be a control instruction for the service application.

[0180] The proxy server can forward the object control information sent by the second terminal device to the first terminal device through the indirect connection relationship. The first terminal device can decode the object control information based on the object control information. The first terminal device can control the service application in the streaming service component through the decoded object control information, and execute the interactive operation corresponding to the object control information through the service application, thereby generating new multimedia data. The first terminal device can send the new multimedia data to the proxy server, and the proxy server forwards the new multimedia data to the second terminal device through the indirect connection relationship. The second terminal device can generate new object control information based on the new multimedia data, thereby realizing the streaming service between the first terminal device and the second terminal device.

[0181] Optionally, after the indirect connection relationship is established, the proxy server can perform network speed testing on the networks of the first terminal device and the second terminal device. The process can be: generating M test data packets, sending the M test data packets to the first terminal device based on the indirect connection relationship, determining first network test information for the first terminal device based on first sending time and first receiving time for the M test data packets; the first sending time refers to the time at which the proxy server sends the M test data packets to the first terminal device, and the first receiving time refers to the time at which the first terminal device returns the M test data packets to the proxy server; M is a positive integer; sending the M test data packets to the second terminal device based on the indirect connection relationship, determining second network test information for the second terminal device based on second sending time and second receiving time for the M test data packets; the second sending time refers to the time at which the proxy server sends the M test data packets to the second terminal device, and the second receiving time refers to the time at which the second terminal device returns the M test data packets to the proxy server; and adjusting a target network based on the first network test information and the second network test information; the target network includes a network to which the first terminal device is connected or a network to which the second terminal device is connected.

[0182] Specifically, the proxy server can generate M test data packets, the data sizes of the M test data packets can be different, and the proxy server can send the M test data packets to the first terminal device and the second terminal device based on the indirect connection relationship. The first terminal device can return the M test data packets to the proxy server after obtaining the M test data packets. The second terminal device can also return the M test data packets to the proxy server after obtaining the M test data packets.

[0183] The proxy server can determine first network test information for the first terminal device based on first sending time and first receiving time for the M test data packets. The first sending time refers to the time at which the proxy server sends the M test data packets to the first terminal device, and the first receiving time refers to the time at which the first terminal device returns the M test data packets to the proxy server. The proxy server can determine second network test information for the second terminal device based on second sending time and second receiving time for the M test data packets. The second sending time refers to the time at which the proxy server sends the M test data packets to the second terminal device, and the second receiving time refers to the time at which the second terminal device returns the M test data packets to the proxy server. The first network test information can include a transmission rate and a transmission delay of a network to which the first terminal device is connected, and the second network test information can include a transmission rate and a transmission delay of a network to which the second terminal device is connected.

[0184] The proxy server can adjust the network indicated by the first network connection state or the network indicated by the second network connection state based on the first network test information and the second network test information. The network indicated by the first network connection state or the network indicated by the second network connection state can also be referred to as a target network. The process of adjusting the network indicated by the first network connection state or the network indicated by the second network connection state can be: if the first network test information does not satisfy the network transmission condition set by the streaming service component for the service application, determining the network indicated by the first network connection state as the target network, and returning first network prompt information to the first terminal device; the first network prompt information is used to prompt the first terminal device to switch the connected target network to the network connected by the second terminal device; if the second network test information does not satisfy the network transmission condition set by the streaming service component for the service application, determining the network indicated by the second network connection state as the target network, and returning second network prompt information to the second terminal device; the second network prompt information is used to prompt the second terminal device to switch the connected target network to the network connected by the first terminal device.

[0185] Specifically, the streaming service component can preset a network transmission condition for the service application. The network transmission condition can include a transmission rate threshold and a transmission delay threshold of the first connection relationship. When the service application is a game application, the network transmission condition can require the first connection relationship to have a higher transmission rate and a lower transmission delay.

[0186] If the first network test information does not satisfy the network transmission condition set by the streaming service component for the service application, the proxy server can determine the network indicated by the first network connection state as the target network, and return the first network prompt information to the first terminal device. The first network prompt information is used to prompt the first terminal device to switch the connected target network to the network connected by the second terminal device, i.e., to prompt the object to switch the target network, so as to realize that the first terminal device and the second terminal device are connected to the same network.

[0187] It can be understood that after the object switches the target network, the networks connected by the first terminal device and the second terminal device are the same, and the network types of the networks connected by the first terminal device and the second terminal device are both local area networks. The proxy server stores service information of the first terminal device and service information of the second terminal device, and the second terminal device stores service information of the proxy server. The proxy server can directly establish a new indirect connection relationship based on the networks connected by the first terminal device and the second terminal device.

[0188] If the second network test information does not satisfy the network transmission condition set by the streaming service component for the service application, the network indicated by the second network connection state is determined as the target network, and second network prompt information is returned to the second terminal device. The second network prompt information is used to prompt the second terminal device to switch the connected target network to the network connected by the first terminal device, i.e., to prompt the object to switch the target network, so as to realize that the first terminal device and the second terminal device are connected to the same network.

[0189] Optionally, the object can adjust the target network based on the first network prompt information and the second network prompt information. After adjusting the target network, the proxy server can continue to perform network speed testing on the networks connected by the first terminal device and the second terminal device, and obtain new first network test information and new second network test information. If the new first network test information and the new second network test information obtained after adjusting the target network do not satisfy the network transmission condition, the proxy server can determine the data compression information of the indirect connection relationship based on the new first network test information and the new second network test information.

[0190] The proxy server sends the data compression information to the first terminal device. The data compression information can be a compression code rate of the multimedia data. The first terminal device can perform data compression on the multimedia data based on the data compression information. The data compression of the multimedia data satisfies the network transmission condition. The first terminal device can send the compressed multimedia data for the service application to the proxy server, so as to realize streaming service in the case of low network speed.

[0191] Optionally, the proxy server can obtain a load state of the proxy server. If the load state satisfies an overload transmission condition (which can be that the number of processed requests exceeds a preset threshold), the proxy server can send a load transmission request to the first terminal device. The first terminal device can split the encoded multimedia data into a first data packet and a second data packet based on the load transmission request, and send the first data packet to the proxy server. The proxy server forwards the first data packet sent by the first terminal device to the second terminal device through the indirect connection relationship.

[0192] The proxy server can send background service information of a background server to the first terminal device. The first terminal device can send the second data packet to the background server, and the background server sends the second data packet to the second terminal device. The first data packet and the second data packet are used to form the multimedia data in the second terminal device.

[0193] The embodiment of the present application obtains the first network connection state sent by the first terminal device through the proxy server, judges the network type of the network indicated by the first network connection state, if the network indicated by the first network connection state belongs to the local area network type, and the service information of the second terminal device is detected in the network indicated by the first network connection state, the streaming verification information is obtained based on the service information of the second terminal device, the streaming verification information is sent to the first terminal device, the verification result between the streaming verification information and the streaming control information is sent to the proxy server by the first terminal device, if the network indicated by the first network connection state belongs to the public network type, or the service information of the second terminal device is not detected in the network indicated by the first network connection state, the authentication request is initiated to the background server, when the streaming verification information sent by the second terminal device and the streaming control information sent by the first terminal device are obtained, the background server sends the verification result between the streaming verification information and the streaming control information to the proxy server according to the authentication request, when the verification result is the verification pass result, the proxy server establishes the indirect connection relationship for the streaming service between the first terminal device and the second terminal device based on the verification result, so that the indirect connection relationship can be established between the two terminal devices of any network type for the streaming service, the compatibility of the streaming service is improved, and the background server can be bypassed in the streaming service process, and the background server does not need to forward data in the indirect connection relationship, the network bandwidth is saved, and the network cost is reduced.

[0194] On the other hand, the embodiment of the present application broadcasts the message probe request by the second terminal device, the network detection is performed by the proxy server, the service information broadcasted by the second terminal device is obtained through the network detection, the background server can not need to perform any data processing in the whole streaming service process, the network bandwidth and the network cost of the data forwarding of the background server are further reduced, the technical threshold and the maintenance cost of the streaming service are reduced. The data compression information of the multimedia data sent by the first terminal device is determined through the network test, the streaming service can be performed in the case that the network rate is low. And the multimedia data is sent through the load balancing algorithm according to the load state of the proxy server, the feasibility of the embodiment of the present application is improved.

[0195] Please refer to Figure 1 , Figure 1 is a flow diagram of a data processing method provided by the embodiment of the present application Figure 2 , the data processing method is interacted by the second terminal device and the proxy server, the first terminal device. The first terminal device can be the first terminal device 200 as shown in Figure 2 , the second terminal device can be the first terminal device 200 as shown in Figure 2 , and the proxy server can be the proxy server 300 as shown in Figure 4The proxy server 100 is shown. The data processing method can include at least the following steps S301-S303:

[0196] In step S301, the second terminal device acquires a second network connection state and stream verification information. The stream verification information is account information input by a subject on the second terminal device.

[0197] Specifically, the subject (which can be a user or a player) can start a stream service component on the first terminal device. After the stream service component is started, the stream control information can be read in the storage space corresponding to the first terminal device. The stream control information can be information registered and generated by the subject when the stream service component is started for the first time. The first terminal device can send the first network connection state to the proxy server.

[0198] The stream service component can be a software or an application program for establishing an indirect connection relationship for stream service. The indirect connection relationship can be a transmission control connection relationship, for example, a TCP continuous data transmission relationship. The stream control information is account information acquired by the first terminal device when the stream service component is started. The stream control information can include a stream ID (account number) and a stream password. The first network connection state can indicate the network to which the first terminal device is connected and the network type of the network to which the first terminal device is connected. The network type can include a local area network type and a public network type.

[0199] It can be understood that when the subject registers or generates the stream control information, the subject can input the network broadcast service information corresponding to the local area network stream and the service information of the second terminal device, and send the network broadcast service information and the service information of the second terminal device to the proxy server. For example, the network broadcast service information can be the management account and password of the network indicated by the first network connection state, and the service information of the second terminal device can include a port number, an address, etc.

[0200] The subject can start the stream service component in the second terminal device and input the stream verification information. The stream verification information can be account information input by the subject on the stream service component of the second terminal device, for example, a stream ID (account number) and a stream password of a device that performs stream service with the second terminal device. The stream service component can directly acquire the second network connection state of the subject of the second terminal device. For details, see Figure 4 , Figure 6 is a data processing scene diagram provided by an embodiment of the present application, as Figure 6As shown, the second terminal device can create a network selection window 301 in the streaming connection component, and in response to the object's network selection operation in the network selection window, obtain the second network connection state of the second terminal device based on the object's network selection operation. When the object selects "public network streaming", the second terminal device can determine that the network type of the network indicated by the second network connection state is a public network type. When the object selects "local area network streaming", the second terminal device can determine that the network type of the network indicated by the second network connection state is a local area network type.

[0201] When the object selects "local area network streaming", but the network to which the second terminal device is connected is a public network, the second terminal device can automatically disconnect the public network connection and automatically connect to a connectable local area network. Similarly, when the object selects "public network streaming", but the network to which the second terminal device is connected is a local area network, the second terminal device can automatically disconnect the local area network connection and automatically connect to a public network.

[0202] The second terminal device can create an account information verification window 302, and in response to the object's account input operation in the account information verification window, obtain the streaming verification information input by the object. The streaming verification information can include a streaming ID (account number) and a streaming password.

[0203] In step S302, if the network indicated by the second network connection state belongs to the local area network type, a message probe request carrying service information of the second terminal device is broadcasted in the network indicated by the second network connection state, so that when the proxy server detects the service information of the second terminal device in the network indicated by the first network connection state of the first terminal device, the proxy server obtains the streaming verification information based on the service information of the second terminal device, and sends the streaming verification information to the first terminal device. The first terminal device is configured to send a verification result between the streaming verification information and streaming control information to the proxy server, and the streaming control information is account information obtained by the first terminal device when starting the streaming service component.

[0204] Specifically, the second terminal device can determine the network type of the network indicated by the second network connection state, so as to determine the streaming connection mode of different network states. The network type can include a public network type and a local area network type.

[0205] If the network indicated by the second network connection state belongs to the local area network type, the second terminal device can broadcast a message probe request in the network indicated by the second network connection state. The message probe request can carry service information of the second terminal device. When the proxy server detects the message probe request sent by the second terminal device, the proxy server can send proxy service information of the proxy server to the second terminal device. The network detection process can be referred to the above description. Figure 4 The specific description of step S202 of the corresponding embodiment is not repeated here.

[0206] The proxy server can send proxy server information (which can include a port number, address, etc. of the proxy server) to the second terminal device based on the service information of the second terminal device when the proxy server detects the service information of the second terminal device in the network indicated by the first network connection state of the first terminal device. The second terminal device can send the stream verification information corresponding to the second terminal device to the proxy server based on the proxy service information.

[0207] The proxy server can obtain the stream verification information, and obtain a verification result based on the stream verification information. The process of obtaining the verification result can be referred to the above Figure 1 For specific descriptions of steps S203 to S204 of the corresponding embodiments, the embodiments of the present application will not be described here.

[0208] In step S303, if the network indicated by the second network connection state belongs to a public network type, or the proxy server does not detect the service information of the second terminal device in the network indicated by the first network connection state, the stream verification information is sent to the background server, so that the background server sends the proxy service information of the proxy server to the second terminal device when obtaining the proxy service information sent by the proxy server. The proxy service information is used to instruct the second terminal device to send an authentication request to the proxy server. The authentication request is used to instruct the proxy server to obtain a verification result between the stream verification information and stream control information from the background server based on the authentication request, and the stream control information is sent by the first terminal to the background server.

[0209] Specifically, if the network indicated by the first network connection state belongs to a public network type, or the service information of the second terminal device is not detected in the network indicated by the first network connection state, the proxy server can send the proxy service information to the background server.

[0210] The second terminal device can send the stream verification information to the background server when the network indicated by the second network connection state belongs to a public network type, or the waiting time length of the second terminal device for obtaining the proxy service information reaches a waiting threshold. The waiting time length can be the time length for the second terminal device to wait for the proxy server 100 to return the proxy service information from the broadcast message probe request. When the waiting time length reaches the waiting threshold, it means that the network connected by the second terminal device is different from the network indicated by the first network connection state.

[0211] It can be understood that the service information of the second terminal device is not detected in the network indicated by the first network connection state, which means that the second terminal device does not broadcast a message probe request in the network indicated by the first network connection state, i.e., the network connected by the first terminal device is different from the network connected by the second terminal device, and the network indicated by the second network connection state can be a network belonging to a public network type. The second terminal device can send the stream verification information to the background server when the waiting time reaches the waiting threshold.

[0212] After the background server obtains the stream verification information, the proxy service information can be sent to the second terminal device, and the authentication request sent by the second terminal device through the proxy service information is obtained. The authentication request can be a request for checking the stream verification information and performing the stream service. The proxy server can forward the authentication request to the background server, and the background server can verify the stream verification information and the stream control information, which can be comparing whether the stream ID and the stream password corresponding to the stream verification information and the stream control information are the same. If the stream ID and the stream password are the same, the background server can send a verification pass result to the proxy server. The first terminal device can send the stream control information to the background server when starting the stream service component.

[0213] The second terminal device can perform stream service based on the indirect connection relationship. The process can be: obtaining the multimedia data for the business application sent by the first terminal device through the indirect connection relationship, generating object control information based on the interactive operation of the object on the multimedia data, and sending the object control information to the first terminal device; the object control information is used to control the business application in the first terminal device through the stream service component.

[0214] Specifically, the first terminal device can run the business application in the stream service component after the indirect connection relationship is successfully established. The first terminal device can start to encode and compress to generate multimedia data for the business application, and send the multimedia data to the proxy server through the indirect connection relationship. The multimedia data can be a combination of various types of media information of the business application, which can include text data, image data, audio data, video data, etc.

[0215] The proxy server can forward the multimedia data to the second terminal device through the indirect connection relationship. The second terminal device can perform data analysis on the acquired multimedia data, perform picture rendering on the analyzed multimedia data, and display the picture and music of the service application corresponding to the multimedia data in the streaming service component of the second terminal device. The object can directly perform any interactive operation on the second terminal device. The object can perform the interactive operation in the streaming service component based on the picture and music of the service application. The second terminal device can generate object control information based on the interactive operation of the object on the multimedia data, and send the object control information to the proxy server through the indirect connection relationship. The object control information can be a control instruction for the service application.

[0216] The proxy server can forward the object control information sent by the second terminal device to the first terminal device through the indirect connection relationship. The first terminal device can decode the object control information based on the object control information. The first terminal device can control the service application in the streaming service component through the decoded object control information, execute the interactive operation corresponding to the object control information through the service application, and generate new multimedia data. The first terminal device can send the new multimedia data to the proxy server. The proxy server forwards the new multimedia data to the second terminal device through the indirect connection relationship. The second terminal device can generate new object control information based on the new multimedia data, thereby realizing the streaming service between the first terminal device and the second terminal device.

[0217] Optionally, the second terminal device can acquire the first network connection state of the first terminal device based on the indirect connection relationship. If the network type of the network indicated by the first network connection state is different from the network type of the network indicated by the second network connection state, the second network prompt information is displayed in the streaming connection component. The second network prompt information can be used to prompt the second terminal device to switch the connected network to the network connected by the first terminal device, that is, to prompt the object to switch the network connected by the second terminal device, so as to realize that the first terminal device and the second terminal device are connected to the same network.

[0218] The embodiment of the present application obtains the first network connection state sent by the first terminal device through the proxy server, judges the network type of the network indicated by the first network connection state, if the network indicated by the first network connection state belongs to the local area network type, and the service information of the second terminal device is detected in the network indicated by the first network connection state, the streaming verification information is obtained based on the service information of the second terminal device, the streaming verification information is sent to the first terminal device, the verification result between the streaming verification information and the streaming control information is sent to the proxy server by the first terminal device, if the network indicated by the first network connection state belongs to the public network type, or the service information of the second terminal device is not detected in the network indicated by the first network connection state, the authentication request is initiated to the background server, when the streaming verification information sent by the second terminal device and the streaming control information sent by the first terminal device are obtained, the background server sends the verification result between the streaming verification information and the streaming control information to the proxy server according to the authentication request, when the verification result is the verification pass result, the proxy server establishes the indirect connection relationship for the streaming service between the first terminal device and the second terminal device based on the verification result, so that the indirect connection relationship can be established between the two terminal devices of any network type for the streaming service, the compatibility of the streaming service is improved, and the background server can be bypassed in the streaming service process, and the background server does not need to forward data in the indirect connection relationship, the network bandwidth is saved, and the network cost is reduced.

[0219] On the other hand, the embodiment of the present application broadcasts the message detection request by the second terminal device, and the network detection is performed by the proxy server, the service information of the second terminal device is sniffed through the broadcast, so that the background server does not need to perform any data processing in the whole streaming service process, the network bandwidth and the network cost of the data forwarding of the background server are further reduced, the technical threshold and the maintenance cost of the streaming service are reduced. The data compression information of the multimedia data sent by the first terminal device is determined through the network test, so that the streaming service can be performed in the case that the network rate is low. And the multimedia data is sent through the load balancing algorithm according to the load state of the proxy server, so that the feasibility of the embodiment of the present application is improved.

[0220] Please refer to Figure 1 , Figure 1 is a flow diagram of a data processing method provided by the embodiment of the present application Figure 4 , the data processing method flow can be the data processing flow of the first terminal device, the second terminal device and the proxy server when the networks connected by the first terminal device and the second terminal device are the same, the first terminal device can be the first terminal device 200 as shown in Figure 4 , and the second terminal device can be the second terminal device 200 as shown in Figure 4The first terminal device 200 shown, the proxy server can be as Figure 7 The proxy server 100 shown. The following will be taken as an example of the data processing method executed by the computer device. The data processing method can at least include the following steps S401-S413:

[0221] Step S401, the first terminal device acquires the first network connection state;

[0222] Step S402, the first terminal equipment sends the first network connection state to the proxy server;

[0223] Specifically, the first terminal device can acquire the first network connection state, and send the first network connection state to the proxy server. The process can refer to the specific description of step S201 of the above Figure 7 The specific description of step S201 of the corresponding embodiment, the embodiments of the application will not be repeated here.

[0224] Step S403, the proxy server performs LAN detection;

[0225] Specifically, after the proxy server acquires the first network connection state sent by the first terminal device, the first network connection state of the first terminal device is judged, so as to determine the stream connection mode of different network states. If the network indicated by the first network connection state belongs to the LAN type, the proxy server can acquire the network broadcast service information of the target network, and the proxy server can start the scanning event for the network indicated by the first network connection state based on the network broadcast service information.

[0226] Step S404, the proxy server returns the confirmation information to the first terminal device;

[0227] Step S405, the first terminal device displays the stream interface in the stream service component;

[0228] Specifically, the proxy server can first return the confirmation information of successfully acquiring the first network connection state to the first terminal device. The first terminal device can display the stream interface in the stream service component after acquiring the confirmation information of the proxy server. The stream interface can be a loading interface waiting for the second terminal device to establish an indirect connection relationship.

[0229] Step S406, the second terminal device broadcasts message probe request;

[0230] Step S407, the proxy server returns the proxy service information to the second terminal device;

[0231] Step S408, the second terminal device acquires the stream verification information;

[0232] Specifically, the object can start the streaming service component in the second terminal device, input the streaming authentication information, which can be the account information input by the object on the streaming service component of the second terminal device, for example, can be the streaming ID (account number) and the streaming password of the device performing the streaming service with the second terminal device. If the network indicated by the second network connection state is a local area network type, the second terminal device can broadcast a message probe request in the network indicated by the second network connection state after the streaming service component is started, and the message probe request can carry the service information of the second terminal device.

[0233] In step S409, the second terminal device sends the streaming authentication information to the proxy server.

[0234] Specifically, when the proxy server detects the message probe request sent by the second terminal device, the proxy service information of the proxy server can be sent to the second terminal device. The network detection process can be referred to the above description Figure 5 For the specific description of step S202 of the corresponding embodiment, the embodiments of the present application will not be repeated here.

[0235] The second terminal device can send the streaming authentication information corresponding to the second terminal device to the proxy server based on the proxy service information. For example, the second terminal device can connect to the proxy server according to the IP address and the port of the proxy server through the socket (socket), and send the streaming ID (account number) and the streaming password of the second terminal device to the proxy server.

[0236] In step S410, the proxy server sends an authentication request to the first terminal device.

[0237] In step S411, the first terminal device returns the verification result to the proxy server.

[0238] Specifically, the proxy server can send an authentication request to the first terminal device, and the first terminal device can perform account verification on the streaming control information and the streaming authentication information. If the streaming authentication information and the streaming control information are the same, it is determined that the verification result between the streaming authentication information and the streaming control information is a verification pass result. The first terminal device can send the verification pass result to the proxy server. For example, the proxy server can apply for verification to the first terminal device, and the first terminal device can judge whether the streaming ID and the password are correct. If correct, the first terminal device returns the verification pass result to the proxy server.

[0239] In step S412, the proxy server establishes a first connection relationship between the proxy server and the first terminal device.

[0240] In step S413, the proxy server establishes a second connection relationship between the proxy server and the second terminal device.

[0241] Specifically, see the above Figure 1 For specific description of step S207 of the corresponding embodiment, the embodiment of the present application will not be repeated here.

[0242] The embodiment of the present application obtains the first network connection state sent by the first terminal device through the proxy server, judges the network type of the network indicated by the first network connection state, if the network indicated by the first network connection state belongs to the local area network type, and the service information of the second terminal device is detected in the network indicated by the first network connection state, the streaming verification information is obtained based on the service information of the second terminal device, the streaming verification information is sent to the first terminal device, the verification result between the streaming verification information and the streaming control information is sent to the proxy server by the first terminal device, if the network indicated by the first network connection state belongs to the public network type, or the service information of the second terminal device is not detected in the network indicated by the first network connection state, an authentication request is initiated to the background server, when the streaming verification information sent by the second terminal device and the streaming control information sent by the first terminal device are obtained, the background server sends the verification result between the streaming verification information and the streaming control information to the proxy server according to the authentication request, when the verification result is a verification pass result, the proxy server establishes an indirect connection relationship for streaming service between the first terminal device and the second terminal device based on the verification result, so that the indirect connection relationship can be established between two terminal devices of any network type for streaming service, the compatibility of implementing streaming service is improved, and the background server can be bypassed in the streaming service process, without the background server performing data forwarding in the indirect connection relationship, the network bandwidth is saved, and the network cost is reduced.

[0243] On the other hand, the embodiment of the present application broadcasts a message probe request through the second terminal device, and the network detection is performed by the proxy server, by sniffing the service information of the second terminal device through broadcasting, the background server can not need to perform any data processing in the whole streaming service process, further reducing the network bandwidth and network cost of the background server for data forwarding, reducing the technical threshold and maintenance cost of streaming service. By network testing, the data compression information of the multimedia data sent by the first terminal device can be determined, so that streaming service can be performed in the case of low network rate. And through the load state of the proxy server, the multimedia data is sent through the load balancing algorithm, improving the feasibility of the embodiment of the present application.

[0244] See Figure 1 , Figure 1 is a flowchart of a data processing method provided by the embodiment of the present application Figure 1The data processing method can be a data processing flow of the first terminal device, the second terminal device, the proxy server and the background server when the first terminal device and the second terminal device are connected to different networks or the first terminal device and the second terminal device are connected to public networks. The first terminal device can be the first terminal device 200 as shown in Figure 4 , the second terminal device can be the first terminal device 200 as shown in Figure 4 , the proxy server can be the proxy server 100 as shown in Figure 8 , and the background server can be the background server 400 as shown in Figure 8 . The following will be described by taking an example of the data processing method executed by a computer device. The data processing method can at least include the following steps S501-S517:

[0245] Step S501, the first terminal device acquires a first network connection state;

[0246] Step S502, the first terminal device sends the first network connection state to the proxy server;

[0247] Specifically, the first terminal device can acquire the first network connection state and send the first network connection state to the proxy server. The process can refer to the specific description of step S201 of the above-mentioned Figure 1 corresponding embodiment, which will not be described here.

[0248] Step S503, the first terminal device sends stream control information to the background server;

[0249] Step S504, the proxy server sends proxy service information to the background server;

[0250] Step S505, the background server records;

[0251] Specifically, the first terminal device can send the stream control information to the background server. If the network indicated by the first network connection state belongs to a public network or the service information of the second terminal device is not detected in the network indicated by the first network connection state, the proxy server can send the proxy service information to the background server. The stream control information and the proxy service information are recorded by the background server.

[0252] Step S506, return the confirmation information to the proxy server;

[0253] Step S507, return the confirmation information to the first terminal device;

[0254] Step S508, display the stream interface;

[0255] Specifically, the proxy server can return confirmation information to the first terminal device that the stream control information is successfully acquired, and return confirmation information to the proxy server that the proxy service information is successfully acquired. The first terminal device can display a stream interface in the stream service component after acquiring the confirmation information of the proxy server, and the stream interface can be a loading interface waiting for the second terminal device to establish an indirect connection relationship.

[0256] Step S509, the second terminal device acquires stream verification information;

[0257] Step S510, the second terminal device sends the stream verification information to the background server;

[0258] Specifically, the object can start the stream service component in the second terminal device, input the stream verification information, and the stream verification information can be the account information input by the object on the stream service component of the second terminal device, for example, the stream ID (account number) and the stream password of the device performing the stream service with the second terminal device. The stream service component can directly acquire the second network connection state of the second terminal device object. After the stream service component is started, the second terminal device can broadcast a message probe request in the network indicated by the second network connection state, and the message probe request can carry the service information of the second terminal device.

[0259] The second terminal device can send the stream verification information to the background server when the network indicated by the second network connection state belongs to a public network type, or when the waiting time of the second terminal device acquiring the proxy service information reaches a waiting threshold. The waiting time can be the time length of the second terminal device waiting for the proxy server 100 to return the proxy service information from the broadcast message probe request. When the waiting time reaches the waiting threshold, it means that the network connected by the second terminal device is different from the network indicated by the first network connection state.

[0260] Step S511, the background server reads the proxy service information;

[0261] Step S512, the background server returns the proxy service information to the second terminal device;

[0262] Specifically, the background server can read the proxy service information after acquiring the stream verification information sent by the second terminal device, and send the proxy service information to the second terminal device.

[0263] Step S513, the second terminal device initiates an authentication request to the proxy server;

[0264] Step S514, the proxy server forwards the authentication request to the background server;

[0265] Specifically, the second terminal device can initiate an authentication request to the proxy server based on the proxy service information, and the proxy server can forward the authentication request to the background server.

[0266] In step S515, the background server returns the verification result to the proxy server.

[0267] Specifically, the background server can perform account verification on the stream verification information and the stream control information, and if the stream verification information and the stream control information are the same, it is determined that the verification result between the stream verification information and the stream control information is a verification pass result.

[0268] In step S516, the proxy server establishes a first connection relationship between the proxy server and the first terminal device.

[0269] In step S517, the proxy server establishes a second connection relationship between the proxy server and the second terminal device.

[0270] Specifically, reference can be made to the above Figure 8 For the specific description of step S207 of the corresponding embodiment, the embodiments of the present application will not be repeated here.

[0271] The embodiments of the present application obtain the first network connection state sent by the first terminal device through the proxy server, judge the network type of the network indicated by the first network connection state, if the network indicated by the first network connection state belongs to a local area network type, and the service information of the second terminal device is detected in the network indicated by the first network connection state, obtain the stream verification information based on the service information of the second terminal device, send the stream verification information to the first terminal device, send the verification result between the stream verification information and the stream control information to the proxy server by the first terminal device, if the network indicated by the first network connection state belongs to a public network type, or the service information of the second terminal device is not detected in the network indicated by the first network connection state, initiate an authentication request to the background server, and when the background server obtains the stream verification information sent by the second terminal device and the stream control information sent by the first terminal device, send the verification result between the stream verification information and the stream control information to the proxy server according to the authentication request, when the verification result is a verification pass result, the proxy server establishes an indirect connection relationship for stream service between the first terminal device and the second terminal device based on the verification result, so that an indirect connection relationship can be established between two terminal devices of any network type for stream service, improving the compatibility of implementing stream service, and bypassing the background server in the stream service process, without the background server forwarding data in the indirect connection relationship, saving network bandwidth and reducing network cost.

[0272] In another aspect, the embodiment of the present application broadcasts a message detection request by the second terminal device, and the proxy server performs network detection, and the service information of the second terminal device is sniffed by broadcasting, so that the background server does not need to perform any data processing in the entire streaming service process, further reducing the network bandwidth and network cost of the background server for data forwarding, and reducing the technical threshold and maintenance cost of the streaming service. By network testing, the data compression information of the multimedia data sent by the first terminal device is determined, so that the streaming service can be performed in the case of low network rate. And through the load state of the proxy server, the multimedia data is sent by the load balancing algorithm, which improves the feasibility of the embodiment of the present application.

[0273] Please refer to Figure 9 , Figure 9 is a structure schematic diagram of a data processing device provided by the embodiment of the present application Figure 2 . As Figure 9 shown, the data processing device 1 comprises a state acquisition module 810, a local area network streaming module 820 and a public network streaming module 830.

[0274] The state acquisition module 810 is configured to acquire, by the proxy server, a first network connection state of a first terminal device.

[0275] The local area network streaming module 820 is configured to, if the network indicated by the first network connection state belongs to a local area network type and the service information of the second terminal device is detected in the network indicated by the first network connection state, acquire streaming verification information based on the service information of the second terminal device, and send the streaming verification information to the first terminal device, so that the first terminal device sends a verification result between the streaming verification information and streaming control information to the proxy server; the streaming verification information is account information input by an object on the second terminal device; the streaming control information is account information acquired by the first terminal device when starting a streaming service component.

[0276] The public network streaming module 830 is configured to, if the network indicated by the first network connection state belongs to a public network type or the service information of the second terminal device is not detected in the network indicated by the first network connection state, initiate an authentication request to the background server, so that the background server sends a verification result between the streaming verification information and the streaming control information to the proxy server according to the authentication request when the streaming verification information sent by the second terminal device and the streaming control information sent by the first terminal device are acquired.

[0277] If the verification result is a verification pass result, the verification result is used to instruct the proxy server to establish an indirect connection relationship for streaming service between the first terminal device and the second terminal device; the indirect connection relationship refers to a connection relationship of data forwarding between the second terminal device and the first terminal device through the proxy server.

[0278] In a possible implementation, the state obtaining module 810 is further configured to perform the following operation:

[0279] obtain the multimedia data sent by the first terminal device for the service application, and forward the multimedia data to the second terminal device through the indirect connection relationship, so that the second terminal device generates object control information based on the interactive operation of the object on the multimedia data;

[0280] forward the object control information sent by the second terminal device to the first terminal device through the indirect connection relationship, so that the first terminal device controls the service application in the first terminal device based on the object control information through the streaming service component.

[0281] In a possible implementation, the state obtaining module 810 is further configured to perform the following operation:

[0282] determine the network indicated by the first network connection state as a target network, obtain network broadcast service information of the target network, perform service information detection on a data request sent by a terminal device under the target network based on the network broadcast service information, and if the data request with the service information of the second terminal device is detected in the target network, determine that the service information of the second terminal device is detected in the network indicated by the first network connection state.

[0283] In a possible implementation, when the LAN streaming module 820 is used for obtaining the streaming verification information based on the service information of the second terminal device, the LAN streaming module 820 is specifically configured to perform the following operation:

[0284] based on the service information of the second terminal device, send the proxy service information of the proxy server to the second terminal device;

[0285] obtain the streaming verification information sent by the second terminal device through the proxy service information.

[0286] In a possible implementation, the verification result generated by the first terminal device is obtained by verifying the streaming verification information and the streaming control information by the first terminal device when the streaming verification information sent by the proxy server is obtained; if the streaming verification information and the streaming control information are the same, the verification result is a verification pass result.

[0287] In a possible implementation, when the public network streaming module 830 is used for initiating an authentication request to the background server, the public network streaming module 830 is specifically configured to perform the following operation:

[0288] The authentication request sent by the second terminal device is acquired, and the authentication request is forwarded to the background server; wherein the verification result generated by the background server is obtained by the background server when the stream verification information sent by the second terminal device and the stream control information sent by the first terminal device are acquired, and the stream verification information and the stream control information are verified according to the authentication request; if the stream verification information and the stream control information are the same, the verification result is a verification pass result.

[0289] In a possible implementation, the public network stream module 830 is configured to acquire the authentication request sent by the second terminal device, and specifically configured to perform the following operations:

[0290] The proxy service information is sent to the background server, so that the background server sends the proxy service information to the second terminal device when the stream verification information sent by the second terminal device is acquired;

[0291] The authentication request sent by the second terminal device through the proxy service information is acquired.

[0292] In a possible implementation, the state acquisition module 810 is further configured to perform the following operations:

[0293] The verification result is acquired;

[0294] If the verification result is a verification pass result, the first connection relationship between the first terminal device and the proxy server is established through the network indicated by the first network connection state, the second connection relationship between the second terminal device and the proxy server is established through the network indicated by the second network connection state of the second terminal device, and the first connection relationship and the second connection relationship are determined as an indirect connection relationship.

[0295] In a possible implementation, the multimedia data includes a first data packet and a second data packet, and the state acquisition module 810 is further configured to perform the following operations:

[0296] The load state of the proxy server is acquired, and if the load state meets the overload transmission condition, the first data packet sent by the first terminal device is forwarded to the second terminal device based on the proxy server;

[0297] The background service information of the background server is sent to the first terminal device, so that the second data packet is sent to the background server by the first terminal device; the second data packet is used to be forwarded to the second terminal device through the background server; the first data packet and the second data packet are used to form multimedia data in the second terminal device.

[0298] In a possible implementation, the state acquisition module 810 is further configured to perform the following operations:

[0299] M test data packets are generated, the M test data packets are sent to the first terminal device based on the indirect connection relationship, and first network test information for the first terminal device is determined based on first sending time and first receiving time for the M test data packets; the first sending time refers to time at which the proxy server sends the M test data packets to the first terminal device, and the first receiving time refers to time at which the first terminal device returns the M test data packets to the proxy server; M is a positive integer;

[0300] The M test data packets are sent to the second terminal device based on the indirect connection relationship, and second network test information for the second terminal device is determined based on second sending time and second receiving time for the M test data packets; the second sending time refers to time at which the proxy server sends the M test data packets to the second terminal device, and the second receiving time refers to time at which the second terminal device returns the M test data packets to the proxy server;

[0301] The target network is adjusted based on the first network test information and the second network test information; the target network includes a network to which the first terminal device is connected or a network to which the second terminal device is connected.

[0302] In a possible implementation, the state obtaining module 810 is configured to, when the target network is adjusted based on the first network test information and the second network test information, perform the following operations:

[0303] If the first network test information does not satisfy a network transmission condition set by the streaming service component for the service application, the network to which the first terminal device is connected is determined as the target network, and first network prompt information is returned to the first terminal device; the first network prompt information is used to prompt the first terminal device to switch the connected target network to the network to which the second terminal device is connected;

[0304] If the second network test information does not satisfy the network transmission condition set by the streaming service component for the service application, the network to which the second terminal device is connected is determined as the target network, and second network prompt information is returned to the second terminal device; the second network prompt information is used to prompt the second terminal device to switch the connected target network to the network to which the first terminal device is connected.

[0305] In a possible implementation, the indirect connection relationship is used to send multimedia data of the service application of the first terminal device to the second terminal device, and the state obtaining module 810 is further configured to perform the following operations:

[0306] If the new first network test information and the new second network test information after adjusting the target network do not satisfy the network transmission condition, data compression information of the indirect connection relationship is determined based on the new first network test information and the new second network test information, the data compression information is sent to the first terminal device, and compressed multimedia data for the service application sent by the first terminal device is received; the compressed multimedia data is obtained by data compression of the multimedia data by the first terminal device based on the data compression information.

[0307] The embodiment of the present application obtains the stream control information sent by the first terminal device and the first network connection state through the proxy server, obtains the stream verification information corresponding to the second terminal device and the second network connection state through the proxy server, and selects different stream modes by distinguishing the network connection states corresponding to the first terminal device and the second terminal device, thereby realizing stream service in different network types. When the verification result between the stream verification information and the stream control information obtained through the proxy server is a verification pass result, the indirect connection relationship between the first terminal device and the second terminal device for data forwarding by the proxy server can be established based on the first network connection state and the second network connection state, the background server can be bypassed, the background server does not need to perform data forwarding in the indirect connection relationship, stream service of any two terminal devices and any network type can be realized, and network bandwidth is saved and network cost is reduced.

[0308] On the other hand, the embodiment of the present application broadcasts a message probe request through the second terminal device, and performs network detection through the proxy server. By sniffing the service information of the second terminal device through broadcasting, the background server does not need to perform any data processing in the entire stream service process, further reducing the network bandwidth and network cost of data forwarding by the background server, reducing the technical threshold and maintenance cost of stream service. The data compression information of the multimedia data sent by the first terminal device is determined through network test, and stream service can be realized in the case of low network rate. And through the load state of the proxy server, the multimedia data is sent through the load balancing algorithm, improving the feasibility of the embodiment of the present application.

[0309] In the embodiment of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program with a predetermined function, and works together with other related parts to achieve a predetermined target, and can be implemented entirely or partially by using software, hardware (such as a processing circuit or a memory) or a combination thereof. Similarly, one processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be a part of an overall module or unit that includes the functions of the module or unit.

[0310] Please refer toFigure 10 , Figure 10 is a structural schematic of a data processing device provided by an embodiment of the present application Figure 10 . As shown in Figure 10 , the data processing device 2 comprises a verification obtaining module 910, a local network processing module 920 and a public network processing module 930.

[0311] The verification obtaining module 910 is configured to obtain, by the second terminal device, a second network connection state and stream verification information; the stream verification information is account information input by an object on the second terminal device.

[0312] The local network processing module 920 is configured to, if the network indicated by the second network connection state belongs to a local network type, broadcast a message probe request carrying service information of the second terminal device in the network indicated by the second network connection state, so that, when the proxy server detects the service information of the second terminal device in the network indicated by the first network connection state of the first terminal device, the proxy server obtains the stream verification information based on the service information of the second terminal device, and sends the stream verification information to the first terminal device; the first terminal device is configured to send a verification result between the stream verification information and stream control information to the proxy server, the stream control information being account information obtained by the first terminal device when starting a stream service component.

[0313] The public network processing module 930 is configured to, if the network indicated by the second network connection state belongs to a public network type, or the proxy server does not detect the service information of the second terminal device in the network indicated by the first network connection state, send the stream verification information to a background server, so that, when the background server obtains the proxy service information sent by the proxy server, the background server sends the proxy service information of the proxy server to the second terminal device; the proxy service information is used to instruct the second terminal device to send an authentication request to the proxy server; the authentication request is used to instruct the proxy server to obtain a verification result between the stream verification information and the stream control information from the background server based on the authentication request, the stream control information being sent by the first terminal to the background server.

[0314] If the verification result is a verification pass result, the verification result is used to instruct the proxy server to establish an indirect connection relationship for the stream service between the first terminal device and the second terminal device; the indirect connection relationship refers to a connection relationship in which data is forwarded between the second terminal device and the first terminal device through the proxy server.

[0315] In a possible implementation manner, the verification obtaining module 910 is further configured to perform the following operations:

[0316] The multimedia data sent by the first terminal device for the service application is acquired through the indirect connection relationship, the object manipulation information is generated based on the interactive operation of the object on the multimedia data, and the object manipulation information is sent to the first terminal device; the object manipulation information is used to control the service application in the first terminal device through the streaming service component.

[0317] In a possible implementation, the verification obtaining module 910 is configured to, when the second terminal device obtains the second network connection state of the second terminal device and the streaming verification information, specifically perform the following operations:

[0318] The network selection window is created in the streaming service component, and the second network connection state of the second terminal device is obtained in response to the network selection operation of the object on the network selection window.

[0319] The account information verification window is created, and the streaming verification information input by the object is obtained in response to the account input operation of the object on the account information verification window.

[0320] In a possible implementation, the verification obtaining module 910 is further configured to perform the following operations:

[0321] The first network connection state of the first terminal device is obtained based on the indirect connection relationship, and if the network type of the network indicated by the first network connection state is different from the network type of the network indicated by the second network connection state, the second network prompt information is displayed in the streaming connection component; the second network prompt information is used to prompt the second terminal device to switch the connected network to the network connected by the first terminal device.

[0322] The embodiments of the present application obtain the streaming manipulation information and the first network connection state of the first terminal device through the proxy server, obtain the streaming verification information and the second network connection state of the second terminal device through the proxy server, can select different streaming modes by distinguishing the network connection states corresponding to the first terminal device and the second terminal device respectively, and thus realize streaming service in different network types. When the verification result between the streaming verification information and the streaming manipulation information obtained by the proxy server is a verification pass result, the indirect connection relationship between the first terminal device and the second terminal device for data forwarding by the proxy server can be established based on the first network connection state and the second network connection state, the background server can be bypassed, the background server does not need to perform data forwarding in the indirect connection relationship, streaming service of any two terminal devices and any network type can be realized, and network bandwidth is saved and network cost is reduced.

[0323] In another aspect, the embodiment of the present application broadcasts a message detection request by the second terminal device, and the network detection is performed by the proxy server. The service information of the second terminal device is sniffed by broadcasting, so that the background server does not need to perform any data processing in the entire streaming service process, and the network bandwidth and network cost of the background server for data forwarding are further reduced, and the technical threshold and maintenance cost of the streaming service are reduced. The data compression information of the multimedia data sent by the first terminal device is determined through network testing, so that the streaming service can be performed in the case of low network rate. And through the load state of the proxy server, the multimedia data is sent through the load balancing algorithm, which improves the feasibility of the embodiment of the present application.

[0324] In the embodiment of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program with a predetermined function, and works together with other related parts to achieve a predetermined target, and can be implemented entirely or partially by using software, hardware (such as a processing circuit or a memory) or a combination thereof. Similarly, one processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be a part of an overall module or unit that includes the functions of the module or unit.

[0325] Please refer to Figure 10 , Figure 3 is a structural schematic diagram of a computer device provided by the embodiment of the present application. As Figure 4 shown, the computer device 1000 can include a processor 1001, a network interface 1004 and a memory 1005, in addition, the above-mentioned computer device 1000 can further include a user interface 1003, and at least one communication bus 1002. Wherein, the communication bus 1002 is used to realize the connection communication between these components. Wherein, the user interface 1003 can include a display (Display), a keyboard (Keyboard), and the optional user interface 1003 can further include a standard wired interface, a wireless interface. The network interface 1004 can optionally include a standard wired interface, a wireless interface (such as a WI-FI interface). The memory 1005 can be a high-speed RAM memory, or a non-volatile memory, for example, at least one disk storage. The memory 1005 can optionally be at least one storage device located away from the aforementioned processor 1001. As Figure 5 shown, the memory 1005 as a computer readable storage medium can include an operating system, a network communication module, a user interface module and a device control application program.

[0326] As Figure 6In the computer device 1000 shown, the network interface 1004 can provide a network communication element; the user interface 1003 is mainly used to provide an interface for user input; and the processor 1001 can be used to invoke the device control application program stored in the memory 1005.

[0327] When the computer device 1000 is the data processing apparatus 1, the following is implemented:

[0328] The proxy server obtains the first network connection state of the first terminal device;

[0329] If the network indicated by the first network connection state belongs to a local area network type, and the service information of the second terminal device is detected in the network indicated by the first network connection state, the streaming verification information is obtained based on the service information of the second terminal device, the streaming verification information is sent to the first terminal device, so that the first terminal device sends the verification result between the streaming verification information and the streaming control information to the proxy server; the streaming verification information is account information input by an object on the second terminal device; and the streaming control information is account information obtained by the first terminal device when starting the streaming service component;

[0330] If the network indicated by the first network connection state belongs to a public network type, or the service information of the second terminal device is not detected in the network indicated by the first network connection state, an authentication request is initiated to the background server, so that when the streaming verification information sent by the second terminal device and the streaming control information sent by the first terminal device are obtained, the background server sends the verification result between the streaming verification information and the streaming control information to the proxy server according to the authentication request;

[0331] If the verification result is a verification pass result, the verification result is used to instruct the proxy server to establish an indirect connection relationship for streaming service between the first terminal device and the second terminal device; the indirect connection relationship refers to a connection relationship between the second terminal device and the first terminal device through data forwarding of the proxy server.

[0332] When the computer device 1000 is the data processing apparatus 2, the following is implemented:

[0333] The second terminal device obtains the second network connection state and the streaming verification information; the streaming verification information is account information input by an object on the second terminal device;

[0334] If the network indicated by the second network connection state belongs to a local area network type, a message probe request carrying service information of the second terminal device is broadcast in the network indicated by the second network connection state, so that when the proxy server detects the service information of the second terminal device in the network indicated by the first network connection state of the first terminal device, the proxy server obtains stream authentication information based on the service information of the second terminal device, and sends the stream authentication information to the first terminal device; the first terminal device is configured to send a verification result between the stream authentication information and stream control information to the proxy server, and the stream control information is account information obtained by the first terminal device when starting a stream service component;

[0335] If the network indicated by the second network connection state belongs to a public network type, or the proxy server does not detect the service information of the second terminal device in the network indicated by the first network connection state, the stream authentication information is sent to a background server, so that when the background server obtains the proxy service information sent by the proxy server, the background server sends the proxy service information of the proxy server to the second terminal device; the proxy service information is used to instruct the second terminal device to send an authentication request to the proxy server; the authentication request is used to instruct the proxy server to obtain a verification result between the stream authentication information and the stream control information based on the authentication request, and the stream control information is sent by the first terminal to the background server.

[0336] If the verification result is a verification pass result, the verification result is used to instruct the proxy server to establish an indirect connection relationship for the stream service between the first terminal device and the second terminal device; the indirect connection relationship refers to a connection relationship between the second terminal device and the first terminal device through data forwarding of the proxy server.

[0337] It should be understood that the computer device 1000 described in the embodiments of the present application can perform the description of the data processing method in any one of the embodiments described in the foregoing Figure 7 、 Figure 3 、 Figure 4 、 Figure 5 and Figure 6 , which will not be repeated here. In addition, the beneficial effects of using the same method will not be described.

[0338] In addition, it should be noted that the embodiments of the present application also provide a computer readable storage medium, and the computer readable storage medium stores a computer program, and when the processor executes the computer program, the computer program can execute the description of the data processing method in any one of the foregoing Figure 7 、 Figure 3 、 Figure 4 、 Figure 5 and Figure 6The description of the data processing method in any of the corresponding embodiments is described above, and therefore, will not be described here. In addition, the description of the beneficial effects of using the same method will not be described here. For technical details not disclosed in the computer-readable storage medium embodiments involved in the present application, please refer to the description of the method embodiments of the present application.

[0339] The computer-readable storage medium can be an internal storage unit of the computer device, such as a hard disk or a memory of the computer device, or a data processing apparatus provided by any of the preceding embodiments. The computer-readable storage medium can also be an external storage device of the computer device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. Further, the computer-readable storage medium can include both the internal storage unit and the external storage device of the computer device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium can also be used to temporarily store data that has been displayed or will be displayed.

[0340] In addition, it should be noted that the embodiments of the present application also provide a computer program product, which includes a computer program stored in a computer-readable storage medium. The processor of the computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program to make the computer device execute the method provided by any of the preceding Figure 7 、 Figure 1 、 Figure 1 、 Figure 1 and Figure 1 any of the corresponding embodiments.

[0341] The terms "second", "first", etc. in the specification and claims and drawings of the embodiments of the present application are used to distinguish different objects, and are not used to describe a specific order. In addition, the term "comprises" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, device, product or equipment that includes a series of steps or units is not limited to the listed steps or modules, but can optionally include steps or modules that are not listed, or can optionally include other steps or units inherent to the process, method, device, product or equipment.

[0342] Those skilled in the art can understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware, computer software or a combination of both. In order to clearly illustrate the interchangeability of hardware and software, the components and steps of each example have been described in the above description in a general manner. Whether the components and steps are implemented in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to implement the described components for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0343] The method and related apparatus provided by the embodiments of the present application are described with reference to the method flowchart and / or structural schematic diagram provided by the embodiments of the present application. Each flow and / or block in the method flowchart and / or structural schematic diagram, and the combination of the flows and / or blocks in the flowchart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor or other programmable devices to produce a machine, so that the instructions executed by the computer or other programmable devices produce a device implemented in the flow specified in the flowchart and / or block diagram. Figure 1 The method and related apparatus provided by the embodiments of the present application are described with reference to the method flowchart and / or structural schematic diagram provided by the embodiments of the present application. Each flow and / or block in the method flowchart and / or structural schematic diagram, and the combination of the flows and / or blocks in the flowchart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor or other programmable devices to produce a machine, so that the instructions executed by the computer or other programmable devices produce a device implemented in the flow specified in the flowchart and / or block diagram. ​ The method and related apparatus provided by the embodiments of the present application are described with reference to the method flowchart and / or structural schematic diagram provided by the embodiments of the present application. Each flow and / or block in the method flowchart and / or structural schematic diagram, and the combination of the flows and / or blocks in the flowchart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor or other programmable devices to produce a machine, so that the instructions executed by the computer or other programmable devices produce a device implemented in the flow specified in the flowchart and / or block diagram. ​ The method and related apparatus provided by the embodiments of the present application are described with reference to the method flowchart and / or structural schematic diagram provided by the embodiments of the present application. Each flow and / or block in the method flowchart and / or structural schematic diagram, and the combination of the flows and / or blocks in the flowchart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor or other programmable devices to produce a machine, so that the instructions executed by the computer or other programmable devices produce a device implemented in the flow specified in the flowchart and / or block diagram. ​ The method and related apparatus provided by the embodiments of the present application are described with reference to the method flowchart and / or structural schematic diagram provided by the embodiments of the present application. Each flow and / or block in the method flowchart and / or structural schematic diagram, and the combination of the flows and / or blocks in the flowchart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor or other programmable devices to produce a machine, so that the instructions executed by the computer or other programmable devices produce a device implemented in the flow specified in the flowchart and / or block diagram. ​ The method and related apparatus provided by the embodiments of the present application are described with reference to the method flowchart and / or structural schematic diagram provided by the embodiments of the present application. Each flow and / or block in the method flowchart and / or structural schematic diagram, and the combination of the flows and / or blocks in the flowchart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor or other programmable devices to produce a machine, so that the instructions executed by the computer or other programmable devices produce a device implemented in the flow specified in the flowchart and / or block diagram.

[0344] The steps in the method embodiments of the present application can be adjusted, combined and deleted in sequence according to actual needs.

[0345] The modules in the apparatus embodiments of the present application can be combined, divided and deleted according to actual needs.

[0346] The above disclosure is only the preferred embodiments of the present application, and of course cannot limit the scope of the rights of the present application, so the equivalent changes made by the claims of the present application are still within the scope of the present application.

Claims

1. A data processing method, characterized by, The method comprises the following steps: The proxy server acquires a first network connection state of a first terminal device; If the network indicated by the first network connection state belongs to a local area network type and service information of a second terminal device is detected in the network indicated by the first network connection state, the proxy server acquires stream authentication information based on the service information of the second terminal device, sends the stream authentication information to the first terminal device, and makes the first terminal device send a verification result between the stream authentication information and stream control information to the proxy server; the stream authentication information is account information input by an object on the second terminal device; the stream control information is account information acquired by the first terminal device when starting a stream service component; If the network indicated by the first network connection state belongs to a public network type or the service information of the second terminal device is not detected in the network indicated by the first network connection state, the proxy server initiates an authentication request to a background server, and makes the background server send a verification result between the stream authentication information and the stream control information to the proxy server according to the authentication request when the stream authentication information sent by the second terminal device and the stream control information sent by the first terminal device are acquired; If the verification result is a verification pass result, the verification result is used to instruct the proxy server to establish an indirect connection relationship for stream service between the first terminal device and the second terminal device; the indirect connection relationship refers to a connection relationship in which data is forwarded between the second terminal device and the first terminal device through the proxy server.

2. The method of claim 1, wherein, The method further comprises the following steps: Multimedia data sent by the first terminal device for a business application is acquired, and the multimedia data is forwarded to the second terminal device through the indirect connection relationship, so that the second terminal device generates object control information based on an interactive operation of the object on the multimedia data; The object control information sent by the second terminal device is forwarded to the first terminal device through the indirect connection relationship, so that the first terminal device controls the business application in the first terminal device through the stream service component based on the object control information.

3. The method of claim 1, wherein, The method further comprises the following steps: The network indicated by the first network connection state is determined as a target network, network broadcast service information of the target network is acquired, service information detection is performed on data requests sent by terminal devices under the target network based on the network broadcast service information, and if a data request with the service information of the second terminal device is detected in the target network, it is determined that the service information of the second terminal device is detected in the network indicated by the first network connection state.

4. The method of claim 1, wherein, The step of acquiring stream authentication information based on the service information of the second terminal device comprises the following steps: The proxy service information of the proxy server is sent to the second terminal device based on the service information of the second terminal device; Stream authentication information sent by the second terminal device through the proxy service information is acquired.

5. The method of claim 1, wherein, The verification result generated by the first terminal device is obtained by the first terminal device when the first terminal device obtains the stream verification information sent by the proxy server, verifying the stream verification information and the stream control information; if the stream verification information and the stream control information are the same, the verification result is a verification pass result.

6. The method of claim 1, wherein, The authentication request initiated to the background server includes: The authentication request sent by the second terminal device is obtained, and the authentication request is forwarded to the background server; wherein the verification result generated by the background server is obtained by the background server when the background server obtains the stream verification information sent by the second terminal device and the stream control information sent by the first terminal device, and the stream verification information and the stream control information are verified according to the authentication request; if the stream verification information and the stream control information are the same, the verification result is a verification pass result.

7. The method of claim 6, wherein, The authentication request sent by the second terminal device is obtained, and the authentication request is forwarded to the background server; wherein the verification result generated by the background server is obtained by the background server when the background server obtains the stream verification information sent by the second terminal device and the stream control information sent by the first terminal device, and the stream verification information and the stream control information are verified according to the authentication request; if the stream verification information and the stream control information are the same, the verification result is a verification pass result. The authentication request sent by the second terminal device is obtained, and the authentication request is forwarded to the background server; wherein the verification result generated by the background server is obtained by the background server when the background server obtains the stream verification information sent by the second terminal device and the stream control information sent by the first terminal device, and the stream verification information and the stream control information are verified according to the authentication request; if the stream verification information and the stream control information are the same, the verification result is a verification pass result. The verification result is obtained.

8. The method of claim 1, wherein, If the verification result is a verification pass result, a first connection relationship between the first terminal device and the proxy server is established through a network indicated by the first network connection state, a second connection relationship between the second terminal device and the proxy server is established through a network indicated by the second network connection state of the second terminal device, and the first connection relationship and the second connection relationship are determined as an indirect connection relationship. The multimedia data includes first data packets and second data packets, and the method further includes: The load state of the proxy server is obtained, and if the load state satisfies an overload transmission condition, the first data packets sent by the first terminal device are forwarded to the second terminal device based on the proxy server; 9. The method of claim 2, wherein, The background service information of the background server is sent to the first terminal device, so that the first terminal device sends the second data packets to the background server; the second data packets are used to be forwarded to the second terminal device through the background server; the first data packets and the second data packets are used to form multimedia data in the second terminal device. Further comprising: M test data packets are generated, the M test data packets are sent to the first terminal device based on the indirect connection relationship, first network test information for the first terminal device is determined based on a first sending time and a first receiving time for the M test data packets; the first sending time refers to the time when the proxy server sends the M test data packets to the first terminal device, and the first receiving time refers to the time when the first terminal device returns the M test data packets to the proxy server; 10. The method of claim 1, wherein, M is a positive integer; ​ ​ sending M test data packets to the second terminal device based on the indirect connection relationship, determining second network test information for the second terminal device based on second sending time and second receiving time for the M test data packets; the second sending time refers to time for the proxy server to send the M test data packets to the second terminal device, and the second receiving time refers to time for the second terminal device to return the M test data packets to the proxy server; adjusting a target network based on the first network test information and the second network test information; the target network includes a network to which the first terminal device is connected or a network to which the second terminal device is connected.

11. The method of claim 10, wherein, The adjusting of the target network based on the first network test information and the second network test information includes: if the first network test information does not satisfy a network transmission condition set by the streaming service component for the service application, determining the network to which the first terminal device is connected as the target network, and returning first network prompt information to the first terminal device; the first network prompt information is used to prompt the first terminal device to switch the connected target network to the network to which the second terminal device is connected; if the second network test information does not satisfy the network transmission condition set by the streaming service component for the service application, determining the network to which the second terminal device is connected as the target network, and returning second network prompt information to the second terminal device; the second network prompt information is used to prompt the second terminal device to switch the connected target network to the network to which the first terminal device is connected.

12. The method of claim 11, wherein, The indirect connection relationship is used to send multimedia data for a service application of the first terminal device to the second terminal device, and the method further includes: if new first network test information and new second network test information obtained after the target network is adjusted both do not satisfy the network transmission condition, determining data compression information of the indirect connection relationship based on the new first network test information and the new second network test information, sending the data compression information to the first terminal device, and receiving compressed multimedia data for the service application sent by the first terminal device; the compressed multimedia data is obtained by the first terminal device based on data compression of the multimedia data according to the data compression information.

13. A data processing method, characterized by, The method includes: the second terminal device acquires second network connection state and streaming verification information; the streaming verification information is account information input by a user on the second terminal device; and the method further includes: the first terminal device sends the multimedia data for the service application to the second terminal device based on the data compression information, and the second terminal device receives the multimedia data for the service application sent by the first terminal device. If the network indicated by the second network connection state belongs to a local area network type, a message probe request carrying service information of a second terminal device is broadcast in the network indicated by the second network connection state, so that when the proxy server detects the service information of the second terminal device in the network indicated by the first network connection state of the first terminal device, the proxy server acquires stream authentication information based on the service information of the second terminal device, and sends the stream authentication information to the first terminal device; the first terminal device is configured to send a verification result between the stream authentication information and stream control information to the proxy server, the stream control information being account information acquired by the first terminal device when starting a stream service component; If the network indicated by the second network connection state belongs to a public network type, or the proxy server does not detect the service information of the second terminal device in the network indicated by the first network connection state, stream authentication information is sent to a background server, so that when the background server acquires the proxy service information sent by the proxy server, the background server sends the proxy service information of the proxy server to the second terminal device; the proxy service information is used to instruct the second terminal device to send an authentication request to the proxy server; the authentication request is used to instruct the proxy server to acquire a verification result between the stream authentication information and the stream control information based on the authentication request, the stream control information being sent by the first terminal to the background server; If the verification result is a verification pass result, the verification result is used to instruct the proxy server to establish an indirect connection relationship for stream service between the first terminal device and the second terminal device; the indirect connection relationship refers to a connection relationship in which data is forwarded between the second terminal device and the first terminal device through the proxy server.

14. The method of claim 13, wherein, Further comprising: Multimedia data sent by the first terminal device for a business application is acquired through the indirect connection relationship, object control information is generated based on an interactive operation of the object on the multimedia data, and the object control information is sent to the first terminal device; The object control information is used to control the business application in the first terminal device through the stream service component.

15. The method of claim 13, wherein, The second terminal device acquires a second network connection state of the second terminal device and stream authentication information, comprising: A network selection window is created in a stream service component, a second network connection state of the second terminal device is acquired in response to a network selection operation of an object on the network selection window; An account information verification window is created, and stream authentication information input by the object is acquired in response to an account input operation of the object on the account information verification window.

16. The method of claim 13, wherein, Further comprising: Based on the indirect connection relationship, a first network connection state of the first terminal device is acquired, and if a network type indicated by the first network connection state is different from a network type indicated by the second network connection state, second network prompt information is displayed in a streaming connection component; the second network prompt information is used to prompt the second terminal device to switch a connected network to a network connected by the first terminal device.

17. A data processing apparatus, characterized by: Comprise: A state acquisition module configured to acquire, by a proxy server, a first network connection state of a first terminal device; A local area network streaming module configured to, if the network indicated by the first network connection state belongs to a local area network type and service information of a second terminal device is detected in the network indicated by the first network connection state, acquire streaming verification information based on the service information of the second terminal device, and send the streaming verification information to the first terminal device, so that the first terminal device sends a verification result between the streaming verification information and streaming control information to the proxy server; the streaming verification information is account information input by an object on the second terminal device; and the streaming control information is account information acquired by the first terminal device when starting a streaming service component; A public network streaming module configured to, if the network indicated by the first network connection state belongs to a public network type or the service information of the second terminal device is not detected in the network indicated by the first network connection state, initiate an authentication request to a background server, so that the background server sends a verification result between the streaming verification information and the streaming control information to the proxy server when the streaming verification information sent by the second terminal device and the streaming control information sent by the first terminal device are acquired according to the authentication request; If the verification result is a verification pass result, the verification result is used to instruct the proxy server to establish an indirect connection relationship for streaming service between the first terminal device and the second terminal device; and the indirect connection relationship refers to a connection relationship between the second terminal device and the first terminal device through data forwarding of the proxy server.

18. A data processing apparatus, characterized by Comprise: A verification acquisition module configured to acquire, by a second terminal device, a second network connection state and streaming verification information; The streaming verification information is account information input by an object on the second terminal device; and The LAN processing module is configured to, if the network indicated by the second network connection state belongs to a LAN type, broadcast a message probe request carrying service information of the second terminal device in the network indicated by the second network connection state, so that the proxy server acquires stream authentication information based on the service information of the second terminal device when detecting the service information of the second terminal device in the network indicated by the first network connection state of the first terminal device, and sends the stream authentication information to the first terminal device; and the first terminal device is configured to send a verification result between the stream authentication information and stream control information to the proxy server, the stream control information being account information acquired by the first terminal device when starting a stream service component. The public network processing module is configured to, if the network indicated by the second network connection state belongs to a public network type, or the proxy server does not detect the service information of the second terminal device in the network indicated by the first network connection state, send stream authentication information to a background server, so that the background server sends proxy service information of the proxy server to the second terminal device when acquiring the proxy service information sent by the proxy server; the proxy service information is used to instruct the second terminal device to send an authentication request to the proxy server; and the authentication request is used to instruct the proxy server to acquire a verification result between the stream authentication information and the stream control information from the background server based on the authentication request, the stream control information being sent by the first terminal device to the background server. If the verification result is a verification pass result, the verification result is used to instruct the proxy server to establish an indirect connection relationship for stream service between the first terminal device and the second terminal device; and the indirect connection relationship refers to a connection relationship in which data is forwarded between the second terminal device and the first terminal device through the proxy server.

19. A computer device, comprising: The computer device comprises a processor, a memory and a network interface. The network interface is configured to provide a data communication function, the memory is configured to store a computer program, and the processor is configured to call the computer program, so that the computer device executes the method in any one of claims 1-16. The computer readable storage medium stores a computer program, and the computer program is adapted to be loaded and executed by the processor, so that the computer device with the processor executes the method in any one of claims 1-16.

20. A computer-readable storage medium, characterized in that, The computer program product comprises a computer program stored in a computer readable storage medium and adapted to be read and executed by a processor, so that the computer device with the processor executes the method in any one of claims 1-16.

21. A computer program product, characterised in that, ​

Images