A data transmission method and related device

Abstract

The embodiment of the present application provides a data transmission method and related equipment, which are used for synchronously transmitting haptic information and other types of information, increasing transmission efficiency, and improving overall user experience. The method of the embodiment of the present application comprises the following steps: a network device receives a haptic data stream and at least one first data stream sent by a machine side device, wherein the haptic data stream and the at least one first data stream comprise a synchronization identifier; and the network device synchronizes transmission time of the haptic data stream and the at least one first data stream.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the field of signal processing, and in particular to a data transmission method and related equipment. BACKGROUND

[0002] With the popularization of remote operation applications, haptic information will become an important information carried by wireless communication. At the same time, since the human body reacts to haptic information faster, the sampling rate of haptic information is much higher than that of video and audio information, usually on the order of 1000 Hz. That is, the frame rate of haptic information is increased to 200 Hz to 1000 Hz, compared with the frame rate of video information of 20 Hz to 120 Hz. The collected data should be immediately packaged and transmitted to reduce delay, which puts a huge pressure on wireless network transmission.

[0003] In existing haptic information sending technologies, different transmission priorities are usually allocated to haptic information that needs to be immediately packaged and transmitted and other information that does not need to be immediately packaged and transmitted, so that the haptic information that needs to be immediately transmitted is preferentially sent, and the other information that does not need to be immediately transmitted is not preferentially sent, thereby meeting the requirement of haptic information on transmission speed. For example, in existing 5G networks, when a terminal network device receives multiple data streams, it can classify and correspond different air interface connection resources according to different data transmission requirements of the data streams, so as to schedule air interface resources respectively and meet different data transmission requirements of the data streams.

[0004] Since the existing haptic information sending technology separates the transmission of haptic information and other information, but when the haptic information and other information have a dependent or associated relationship, such as temperature information, audio information, and device state information associated with haptic information, due to asynchronous data transmission, invalid transmission of haptic information or other information may occur, such as haptic information transmission failure, other information cannot be decoded alone, or other information transmission delay exceeds the waiting time range of haptic information, so that haptic information and other information with an associated relationship cannot be transmitted synchronously and completely, thereby reducing transmission efficiency. SUMMARY

[0005] Embodiments of the present application provide a data transmission method and related equipment to synchronously transmit haptic information and other types of information, increase transmission efficiency, and improve overall user experience.

[0006] The first aspect of the embodiment of the present application provides a data transmission method, which is used in a data transmission network system, the data transmission network system comprising a machine-side device, a network device and a user-side device, and is used for synchronously transmitting haptic information and other types of information between the machine-side device, the network device and the user-side device. The method comprises the following steps: the network device receives a haptic data stream and at least one first data stream sent by the machine-side device, the haptic data stream comprising a synchronization identifier, and each of the at least one first data stream comprising a synchronization identifier; and the network device synchronizes transmission times of the haptic data stream and the at least one first data stream.

[0007] In the possible implementation manner, the network device synchronizes the haptic data stream and the first data stream with the same synchronization identifier, so as to synchronize the transmission times and the transmission priorities of the haptic data stream and the at least one first data stream, so that the haptic data stream and the at least one first data stream can be synchronously transmitted, the probability of invalid transmission is reduced, the transmission efficiency is improved, and the overall user experience is improved.

[0008] In a possible implementation manner of the first aspect, the network device synchronizes transmission time intervals of the haptic data stream and the at least one first data stream, comprising: the network device determines the transmission time intervals of the haptic data stream and the at least one first data stream; and the network device synchronizes the transmission time intervals of the at least one first data stream with the transmission time intervals of the haptic data stream.

[0009] In the possible implementation manner, a method for synchronizing transmission time intervals and transmission priorities of the haptic data stream and the at least one first data stream by the network device is specifically provided, and the realizability of the present solution is improved.

[0010] In a possible implementation manner of the first aspect, the haptic data stream and the at least one first data stream are sent by a plurality of machine-side devices, and the network device synchronizes the transmission time intervals of the at least one first data stream with the transmission time intervals of the haptic data stream, comprising: the network device determines the transmission time intervals of the haptic data stream and the at least one first data stream sent by the plurality of machine-side devices; and the network device synchronizes the transmission time intervals of the at least one first data stream sent by the plurality of machine-side devices with the transmission time intervals of the haptic data stream.

[0011] In the possible implementation manner, a method for synchronizing transmission time intervals and transmission priorities of the haptic data stream and the at least one first data stream by the network device is specifically provided, and the realizability of the present solution is improved.

[0012] In a possible implementation manner of the first aspect, before the network device receives the haptic data stream and the at least one first data stream sent by the machine-side device, the method further includes: receiving, by the network device, data stream parameter information sent by the machine-side device, the data stream parameter information being parameter information of data streams transmitted by the network device and the machine-side device and the user-side device, and the data stream parameter information including a quality experience coefficient, a synchronization time reference and a frequency of a sensor of the data stream.

[0013] In a possible implementation manner of the first aspect, the method further includes: determining, by the network device, transmission priorities of the haptic data stream and the at least one first data stream; and synchronizing, by the network device, the transmission priorities of the haptic data stream and the at least one first data stream.

[0014] In a possible implementation manner of the first aspect, the determining, by the network device, of the transmission priorities of the haptic data stream and the at least one first data stream includes: determining, by the network device, a product of a channel quality coefficient and a quality experience coefficient corresponding to the haptic data stream and the at least one first data stream as a first parameter; and determining, by the network device, a ratio of the first parameter to a historical average rate as a corresponding transmission priority of the haptic data stream and the at least one first data stream.

[0015] In a possible implementation manner of the first aspect, the method further includes: sending, by the network device, the haptic data stream and the at least one first data stream to the user-side device.

[0016] In the possible implementation manner, the network device further sends the haptic data stream and the at least one first data stream to the user-side device, to implement synchronized transmission of the haptic data stream and the at least one first data stream.

[0017] In a possible implementation manner of the first aspect, the synchronization identifier includes a frame number of a haptic frame corresponding to the haptic data and a common air interface transmission time interval number.

[0018] The second aspect of the embodiments of the present application provides a data transmission method, which is used in a data transmission network system including a machine-side device, a network device and a user-side device, and is used for synchronously transmitting haptic information and other types of information between the machine-side device, the network device and the user-side device. The method includes: obtaining, by the machine-side device, a first signal, the first signal including haptic data and at least one first data; generating, by the machine-side device, a corresponding haptic data stream and at least one first data stream according to the first signal, the haptic data stream including a synchronization identifier, and each of the at least one first data stream including a synchronization identifier; and sending, by the machine-side device, the haptic data stream and the at least one first data stream to the network device.

[0019] In the possible implementation manner, the network device synchronizes the haptic data stream and the first data stream with the same synchronization identifier, so as to synchronize the transmission time and the transmission priority of the haptic data stream and the at least one first data stream, so that the haptic data stream and the at least one first data stream can be synchronously transmitted, the probability of invalid transmission is reduced, the transmission efficiency is improved, and the overall user experience is improved.

[0020] In a possible implementation manner of the second aspect, the machine-side device generates the corresponding haptic data stream and the at least one first data stream according to the first signal, including: the machine-side device generates the haptic data stream according to the haptic data, the haptic data stream including the synchronization identifier; and the machine-side device generates the at least one first data stream according to the at least one first data, each of the at least one first data stream including the synchronization identifier.

[0021] In a possible implementation manner of the second aspect, before the machine-side device acquires the first signal, the method further includes: the machine-side device sends data stream parameter information to the network device, the data stream parameter information being parameter information of data streams transmitted by the network device and the machine-side device and the user-side device, the data stream parameter information including a quality experience coefficient of the data stream, a synchronization time reference, and a frequency of a sensor.

[0022] In the possible implementation manner, a scheme for processing the first signal by the machine-side device is specifically provided, and the realizability of the embodiments of the present application is improved.

[0023] In a possible implementation manner of the second aspect, the synchronization identifier includes a frame number of a haptic frame corresponding to the haptic data and a common air interface transmission time interval number.

[0024] The third aspect of the present application provides a network device having the function of implementing the method of the first aspect or any possible implementation manner of the first aspect. The function can be realized by hardware, or realized by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions, for example: a determination unit.

[0025] The fourth aspect of the present application provides a machine-side device having the function of implementing the method of the second aspect or any possible implementation manner of the second aspect. The function can be realized by hardware, or realized by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions, for example: an acquisition unit.

[0026] The fifth aspect of the present application provides a network device, comprising at least one processor, a memory, an input / output (I / O) interface, and computer-executable instructions stored in the memory and executable on the processor, when the computer-executable instructions are executed by the processor, the processor executes the method of the first aspect or any possible implementation manner of the first aspect.

[0027] The sixth aspect of the present application provides a machine-side device, comprising at least one processor, a memory, an input / output (I / O) interface, and computer-executable instructions stored in the memory and executable on the processor, when the computer-executable instructions are executed by the processor, the processor executes the method of the second aspect or any possible implementation manner of the second aspect.

[0028] The seventh aspect of the present application provides a computer-readable storage medium storing one or more computer-executable instructions, when the computer-executable instructions are executed by the processor, the processor executes the method of the first aspect or any possible implementation manner of the first aspect.

[0029] The eighth aspect of the present application provides a computer-readable storage medium storing one or more computer-executable instructions, when the computer-executable instructions are executed by the processor, the processor executes the method of the second aspect or any possible implementation manner of the second aspect.

[0030] The ninth aspect of the present application provides a computer program product storing one or more computer-executable instructions, when the computer-executable instructions are executed by the processor, the processor executes the method of the first aspect or any possible implementation manner of the first aspect.

[0031] The tenth aspect of the present application provides a computer program product storing one or more computer-executable instructions, when the computer-executable instructions are executed by the processor, the processor executes the method of the second aspect or any possible implementation manner of the second aspect.

[0032] The eleventh aspect of the present application provides a chip system, comprising at least one processor, the at least one processor being configured to implement the functions involved in the first aspect or any possible implementation manner of the first aspect. In a possible design, the chip system can further comprise a memory, the memory being configured to store program instructions and data necessary for the processor to process the artificial intelligence model. The chip system can be composed of a chip, or can comprise a chip and other discrete devices.

[0033] The twelfth aspect of the present application provides a chip system, which comprises at least one processor, and the at least one processor is used to realize the functions involved in the second aspect or any possible implementation manner of the second aspect. In a possible design, the chip system can further comprise a memory, and the memory is used to store the necessary program instructions and data of the device based on the artificial intelligence model data processing. The chip system can be composed of a chip, or can comprise the chip and other discrete devices.

[0034] From the above technical solutions, it can be seen that the embodiments of the present application have the following advantages:

[0035] The embodiments of the present application provide a data transmission method, which is used in a data transmission network system, the data transmission network system comprising a machine-side device, a network device and a user-side device, and the data transmission method is used for synchronously transmitting haptic information and other types of information between the machine-side device, the network device and the user-side device. The method comprises: the network device receiving a haptic data stream and at least one first data stream sent by the machine-side device, the haptic data stream comprising a synchronization identifier, and each data stream in the at least one first data stream comprising a synchronization identifier; and the network device synchronizing the transmission time and the transmission priority of the haptic data stream and the at least one first data stream. In a possible implementation manner, the network device synchronizes the haptic data stream and the first data stream having the same synchronization identifier, thereby synchronizing the transmission time and the transmission priority of the haptic data stream and the at least one first data stream, so that the haptic data stream and the at least one first data stream can be synchronously transmitted, the probability of invalid transmission is reduced, the transmission efficiency is increased, and the overall user experience is improved. BRIEF DESCRIPTION OF DRAWINGS

[0036] Figure 1 A scene schematic diagram for haptic information transmission;

[0037] Figure 2 A network architecture diagram of a haptic information transmission network in the embodiments of the present application;

[0038] Figure 3 A flowchart of a data transmission method in the embodiments of the present application;

[0039] Figure 4 A structure schematic diagram of a data stream of a data transmission method in the embodiments of the present application;

[0040] Figure 5 Another flowchart of a data transmission method in the embodiments of the present application;

[0041] Figure 6 Another flowchart of a data transmission method in the embodiments of the present application;

[0042] Figure 7Another flowchart of a data transmission method in the embodiments of the present application;

[0043] Figure 8 Another structural diagram of a network device in the embodiments of the present application;

[0044] Figure 9 Another structural diagram of a machine-side device in the embodiments of the present application;

[0045] Figure 10 Another structural diagram of a network device in the embodiments of the present application;

[0046] Figure 11 Another structural diagram of a machine-side device in the embodiments of the present application;

[0047] Figure 12 A structural diagram of a haptic information transmission network in the embodiments of the present application. DETAILED DESCRIPTION

[0048] The embodiments of the present application provide a data transmission method and related devices, to synchronously transmit haptic information and other types of information, increase transmission efficiency, and improve overall user experience.

[0049] The embodiments of the present application are described below with reference to the drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments. Those skilled in the art can know that with the development of technology and the appearance of new scenes, the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems.

[0050] The terms "first", "second", and the like in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or a chronological sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but can include other steps or units that are not clearly listed or inherent to the process, method, product or device.

[0051] Please refer to Figure 1With the development of remote operation applications, tactile information will become an important information carried by wireless communication. At the same time, since the human body has a faster response speed to tactile information, the sampling rate of tactile information is much higher than that of video and audio information, usually at the order of 1000 Hz, that is, the frame rate of tactile information is increased from 20 Hz to 120 Hz of video information to 200 Hz to 1000 Hz. The collected data should be immediately packaged and transmitted to reduce the delay, which puts a huge pressure on wireless network transmission.

[0052] In the existing tactile information sending technology, different transmission priorities are usually allocated to tactile information that needs to be immediately packaged and transmitted and other information that does not need to be immediately packaged and transmitted, so that the tactile information that needs to be immediately transmitted is preferentially sent, and the other information that does not need to be immediately transmitted is not preferentially sent, thereby meeting the requirement of tactile information on transmission speed. For example, in the existing 5G network, when a terminal network device receives multiple data streams, it can classify and correspond different air interface connection resources according to the different data transmission requirements of each data stream, so as to schedule the air interface resources respectively and meet the different data transmission requirements of each data stream.

[0053] Since the existing tactile information sending technology separates the transmission of tactile information and other information, if the tactile information and other information have a dependent or associated relationship, such as temperature information, audio information and device state information associated with tactile information, due to the asynchronous data transmission, invalid transmission of tactile information or other information may occur, such as transmission failure of tactile information, and other information cannot be decoded alone; or the transmission delay of other information exceeds the waiting time range of tactile information, so that the tactile information and other information with an associated relationship cannot be transmitted synchronously and completely, thereby reducing the transmission efficiency.

[0054] Please refer to Figure 2 The embodiment of the present application is applied to a tactile information transmission network, which includes a user side device, a network device and a machine side device. The user side device and the machine side device are respectively connected with the network device. The network connection can be wired connection or wireless connection.

[0055] The user side device can include an application server with service data stream management and combination function and a user operation platform. The user operation platform can transmit information with the network device through the application server. The user side device can include a feedback device and an operation device. The feedback device can be a display, a loudspeaker, a finger feedback dot matrix and an arm feedback dot matrix.

[0056] The machine side device can include a user terminal (UE), an application terminal with data stream management and time synchronization marking function, an execution device and a sensor.

[0057] The network device can include a next-generation base station (gNB, generation NodeB), i.e., a 5G base station, a session management function network element (SMP, Session Management Function) network element with a session management function, a network exposure function (NEF, Network Exposure Function) network element, a policy control function (PCF, Policy Control Function) network element, and a user plane function (UPF, User plane Function) network element with a data flow management function and a QoS mapping function.

[0058] In the embodiments of the present application, the user-side device, the network device, and the machine-side device will notify the UPF, the gNB, the UE, and the application terminal of the quality of service (QoS, Quality of service) parameters of each data stream of the service encoding, the frame rate of each sensor, and the time reference before transmitting data. For example, the high-QoS stream can include haptic data; the medium-QoS stream can include audio data and video basic I-frame data; the low-QoS stream can include video enhancement P-frame data and other data (maintenance / alarm data) ; and the gNB, UE1, and UE2 can be notified as collaborative terminals. For the time reference, the transmission time interval (TTI, transmission time interval) number or the frame number of the haptic data can be used as the timestamp; the haptic signal frame rate is 5000 Hz (2 ms), the video signal frame rate is 25 Hz (40 ms), and the audio signal frame rate is 50 Hz (20 ms).

[0059] Based on the above haptic information transmission network, the data transmission method in the embodiments of the present application is described as follows:

[0060] Please refer to Figure 3 The embodiments of the present application provide a data transmission method and related devices.

[0061] 301、The network device receives data stream parameter information.

[0062] The network device receives the data stream parameter information sent by the machine-side device, the data stream parameter information is the parameter information of the data stream transmitted by the network device, the machine-side device, and the user-side device, and the data stream parameter information includes the quality of service coefficient of the data stream, the synchronization time reference, and the frequency of the sensor.

[0063] Specifically, the user-side device, the network device and the machine-side device notify the UPF, the gNB, the UE and the application terminal of the quality of service (QoS) parameters of each data stream of the service encoding, the frame rate of each sensor, and synchronize the time reference before transmitting the data. For example, the high QoS stream can include haptic data; the medium QoS stream can include audio data and video basic I frame data; the low QoS stream can include video enhancement P frame data and other data (maintenance / alarm data, etc.); and the gNB, UE1 and UE2 can be notified as cooperative terminals. For the synchronization reference, the air interface transmission time interval (TTI) number or the frame number of the haptic data can be used as the timestamp; the haptic signal frame rate is 5000 Hz (2 ms), the video signal frame rate is 25 Hz (40 ms), and the audio signal frame rate is 50 Hz (20 ms).

[0064] 302. The machine-side device acquires the first signal.

[0065] The network device receives the first signal sent by the machine-side device, which can include haptic data and at least one first data, which can be multiple types of data such as audio data, video basic I frame data, video enhancement P frame data and text data, etc., without limitation.

[0066] In one possible implementation, the machine-side device includes an application terminal, a haptic sensor, a camera and a microphone, etc. The application terminal acquires the first signal through the haptic sensor, the camera and the microphone, etc.

[0067] 303. The machine-side device generates a haptic data stream and a first data stream according to the first signal.

[0068] As shown in Figure 4 , the machine-side device generates a corresponding haptic data stream and a first data stream according to the first signal, i.e., the haptic data and the at least one first data. Specifically, the machine-side device generates a haptic data stream according to the haptic data, and the packet header of the haptic data stream includes a synchronization identifier; the machine-side device also generates a corresponding at least one first data stream according to the at least one first data, and the packet header of each data stream of the at least one first data stream includes the synchronization identifier. The synchronization identifier can be the frame number of the haptic frame corresponding to the haptic data or the common air interface TTI number.

[0069] As shown in Figure 5As shown in FIG. 1, in one possible implementation, the machine-side device includes an application terminal, a haptic sensor, a camera, a microphone, and other sensors. After the application terminal receives the first signals sent by the haptic sensor, the camera, the microphone, and other sensors, the application terminal generates a haptic data stream by compressively encoding the haptic data, and generates at least one first data stream by compressively encoding the at least one first data. Then, the frame number of the haptic frame corresponding to the haptic data is added to the packet header of the haptic data stream and the at least one first data stream as an application synchronization word.

[0070] As shown in FIG. 1, in one possible implementation, the machine-side device includes an application terminal, a haptic sensor, a camera, a microphone, and other sensors. After the application terminal receives the first signals sent by the haptic sensor, the camera, the microphone, and other sensors, the application terminal generates a haptic data stream by compressively encoding the haptic data, and generates at least one first data stream by compressively encoding the at least one first data. Then, the frame number of the haptic frame corresponding to the haptic data is added to the packet header of the haptic data stream and the at least one first data stream as an application synchronization word. Figure 6

[0071] In one possible implementation, the machine-side device further includes a user terminal. After the application terminal generates the haptic data stream and the at least one first data stream, the user terminal adds or subtracts the transmission synchronization word, i.e., the frame number of the haptic frame and the frame rate information corresponding to the data stream, to the packet header of the haptic data stream and the at least one first data stream.

[0072] The machine-side device in the embodiments of the present application can also have other non-haptic application data transmission simultaneously, which is irrelevant to the haptic application data. These non-haptic application data do not include the above-mentioned synchronization word.

[0073] 304. The machine-side device sends the haptic data stream and the first data stream to the network device.

[0074] The machine-side device sends the haptic data stream and the at least one first data stream to the network device. Correspondingly, the network device receives the haptic data stream and the at least one first data stream sent by the machine-side device.

[0075] 305. The network device synchronizes the transmission time and the transmission priority of the haptic data stream and the first data stream.

[0076] After receiving the haptic data stream and the first data stream, the network device acquires the transmission time and the transmission priority of the haptic data stream and the first data stream, and synchronizes the transmission time and the transmission priority of the first data stream to the same as the transmission time and the transmission priority of the haptic data stream.

[0077] ​In one possible implementation, the network device includes a next-generation base station (gNB). After receiving the tactile data stream and the first data stream, since the gNB has not yet established a synchronization relationship with the tactile data stream and the first data stream, the gNB first determines the scheduling priority based on the QoS level of the tactile data stream and the first data stream, and then performs resource scheduling.

[0078] One specific method for the gNB to determine the scheduling priority of data streams includes: scheduling priority P = (E*Y) / A, where P is the scheduling priority of the data stream and E is the channel quality parameter eff. CQI Y represents the QoS level coefficient of the data stream, and A represents the historical average rate (avgRate). In addition, the gNB can use other methods to determine the scheduling priority of the data stream, such as directly determining the QoS level as the scheduling priority; specific methods are not limited here.

[0079] like Figure 7 As shown, in one possible implementation, the network device includes a next-generation base station (gNB). After receiving multiple data streams, the gNB enters a synchronization training phase: the gNB identifies the data streams with the same synchronization identifier (i.e., the aforementioned tactile data stream and the first data stream), then determines the first TTI number of each data stream, which is the TTI number of the first air interface scheduling of the data stream, and calculates the difference between the first TTI of each data stream from the same application terminal and the high QoS data stream. Figure 7 dT1, dT2, dT3, and dT4 in the equation.

[0080] Then the gNB enters the synchronization optimization scheduling phase. The gNB continuously calculates dT1, dT2, dT3, and dT4, and performs alpha filtering on each. For example, dT = a*dT + b*dT, where a = 0.95 and b = 0.05. Synchronization optimization scheduling is crucial because the signal acquisition from haptic / video / audio sensors has a fixed frame rate (i.e., sampling interval). Synchronized multi-sensor information provides the operator with more information, making it more important. Based on the training phase, the possible TTI numbers for air interface transmissions with synchronization information are: high QoS stream: T; medium QoS stream of terminal 1: T + dT1; low QoS stream of terminal 1: T + dT2; medium QoS stream of terminal 2: T + dT3; low QoS stream of terminal 2: T + dT4. Then, in the gNB's air interface resource scheduling, the scheduling priority of the TTI corresponding to each data stream is increased. For example, the scheduling priority P = (E*Y) / A*Ys, where P is the scheduling priority of the data stream and E is the channel quality parameter eff. CQI Y is the QoS level coefficient of the data stream, A is the historical average rate (avgRate), and Ys is the QoS level coefficient of the data stream.QoS，sync Generally 3.

[0081] 306、The network device sends the haptic data stream and the first data stream to the user-side device.

[0082] The network device sends the haptic data stream and the first data stream to the user-side device, and accordingly, the user-side device receives the haptic data stream and the first data stream sent by the network device.

[0083] In a possible implementation, the user-side device includes an application server and a plurality of feedback devices. After receiving the haptic data stream and the first data stream, the application server decodes the haptic data stream and the first data stream, and then aligns the time of each sensor signal according to the application synchronization word and sends the sensor signal to the corresponding feedback device. The feedback device can be an arm feedback array, a finger feedback array, a display, a loudspeaker, or the like.

[0084] The network device in the embodiments of the present application is described below. Please refer to Figure 8 The network device 800 provided in the embodiments of the present application can be the network device in the above Figure 3 The network device 800 includes:

[0085] The first receiving module 801 is configured to receive data stream parameter information sent by the machine-side device. The data stream parameter information is parameter information of a data stream transmitted by the network device, the machine-side device, and the user-side device. The data stream parameter information includes a quality experience coefficient of the data stream, a synchronization time reference, and a frequency of a sensor. For a specific implementation, please refer to step 301 in the embodiment shown in Figure 3 The network device receives the data stream parameter information sent by the machine-side device, which is not repeated here.

[0086] The second receiving module 802 is configured to receive a haptic data stream and at least one first data stream sent by the machine-side device. The haptic data stream includes a synchronization identifier, and each data stream in the at least one first data stream includes a synchronization identifier. For a specific implementation, please refer to step 304 in the embodiment shown in Figure 3 The machine-side device sends the haptic data stream and the first data stream to the network device, which is not repeated here.

[0087] The synchronization module 803 is configured to synchronize the transmission time and the transmission priority of the haptic data stream and the at least one first data stream. For a specific implementation, please refer to step 305 in the embodiment shown in Figure 3 The network device synchronizes the transmission time and the transmission priority of the haptic data stream and the first data stream, which is not repeated here.

[0088] In a possible implementation, the synchronization module 803 includes:

[0089] The first determining unit 804 is configured to determine a transmission time interval of the haptic data stream and the at least one first data stream; for details, please refer to Figure 3 In the embodiment shown in FIG. 3, the network device synchronizes the transmission time of the haptic data stream and the first data stream, which will not be repeated here.

[0090] In a possible implementation, the first determining unit 804 is configured to determine a transmission time interval of the haptic data stream and the at least one first data stream sent by the plurality of machine-side devices; for details, please refer to Figure 3 In the embodiment shown in FIG. 3, the network device synchronizes the transmission time of the haptic data stream and the first data stream, which will not be repeated here.

[0091] The first synchronizing unit 805 is configured to synchronize the transmission time interval of the at least one first data stream with the transmission time interval of the haptic data stream; for details, please refer to Figure 3 In the embodiment shown in FIG. 3, the network device synchronizes the transmission time and the transmission priority of the haptic data stream and the first data stream, which will not be repeated here.

[0092] In a possible implementation, the first synchronizing unit 805 is configured to synchronize the transmission time interval of the at least one first data stream with the transmission time interval of the haptic data stream sent by the plurality of machine-side devices; for details, please refer to Figure 3 In the embodiment shown in FIG. 3, the network device synchronizes the transmission time and the transmission priority of the haptic data stream and the first data stream, which will not be repeated here.

[0093] The second determining unit 806 is configured to determine a transmission priority of the haptic data stream and the at least one first data stream; for details, please refer to Figure 3 In the embodiment shown in FIG. 3, the network device synchronizes the transmission time and the transmission priority of the haptic data stream and the first data stream, which will not be repeated here.

[0094] In a possible implementation, the second determining unit 806 is configured to determine a product of a channel quality coefficient and a quality experience coefficient corresponding to the haptic data stream and the at least one first data stream as a first parameter; and determine a ratio of the first parameter to a historical average rate as a corresponding transmission priority of the haptic data stream and the at least one first data stream. For details, please refer to Figure 3 In the embodiment shown in FIG. 3, the network device synchronizes the transmission time and the transmission priority of the haptic data stream and the first data stream, which will not be repeated here.

[0095] The second synchronizing unit 807 is configured to synchronize the transmission priority of the haptic data stream and the at least one first data stream. For details, please refer to Figure 3In the step 305 of the embodiment, the network device synchronizes the transmission time and the transmission priority of the haptic data stream and the first data stream, which is not repeated here.

[0096] The sending module 808 is configured to send the haptic data stream and the at least one first data stream to the user-side device. Figure 3 In the step 306 of the embodiment, the network device sends the haptic data stream and the first data stream to the user-side device, which is not repeated here.

[0097] In the embodiment, the network device can perform the operation of any one of the preceding embodiments. Figure 3 In the embodiment of any one of the preceding embodiments, the network device performs the operation, which is not repeated here.

[0098] The machine-side device in the embodiments of the present application is described below. Figure 9 The machine-side device 900 provided in the embodiments of the present application can be the machine-side device in the above embodiments. Figure 3 The machine-side device 900 includes:

[0099] The first sending module 901 is configured to send data stream parameter information to the network device, the data stream parameter information being parameter information of data streams transmitted by the network device and the machine-side device and the user-side device, the data stream parameter information including a quality experience coefficient of the data stream, a synchronization time reference, and a frequency of a sensor.

[0100] The acquisition module 902 is configured to acquire a first signal, the first signal including haptic data and at least one first data. Figure 3 In the step 302 of the embodiment, the machine-side device acquires the first signal, which is not repeated here.

[0101] The generation module 903 is configured to generate a corresponding haptic data stream and at least one first data stream according to the first signal, the haptic data stream including a synchronization identifier, and each of the at least one first data stream including a synchronization identifier. Figure 3 In the step 303 of the embodiment, the machine-side device generates the haptic data stream and the first data stream according to the first signal, which is not repeated here.

[0102] In a possible implementation, the generation module 902 is configured to generate a haptic data stream according to the haptic data, the haptic data stream including a synchronization identifier; and generate a corresponding at least one first data stream according to the at least one first data, each of the at least one first data stream including a synchronization identifier. Figure 3 In the step 303 of the embodiment, the machine-side device generates the haptic data stream and the first data stream according to the first signal, which is not repeated here.

[0103] The sending module 904 is configured to send the haptic data stream and the at least one first data stream to the network device. For specific implementation, please refer to Figure 3 In the step 304 of the embodiment shown in the figure, the machine-side device sends the haptic data stream and the first data stream to the network device, which will not be repeated here.

[0104] In this embodiment, the machine-side device can perform the operation performed by the controller in any one of the preceding Figure 3 embodiments, which will not be repeated here.

[0105] Figure 10 Fig. 1 is a schematic diagram of a network device structure according to an embodiment of the present application. The network device 1000 can include one or more central processing units (CPU) 1001 and a memory 1005, in which one or more application programs or data are stored.

[0106] The memory 1005 can be volatile memory or persistent storage. The programs stored in the memory 1005 can include one or more modules, each of which can include a series of instruction operations in the network device. Further, the central processing unit 1001 can be configured to communicate with the memory 1005 and execute the series of instruction operations in the memory 1005 on the network device 1000.

[0107] The central processing unit 1001 is configured to execute the computer programs in the memory 1005, so that the network device 1000 is configured to perform: the network device receives the haptic data stream and the at least one first data stream sent by the machine-side device, the haptic data stream includes a synchronization identifier, and each of the at least one first data stream includes a synchronization identifier; and the network device synchronizes the transmission time and the transmission priority of the haptic data stream and the at least one first data stream. For specific implementation, please refer to Figure 3 steps 301-306 of the embodiment shown in the figure, which will not be repeated here.

[0108] The network device 1000 can further include one or more power supplies 1002, one or more wired or wireless network interfaces 1003, one or more input / output interfaces 1004, and / or one or more operating systems, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

[0109] The network device 1000 can perform the operation performed by the network device in any one of the preceding Figure 3 embodiments, which will not be repeated here.

[0110] Figure 11 This is a schematic diagram of a machine-side device structure provided in an embodiment of this application. The machine-side device 1100 may include one or more central processing units (CPUs) 1101 and a memory 1105, in which one or more applications or data are stored.

[0111] The memory 1105 can be volatile or persistent storage. The program stored in the memory 1105 can include one or more modules, each module including a series of instruction operations on the machine-side device. Furthermore, the central processing unit 1101 can be configured to communicate with the memory 1105 and execute the series of instruction operations in the memory 1105 on the machine-side device 1100.

[0112] The central processing unit 1101 executes the computer program stored in the memory 1105, enabling the machine-side device 1100 to perform the following actions: the machine-side device acquires a first signal, the first signal including tactile data and at least one first data; the machine-side device generates a corresponding tactile data stream and at least one first data stream based on the first signal, the tactile data stream including a synchronization identifier, and each of the at least one first data stream including a synchronization identifier; the machine-side device sends the tactile data stream and at least one first data stream to the network device. For specific implementation details, please refer to [reference needed]. Figure 3 Steps 301-306 in the illustrated embodiment will not be repeated here.

[0113] The machine-side device 1100 may also include one or more power supplies 1102, one or more wired or wireless network interfaces 1103, one or more input / output interfaces 1104, and / or one or more operating systems, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, etc.

[0114] The machine-side device 1100 can perform the aforementioned... Figure 3 The specific operations performed by the machine-side device in the illustrated embodiment will not be described in detail here.

[0115] Figure 12 This application provides a data transmission network system 1200, which may include the above-described... Figure 9 The machine-side equipment 1201 shown Figure 8 The network device 1202 and user-side device 1203 shown herein, the data transmission network system 1200 can perform the aforementioned functions. Figure 3 The specific operations performed by the data transmission network system in the illustrated embodiment will not be described in detail here.

[0116] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

[0117] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.

[0118] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0119] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0120] If the integrated unit is realized in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the part of the prior art that makes a contribution or the whole or part of the technical solutions can be embodied in the form of a software product, which is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the embodiments of the method of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various program code storage media.

Claims

1. A data transmission method, characterized by, The method comprises: The network device receives the haptic data stream and at least one first data stream sent by the machine-side device, and the haptic data stream and the at least one first data stream comprise synchronization identifiers; The network device synchronizes the transmission time of the haptic data stream and at least one first data stream with the same synchronization identifier; The network device synchronizes the transmission priority of the haptic data stream and at least one first data stream with the same synchronization identifier.

2. The method of claim 1, wherein, The network device synchronizes the transmission time interval of the haptic data stream and at least one first data stream, comprising: The network device determines the transmission time interval of the haptic data stream and at least one first data stream; The network device synchronizes the transmission time interval of the at least one first data stream with the transmission time interval of the haptic data stream.

3. The method of claim 2, wherein, The haptic data stream and at least one first data stream are sent by a plurality of machine-side devices, and the network device synchronizes the transmission time interval of the at least one first data stream with the transmission time interval of the haptic data stream, comprising: The network device determines the transmission time interval of the haptic data stream and at least one first data stream sent by the plurality of machine-side devices; The network device synchronizes the transmission time interval of the at least one first data stream sent by the plurality of machine-side devices with the transmission time interval of the haptic data stream.

4. The method of claim 3, wherein, Before the network device receives the haptic data stream and at least one first data stream sent by the machine-side device, the method further comprises: The network device receives data stream parameter information sent by the machine-side device, the data stream parameter information being parameter information of data streams transmitted by the network device and the machine-side device and user-side device, and the data stream parameter information comprising a quality experience coefficient of a data stream, a synchronization time reference, and a frequency of a sensor.

5. The method of claim 4, wherein, The method further comprises: The network device determines the transmission priority of the haptic data stream and at least one first data stream; The network device synchronizes the transmission priority of the haptic data stream and at least one first data stream.

6. The method of claim 5, wherein, The network device determines the transmission priority of the haptic data stream and at least one first data stream, comprising: The network device determines a product of a channel quality coefficient and a quality experience coefficient corresponding to the haptic data stream and at least one first data stream as a first parameter; The network device determines a ratio of the first parameter to a historical average rate as the corresponding transmission priority of the haptic data stream and at least one first data stream.

7. The method of claim 6, wherein, The method further comprises: The network device sends the haptic data stream and at least one first data stream to the user-side device.

8. The method of claim 7, wherein, The synchronization identifier comprises a frame number of a haptic frame corresponding to the haptic data and a common air interface transmission time interval number.

9. A data transmission method, characterized by, The method comprises: The machine-side device obtains a first signal, and the first signal comprises haptic data and at least one first data; The machine-side device generates a corresponding haptic data stream and at least one first data stream according to the first signal, and the haptic data stream comprises a synchronization identifier, and each of the at least one first data stream comprises the synchronization identifier; The machine-side device sends the haptic data stream and the at least one first data stream to a network device, so that the network device synchronizes transmission time and transmission priority of the haptic data stream and the at least one first data stream with the same synchronization identifier.

10. The method of claim 9, wherein, The machine-side device generates a corresponding haptic data stream and at least one first data stream according to the first signal, including: The machine-side device generates the haptic data stream according to the haptic data, the haptic data stream including the synchronization identifier; The machine-side device generates a corresponding at least one first data stream according to the at least one first data, each data stream of the at least one first data stream including the synchronization identifier.

11. The method of claim 10, wherein, Before the machine-side device acquires the first signal, the method further includes: The machine-side device sends data stream parameter information to the network device, the data stream parameter information being parameter information of data streams transmitted by the network device and the machine-side device and a user-side device, the data stream parameter information including a quality experience coefficient of the data stream, a synchronization time reference, and a frequency of a sensor.

12. The method of claim 11, wherein, The synchronization identifier includes a frame number of a haptic frame corresponding to the haptic data and a common air interface transmission time interval number.

13. A network device, comprising: The network device includes: A receiving module configured to receive a haptic data stream and at least one first data stream sent by a machine-side device, the haptic data stream including a synchronization identifier, and each data stream of the at least one first data stream including the synchronization identifier; A synchronization module configured to synchronize transmission time of the haptic data stream and the at least one first data stream with the same synchronization identifier; The synchronization module is further configured to synchronize transmission priority of the haptic data stream and the at least one first data stream with the same synchronization identifier.

14. The network device of claim 13, wherein, The network device further includes: A receiving module configured to receive data stream parameter information sent by the machine-side device, the data stream parameter information being parameter information of data streams transmitted by the network device and the machine-side device and a user-side device, the data stream parameter information including a quality experience coefficient of the data stream, a synchronization time reference, and a frequency of a sensor.

15. The network device of claim 14, wherein, The network device further includes: A sending module configured to send the haptic data stream and the at least one first data stream to the user-side device.

16. A machine side device, characterized by The machine-side device includes: An acquiring module configured to acquire a first signal, the first signal including haptic data and at least one first data; A generating module configured to generate a corresponding haptic data stream and at least one first data stream according to the first signal, the haptic data stream including a synchronization identifier, and each data stream of the at least one first data stream including the synchronization identifier; A sending module configured to send the haptic data stream and the at least one first data stream to a network device, so that the network device synchronizes transmission time and transmission priority of the haptic data stream and the at least one first data stream with the same synchronization identifier.

17. The machine side device according to claim 16, characterized in that The generating module includes: A first generating unit configured to generate the haptic data stream according to the haptic data, the haptic data stream including the synchronization identifier; A second generating unit is configured to generate at least one first data stream corresponding to the at least one first data according to the at least one first data, each of the at least one first data stream comprising the synchronization identifier.

18. The machine side device according to claim 17, characterized by The machine-side device further comprises: A sending module is configured to send data stream parameter information to the network device, the data stream parameter information being parameter information of data streams transmitted by the network device and the machine-side device and the user-side device, the data stream parameter information comprising a quality experience coefficient of a data stream, a synchronization time reference, and a frequency of a sensor.

19. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program, when executed by a processor, implements the method of any one of claims 1-8.

20. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program, when executed by a processor, implements the method of any one of claims 9-12.

21. A network device, comprising: A computer readable storage medium storing the computer program; The processor is coupled to the computer readable storage medium, and the computer program, when executed by the processor, implements the method of any one of claims 1-8.

22. A machine side device, characterized by A computer readable storage medium storing the computer program; The processor is coupled to the computer readable storage medium, and the computer program, when executed by the processor, implements the method of any one of claims 9-12.

23. A chip system, characterized by A processor is called to execute the method of any one of claims 1-8.

24. A chip system, characterized by A processor is called to execute the method of any one of claims 9-12.

25. A data transmission system, characterized by The data transmission system comprises the network device and the user-side device of any one of claims 13-15 and the machine-side device of claims 16-18.

Images