Image transmission method and device
By using logical frame and line number indicators in data packets, the method improves encapsulation efficiency and frame synchronization reliability in image transmission for in-vehicle devices, addressing inefficiencies in existing technologies.
Patent Information
- Application Number
- JP2023513833
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-08-29
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2040-08-29
AI Technical Summary
Existing image transmission methods in in-vehicle devices, such as ADAS or ADS, face inefficiencies due to large header sizes in data packets, which reduce encapsulation efficiency and increase transmission overhead.
The method involves generating data packets with first information that indicates the logical frame and line numbers within an image, using joint coding schemes to reduce the number of bits required for header information, thereby improving encapsulation efficiency and reliability of frame synchronization.
This approach reduces the number of bits occupied by headers, decreases transmission overhead, and enhances the reliability of frame synchronization, preventing image artifacts caused by packet loss.
Smart Images

Figure 0007577836000004 
Figure 0007577836000005 
Figure 0007577836000006
Abstract
Description
[Technical field]
[0001] This application relates to the field of communications, and in particular to an image transmission method and device. [Background technology]
[0002] At present, automobiles are developed intelligently, and corresponding in-vehicle devices are installed in automobiles to provide intelligent services. For example, an increasing number of advanced driver assistance systems (ADAS) or advanced driver systems (ADS) are installed in automobiles. The in-vehicle devices need to transmit data to each other to function together. For example, most ADAS or ADS currently rely on cameras to sense the environment around the automobile in real time. Therefore, it becomes particularly important for the cameras to accurately transmit the sensed driving environment information to the image processing unit of the ADAS or ADS.
[0003] Before sending data to another in-vehicle device, one in-vehicle device needs to encapsulate the data and then send the encapsulated data. The encapsulated data may be a data packet. The data packet may include a header and a payload. The payload is used to carry the data, and the header is used to carry some descriptive information of the data. Currently, the header of a data packet occupies a relatively large amount of bits, resulting in reduced encapsulation efficiency. Summary of the Invention [Means for solving the problem]
[0004] The embodiments of this application provide an image transmission method and apparatus to improve encapsulation efficiency.
[0005] According to a first aspect, a first image transmission method is provided. The method includes: a first communication device generates a first data packet, the first data packet including a portion of content of a frame of an image and first information, the first information being used to indicate a logical frame number of the frame in which the portion of content is located and a line in the frame of the image in which the portion of content is located. The first communication device sends the first data packet to a second communication device.
[0006] The method may be performed by a first communication device. The first communication device may be a communication device or a communication device, e.g., a chip, capable of supporting functions required by the communication device to perform the method. For example, the first communication device is a terminal device. The terminal device may be an in-vehicle device, such as an in-vehicle camera or CDC, or may be a non-in-vehicle device. The terminal device is a terminal device, or a chip located in the terminal device and configured to realize the functions of the terminal device, or another component configured to realize the functions of the terminal device.
[0007] In an embodiment of this application, the first information may indicate a logical frame number of a frame in which the content included in the first data packet is located. Because the first information indicates a logical frame number and does not need to indicate an actual frame number, the first information does not need to occupy excess bits. For example, the first information can indicate a logical frame number even if it occupies only one bit. Compared with the prior art, the technical solution provided in the embodiment of this application can reduce the amount of bits occupied by the header of a data packet, reduce transmission overhead, and improve encapsulation efficiency.
[0008] In an optional implementation, the first information includes frame display information and line number display information, where the frame display information is carried in a frame display field and the line number display information is carried in a line number display field. The fact that the first information is used to indicate the logical frame number of the frame in which the portion of the content is located and the line in which the portion of the content is located in the frame of the image may be realized in the following manner.
[0009] The frame indication field is used to indicate the frame number of the frame in which the portion of content is located, and the line number indication field is used to indicate the line within the frame of the image in which the portion of content is located.
[0010] In this manner, the frame indication field (or frame indication information) may indicate the frame number of the frame in which the portion of the content is located, and the line number indication field may indicate the line in which the portion of the content is located in the frame of the image. In other words, different contents may be indicated by using different information to achieve clearer indication. In addition, the frame indication information may indicate the frame in which the portion of the content is located. Therefore, the frame indication information included in the data packets containing the content of the same frame should have the same value and is used to indicate the logical frame number of the frame. In this way, even if some data packets are lost in the transmission process, there are still some data packets that can be normally received. The receiving end can extract a frame synchronization signal based on the frame indication information included in the received data packet. It can be seen that the solution provided in the embodiment of this application can improve the reliability of frame synchronization and avoid image disturbance caused by the receiving end being unable to extract the frame synchronization signal.
[0011] In an optional implementation, the fact that the first information is used to indicate the logical frame number of the frame in which the portion of the content is located and the line in which the portion of the content is located within the frame of the image may be achieved in the following manner:
[0012] The first information is used to indicate the logical frame number of the frame in which the portion of content is located and the line in which the portion of content is located within the frame of the image by using a joint coding scheme.
[0013] A joint coding scheme is used, which allows one piece of information (i.e., the first piece of information) to indicate more content, thereby improving information utilization. In addition, using a joint coding scheme can help reduce the amount of bits occupied by a field to complete the same function, and improve encapsulation efficiency to a greater extent. In addition, the state of the first piece of information clearly indicates the start and end of a frame, respectively. Even if a data packet used to indicate the end frame of the previous frame is lost, the receiving end can determine the start position of the next frame based on the received data packet used to indicate the start frame of the next frame, and can determine the end position of the previous frame accordingly. Obviously, according to the technical solution in the embodiment of this application, the receiving end can determine the start and end of a frame more reliably.
[0014] In an optional implementation, the first data packet may further include a line segment representation field, where the line segment representation field is used to indicate a first quantity, where the first quantity is used to indicate a quantity of data packets in the line in which the portion of the content is located.
[0015] For example, in an in-vehicle scenario, a line of a frame of an image is not divided into excessive segments. Thus, the segments of the line of the frame of an image can be displayed without using excessive bits. In an embodiment of this application, the line segment display field indicates the number of segments into which a line is divided, and does not need to indicate a specific segment number. In this way, the amount of bits occupied by the line segment display field can be reduced, and the encapsulation efficiency can be improved. In other words, the embodiment of this application provides another display scheme (i.e., indicating the number of segments into which a line is divided), which can reduce the amount of bits occupied by the line segment display field.
[0016] In an optional implementation, the number of bits occupied by the line segment representation field is greater than or equal to 2 and less than 8.
[0017] The number of bits occupied by the line segment indication field may be 2 or more and less than 8. Alternatively, the number of bits occupied by the line segment indication field is not limited, and may be, for example, 1 or may be 8 or more. When the existing header of the data packet is used, the receiving end may determine the segment number of the data packet by using the value of the i_seq_num field. The i_seq_num field occupies 8 bits. However, in the embodiment of this application, the receiving end may determine the number of segments into which the line is divided by using the line segment indication field, and the number of bits occupied by the line segment indication field is less than 8. Obviously, compared with the existing scheme, the technical solution provided in the embodiment of this application can reduce the amount of bits occupied by the header, thereby improving the encapsulation efficiency.
[0018] In an optional implementation, the first information is further used to indicate a first quantity, and the first quantity is used to indicate the quantity of data packets in the line in which the portion of the content is located. The fact that the first information is used to indicate the logical frame number of the frame in which the portion of the content is located, the line in which the portion of the content is located in the frame of the image, and the first quantity may be realized in the following manner.
[0019] The first information is used to indicate a logical frame number of a frame in which the portion of the content is located, a line in which the portion of the content is located within the frame of the image, and a first quantity by using a joint coding scheme.
[0020] A joint coding scheme is used, so that one piece of information (i.e., the first information) can indicate more content, thereby improving information utilization. In addition, in the third implementation, the first information can indicate more content, so that the amount of bits occupied by the field to complete the same function can be reduced to a greater extent, thereby improving encapsulation efficiency to a greater extent. In addition, the state of the first information clearly indicates the start and end of a frame, respectively. Even if the data packet used to indicate the end frame of the previous frame is lost, the receiving end can determine the start position of the next frame based on the received data packet used to indicate the start frame of the next frame, and can determine the end position of the previous frame accordingly. According to the technical solution in the embodiment of this application, the receiving end can more reliably determine the start and end of a frame.
[0021] In an optional implementation, the first information being used to indicate a line in a frame of an image on which a portion of content is located may be realized in the following manner.
[0022] The first information is used to indicate the logical line number of a portion of the content within a frame of an image.
[0023] The logical line number is a line counting mode, which does not record the actual line number, but is used to distinguish between different lines within a certain range. Because the first information indicates the logical line number and does not need to indicate the actual line number, the first information does not need to occupy excess bits. Therefore, because the first information indicates the logical line number and does not need to indicate the actual line number, the technical solution provided in the embodiment of this application can reduce the quantity of bits occupied by the header, reduce the transmission overhead, and improve the encapsulation efficiency.
[0024] In an optional implementation, the first data packet may further include a sequence number field, which is used to indicate a sequence number of the first data packet in the first data stream, the first data stream being the data stream in which the first data packet is located.
[0025] In an optional implementation, the number of bits occupied by the sequence number field is greater than or equal to 6 and less than or equal to 8.
[0026] The first communication device may count all data packets by using the sequence number field, so that the sequence numbers of all data packets sent by the first communication device are consecutive, and the receiving end can determine the data packets lost in the transmission process based on the sequence number field in the received data packets, and determine the position of the lost data packets based on the sequence number field, thereby reducing the probability that the data received by the receiving end is disturbed.
[0027] In an optional implementation, the first data packet may further include a stream identifier field, where the stream identifier field is used to indicate an identifier of the data stream in which the first data packet is located.
[0028] In an optional implementation, the number of bits occupied by the stream identifier field is greater than or equal to 2 and less than or equal to 5.
[0029] The stream identifier field may indicate an identifier of a first data stream, which is the data stream in which the first data packet is located, so that the second communication device can determine the data stream to which the first data packet belongs. For example, in an in-vehicle scenario, a small amount of data streams are transmitted. Therefore, the stream identifier field can indicate the data stream without occupying excessive bits. In this way, the amount of bits occupied by the header can be reduced and the encapsulation efficiency can be improved.
[0030] In an optional implementation, the first data packet may further include a data format field, where the data format field is used to indicate a format and pixel quantization depth of the frame of the image.
[0031] The second communication device can determine the format and pixel quantization depth of the image in which the content contained in the first data packet is located by using the data format field.
[0032] According to a second aspect, a second image transmission method is provided, the method including: a second communication device receiving a first data packet from a first communication device; the second communication device obtaining a portion of content of a frame of the image and first information from the first data packet, and determining a logical frame number of the frame in which the portion of content is located and a line in the frame of the image in which the portion of content is located based on the first information.
[0033] The method may be performed by a second communication device. The second communication device may be a communication device or a communication device, e.g., a chip, capable of supporting functions required by the communication device to perform the method. For example, the second communication device is a terminal device. The terminal device may be an in-vehicle device such as an MDC or an in-vehicle display, or may be a non-in-vehicle device. The terminal device may be a terminal device, or a chip located in the terminal device and configured to realize the functions of the terminal device, or another component configured to realize the functions of the terminal device.
[0034] In an optional implementation, the first information includes frame indication information and line number indication information, the frame indication information is carried in a frame indication field, and the line number indication information is carried in a line number indication field. The second communication device determining the logical frame number of the frame in which the portion of the content is located and the line in which the portion of the content is located in the frame of the image based on the first information included in the first data packet may be realized in the following manner.
[0035] The second communication device determines a logical frame number of a frame in which the portion of the content is located based on the frame indication field, and determines a line within the frame of the image in which the portion of the content is located based on the line number indication field.
[0036] In an optional implementation, the second communication device determining the logical frame number of the frame in which the portion of the content is located and the line in which the portion of the content is located within the frame of the image based on the first information included in the first data packet may be achieved in the following manner.
[0037] The second communication device determines a logical frame number of a frame in which the portion of the content is located and a line in which the portion of the content is located within the frame of the image based on the joint coding scheme in the first information.
[0038] In an optional implementation, the first data packet further includes a line segment representation field, the line segment representation field is used to indicate a first quantity, the first quantity is used to indicate a quantity of data packets in the line in which the portion of the content is located.
[0039] In an optional implementation, the number of bits occupied by the line segment representation field is greater than or equal to 2 and less than 8.
[0040] In an optional implementation, the first information is further used to indicate a first quantity, and the first quantity is used to indicate a quantity of data packets in a line in which the portion of the content is located. In an optional implementation, the second communication device determining the logical frame number of the frame in which the portion of the content is located, the line in which the portion of the content is located in the frame of the image, and the first quantity based on the first information included in the first data packet may be realized in the following manner.
[0041] The second communication device determines a logical frame number of a frame in which the portion of the content is located, a line in which the portion of the content is located in the frame of the image, and a first quantity based on the joint coding scheme in the first information.
[0042] In an optional implementation, the second communication device determining a line in which the portion of the content is located in the frame of the image based on the first information may be realized in the following manner: The second communication device determines a logical line number of the portion of the content in the frame of the image based on the first information.
[0043] In an optional implementation, the first data packet may further include a sequence number field, which is used to indicate a sequence number of the first data packet in the first data stream, the first data stream being the data stream in which the first data packet is located.
[0044] In an optional implementation, the number of bits occupied by the sequence number field is greater than or equal to 6 and less than or equal to 8.
[0045] In an optional implementation, the first data packet further includes a stream identifier field, which is used to indicate an identifier of the data stream in which the first data packet is located.
[0046] In an optional implementation, the number of bits occupied by the stream identifier field is greater than or equal to 2 and less than or equal to 5.
[0047] In an optional implementation, the first data packet further includes a data format field, where the data format field is used to indicate a format and pixel quantization depth of the frame of the image.
[0048] For technical effects provided by the second aspect or optional implementations, please refer to the description of the technical effects provided by the first aspect or corresponding implementations.
[0049] According to a third aspect, a communication device is provided. For example, the communication device is the first communication device described above. The first communication device is configured to execute the method in the first aspect or any optional implementation. Specifically, the first communication device may include modules configured to execute the method in the first aspect or any optional implementation, for example, a processing module and a transceiver module. For example, the transceiver module may include a sending module and a receiving module. The sending module and the receiving module may be different functional modules, or may be the same functional module but realize different functions (the sending module is configured to realize the function of sending a signal, and the receiving module is configured to realize the function of receiving a signal). For example, the first communication device is a communication device, or a chip or another component disposed in the communication device. For example, the communication device is a terminal device or an in-vehicle module. For example, the first communication device may be an in-vehicle module, or a chip or another component disposed in the in-vehicle module. For example, the transceiver module may alternatively be realized by a transceiver, and the processing module may alternatively be realized by a processor. Alternatively, the sending module may be realized by a transmitter, and the receiving module may be realized by a receiver. The transmitter and receiver may be different functional modules, or may be the same functional module but realize different functions (the transmitter is configured to realize the function of sending a signal, and the receiver is configured to realize the function of receiving a signal). If the first communication device is a communication device, the transceiver is realized by an antenna, a feeder, a codec, or the like in the communication device. Alternatively, if the first communication device is a chip disposed in the communication device, the transceiver (or the transmitter and receiver) is a communication interface (or an interface circuit) or the like in the chip.The communication interface is connected to a radio frequency transceiver component in the communication device to realize information reception and transmission by using the radio frequency transceiver component. The processing module and the transceiver module are still used as examples to explain the third aspect.
[0050] The processing module is configured to generate a first data packet, the first data packet including a portion of content of a frame of the image and first information, the first information used to indicate a logical frame number of the frame in which the portion of content is located and a line in which the portion of content is located within the frame of the image.
[0051] The transceiver module is configured to send the first data packet to a second communication device.
[0052] In an optional implementation, the first information includes frame display information and line number display information, where the frame display information is carried in a frame display field and the line number display information is carried in a line number display field. The fact that the first information is used to indicate the logical frame number of the frame in which the portion of the content is located and the line in which the portion of the content is located in the frame of the image may be realized in the following manner.
[0053] The frame indication field is used to indicate the logical frame number of the frame in which the portion of content is located, and the line number indication field is used to indicate the line in which the portion of content is located within the frame of the image.
[0054] In an optional implementation, the fact that the first information is used to indicate the logical frame number of the frame in which the portion of the content is located and the line in which the portion of the content is located within the frame of the image may be achieved in the following manner:
[0055] The first information is used to indicate the logical frame number of the frame in which the portion of content is located and the line in which the portion of content is located within the frame of the image by using a joint coding scheme.
[0056] In an optional implementation, the first data packet may further include a line segment representation field, where the line segment representation field is used to indicate a first quantity, where the first quantity is used to indicate a quantity of data packets in the line in which the portion of the content is located.
[0057] In an optional implementation, the number of bits occupied by the line segment representation field is greater than or equal to 2 and less than 8.
[0058] In an optional implementation, the first information is further used to indicate a first quantity, and the first quantity is used to indicate the quantity of data packets in the line in which the portion of the content is located. The fact that the first information is used to indicate the logical frame number of the frame in which the portion of the content is located, the line in which the portion of the content is located in the frame of the image, and the first quantity may be realized in the following manner.
[0059] The first information is used to indicate a logical frame number of a frame in which the portion of the content is located, a line in which the portion of the content is located within the frame of the image, and a first quantity by using a joint coding scheme.
[0060] In an optional implementation, the first information being used to indicate a line in a frame of an image on which a portion of content is located may be realized in the following manner.
[0061] The first information is used to indicate the logical line number of a portion of the content within a frame of an image.
[0062] In an optional implementation, the first data packet may further include a sequence number field, which is used to indicate a sequence number of the first data packet in the first data stream, the first data stream being the data stream in which the first data packet is located.
[0063] In an optional implementation, the number of bits occupied by the sequence number field is greater than or equal to 6 and less than or equal to 8.
[0064] In an optional implementation, the first data packet may further include a stream identifier field, where the stream identifier field is used to indicate an identifier of the data stream in which the first data packet is located.
[0065] In an optional implementation, the number of bits occupied by the stream identifier field is greater than or equal to 2 and less than or equal to 5.
[0066] In an optional implementation, the first data packet may further include a data format field, where the data format field is used to indicate a format and pixel quantization depth of the frame of the image.
[0067] For technical effects provided by the third aspect or optional implementations, please refer to the description of the technical effects provided by the first aspect or corresponding implementations.
[0068] According to a fourth aspect, a communication device is provided. For example, the communication device is the second communication device described above. The second communication device is configured to execute the method in the second aspect or any optional implementation. Specifically, the second communication device may include modules configured to execute the method in the second aspect or any optional implementation, for example, a processing module and a transceiver module. For example, the transceiver module may include a sending module and a receiving module. The sending module and the receiving module may be different functional modules, or may be the same functional module but realize different functions (the sending module is configured to realize the function of sending a signal, and the receiving module is configured to realize the function of receiving a signal). For example, the second communication device is a communication device, or a chip or another component disposed in the communication device. For example, the communication device is a network device (for example, an access network device), a terminal device, or an in-vehicle module. For example, the second communication device may be an in-vehicle module, or a chip or another component disposed in the in-vehicle module. For example, the transceiver module may alternatively be realized by a transceiver, and the processing module may alternatively be realized by a processor. Alternatively, the sending module may be realized by a transmitter, and the receiving module may be realized by a receiver. The transmitter and receiver may be different functional modules, or may be the same functional module but realize different functions (the transmitter is configured to realize the function of sending a signal, and the receiver is configured to realize the function of receiving a signal). If the second communication device is a communication device, the transceiver is realized by an antenna, a feeder, a codec, or the like in the communication device. Alternatively, if the second communication device is a chip disposed in the communication device, the transceiver (or the transmitter and receiver) is a communication interface (or an interface circuit) or the like in the chip.The communication interface is connected to a radio frequency transceiver component in the communication device to realize information reception and transmission by using the radio frequency transceiver component. The processing module and the transceiver module are still used as examples to explain the fourth aspect.
[0069] The transceiver module is configured to receive a first data packet from a first communication device.
[0070] The processing module is configured to obtain a portion of the content of the frame of the image and first information from the first data packet, and to determine a logical frame number of the frame in which the portion of the content is located and a line in which the portion of the content is located within the frame of the image based on the first information.
[0071] In an optional implementation, the first information includes frame indication information and line number indication information, the frame indication information being carried in a frame indication field, and the line number indication information being carried in a line number indication field. The logical frame number of the frame in which the portion of content is located is determined based on the frame representation field, and the line in the frame of the image in which the portion of content is located is determined based on the line number representation field.
[0072] In an optional implementation, the processing module comprises: The method is configured to determine a logical frame number of a frame in which the portion of content is located and a line within the frame of the image in which the portion of content is located based on the joint coding scheme in the first information.
[0073] In an optional implementation, the first data packet further includes a line segment representation field, the line segment representation field is used to indicate a first quantity, the first quantity is used to indicate a quantity of data packets in the line in which the portion of the content is located.
[0074] In an optional implementation, the number of bits occupied by the line segment representation field is greater than or equal to 2 and less than 8.
[0075] In an optional implementation, the first information is further used to indicate a first quantity, and the first quantity is used to indicate a quantity of data packets in the line in which the portion of the content is located. The method is configured to determine a logical frame number of a frame in which the portion of the content is located, a line in which the portion of the content is located within the frame of the image, and a first quantity based on a joint coding scheme in the first information.
[0076] In an optional implementation, the processing module comprises: A logical line number of the portion of the content within the frame of the image is configured to be determined based on the first information.
[0077] In an optional implementation, the first data packet may further include a sequence number field, which is used to indicate a sequence number of the first data packet in the first data stream, the first data stream being the data stream in which the first data packet is located.
[0078] In an optional implementation, the number of bits occupied by the sequence number field is greater than or equal to 6 and less than or equal to 8.
[0079] In an optional implementation, the first data packet may further include a stream identifier field, where the stream identifier field is used to indicate an identifier of the data stream in which the first data packet is located.
[0080] In an optional implementation, the number of bits occupied by the stream identifier field is greater than or equal to 2 and less than or equal to 5.
[0081] In an optional implementation, the first data packet may further include a data format field, where the data format field is used to indicate a format and pixel quantization depth of the frame of the image.
[0082] For technical effects provided by the fourth aspect or optional implementations, please refer to the description of the technical effects provided by the second aspect or corresponding implementations.
[0083] According to a fifth aspect, a communication device is provided. For example, the communication device is the first communication device or the second communication device described above. The communication device includes a processor and a communication interface (or an interface circuit). The communication interface may be configured to communicate with another device or device. Optionally, the communication device may further include a memory configured to store computer instructions. The processor and the memory are coupled to each other to perform the method described in the first aspect or any optional implementation, or the method described in the second aspect or any optional implementation. Alternatively, the communication device may not include a memory, and the memory may be located outside the communication device. The processor, the memory, and the communication interface are coupled to each other to perform the method described in the first aspect or any optional implementation, or the method described in the second aspect or any optional implementation. For example, when the processor executes the computer instructions stored in the memory, the communication device is enabled to perform the method in the first aspect or any optional implementation, or the method in the second aspect or any optional implementation. For example, the communication device may be a communication device, or may be a chip or other component disposed in a communication device. For example, the communication device may be a terminal device or an in-vehicle module. For example, the communication device may be an in-vehicle module, or may be a chip or other component disposed in an in-vehicle module.
[0084] If the communication apparatus is a communication device, the communication interface is realized by a transceiver (or a transmitter and a receiver) or the like in the communication device. For example, the transceiver is realized by an antenna, a feeder, or a codec in the communication device. Alternatively, if the communication apparatus is a chip disposed in the communication device, the communication interface is an input / output interface or the like in the chip, for example, an input / output pin. The communication interface is connected to a radio frequency transceiver component in the communication device to realize information reception and transmission by using the radio frequency transceiver component.
[0085] In an optional implementation, a portion of the content of the frame of the image may be included in the payload of the first data packet.
[0086] In an optional implementation, one or more of the first information, a segment indication field, a sequence number field, a stream identifier field, a data format field, and the like may be included in a header of the first data packet.
[0087] According to a sixth aspect, there is provided a chip, the chip including a processor and a communication interface, the processor configured to call and launch instructions from the communication interface, and when the processor executes the instructions, the chip is enabled to perform the method of the first aspect or an implementation of the first aspect, or the method of the second aspect or an implementation of the second aspect.
[0088] According to a seventh aspect, there is provided a computer-readable storage medium, configured to store computer instructions, which when executed in a computer, enable the computer to execute the method of the first aspect or an implementation of the first aspect, or the method of the second aspect or an implementation of the second aspect.
[0089] According to an eighth aspect, there is provided a computer program product comprising computer instructions which, when executed in a computer, enable the computer to execute the method of the first aspect or an implementation of the first aspect, or the method of the second aspect or an implementation of the second aspect.
[0090] According to a ninth aspect, an embodiment of the present application provides a communication system, the communication system including a communication device according to the third aspect, a communication device according to the fifth aspect (configured to perform the method described in the first aspect or optional implementation), or a chip according to the sixth aspect (configured to perform the method described in the first aspect or optional implementation), and including a communication device according to the fourth aspect, a communication device according to the fifth aspect (configured to perform the method described in the second aspect or optional implementation), or a chip according to the sixth aspect (configured to perform the method described in the second aspect or optional implementation).
[0091] In an embodiment of this application, the first information may indicate a logical frame number of a frame in which the content included in the first data packet is located. Thus, the first information does not need to include excess bits, thereby reducing the amount of bits occupied by the header, reducing transmission overhead, and improving encapsulation efficiency. [Brief description of the drawings]
[0092] [Figure 1] FIG. 1 is a schematic diagram of an application scenario according to an embodiment of the present application. [Diagram 2] 2 is a schematic diagram of an encapsulation format of a data packet. [Diagram 3] FIG. 2 is a schematic diagram of another application scenario according to an embodiment of the present application. [Figure 4A] FIG. 2 is a schematic diagram of another application scenario according to an embodiment of the present application. [Figure 4B]FIG. 2 is a schematic diagram of another application scenario according to an embodiment of the present application. [Figure 4C] FIG. 2 is a schematic diagram of another application scenario according to an embodiment of the present application. [Diagram 5] 1 is a flowchart of an image transmission method according to an embodiment of the present application. [Figure 6] FIG. 2 is a schematic diagram of the structure of a first communication device according to an embodiment of this application; [Figure 7] FIG. 2 is a schematic diagram of the structure of a second communication device according to an embodiment of this application; [Figure 8] 1 is a schematic diagram of the structure of a communication device according to an embodiment of this application; [Figure 9] FIG. 1 is a schematic diagram of the structure of an apparatus according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0093] In the description, claims, and accompanying drawings of the embodiments of this application, the terms "comprise", "contain", and any other variations thereof are meant to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that includes a list of steps or units is not necessarily limited to the explicitly listed steps or units, but may include other steps or units that are not explicitly listed or that are inherent to such process, method, product, or device.
[0094] For example, the communication device in the embodiment of this application may be a device that can send an image or video file to another device, for example, an in-vehicle device such as an in-vehicle camera or a cockpit domain controller (CDC), or may be an electronic device such as a mobile phone, a tablet computer, a desktop computer, a laptop computer, a notebook computer, an ultra-mobile personal computer (UMPC), a handheld computer, a netbook, a personal digital assistant (PDA), a wearable electronic device, or a virtual reality device. For another example, the communication device in the embodiment of this application may alternatively be an intelligent terminal other than a vehicle having a function that can be realized by the first communication device or the second communication device in the embodiment of this application, or may be disposed in an intelligent terminal other than a vehicle having a function that can be realized by the first communication device or the second communication device in the embodiment of this application, or may be disposed in a component of an intelligent terminal. The intelligent terminal may be another terminal device, such as an intelligent transportation device, a smart home device, or a robot. The communication device includes, but is not limited to, an intelligent terminal, and a controller in the intelligent terminal, another sensor such as a chip, a radar, or a camera, another component, and the like. Alternatively, the communication device in the embodiment of this application may be any one of the above devices, for example, a functional module disposed in a chip system.
[0095] The following will first explain some terms in the embodiments of this application to help those skilled in the art have a better understanding.
[0096] (1) Cockpit Domain Controller (CDC), also called head unit. In addition to traditional functions such as radio, music time frequency playback, and navigation, current in-vehicle machines also have cellular communication functions (3G, 4G, or similar), and can combine controller area network (CAN) technology with vehicle bus (BUS) technology to realize vehicle-to-pedestrian and vehicle-to-everything information communication, and improve user experience and services as well as safety-related functions.
[0097] (2) A multi-domain controller (MDC), also known as a mobile data center (MDC), is a control center for an ADAS or ADS. The MDC may receive information sensed by sensors such as a camera, laser radar, or millimeter-wave radar, process the received information, and correspondingly make decisions to control the progression of the vehicle.
[0098] (3) In the embodiments of this application, "at least one" means one or more, and "multiple" means two or more. The term "and / or" describes an association relationship to describe associated objects and expresses that three relationships may exist. For example, A and / or B may represent the following three cases: only A exists, both A and B exist, and only B exists, where A and B may be singular or plural. The character " / " usually expresses an "or" relationship between associated objects. "At least one of" or similar expressions indicate "any combination of the following," including "one or any combination of the following." For example, at least one of a, b, or c may represent a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c may be singular or plural.
[0099] In addition, unless otherwise stated, in the embodiments of this application, ordinals such as "first" and "second" are used to distinguish between multiple objects, and are not intended to limit the size, content, order, time sequence, priority, or importance of the multiple objects. For example, a first data packet and a second data packet are merely names given for ease of description, and the two data packets may be the same data packet or different data packets.
[0100] The above describes some noun concepts in the embodiments of this application. The following describes the technical features in the embodiments of this application.
[0101] At present, automobiles are developed intelligently, and corresponding in-vehicle devices are installed in automobiles to provide intelligent services. For example, ADAS or ADS are increasingly installed in automobiles. In-vehicle devices need to transmit data to each other to function together. For example, most ADAS or ADS currently rely on cameras to sense the environment around the vehicle in real time. Therefore, it becomes particularly important for the camera to accurately transmit the sensed driving environment information to the image processing unit of the ADAS or ADS. ADAS or ADS has increasingly higher requirements for image resolution, frame rate, and pixel quantization depth. Therefore, the amount of data that needs to be transmitted is also larger, and the rate requirements for the transmission chip are also higher.
[0102] FIG. 1 shows an example of an in-vehicle image transmission process. FIG. 1 includes a camera and an MDC. An image sensor in the camera sends sensed image data to a serializer in the camera. The serializer encapsulates the received image data into a data packet according to a specific format, and then sends the data packet to a deserializer in the MDC. The deserializer parses the data packet to obtain the image data contained in the data packet, and sends the image data to a main control chip in the MDC.
[0103] A video includes images at a certain frame rate. Each frame of an image includes a fixed number of lines and columns. The number of pixels of an image is obtained by multiplying the number of lines with the number of columns. For example, an image with a resolution of 1080P includes 1080 lines and 1920 columns, and the number of pixels of an image is 1080x1920. Each pixel is carried by using a certain number of bits. For example, a pixel may be carried by using 16 bits, or by using another number of bits.
[0104] During image transmission, in addition to the pixel data of the image, two synchronization signals are also transmitted: a frame synchronization signal and a line synchronization signal. The frame synchronization signal is used to identify the start and end of a frame, and the line synchronization signal is used to identify the start and end of each line within a frame.
[0105] Figure 2 shows the header and payload of a data packet. Each scale in Figure 2 represents one bit, and eight bits form one byte.
[0106] The subtype field is used to indicate the data type, e.g., RAW image, and occupies 1 byte.
[0107] The sv field, ie, stream_id valid field, is used to indicate whether the stream ID is valid and occupies 1 bit.
[0108] The version field is used to indicate the protocol version number and occupies 4 bits.
[0109] The mr field, ie, media clock restart field, is used to indicate whether the clock source is switched and occupies 1 bit.
[0110] The rsv field, ie, the reserved field, is used as reserved bits and occupies 2 bits.
[0111] The tv field, ie, timestamp valid field, is used to indicate whether the timestamp is valid and occupies one bit.
[0112] The sequence_num field is used to indicate the sequence number of the data packet and occupies 1 byte.
[0113] The header depicted in FIG. 2 includes several reserved bit fields, which are used to indicate reserved positions within the header and which are unused.
[0114] The tu field, i.e. timestamp uncertain, is used to indicate whether the timestamp is accurate and occupies one bit.
[0115] The subtype field, sv field, version field, mr field, rsv field, tv field, sequence_num field, reserved field occupying 7 bits, and tu field belong to subtype data.
[0116] The stream_id field is used to indicate the ID of the data stream to which the data packet belongs and occupies 8 bytes.
[0117] The avtp_timestamp field is used to indicate the timestamp of the current data packet and occupies 4 bytes. The avtp_timestamp field belongs to the audio / video transport protocol (AVTP) time, and "timestamp" indicates the timestamp.
[0118] The active_pixels field is used to indicate the quantity of active pixels contained in the line in which the data packet is located within the frame of the image and occupies 2 bytes.
[0119] The total_line field is used to indicate the number of lines contained in the frame of the image in which the data packet is located and occupies 2 bytes.
[0120] The active_pixels and total_line fields are subtype specific.
[0121] The stream_data_length(octets) field is used to indicate the length of the packet's payload, the length in bytes. Here, "octets" means a group of 8 bits, i.e., 8 bits, 1 byte. The stream_data_length field occupies 2 bytes.
[0122] The ap field, i.e., active pixel field, is used to indicate whether the data packet contains an active pixel and occupies 1 bit.
[0123] The r field is used to indicate a reserved field and occupies one bit.
[0124] The f field, i.e., the field field, is used to indicate the first and second fields of an interlaced pair in an interlaced video payload and occupies 1 bit.
[0125] The ef field, i.e., end frame field, is used to indicate the end of a frame and occupies 1 bit. If the current data packet is the last data packet in a frame of an image, the ef field is set to 1; otherwise, the ef field is set to 0.
[0126] The evt field, ie, event field, is reserved for indicating events of higher layer protocols and occupies 4 bits.
[0127] The pd field, ie, pull-down field, is used to indicate whether the video frame rate is reduced and occupies 1 bit.
[0128] The i field, ie, interlaced field, is used to indicate whether the video source is in interlaced video mode and occupies 1 bit.
[0129] The stream_data_length(octets) field, the ap field, the r field, the f field, the ef field, the evt field, the pd field, the i field, and the reserved field occupying 6 bits belong to packet information.
[0130] The pixel_depth field is used to indicate the pixel quantization depth of the frame of the image in which the data packet is located and occupies 4 bits.
[0131] The pixel_format field is used to indicate the type of image frame in which the data packet is located, for example, to indicate that the image type is red, green, and blue (RGB), and occupies 4 bits.
[0132] For example, it may be determined that the frame of the image in which the data packet is located is an RGB888 image by referring to the pixel_depth and pixel_format fields.
[0133] The frame_rate field is used to indicate the frame rate of the frame of the image in which the data packet is located and occupies 1 byte.
[0134] The color space field is used to indicate the color space of the image in which the content contained in the data packet is located, i.e., to indicate the color composition of the image being displayed, and occupies 4 bits.
[0135] The number of lines (num_lines) field is used to indicate the number of lines contained in the current data packet and occupies 4 bits. When the number of lines contained in the data packet is less than 1 (e.g., the data packet contains only some pixels of one line), the field is set to 0.
[0136] The reserved field, which occupies 1 byte, the pixel_depth field, the pixel_format field, the frame_rate field, the colorspace field, the num_lines field, the reserved field, which occupies 1 byte, the i_seq_num field, and the line_number field belong to the raw header.
[0137] The segment number (i_seq_num) field is used to indicate a segment number corresponding to the content contained in the current data packet in a line of a frame of an image, and occupies one byte. Specifically, a line of pixels in a frame of an image may be divided into multiple segments, and one segment is carried in one data packet. In this case, each of the multiple segments corresponds to one segment number, and the i_seq_num field is used to indicate the segment number of the pixel carried in the current data packet. When the value of the num_lines field is 0, it indicates that one line of pixels is divided into multiple data packets for transmission, and the i_seq_num field is used to indicate the segment number of the current data packet in the line of pixels. When the value of the num_lines field is greater than 0, the value of the i_seq_num field is set to 0.
[0138] The line_number field is used to indicate the line in which the pixel contained in the current data packet is located and occupies 2 bytes. When the data packet contains multiple lines of an image frame, the line_number field is used to indicate the maximum line number among the multiple lines. When the value of the line_number field is equal to the value of the total_line field, it indicates that the current frame ends.
[0139] In addition, a video_data_payload field is used to carry image data.
[0140] It can be known from the above description that the receiving end may extract a frame synchronization signal by using the value of the ef field and by determining whether the value of the line_number field is equal to the value of the total_line field. In addition, the receiving end may extract a line synchronization signal by using the value of the line_number field. In addition, when a packet loss occurs, the receiving end may determine the line of the image frame in which the pixel included in the lost data packet is located by using the line_number field, and may further determine the position of the pixel included in the lost data packet in the line of the image frame by using the i_seq_num field. Therefore, no disturbance is caused in the image frame at the receiving end after a packet loss occurs.
[0141] In some special scenarios, the header of the data packet shown in Figure 2 actually contains some redundant fields, resulting in reduced encapsulation efficiency. The following uses an in-vehicle scenario as an example for illustration.
[0142] For example, in an in-vehicle scenario, all the cameras used are high definition cameras. Therefore, a line of an image frame contains a relatively large number of pixels, and the amount of data is relatively large. In practical applications, multiple lines are generally not encapsulated in one data packet, but only one line is encapsulated in one data packet at most. Therefore, the num_lines field is actually an invalid field in the in-vehicle scenario, resulting in reduced encapsulation efficiency.
[0143] For another example, if the data packet header shown in Figure 2 is used, the frame synchronization signal and the line synchronization signal may be extracted by using the total_line field and the line_number field, which occupy a relatively large amount of bits, resulting in an excessively high overhead and reduced encapsulation efficiency.
[0144] For another example, if the data packet header shown in Figure 2 is used, the frame synchronization signal may be extracted by using the ef field or by using the total_line and line_number fields. Obviously, the functions are duplicated.
[0145] For another example, in an in-vehicle scenario, during image transmission, if a line of a frame of an image needs to be segmented, the amount of segments obtained is not very large, for example, up to a dozen segments. Thus, the segment number in the line can be indicated without using excessive bits. However, the i_seq_num field occupies a relatively large amount of bits, resulting in a relatively high overhead and reduced encapsulation efficiency.
[0146] For another example, in an in-vehicle scenario, the pixels carried in the data packets are generally active pixels, so there is no need for the active-pixel field to be used to indicate the active pixels.
[0147] For another example, in an in-vehicle scenario, the frame rate of an image is generally fixed and pre-configured by both the transmitting end and the receiving end, so there is no need for the frame-rate field to be used to indicate the frame rate of an image.
[0148] For another example, in a vehicle-in scenario, a camera generally outputs video data directly collected by an image sensor, and there is no color space. When a CDC outputs video data, the sending end and the receiving end generally pre-configure the color space. Therefore, there is no need for the colorspace field to be set in the data packet.
[0149] In conclusion, in some special scenarios, the header shown in Fig. 2 includes some redundant fields or redundant bits, resulting in a relatively high encapsulation overhead. In addition, a data packet includes a header and a payload, and the encapsulation efficiency is equal to the number of bytes occupied by the payload in the data packet divided by the total number of bytes of the data packet. It can be known that a larger number of bits occupied by the header indicates a larger total number of bytes of the data packet and a lower encapsulation efficiency.
[0150] In view of this, a technical solution is provided in an embodiment of this application. In an embodiment of this application, the first information may indicate a logical frame number of a frame in which the content included in the first data packet is located. Because the first information indicates a logical frame number and does not need to indicate an actual frame number, the first information does not need to include excess bits. For example, even if the first information includes only one bit, the first information can indicate a logical frame number. Compared with the prior art, the technical solution provided in an embodiment of this application can reduce the amount of bits occupied by the header, reduce transmission overhead, and improve encapsulation efficiency.
[0151] The communication scenarios to which the technical solutions provided in the embodiments of this application are applied may include wide-area communication, for example, communication between multiple base stations and multiple terminal devices, or may include in-vehicle communication scenarios, for example, communication between a CDC and a display or between a camera and an MDC, or may include vehicle-to-everything communication scenarios. For example, the embodiments of this application may be applied to the fields of autonomous driving, intelligent driving, or short-range communication, or may be applied to Internet of Vehicles, for example, vehicle-to-everything (V2X), long term evolution-vehicle (LTE)-V, and vehicle-to-vehicle (V2V). Alternatively, the communication scenarios may include local wireless communication, for example, communication between multiple access points (AP) and multiple stations.
[0152] For example, when the technical solution provided in the embodiment of this application is applied to an in-vehicle communication scenario, FIG. 1 and FIG. 3 represent two application scenario examples of the embodiment of this application. FIG. 1 includes a camera and an MDC. The camera may be used as a transmitting end of a data packet, and the MDC may be used as a receiving end of the data packet. The camera and the MDC are connected by using a cable such as a coaxial cable or a twisted pair cable. The camera includes an image sensor and a serializer (e.g., a transmission chip), and the interface between the image sensor and the serializer in the camera is a mobile industry processor interface (MIPI) or a parallel interface. The deserializer and the processor in the MDC are connected through an interface such as a MIPI interface or a parallel interface. The image data collected by the image sensor is sent to the serializer through an interface such as MIPI. The serializer receives the image data from the interface such as MIPI, and then transmits the image data to the deserializer in the MDC through a cable. After receiving the image data, the deserializer transmits the image data to the processor through an interface such as MIPI. The processor may receive the image data, analyze the content of the image data, and perform decisions regarding driving.
[0153] FIG. 3 includes a CDC and a display. The CDC and the display are connected by using a cable such as a coaxial cable or a twisted pair cable. The CDC includes an image processor and a serializer (e.g., a transmission chip), and the interface between the processor and the serializer is a MIPI or parallel interface. The deserializer and the screen in the display are connected through an interface such as a MIPI interface or a parallel interface. Image data acquired by the processor in the CDC is sent to the serializer through an interface such as a MIPI interface. The serializer receives the image data from the interface such as MIPI, and then transmits the image data to the deserializer in the display through a cable. After receiving the image data, the deserializer may transmit the image data to the screen through an interface such as MIPI, and then display the image data on the screen.
[0154] Alternatively, when the technical solutions provided in the embodiments of this application are applied to an in-vehicle communication scenario, the scenarios shown in Fig. 1 or 3 do not constitute limitations. The technical solutions provided in the embodiments of this application may be used under the condition that two in-vehicle devices transmit images through line transmission, and the lines of the images include a relatively large amount of pixels. In addition, when the technical solutions provided in the embodiments of this application are applied to another wide-area communication or local-area communication scenario, the network architecture to which the embodiments of this application are applied may be changed accordingly.
[0155] For example, when the technical solutions provided in the embodiments of this application are applied to a V2X communication scenario, Fig. 4A represents an application scenario of the embodiments of this application. Fig. 4A includes a terminal device 1 and a terminal device 2. The terminal device 1 and the terminal device 2 may communicate on a sidelink (SL).
[0156] For another example, when the technical solution provided in the embodiment of this application is applied to communication based on the Uu interface in an LTE system or an NR system, Figure 4B illustrates an application scenario of the embodiment of this application. Figure 4B includes a network device and a terminal device. The network device and the terminal device may communicate through the Uu interface.
[0157] For another example, when the technical solution provided in the embodiment of this application is applied to a wireless fidelity (Wi-Fi) scenario, FIG. 4C represents the application scenario of the embodiment of this application. FIG. 4C includes an AP and a station. The station may access the AP over Wi-Fi. In FIG. 4C, an example is used in which the station is a mobile phone.
[0158] 4A and 4B, an example is used in which the terminal device is a mobile phone, but the terminal device in the embodiment of this application is not limited thereto.
[0159] The following describes the technical solutions provided in the embodiments of this application with reference to the accompanying drawings. It should be noted that the names of fields, names of information, and the like in the following description in the embodiments of this application are examples, and the fields or information in the following description may have different names. The names of fields and names of information are not limited in the embodiments of this application.
[0160] An embodiment of this application provides an image transmission method. Figure 5 is a flow chart of the method. The method may be applied to any one of the network architectures shown in Figure 1, Figure 3, Figure 4A, Figure 4B, or Figure 4C.
[0161] For ease of explanation, an example in which the method is performed by a first communication device and a second communication device is used below. When the embodiment of this application is applied to the network architecture shown in FIG. 1, the first communication device may be the camera shown in FIG. 1, and the second communication device may be the MDC shown in FIG. 1. Alternatively, when the embodiment of this application is applied to the network architecture shown in FIG. 3, the first communication device may be the CDC shown in FIG. 3, and the second communication device may be the display shown in FIG. 3. Alternatively, when the embodiment of this application is applied to the network architecture shown in FIG. 4A, the first communication device may be the terminal device 1 shown in FIG. 4A, and the second communication device may be the terminal device 2 shown in FIG. 4A, or the first communication device may be the terminal device 2 shown in FIG. 4A, and the second communication device may be the terminal device 1 shown in FIG. 4A. Alternatively, when the embodiment of this application is applied to the network architecture shown in Figure 4B, the first communication device may be the network device shown in Figure 4B, and the second communication device may be the terminal device shown in Figure 4B, or the first communication device may be the terminal device shown in Figure 4B, and the second communication device may be the network device shown in Figure 4B. Alternatively, when the embodiment of this application is applied to the network architecture shown in Figure 4C, the first communication device may be the AP shown in Figure 4C, and the second communication device may be the station shown in Figure 4C, or the first communication device may be the station shown in Figure 4C, and the second communication device may be the AP shown in Figure 4C.
[0162] S51: A first communication device generates a first data packet.
[0163] The first data packet may include a payload and a header. The payload of the first data packet includes a portion of the content of a frame of an image, for example, may include a line of pixels of the frame of an image, or may include a portion of the line of pixels of the frame of an image (or a segment including the line of pixels of the frame of an image). For ease of description, the content included in the payload of the first data packet is referred to as the first content.
[0164] The header of the first data packet may include first information, which may indicate a logical frame number of the frame in which the first content is located, and a line in which the first content is located in the frame of the image. When the header of the data packet shown in FIG. 2 is used, the receiving end may extract a frame synchronization signal by using the value of the ef field and by determining whether the value of the line_number field is equal to the value of the total_line field. In addition, the receiving end may extract a line synchronization signal by using the value of the line_number field. However, in an embodiment of this application, the frame synchronization signal and the line synchronization signal may be provided by using the first information. Therefore, it may be considered that the first information may replace the ef field, the line_number field, and the total_line field in the header shown in FIG. 2. When the header shown in FIG. 2 is used, the ef field may only indicate an end frame, and only the ef field in the data packet containing the last content of the frame may be set to 1, and the ef field in another data packet may only be set to 0. Alternatively, when the frame synchronization signal is extracted by using the line_number field and the total_line field, the value of the line_number field is equal to the value of the total_line field only in the data packet containing the last content of the frame. That is, for a frame of an image, the receiving end can extract the frame synchronization signal only from one data packet. If that data packet is lost, the receiving end cannot extract the frame synchronization signal, and therefore cannot determine the position of the end frame or the position of the start of the next frame. Thus, disturbance of the image transmission is caused. However, in the embodiment of this application, the first information may indicate the logical frame number of the frame in which the first content is located. Therefore, the first information included in the data packets containing the content of the same frame must have the same value and is used to indicate the logical frame number of the frame.In this way, even if some data packets are lost in the transmission process, there are still some data packets that can be received normally. The receiving end can extract a frame synchronization signal based on the first information contained in the received data packets. It can be seen that the solution provided in the embodiment of this application can improve the reliability of frame synchronization and avoid image disturbance caused by the receiving end being unable to extract the frame synchronization signal.
[0165] In addition, in the embodiment of this application, the first information indicates a logical frame number of a frame in which the first content is located. The logical frame number is a frame count mode, which does not record an actual frame number, but is used to distinguish between different frames within a certain range. Because the first information indicates a logical frame number and does not need to indicate an actual frame number, the first information does not need to include excess bits. For example, even if the first information includes only one bit, the first information can indicate a logical frame number. However, it can be known from the above description that the header shown in FIG. 2 indicates an end frame by using the ef field, the line_number field, and the total_line field. Compared with the conventional technology, it can be known that the technical solution provided in the embodiment of this application can reduce the quantity of bits occupied by the header, reduce the transmission overhead, and improve the encapsulation efficiency.
[0166] Optionally, the first information indicates a line where the content included in the first content is located in the frame of the image. In one implementation, the first information indicates a logical line number of the content included in the first content in the frame of the image. The logical line number is a line count mode, which does not record the actual line number, but is used to distinguish between different lines within a certain range. Since the first information indicates a logical line number and does not need to indicate an actual line number, the first information does not need to include excess bits. However, it can be known from the above description that the header shown in FIG. 2 indicates a line number by using a line_number field, and the line_number field occupies one byte. Therefore, compared with the prior art, since the first information indicates a logical line number and does not need to indicate an actual line number, the technical solution provided in the embodiment of this application can reduce the amount of bits occupied by the header, reduce transmission overhead, and improve encapsulation efficiency.
[0167] For example, the number of bits occupied by the first information may be equal to or greater than 1 and less than 32. Alternatively, the number of bits occupied by the first information is not limited, and may be equal to or greater than 32, for example. However, the ef field, the line_number field, and the total_line field in the header shown in FIG. 2 occupy a total of 33 bits. It may be seen that, compared with the solution shown in FIG. 2, the embodiment of this application reduces the quantity of bits occupied by the header, reduces the transmission overhead, and improves the encapsulation efficiency. Of course, the number of bits occupied by the first information is merely an example here, and is not limited thereto in practice.
[0168] The fact that the first information indicates the logical frame number of the frame in which the first content is located and the line in which the content included in the first content is located in the frame of the image may be realized in different manners. The following provides an example description.
[0169] 1. Implementation 1 The first information may include frame indication information and line number indication information, and the header of the first data packet may include a frame indication field and a line number indication field. The frame indication information may be carried in the frame indication field, and the line number indication information may be carried in the line number indication field. For example, the number of bits occupied by the frame indication field is equal to or greater than 1 and less than 16, and the number of bits occupied by the line number indication field is equal to or greater than 1 and less than 16. Of course, the number of bits occupied by the frame indication field and the number of bits occupied by the line number indication field are merely examples here and are not limited thereto in practice. For example, the number of bits occupied by the frame indication field may alternatively be equal to or greater than 16, and / or the number of bits occupied by the line number indication field may alternatively be equal to or greater than 16.
[0170] In this manner, the frame indication field (or frame indication information) may indicate the logical frame number of the frame in which the first content is located, and the line number indication field may indicate the line in which the first content is located in the frame of the image. In other words, different contents may be indicated by using different information to realize a clearer indication. In addition, when the header shown in FIG. 2 is used, the ef field may only indicate the end frame, and only the ef field in the data packet containing the last content of the frame may be set to 1, and the ef field in another data packet may only be set to 0. Alternatively, when the frame synchronization signal is extracted by using the line_number field and the total_line field, only in the data packet containing the last content of the frame, the value of the line_number field is equal to the value of the total_line field. That is, for a frame of an image, the receiving end can only extract the frame synchronization signal from one data packet. If that data packet is lost, the receiving end cannot extract the frame synchronization signal, and therefore cannot determine the position of the end frame or the position of the start of the next frame. Thus, disturbance of the image transmission is caused. However, in the embodiment of this application, the frame indication information may indicate the frame in which the first content is located. Therefore, the frame indication information included in the data packets containing the content of the same frame should have the same value and is used to indicate the logical frame number of the frame. In this way, even if some data packets are lost in the transmission process, there are still some data packets that can be received normally. The receiving end can extract a frame synchronization signal based on the frame indication information included in the received data packets. It can be seen that the solution provided in the embodiment of this application can improve the reliability of frame synchronization and avoid image disturbance caused by the receiving end being unable to extract the frame synchronization signal.
[0171] In addition, when the header of the data packet shown in FIG. 2 is used, the receiving end may extract the frame synchronization signal by using the value of the ef field and by determining whether the value of the line_number field is equal to the value of the total_line field. The ef field, the line_number field, and the total_line field occupy a total of 33 bits. However, in the embodiment of this application, the amount of bits occupied by the frame indication field is, for example, less than 16. Obviously, compared with the existing scheme, the technical solution provided in the embodiment of this application can reduce the amount of bits occupied by the header, thereby improving the encapsulation efficiency.
[0172] The frame indication information needs to indicate the logical frame number of the frame in which the first content is located. In an optional implementation, the frame indication information occupies one bit, and the value of the one bit is inverted once per frame. In this case, the frame indication information may also be called frame inversion indication information or frame inversion indication. Correspondingly, the frame indication field used to carry the frame indication information may also be called the frame inversion indication field. The frame inversion indication may be understood as a logical frame number. For example, when a first frame is transmitted, the value of the frame inversion indication in the data packet containing the first frame is "1". Then, when a second frame is transmitted, the value of the frame inversion indication in the data packet containing the first frame is inverted to "0". Then, when a third frame is transmitted, the value of the frame inversion indication in the data packet containing the first frame is inverted to "1". In this way, the frame synchronization signal can be extracted by using one bit, and the quantity of bits occupied by the header can be greatly reduced.
[0173] Alternatively, the frame indication information needs to indicate the logical frame number of the frame in which the first content is located. In another optional implementation, the amount of bits occupied by the frame indication information is 2 or more, that is, the logical frame number may be indicated by using multiple bits. For example, if the frame indication information occupies 3 bits, the frame indication information can indicate up to 8 frames. For the ninth frame, the value of the frame indication information is returned to the initial value, and counting is performed again. For example, when the first frame is transmitted, the value of the frame indication information in the data packet containing the first frame is "000". Then, when the second frame is transmitted, the value of the frame indication information in the data packet containing the second frame is "001". Then, when the third frame is transmitted, the value of the frame indication information in the data packet containing the third frame is "010". By analogy, when the eighth frame is transmitted, the value of the frame indication information in the data packet containing the eighth frame is "111". Then, when the ninth frame is transmitted, the value of the frame indication information in the data packet containing the ninth frame is "000", that is, the counting is performed again for the frame indication information. The logical frame number is indicated by using a relatively large amount of bits, so that the receiving end can more easily distinguish between different frames.
[0174] Alternatively, the frame indication information may occupy 2 bits and the counting runs cyclically from 0 to 3. Alternatively, the frame indication information may occupy 16 bits and the counting runs cyclically from 0 to 65535, or the like.
[0175] When the header of the data packet shown in FIG. 2 is used, the receiving end may extract the line synchronization signal by using the value of the line_number field, where the line_number field occupies 16 bits. However, in the embodiment of this application, the receiving end may extract the line synchronization signal by using the line number indication information. The amount of bits occupied by the line number indication field is, for example, less than 16. Obviously, compared with the existing scheme, the technical solution provided in the embodiment of this application can reduce the amount of bits occupied by the header, thereby improving the encapsulation efficiency. The line number indication information included in the data packets containing the content of the same line of a frame of an image (for example, a line of a frame of an image is divided into multiple segments, and one packet contains one segment) has the same value. Therefore, even if packet loss occurs in the transmission process, for example, some data packets corresponding to a line are lost, the receiving end can still receive other data packets corresponding to the line. Therefore, the receiving end does not lose the line synchronization signal. For the receiving end, when a packet loss occurs, the receiving end can determine the line of the image frame to which the lost data packet belongs based on the line number indication field, so as to avoid line wandering within the image frame during transmission.
[0176] When the first information indicates the logical line number of the content included in the first content in the frame of the image, the line number indication field (or the line number indication information) may be used to indicate the logical line number of the first content in the frame of the image. For example, when the line number indication information occupies 3 bits, the line number indication information can indicate up to 8 lines. For the ninth line, the value of the line number indication information is returned to the initial value, and counting is performed again. For example, when the first line of the frame of the image is transmitted, the value of the line number indication information in the data packet including the first line is "000". Then, when the second line is transmitted, the value of the line number indication information in the data packet including the second line is "001". Then, when the third line is transmitted, the value of the line number indication information in the data packet including the third line is "010". By analogy, when the eighth line is transmitted, the value of the line number indication information in the data packet including the eighth line is "111". Then, when the ninth line is transmitted, the value of the line number indication information in the data packet containing the ninth line is "000", that is, the counting is performed again for the line number indication information. The logical line number is indicated by using a relatively large number of bits, so that the receiving end can more easily distinguish between different lines.
[0177] In order to enrich the content contained in the header, the header of the first data packet may further include other information in addition to the first information.
[0178] In an optional implementation, the header of the first data packet may further include one or more of the following fields: a line segment indication field, a sequence number field, a stream identifier field, a data format field, an encapsulation service type field, a reserved field, or a payload length indication field. For example, the header of the first data packet may further include a line segment indication field. Alternatively, the header of the first data packet may further include a sequence number field. Alternatively, the header of the first data packet may further include a line segment indication field and a sequence number field. Alternatively, the header of the first data packet may further include a line segment indication field, a sequence number field, and a stream identifier field. Alternatively, the header of the first data packet may further include a line segment indication field, a sequence number field, a stream identifier field, an encapsulation service type field, a reserved field, a payload length indication field, and a data format field.
[0179] The header of the first data packet may further include a line segment display field, i.e., the header of the first data packet further includes line segment display information. The line segment display information is carried in the line segment display field. The line segment display information (or the line segment display field) may indicate a first quantity, and the first quantity may indicate a quantity used to indicate a data packet in the line where the first content is located. For example, the first quantity is a quantity used to indicate a data packet in the line where the first content is located. In other words, when a frame of an image has a relatively large quantity of pixels in a line, in an embodiment of this application, the line of pixels may also be divided into multiple segments, and one data packet carries one segment. When the line where the first content is located is divided into multiple segments, the line segment display field is used to indicate the quantity of the multiple segments. For example, if a first data packet carries a segment of a second line of a frame of an image, and the second line is divided into four segments, then the line segment representation field in each data packet used to carry the second line may indicate 4. Additionally, if a line of pixels is divided into multiple segments, the amount of data (e.g., the number of pixels contained) for all segments may be the same, or the amount of data for different segments may differ.
[0180] For example, in a vehicle-in scenario, a line of a frame of an image is not divided into excessive segments. Thus, a segment of a line of a frame of an image may be indicated without using excessive bits. When the header of the data packet shown in FIG. 2 is used, the receiving end may determine the segment number of the data packet by using the value of the i_seq_num field. The i_seq_num field occupies 8 bits. This is certainly wasteful. In an embodiment of this application, the line segment indication field indicates the number of segments into which a line is divided, and does not need to indicate a specific segment number. In this way, the amount of bits occupied by the line segment indication field can be reduced, and the encapsulation efficiency can be improved. In other words, the embodiment of this application provides another indication scheme (i.e., indicating the number of segments into which a line is divided), so that the amount of bits occupied by the line segment indication field can be reduced.
[0181] Optionally, the number of bits occupied by the line segment indication field may be 2 or more and less than 8. Alternatively, the number of bits occupied by the line segment indication field is not limited, and may be, for example, 1 or 8 or more. When the header of the data packet shown in FIG. 2 is used, the receiving end may determine the segment number of the data packet by using the value of the i_seq_num field. The i_seq_num field occupies 8 bits. However, in the embodiment of this application, the receiving end may determine the number of segments into which the line is divided by using the line segment indication field, and the number of bits occupied by the line segment indication field is less than 8. Obviously, compared with the existing scheme, the technical solution provided in the embodiment of this application can reduce the amount of bits occupied by the header, thereby improving the encapsulation efficiency.
[0182] A line of a frame of an image is divided into a number of segments. When a line of pixels is placed in one data packet, in addition to the fact that the line of pixels is excessive, some control information needs to be transmitted, so the transmission rate may be reduced. In addition to the data, some control information may further need to be transmitted between two communication devices, and the control information has a delay requirement. For example, the delay requirement of the control information is 1 / 4 of the transmission time of the data packet. In this case, the number of segments into which the line is divided may be determined based on the delay requirement of the control information. For example, if the delay requirement of the control information is 1 / 4 of the transmission time of the data packet, the line may be divided into four segments, and the control information may be transmitted in the transmission gap of the four segments so that the control information can meet the delay requirement. In other words, the number of segments into which the line is divided is generally relatively fixed and may be determined, for example, based on the delay requirement of the control information, and may be, for example, two or four segments. Thus, the quantity of segments indicated by the line segment indication field does not need to be a specific value of the line segment indication information, but a correspondence between the value of the line segment indication field and the indicated quantity may be set, and different values (or different states) of the line segment indication field may indicate different quantities. The correspondence may be specified in a protocol or negotiated between the first and second communication devices. In this correspondence, the number of bits occupied by the line segment indication field may be further reduced.
[0183] For example, the line segment indication field occupies two bits, and the two bits may be used as line segment indication information. If the value of the two bits is "00", it indicates that the line on which the current data packet is located is not segmented. It can be understood that the current data packet includes a complete line of pixels. If the value of the two bits is "01", it indicates that the line on which the current data packet is located is divided into two segments, i.e., the line on which the current data packet is located is carried in two data packets, and the current data packet is one of the data packets. If the value of the two bits is "10", it indicates that the line on which the current data packet is located is divided into four segments, i.e., the line on which the current data packet is located is carried in four data packets, and the current data packet is one of the data packets. If the value of the two bits is "11", it may indicate "customized" or "reserved".
[0184] For another example, the line segment indication field occupies 4 bits, and the 4 bits may be used as line segment indication information. If the value of the 4 bits is "0000", it indicates that the line on which the current data packet is located is 2 0 It is understood that the 4-bit value is "0001", which indicates that the line on which the current data packet is located is divided into 2 segments, i.e., one segment, or that the line on which the current data packet is located is not segmented, i.e., the current data packet contains a complete line of pixels. If the 4-bit value is "0001", it indicates that the line on which the current data packet is located is divided into 2 segments, i.e., one segment, or that the line on which the current data packet is located is not segmented, i.e., the current data packet contains a complete line of pixels. 1 If the value of the 4 bits is "0010", it indicates that the line on which the current data packet is located is carried in two data packets, and the current data packet is one of the data packets. 2The 4-bit value is "0011", which indicates that the line on which the current data packet is located is carried in four data packets, and the current data packet is one of the data packets. 3 The 4-bit value is divided into 1111, i.e., 8 segments, i.e., the line on which the current data packet is located is carried in 8 data packets, and the current data packet is one of the data packets. By analogy, every time the value of the 4-bit is incremented by "1", the corresponding power of 2 is incremented by 1. Exceptionally, if the value of the 4-bit is "1111", it may indicate "customized" or "reserved".
[0185] The header of the first data packet may further include a sequence number field, i.e., the header of the first data packet further includes sequence number information. The sequence number information is carried in the sequence number field. The sequence number field may indicate the sequence number of the first data packet in the first data stream, where the first data stream is the data stream in which the first data packet is located. For example, the number of bits occupied by the sequence number field may be equal to or greater than 6 and equal to or less than 8. Alternatively, the number of bits occupied by the sequence number field is not limited, and may be, for example, less than 6 or greater than 8. In an embodiment of this application, the data packets in each data stream may be counted, and the different data streams are counted separately to distinguish between different data streams. For example, the camera in FIG. 1 sends three images to the MDC, and the three images are considered as three data streams. In this case, the sequence number field included in the data packets in each data stream may be counted starting from an initial value. The first communication device may count all data packets by using the sequence number field, so that the sequence numbers of all data packets sent by the first communication device are consecutive, and the receiving end can determine the data packets lost in the transmission process based on the sequence number field in the received data packets, and determine the position of the lost data packets based on the sequence number field, thereby reducing the probability that the data received by the receiving end is disturbed.
[0186] For example, the receiving end may refer to the sequence number field, the line number indication field, and the line segment indication field in the received data packet to determine the position of the lost data packet in the line of the frame of the image. For example, the first communication device sends data packet 1, data packet 2, data packet 3, data packet 4, and data packet 5. The line number indication fields in data packet 1 and data packet 2 indicate a first line, and the line number indication fields in data packet 3, data packet 4, and data packet 5 indicate a second line. The quantity indicated by the line segment indication fields in data packet 1 and data packet 2 is 2, and the quantity indicated by the line segment indication fields in data packet 3, data packet 4, and data packet 5 is 3. The second communication device receives data packet 1, data packet 2, data packet 4, and data packet 5. In this case, the second communication device determines that all the contents in the first line have been received based on the line segment indication fields in data packet 1 and data packet 2, and determines that one data packet has been lost in the second line based on the line segment indication fields in data packet 4 and data packet 5. In addition, the second communication device can determine that the first data packet in the second line has been lost based on the sequence number fields in data packet 1, data packet 2, data packet 4, and data packet 5. It can be known that the embodiment of this application can not only improve the encapsulation efficiency, but also allow the receiving end to relatively clearly determine the location of the lost data packet, thereby preventing image abnormalities.
[0187] The header of the first data packet may further include a stream identifier field, i.e., the header of the first data packet further includes stream identifier information. The stream identifier information is carried in the stream identifier field. The stream identifier field may indicate an identifier of the first data stream, where the first data stream is the data stream in which the first data packet is located. For example, in an in-vehicle scenario, a small amount of data streams are transmitted. Therefore, the stream identifier field can indicate the data stream without occupying excessive bits. For example, the amount of bits occupied by the stream identifier field may be 2 or more and 5 or less. Alternatively, the amount of bits occupied by the stream identifier field is not limited, and may be, for example, 1 or more than 5. For example, the camera in FIG. 1 transmits three images (e.g., three high-dynamic range (HDR) images) to the MDC. The three images are considered as three data streams. In this case, the stream identifier field included in data packets in data stream 1 may indicate data stream 1, the stream identifier field included in data packets in data stream 2 may indicate data stream 2, and the stream identifier field included in data packets in data stream 3 may indicate data stream 3, so that the different data streams can be distinguished from one another.
[0188] The header of the first data packet may further include a data format field, i.e., the header of the first data packet further includes data format information. The data format information is carried in the data format field. The data format field may indicate a format of a frame of an image in which the first content is located and a pixel quantization depth of the frame of the image. For example, the data format field may indicate that the frame of the image is RGB888, RAW10, or YUV422. For example, the number of bits occupied by the data format field may be greater than or equal to 6 and less than or equal to 8. Alternatively, the number of bits occupied by the data format field is not limited and may be, for example, less than 6 or greater than 8.
[0189] The header of the first data packet may further include an encapsulation service type field, i.e., the header of the first data packet further includes encapsulation service type information. The encapsulation service type information is carried in the encapsulation service type field. The encapsulation service type field may indicate a type of service to which the first content belongs, for example, a video service. For example, the number of bits occupied by the encapsulation service type field may be equal to or greater than 4 and equal to or less than 8. Alternatively, the number of bits occupied by the encapsulation service type field is not limited, for example, may be less than 4 or greater than 8.
[0190] The header of the first data packet may further include a reserved field, and the reserved field may be used as a subsequent extension application. For example, the number of bits occupied by the reserved field may be equal to or greater than 6 and equal to or less than 29. Alternatively, the number of bits occupied by the reserved field is not limited, and may be, for example, less than 6 or greater than 29.
[0191] The header of the first data packet may further include a payload length indicator field, i.e., the header of the first data packet further includes payload length indication information. The payload length indication information is carried in the payload length indication field. The payload length indication information may indicate the length of the payload of the first data packet, so that the receiving end can know the length of the payload of the first data packet based on the header to obtain the payload of the first data packet. For example, the number of bits occupied by the payload length indication field may be 16 or more. Alternatively, the number of bits occupied by the payload length indication field is not limited and may be, for example, less than 16.
[0192] In addition, the first data packet further includes a payload and a trailer, and the trailer is used to check the first data packet, e.g., check bits, e.g., cyclic redundancy check (CRC) bits.
[0193] For example, the header of the first data packet includes a frame indicator field, a line number indicator field, a line segment indicator field, a sequence number field, a stream identifier field, a data format field, an encapsulation service type field, a reserved field, and a payload length indicator field. For the format of the first data packet, see Table 1.
[0194] [Table 1]
[0195] In Table 1, an example is used in which the frame indication field is a frame inversion indication field. In addition, the stream ID (ID) field is a stream identifier field.
[0196] 2. Implementation 2 The first information is used to indicate the logical frame number of the frame in which the first content is located and the line in which the first content is located in the frame of the image by using a joint coding scheme. In this scheme, the first information does not need to be divided into frame indication information and line number indication information as in implementation 1, but is used as complete information. The logical frame number of the frame in which the first content is located and the line in which the first content is located in the frame of the image can be indicated by using the information. For example, in this scheme, the first data packet may include an image synchronization indication field, and the image synchronization indication field may carry the first information.
[0197] For example, the first information occupies 6 bits. When the value of the 6 bits is "000000", it indicates the start frame and the logical line number of the first line in the frame. When the value of the 6 bits is "111111", it indicates the end frame and the logical line number of the last line in the frame. When the value of the 6 bits is "000001" to "111110", it indicates the corresponding line number in the frame. For example, when the value is "000001", it indicates the logical line number of the second line in the frame. When the value is "000011", it indicates the logical line number of the third line in the frame. A joint coding scheme is used, which allows one piece of information (i.e., the first information) to indicate more content, thereby improving information utilization. In addition, using the joint coding scheme helps to reduce the quantity of bits occupied by the field to complete the same function, and can improve the encapsulation efficiency to a greater extent. In addition, the state of the first information clearly indicates the start and end of the frame, respectively. Even if the data packet used to indicate the end frame of the previous frame is lost, the receiving end can determine the start position of the next frame based on the received data packet used to indicate the start frame of the next frame, and can determine the end position of the previous frame accordingly. Obviously, compared with the solution in which the frame trailer can be determined by using only one data packet in the header shown in Figure 2, the technical solution in the embodiment of this application can help the receiving end to determine the start and end of the frame more reliably.
[0198] In order to enrich the content contained in the header, the header of the first data packet may further include other information in addition to the first information. In an optional implementation, the header of the first data packet may further include one or more of the following fields: a line segment indication field, a sequence number field, a stream identifier field, a data format field, an encapsulation service type field, a reserved field, or a payload length indication field. For this part of the content, please refer to the description in Implementation 1.
[0199] In addition, the first data packet further includes a payload and a trailer, and the trailer is used to check the first data packet, for example, check bits, for example, CRC bits.
[0200] For example, the header of the first data packet includes a picture synchronization indication field, a line segment indication field, a sequence number field, a stream identifier field, a data format field, an encapsulation service type field, a reserved field, and a payload length indication field. For the format of the first data packet, see Table 2.
[0201] [Table 2]
[0202] In Table 2, the Stream ID field is the stream identifier field.
[0203] 3. Implementation 3 In this implementation, in addition to the logical frame number of the frame in which the first content is located and the line in which the first content is located in the frame of the image, the first information may further indicate a first quantity, and the first quantity is used to indicate the quantity of data packets in the line in which the first content is located. For example, the first information may indicate the logical frame number of the frame in which the first content is located, the line in which the first content is located in the frame of the image, and the first quantity by using a joint coding scheme. In this scheme, the first information does not need to be divided into frame display information, line number display information, and line segment display information as in implementation 1, or the information does not need to be divided into first information and line segment display information as in implementation 2, but is used as complete information. The logical frame number of the frame in which the first content is located, the line in which the first content is located in the frame of the image, and the first quantity can be indicated by using the information. For example, in this scheme, the first data packet may include an image synchronization support display field, and the image synchronization support display field may carry the first information.
[0204] For example, the first information occupies 8 bits. If the value of the 8 bits is "00000000", it indicates that the first content is the first segment in the first line of the first frame. If the value of the 8 bits is "00000001", it indicates that the first content is the second segment in the first line of the first frame. If the value of the 8 bits is "00000011", it indicates that the first content is the third segment in the first line of the first frame. If the value of the 8 bits is "00010000", it indicates that the first content is the first segment in the second line of the first frame. If the value of the 8 bits is "00010001", it indicates that the first content is the second segment in the second line of the first frame. If the value of the 8 bits is "10110000", it indicates that the first content is the first segment in the third line of the second frame. If the 8-bit value is "01110000", it indicates that the first content is the first segment in the seventh line of the third frame, etc. All frame numbers shown here are logical frame numbers, and line numbers shown here are also logical line numbers.
[0205] A joint coding scheme is used, so that one piece of information (i.e., the first information) can indicate more content, thereby improving information utilization. In addition, in the third implementation, the first information can indicate more content, so that the amount of bits occupied by the field to complete the same function can be reduced to a greater extent, thereby improving encapsulation efficiency to a greater extent. In addition, the state of the first information clearly indicates the start and end of a frame, respectively. Even if the data packet used to indicate the end frame of the previous frame is lost, the receiving end can determine the start position of the next frame based on the received data packet used to indicate the start frame of the next frame, and can determine the end position of the previous frame accordingly. Obviously, compared with the solution in which the frame trailer can be determined by using only one data packet in the header shown in FIG. 2, the technical solution in the embodiment of this application can help the receiving end to determine the start and end of a frame more reliably.
[0206] In order to enrich the content contained in the header, the header of the first data packet may further include other information in addition to the first information. In an optional implementation, the header of the first data packet may further include one or more of the following fields: a sequence number field, a stream identifier field, a data format field, an encapsulation service type field, a reserved field, or a payload length indication field. For this part of the content, please refer to the description in Implementation 1.
[0207] In addition, the first data packet further includes a payload and a trailer, and the trailer is used to check the first data packet, for example, check bits, for example, CRC bits.
[0208] For example, the header of the first data packet includes a video synchronization support indication field, a sequence number field, a stream identifier field, a data format field, an encapsulation service type field, a reserved field, and a payload length indication field. For the format of the first data packet, see Table 3.
[0209] [Table 3]
[0210] In Table 3, the Stream ID field is the stream identifier field.
[0211] The particular scheme among the above three schemes used to implement the first information may be specified in the protocol, or may be negotiated between the first communication device and the second communication device, or may be pre-configured in the first communication device and the second communication device.
[0212] S52: The first communication device sends a first data packet to the second communication device, and in response, the second communication device receives the first data packet from the first communication device.
[0213] After generating the first data packet, the first communication device may send the first data packet to the second communication device, so that the second communication device can receive the first data packet. If the second communication device knows the encapsulation format of the first data packet, for example, the format represented in Table 1, Table 2, or Table 3, the second communication device can decapsulate the first data packet according to the corresponding encapsulation format to obtain the payload of the first data packet or obtain the first content.
[0214] In an embodiment of this application, the first information may indicate a logical frame number of a frame in which the first content is located. Because the first information indicates a logical frame number and does not need to indicate an actual frame number, the first information does not need to include excess bits. For example, even if the first information includes only one bit, the first information can indicate a logical frame number. However, it can be known from the above description that the header shown in FIG. 2 indicates an end frame by using the ef field, the line_number field, and the total_line field. Compared with the conventional technology, it can be known that the technical solution provided in the embodiment of this application can reduce the amount of bits occupied by the header, reduce the transmission overhead, and improve the encapsulation efficiency. In addition, the first information may also indicate a logical line number of the first content in the frame. Because the first information indicates a logical line number and does not need to indicate an actual line number, the first information does not need to include excess bits. This can reduce the amount of bits occupied by the header, reduce the transmission overhead, and improve the encapsulation efficiency.
[0215] The method provided in the embodiment of this application has been described in detail above. The following describes in detail the communication device provided in the embodiment of this application. It should be understood that the description of the embodiment of the communication device corresponds to the description of the embodiment of the method. Therefore, for the contents that are not described in detail, please refer to the above embodiment of the method. For the sake of brevity, the details will not be described again here.
[0216] In the embodiment of this application, the functional modules of the communication device may be obtained through division. For example, the functional modules may be obtained through division corresponding to functions, or two or more functions may be integrated into one functional module. The integrated module may be realized in the form of hardware, or in the form of a software functional module. It should be noted that the module division in the embodiment of this application is an example, and is merely a logical functional division. In actual implementation, other division methods may be used.
[0217] For example, when the functional modules of the first communication device are obtained through division in an integrated manner, FIG. 6 is a possible schematic diagram of the structure of the first communication device 600 used in the above embodiment of this application. The first communication device 600 may include a transceiver module 620 and a processing module 610. The processing module 610 may be configured to perform all operations other than the sending operation and the receiving operation performed by the first communication device in the above method embodiment, and / or other processes used to support the technology described in this specification. The transceiver module 620 may be configured to perform the receiving operation and / or the sending operation performed by the first communication device in the above method embodiment, and / or other processes used to support the technology described in this specification. The transceiver module may alternatively be replaced by a transmission module, or the transceiver module may include an independent sending module and an independent receiving module, and may include other processes used to support the technology described in this specification.
[0218] The processing module 610 is configured to generate a first data packet, the first data packet including a portion of content of a frame of the image and first information, the first information used to indicate a logical frame number of the frame in which the portion of content is located and a line in which the portion of content is located within the frame of the image.
[0219] The transceiver module 620 is configured to send the first data packet to a second communication device.
[0220] In an optional implementation, the first information includes frame display information and line number display information, where the frame display information is carried in a frame display field and the line number display information is carried in a line number display field. The first information is used to indicate a logical frame number of a frame in which the portion of the content is located and a line in which the portion of the content is located within a frame of an image, including:
[0221] The frame indication field is used to indicate the logical frame number of the frame in which the portion of content is located, and the line number indication field is used to indicate the line in which the portion of content is located within the frame of the image.
[0222] In an optional implementation, the first information is used to indicate the logical frame number of the frame in which the portion of the content is located, and the line in which the portion of the content is located within the frame of the image, including:
[0223] The first information is used to indicate the logical frame number of the frame in which the portion of content is located and the line in which the portion of content is located within the frame of the image by using a joint coding scheme.
[0224] In an optional implementation, the first data packet further includes a line segment representation field, the line segment representation field is used to indicate a first quantity, the first quantity is used to indicate a quantity of data packets in the line in which the portion of the content is located.
[0225] In an optional implementation, the number of bits occupied by the line segment representation field is greater than or equal to 2 and less than 8.
[0226] In an optional implementation, the first information is further used to indicate a first quantity, and the first quantity is used to indicate a quantity of data packets in a line in which the portion of the content is located. The first information is used to indicate a logical frame number of a frame in which the portion of the content is located, a line in which the portion of the content is located in a frame of an image, and the first quantity include the following:
[0227] The first information is used to indicate a logical frame number of a frame in which the portion of the content is located, a line in which the portion of the content is located within the frame of the image, and a first quantity by using a joint coding scheme.
[0228] In an optional implementation, the first information used to indicate a line within a frame of an image on which a portion of the content is located includes:
[0229] The first information is used to indicate the logical line number of a portion of the content within a frame of an image.
[0230] In an optional implementation, the first data packet further includes a sequence number field, which is used to indicate a sequence number of the first data packet in the first data stream, the first data stream being the data stream in which the first data packet is located.
[0231] In an optional implementation, the number of bits occupied by the sequence number field is greater than or equal to 6 and less than or equal to 8.
[0232] In an optional implementation, the first data packet further includes a stream identifier field, which is used to indicate an identifier of the data stream in which the first data packet is located.
[0233] In an optional implementation, the number of bits occupied by the stream identifier field is greater than or equal to 2 and less than or equal to 5.
[0234] In an optional implementation, the first data packet further includes a data format field, where the data format field is used to indicate a format and pixel quantization depth of the frame of the image.
[0235] For functions that may be completed by the transceiver module 620 and the processing module 610, please refer to the descriptions in the above method embodiments.
[0236] FIG. 7 is a possible schematic diagram of the structure of a second communication device 700 used in the above embodiments of this application. The second communication device 700 may include a transceiver module 720 and a processing module 710. The processing module 710 may be configured to perform all operations other than the sending and receiving operations performed by the second communication device in the above method embodiments, and / or other processes used to support the technology described in this specification. The transceiver module 720 may be configured to perform the receiving and / or sending operations performed by the second communication device in the above method embodiments, and / or other processes used to support the technology described in this specification. The transceiver module may alternatively be replaced by a transmission module, or the transceiver module may include a separate sending module and a separate receiving module, and may include other processes used to support the technology described in this specification.
[0237] The transceiver module 720 is configured to receive a first data packet from a first communication device.
[0238] The processing module 710 is configured to obtain a portion of the content of a frame of the image and first information from the first data packet, and to determine a logical frame number of the frame in which the portion of the content is located and a line in which the portion of the content is located within the frame of the image based on the first information.
[0239] In an optional implementation, the first information includes frame indication information and line number indication information, the frame indication information being carried in a frame indication field, and the line number indication information being carried in a line number indication field. The logical frame number of the frame in which the portion of content is located is determined based on the frame representation field, and the line in the frame of the image in which the portion of content is located is determined based on the line number representation field.
[0240] In an optional implementation, the processing module 710: The method is configured to determine a logical frame number of a frame in which the portion of content is located and a line within the frame of the image in which the portion of content is located based on the joint coding scheme in the first information.
[0241] In an optional implementation, the first data packet further includes a line segment representation field, the line segment representation field is used to indicate a first quantity, the first quantity is used to indicate a quantity of data packets in the line in which the portion of the content is located.
[0242] In an optional implementation, the number of bits occupied by the line segment representation field is greater than or equal to 2 and less than 8.
[0243] In an optional implementation, the first information is further used to indicate a first quantity, and the first quantity is used to indicate a quantity of data packets in the line in which the portion of the content is located. The method is configured to determine a logical frame number of a frame in which the portion of the content is located, a line in which the portion of the content is located within the frame of the image, and a first quantity based on a joint coding scheme in the first information.
[0244] In an optional implementation, the processing module 710: A logical line number of the portion of the content within the frame of the image is configured to be determined based on the first information.
[0245] In an optional implementation, the first data packet further includes a sequence number field, which is used to indicate a sequence number of the first data packet in the first data stream, the first data stream being the data stream in which the first data packet is located.
[0246] In an optional implementation, the number of bits occupied by the sequence number field is greater than or equal to 6 and less than or equal to 8.
[0247] In an optional implementation, the first data packet further includes a stream identifier field, which is used to indicate an identifier of the data stream in which the first data packet is located.
[0248] In an optional implementation, the number of bits occupied by the stream identifier field is greater than or equal to 2 and less than or equal to 5.
[0249] In an optional implementation, the first data packet further includes a data format field, where the data format field is used to indicate a format and pixel quantization depth of the frame of the image.
[0250] For functions that may be completed by the transceiver module 720 and the processing module 710, please refer to the descriptions in the above method embodiments.
[0251] 8 is another possible schematic diagram of the structure of the first communication device or the second communication device according to an embodiment of this application. The communication device 8 may include at least one processor 801, a transmitter 802, and a receiver 803. The function of the processor 801 may correspond to the function of the processing module 610 or the processing module 710, and the function of the transmitter 802 and the receiver 803 may correspond to the function of the transceiver module 620 or the transceiver module 720. Details will not be described again here. Optionally, the communication device 8 may further include a memory 804 configured to store program instructions and / or data for the at least one processor 801 to read.
[0252] FIG. 9 is a schematic diagram of the structure of a device 9 according to an embodiment of this application. The device 9 depicted in FIG. 9 may be a first communication device or a second communication device, or may be a chip or circuit that can complete the function of the first communication device or the second communication device. For example, the chip or circuit may be disposed in the first communication device or the second communication device. The device 9 depicted in FIG. 9 may include at least one processor 901 and an interface circuit 902. The processor 901 executes steps in the method provided in the above embodiment. Optionally, the device 9 may further include a memory 903, and the memory 903 may be configured to store instructions. The processor 901 executes the instructions stored in the memory 903, so that the device 9 executes steps in the method provided in the above embodiment of the method.
[0253] Furthermore, the processor 901, the interface circuit 902, and the memory 903 may communicate with each other over an internal connection path to transfer control signals and / or data signals. The memory 903 is configured to store a computer program. The processor 901 may call and start the computer program from the memory 903 to control the interface circuit 902 to receive or send a signal. Alternatively, the processor 901 calls and starts the computer program from the memory 903 through the interface circuit 902 to complete the steps performed by the first communication device or the second communication device in the method provided in the above embodiment. The memory 903 may be integrated into the processor 901 or may be located separately from the processor 901.
[0254] Optionally, when the apparatus 9 is a device, the interface circuit 902 may include a receiver and a transmitter. The receiver and the transmitter may be the same component or different components. When the receiver and the transmitter are the same component, the component may be called a transceiver.
[0255] Optionally, when the device 9 is a chip or a circuit, the interface circuit 902 may include an input interface and an output interface, and the input interface and the output interface may be the same interface or different interfaces.
[0256] Optionally, when the device 9 is a chip or a circuit, the device 9 may not include the memory 903. The processor 901 may read instructions (programs or codes) in a memory outside the chip or circuit to execute steps performed by the first communication device or the second communication device in the method provided in the above embodiment.
[0257] Optionally, if the device 9 is a chip or a circuit, the device 9 may include resistors, capacitors, or other corresponding functional components, and the processor 901 or the interface circuit 902 may be realized by the corresponding functional components.
[0258] In one implementation, the functionality of the interface circuit 902 may be considered to be realized by a transceiver circuit or a dedicated transceiver chip. The processor 901 may be considered to be realized by a dedicated processing chip, a processing circuit, a processor, or a general-purpose chip.
[0259] In another implementation, the first communication device or the second communication device provided in the embodiment of this application may be considered to be realized by a general-purpose computer. That is, program codes for realizing the functions of the processor 901 and the interface circuit 902 are stored in the memory 903, and the processor 901 realizes the functions of the processor 901 and the interface circuit 902 by executing the program codes stored in the memory 903.
[0260] The functions and operations of the above listed modules or units in the device 9 are merely illustrative examples, and the functional units in the device 9 may be configured to perform the operations or processing performed by the first communication device or the second communication device in the above method embodiments. In order to avoid repetition, details will not be described here.
[0261] An embodiment of this application further provides a communication system that may be applied to unmanned driving or intelligent driving. The communication system includes at least one first communication device or second communication device as described in the above embodiment of this application. At least one communication device in the communication system may be integrated into a whole system or device. Alternatively, at least one communication device in the communication system may be independently arranged as an element or device.
[0262] In an optional manner, when the first communication device or the second communication device is realized by using software, the first communication device or the second communication device may be fully or partially realized in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed in a computer, all or some of the procedures or functions in the embodiments of this application are realized. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or another programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from a computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, a computer, a server, or a data center to another website, a computer, a server, or a data center in a wired (e.g., coaxial cable, optical fiber, or digital subscriber line (DSL)) or wireless (e.g., infrared, radio, or microwave) manner. A computer-readable storage medium may be any available medium accessible by a computer or a data storage device, such as a server or data center, that incorporates one or more available media. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, or a magnetic tape), an optical medium (e.g., a DVD), a semiconductor medium (e.g., a solid state disk, SSD), or the like.
[0263] It should be noted that the first communication device or the second communication device configured to perform the image transmission method provided in the embodiments of this application may include one or more processors. The one or more processors may be a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. The processor may implement or execute various example logic blocks, modules, and circuits described with reference to the contents disclosed in this application. The processor may be a combination of processors that realize computing functions, for example, a combination of one or more microprocessors, or a combination of a DSP and a microprocessor. Alternatively, when the first communication device or the second communication device is a processing device, the processing device may be a CPU, a general-purpose processor, a DSP, an ASIC, an FPGA, or another programmable logic device, a transistor logic device, a hardware component, or any combination thereof. The processing unit may implement or execute the various example logical blocks, modules, and circuits described with reference to the disclosed subject matter in this application. Alternatively, the processing unit may be a combination of processing units that implement computing functions, such as a combination of one or more microprocessors, or a combination of a DSP and a microprocessor.
[0264] The steps of the method or algorithm described in conjunction with the embodiments of this application may be implemented by using hardware or by a processor executing software instructions. The software instructions may include corresponding software modules, which may be stored in a random access memory (RAM), a flash memory, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a register, a hard disk, a removable hard disk, a compact disc read-only memory (CD-ROM), or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor such that the processor can read information from or write information to the storage medium. Of course, the storage medium may be a component of the processor. The processor and the storage medium may be located in an ASIC. In addition, the ASIC may be located in the first device. Of course, the processor and the storage medium may alternatively reside as discrete components in the first communications unit, the second communications unit, the third communications unit, or the fourth communications unit.
[0265] It can be understood that Figures 6 to 9 merely represent simplified designs of the first communication device or the second communication device. In practical applications, the first communication device or the second communication device may include any number of transmitters, receivers, processors, controllers, memories, or other possible elements.
[0266] The above description of the implementation allows those skilled in the art to understand that for the purpose of convenient and concise description, the above division of functional modules is used as an example for illustration. In actual application, the above functions can be allocated to different modules and realized according to requirements, that is, the internal structure of the device is divided into different functional modules to realize all or some of the above-described functions.
[0267] In some embodiments provided in this application, it should be understood that the disclosed apparatus and method may be realized in other ways. For example, the described apparatus embodiment is merely an example. For example, the division into modules or units is merely a logical division of functions, and there may be other division ways in actual implementation. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not implemented. In addition, the shown or discussed mutual couplings or direct couplings or communication connections may be realized through some interfaces. Indirect couplings or communication connections between apparatuses or units may be realized in electronic, mechanical, or other forms.
[0268] The units described as separate parts may or may not be physically separate, and the parts shown as units may be one or more physical units, located in one place or distributed in different places. Some or all of the units may be selected based on the actual requirements to achieve the objectives of the solutions of the embodiments.
[0269] In addition, the functional units in the embodiments of this application may be integrated into one processing unit, or each of the units may exist physically alone, or two or more units may be integrated into one unit. The integrated unit may be realized in the form of hardware or in the form of a software functional unit.
[0270] When the integrated unit is realized in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a readable storage medium. Based on such understanding, all or some of the technical solutions of the embodiments of this application, or the parts that contribute to the prior art, or the technical solutions, may be realized in the form of a software product. The software product is stored in a storage medium and includes some instructions for instructing a device or processor (which may be a single-chip microcomputer, chip, or similar) to execute all or some of the steps of the method described in the embodiments of this application. The above storage medium includes any medium that can store program code, such as a USB flash drive, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
[0271] The above description is merely a specific implementation of the embodiments of this application, but is not intended to limit the scope of protection of the embodiments of this application. Any variation or replacement within the technical scope disclosed in this application shall fall within the scope of protection of the embodiments of this application. Therefore, the scope of protection of the embodiments of this application shall be subject to the scope of protection of the claims. [Explanation of symbols]
[0272] 8. Communication Devices 9 Equipment 600 First communication device 610 Processing Module 620 Transceiver Module 700 Second communication device 710 Processing Module 720 Transceiver Module 801 Processor 802 Transmitter 803 Receiver 804 Memory 901 Processor 902 Interface circuit 903 Memory
Claims
1. generating a first data packet by a first communication device, the first data packet comprising a portion of an image frame and first information, the first information comprising a logical frame number indicating in which frame the portion of the image frame is located, and a logical line number indicating in which line within the frame the portion of the image frame is located; sending the first data packet by the first communication device to a second communication device; An image transmission method comprising:
2. The method of claim 1 , wherein the first information is used to provide a frame synchronization signal and a line synchronization signal.
3. A method as claimed in claim 1 or 2, wherein the logical frame number is conveyed in a frame display field and the logical line number is conveyed in a line number display field.
4. 4. The method of claim 3, wherein the frame display field is a frame inversion display field, the frame inversion display field occupying one bit, and the value of the one bit is inverted once per frame.
5. 5. A method according to claim 1, wherein the logical line number has the same value as another logical line number contained in another data packet containing another portion of the image frame located on the same line on which the portion of the image frame is located.
6. 5. The method according to claim 3 or 4, wherein the line number indication field occupies 3 bits.
7. 7. The method of claim 1, wherein the first data packet comprises a payload and a header, the payload comprising the portion of an image frame and the header comprising the first information.
8. 8. The method of claim 7, wherein the header of the first data packet further comprises a line segment representation field, the line segment representation field being used to indicate a quantity of data packets in the line in which the portion of the image frame is located.
9. The method of claim 8 , wherein the number of bits occupied by the line segment representation field is greater than or equal to 2 and less than 8.
10. 10. The method of claim 7, wherein the header of the first data packet further comprises a sequence number field, the sequence number field being used to indicate a sequence number of the first data packet within a first data stream, the first data stream being the data stream in which the first data packet is located.
11. The method of claim 10, wherein the amount of bits occupied by the sequence number field is less than six.
12. 12. The method according to claim 7, wherein the header of the first data packet further comprises a stream identifier field, the stream identifier field being used to indicate an identifier of a data stream in which the first data packet is located.
13. The method of claim 12 , wherein the stream identifier field occupies 5 bits.
14. 14. The method of claim 7, wherein the header of the first data packet further comprises a data format field, the data format field being used to indicate a format and pixel quantization depth of the frame of an image.
15. receiving, by a second communication device, a first data packet from a first communication device; obtaining, by the second communication device, a portion of the image frame and first information from the first data packet, and determining, based on the first information, a logical frame number indicating in which frame the portion of the image frame is located, and a logical line number indicating in which line of the frame the portion of the image frame is located; An image transmission method comprising:
16. 16. The method of claim 15, wherein the first information is used to provide a frame synchronization signal and a line synchronization signal.
17. A method as claimed in claim 15 or 16, wherein the logical frame number is conveyed in a frame display field and the logical line number is conveyed in a line number display field.
18. 18. The method of claim 17, wherein the frame display field is a frame inversion display field, the frame inversion display field occupying one bit, and the value of the one bit is inverted once per frame.
19. 19. A method according to any one of claims 15 to 18, wherein the logical line number has the same value as another logical line number contained in another data packet including another portion of the image frame located on the same line on which the portion of the image frame is located.
20. 19. The method of claim 17 or 18, wherein the line number indication field occupies 3 bits.
21. 21. The method of claim 15, wherein the first data packet comprises a payload and a header, the payload comprising the portion of an image frame and the header comprising the first information.
22. 22. The method of claim 21, wherein the header of the first data packet further comprises a line segment representation field, the line segment representation field being used to indicate a quantity of data packets in the line in which the portion of the image frame is located.
23. 23. The method of claim 22, wherein the number of bits occupied by the line segment representation field is greater than or equal to 2 and less than 8.
24. 24. The method of claim 21, wherein the header of the first data packet further comprises a sequence number field, the sequence number field being used to indicate a sequence number of the first data packet within a first data stream, the first data stream being the data stream in which the first data packet is located.
25. 25. The method of claim 24, wherein the amount of bits occupied by the sequence number field is less than six.
26. 26. The method according to claim 21, wherein the header of the first data packet further comprises a stream identifier field, the stream identifier field being used to indicate an identifier of a data stream in which the first data packet is located.
27. 27. The method of claim 26, wherein the stream identifier field occupies 5 bits.
28. 28. The method of claim 21, wherein the header of the first data packet further comprises a data format field, the data format field being used to indicate a format and pixel quantization depth of the frame of an image.
29. a processing module configured to generate a first data packet, the first data packet comprising a portion of an image frame, and first information, the first information comprising a logical frame number indicating in which frame the portion of the image frame is located, and a logical line number indicating in which line within the frame the portion of the image frame is located; a transceiver module configured to transmit the first data packet to a second communication device; A communication device comprising:
30. 30. The communications device of claim 29, wherein the first information is used to provide a frame synchronization signal and a line synchronization signal.
31. A communication device as claimed in claim 29 or 30, wherein the logical frame number is conveyed in a frame indication field and the logical line number is conveyed in a line number indication field.
32. 32. The communication device of claim 31, wherein the frame indication field is a frame inversion indication field, the frame inversion indication field occupying one bit, and a value of the one bit is inverted once per frame.
33. 33. A communication device according to any one of claims 29 to 32, wherein the logical line number has the same value as another logical line number contained in another data packet including another portion of an image frame located on the same line on which the portion of the image frame is located.
34. 33. A communications device according to claim 31 or 32, wherein the line number indication field occupies 3 bits.
35. 35. The communications device of claim 29, wherein the first data packet comprises a payload and a header, the payload comprising the portion of an image frame and the header comprising the first information.
36. 36. The communication device of claim 35, wherein the header of the first data packet further comprises a line segment representation field, the line segment representation field being used to indicate a quantity of data packets in the line in which the portion of the image frame is located.
37. 37. The communications device of claim 36, wherein a quantity of bits occupied by the line segment representation field is greater than or equal to 2 and less than 8.
38. 38. The communications device of claim 35, wherein the header of the first data packet further comprises a sequence number field, the sequence number field being used to indicate a sequence number of the first data packet within a first data stream, the first data stream being the data stream in which the first data packet is located.
39. 40. The communications device of claim 38, wherein a quantity of bits occupied by the sequence number field is less than six.
40. 40. The communication device of claim 35, wherein the header of the first data packet further comprises a stream identifier field, the stream identifier field being used to indicate an identifier of a data stream in which the first data packet is located.
41. 41. The communications device of claim 40, wherein the stream identifier field occupies 5 bits.
42. 42. The communication device of claim 35, wherein the header of the first data packet further comprises a data format field, the data format field being used to indicate a format and pixel quantization depth of the frame of an image.
43. a transceiver module configured to receive a first data packet from a first communication device; a processing module configured to obtain a portion of an image frame and first information from the first data packet, and to determine, based on the first information, a logical frame number indicating in which frame the portion of the image frame is located, and a logical line number indicating in which line within the frame the portion of the image frame is located; A communication device comprising:
44. 44. The communications device of claim 43, wherein the first information is used to provide a frame synchronization signal and a line synchronization signal.
45. A communication device as described in claim 43 or 44, wherein the logical frame number is conveyed in a frame indication field and the logical line number is conveyed in a line number indication field.
46. 46. The communication device of claim 45, wherein the frame indication field is a frame inversion indication field, the frame inversion indication field occupying one bit, and a value of the one bit is inverted once per frame.
47. 47. A communication device according to any one of claims 43 to 46, wherein the logical line number has the same value as another logical line number contained in another data packet including another portion of an image frame located on the same line on which the portion of the image frame is located.
48. 47. A communications device according to claim 45 or 46, wherein the line number indication field occupies 3 bits.
49. 49. The communications device of claim 43, wherein the first data packet comprises a payload and a header, the payload comprising the portion of an image frame and the header comprising the first information.
50. 50. The communication device of claim 49, wherein the header of the first data packet further comprises a line segment representation field, the line segment representation field being used to indicate a quantity of data packets in the line in which the portion of the image frame is located.
51. 51. The communications device of claim 50, wherein a quantity of bits occupied by the line segment representation field is greater than or equal to 2 and less than 8.
52. 52. A communications device according to any one of claims 49 to 51, wherein the header of the first data packet further comprises a sequence number field, the sequence number field being used to indicate a sequence number of the first data packet within a first data stream, the first data stream being the data stream in which the first data packet is located.
53. 53. The communications device of claim 52, wherein a quantity of bits occupied by the sequence number field is less than six.
54. 54. A communication device according to any one of claims 49 to 53, wherein the header of the first data packet further comprises a stream identifier field, the stream identifier field being used to indicate an identifier of a data stream in which the first data packet is located.
55. 55. The communications device of claim 54, wherein the stream identifier field occupies 5 bits.
56. 56. The communication device of claim 49, wherein the header of the first data packet further comprises a data format field, the data format field being used to indicate a format and pixel quantization depth of the frame of an image.
57. 15. A communications device comprising a processor, the processor coupled to a memory, the memory configured to store one or more computer programs, the one or more computer programs comprising computer-executable instructions, and wherein, when the communications device is started, the processor executes the one or more computer programs stored in the memory, thereby causing the communications device to perform a method according to any one of claims 1 to 14.
58. 29. A communications device comprising a processor, the processor coupled to a memory, the memory configured to store one or more computer programs, the one or more computer programs comprising computer-executable instructions, and wherein, when the communications device is started, the processor executes the one or more computer programs stored in the memory, thereby causing the communications device to perform a method according to any one of claims 15 to 28.
59. 15. A computer-readable storage medium configured to store a computer program, the computer program enabling the computer to execute the method according to any one of claims 1 to 14, when the computer-readable storage medium is configured to store a computer program, the computer program enabling the computer to execute the method according to any one of claims 1 to 14,
60. A computer-readable storage medium, the computer-readable storage medium configured to store a computer program, the computer program being enabled, when launched in a computer, to execute a method according to any one of claims 15 to 28.
61. A communication system comprising a first communication device configured to perform the method according to any one of claims 1 to 14 and a second communication device configured to perform the method according to any one of claims 15 to 28.
Citation Information
Patent Citations
Multi-channel recording and reproducing device
JP1996307824A
Video and audio transmitter
JP2008061010A
Receiving apparatus and control method thereof, program, and recording medium
JP2010056964A
Display control device, display control method, image display device, program, and storage medium
JP2019124832A
Reception device and transmission device
WO2020116213A1
