Deserializing control circuit, data processing device and related method
Patent Information
- Application Number
- CN202380078073.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-22
- Publication Date
- 2025-07-22
AI Technical Summary
Existing perception systems are difficult to compatible with cameras produced by different manufacturers, resulting in high development costs and poor compatibility.
A deserialization control circuit is designed, including a switch module and multiple deserializers. The deserializers with different data protocols are connected to different data transmission channels through the switch module to achieve compatibility with multiple sensors.
Through this deserialization control circuit, the perception system can successfully obtain data collected by sensors using different data protocols, without the need to develop different data processing devices to adapt to sensors of different data protocols, reducing development costs and improving compatibility.
Smart Images

Figure CN120359740A_ABST
Abstract
Description
Deserialization control circuit, data processing device and related method Technical Field
[0001] The present application relates to the field of sensing technology, and in particular to a deserialization control circuit, a data processing device and related methods. Background Art
[0002] With the development of sensing technology, various sensors have brought great convenience to people's lives and travel. More and more systems are using multiple sensors to collect data and using computing devices to make decisions based on the data collected by multiple sensors. For example, perception systems, such as advanced driving systems (ADS), play a very important role in intelligent driving terminals. They use data collected by multiple sensors to identify objects, generate results through calculation and analysis, and control the terminal or assist human drivers or other decision-making bodies in controlling the terminal.
[0003] In a perception system, sensors transmit their collected data via a high-speed bus to a computing device, which processes the sensor data for analysis and decision-making. A deserializer is typically deployed within the computing device to convert the sensor data. For example, if the sensor is a camera, the data reported by a camera from a certain manufacturer is formatted in the A data protocol. In this case, a deserializer supporting the A data protocol is required within the computing device to convert the camera data and successfully parse the data. Because cameras from different manufacturers typically use different transmission protocols, the deserializers that support each manufacturer's cameras also vary. Furthermore, because the transmission protocols used by cameras are generally proprietary, a perception system is typically only compatible with cameras from a single manufacturer. Compatibility with cameras from multiple manufacturers requires developing a computing device compatible with the sensors, which results in extensive and costly development of the perception system.
[0004] Therefore, how to improve the compatibility of the perception system with sensors and reduce the development cost of the perception system is a hot topic being studied by technical personnel in this field.
[0005] Summary of the Invention
[0006] The present application provides a deserialization control circuit, a data processing device and related methods, which can improve the compatibility of the perception system with sensors and reduce the development cost of the perception system.
[0007] In a first aspect, the present application provides a deserialization control circuit, one end of which is connected to a data processing device, and the other end is connected to a sensor. The deserialization control circuit includes a switch module and N deserializers, where N is an integer and N≥2. At least two of the N deserializers support different data protocols. The N deserializers are respectively located in N data transmission channels, and the N data transmission channels are located between the sensor and the data processing device.
[0008] The switch module is used to select the data transmission channel where the first deserializer among the N deserializers is located to form a path passing through the first deserializer between the sensor and the data processing device, and to switch the selected data transmission channel in response to a control signal from the data processing device. The first deserializer is any one of the N deserializers.
[0009] In the present application, the deserialization control circuit includes multiple deserializers that support different data protocols, and supports the selection of paths where different deserializers are located through a switch module. The deserializer control circuit can be set between the sensor and the data processing device, and select the data transmission channel where the first deserializer is located. On the data transmission channel where the first deserializer is located, the first deserializer can convert the data from the sensor and provide it to the data processing device and / or provide the data from the data processing device to the sensor. In addition, the switch module can also switch the deserializer, thereby supporting the conversion of data transmitted between the sensor and the data processing device using multiple data protocols, so that the data processing device can successfully obtain data collected by sensors using different data protocols, without the need to develop different data processing devices to adapt to sensors with different data protocols, thereby improving the compatibility of the perception system with the sensor and reducing the cost of perception system development.
[0010] In addition, the present application achieves compatibility with multiple sensors through a combination of software and hardware. In terms of hardware, the present application sets up multiple deserializers that support different data protocols and supports the switching of data transmission channels through a switch module. In terms of software, the data processing device outputs a control signal to realize the active switching of multiple deserializers, and attempts to communicate with the sensor before and after the switching to improve the success rate of communication. For example, the switch module selects the first data transmission channel where the A deserializer is located among the N deserializers to form a path through the A deserializer between the sensor and the data processing device, so that the data processing device can try to communicate with the sensor through the first data transmission channel. If the communication fails, the second data transmission channel where the B deserializer is located among the N deserializers is selected through the switch module to form a path through the B deserializer between the sensor and the data processing device, so that the data processing device can try to communicate with the sensor through the second data transmission channel. The above process of switching different data transmission channels is also the process of matching and screening between deserializers and sensors of different data protocols.
[0011] Optionally, the above description reflects that N deserializers are encapsulated in the same deserializer group, and the deserializers in the same deserializer group support different data protocols. However, the data protocols supported by the N deserializers in different deserializer groups may be the same.
[0012] In a possible implementation, when the data transmission channel where the first deserializer is located is selected, the first deserializer is used to transmit a high-speed signal from the sensor to the data processing device through the data transmission channel where the first deserializer is located based on a data protocol supported by the first deserializer.
[0013] Optionally, the high-speed signal includes but is not limited to any one of a mobile industry processor interface (MIPI) signal, a camera serial interface (CSI) signal, or a display serial interface (DSI) signal.
[0014] In the above embodiment, data can be normally transmitted between the first deserializer and the sensor only when the data processing device successfully communicates with the sensor through the first deserializer adapted to the sensor.
[0015] In another possible implementation, the deserialization control circuit includes a high-speed transmission interface, and the deserialization control circuit is connected to the sensor via the high-speed transmission interface.
[0016] In the above embodiment, the sensor and the interface portion of the deserialization control circuit share a high-speed bus interface for data transmission.
[0017] In another possible implementation, the switch module includes a first switch configured to enable a data transmission channel where the first deserializer is located to form a path between the sensor and the first deserializer.
[0018] In the above embodiment, a data transmission channel passing through the deserializer is formed between the sensor and the deserializer. In response to a control signal from the data processing device, different deserializers are switched through the first switch, thereby switching different data transmission channels to achieve matching screening between deserializers and sensors from different manufacturers.
[0019] In another possible embodiment, each of the N deserializers is connected to the data processing device via a different high-speed signal bus. Alternatively, the switch module further includes a second switch, and the N deserializers and the data processing device are connected via the second switch switching corresponding high-speed signal buses.
[0020] In the above embodiment, two connection modes between the data processing device and N deserializers are provided.
[0021] In a second aspect, the present application provides a deserialization control method, which is applied to a deserialization control circuit, wherein one end of the deserialization control circuit is connected to a data processing device and the other end is connected to a sensor. The deserialization control circuit includes a switch module and N deserializers, where N is an integer and N≥2, and at least two of the N deserializers support different data protocols. The N deserializers are respectively located in N data transmission channels, and the N data transmission channels are located between the sensor and the data processing device. The switch module is used to select the data transmission channel where the first deserializer of the N deserializers is located to form a path between the sensor and the data processing device passing through the first deserializer, and the first deserializer is any one of the N deserializers.
[0022] The method includes receiving a first control signal from the data processing device. In response to the first control signal, controlling the switch module to switch a data transmission channel selected from a first data transmission channel to a second data transmission channel, wherein the first data transmission channel passes through a first deserializer among the N deserializers, and the second data transmission channel passes through a second deserializer among the N deserializers.
[0023] In one possible embodiment, the method further includes: continuing to switch the data transmission channel selected by the switch module in response to a control signal from the data processing device until communication with the sensor is successful through the data transmission channel selected by the switch module or the number of times the data transmission channel is switched in response to the control signal reaches a preset value.
[0024] In the above embodiment, if communication between the data processing device and the sensor fails, the switch module, in response to a control signal from the data processing device, selects another data transmission channel until communication with the sensor is successful through the data transmission channel selected by the switch module. Alternatively, if communication between the data processing device and the sensor fails after traversing multiple deserializers, the data processing device stops responding to the control signal when the number of switching data transmission channels in response to the control signal reaches a preset value.
[0025] In another possible implementation, the switch module includes a first switch. The first switch is used to select a data transmission channel where the first deserializer is located to form a path between the sensor and the first deserializer.
[0026] In another possible embodiment, each of the N deserializers is connected to the data processing device via a different high-speed signal bus. Alternatively, the switch module further includes a second switch, and the N deserializers and the data processing device are connected via the second switch switching corresponding high-speed signal buses.
[0027] Optionally, the high-speed signal includes but is not limited to any one of a mobile communications industry processor interface MIPI signal, a CSI signal, or a DSI signal.
[0028] In another possible implementation, when a data transmission channel where a second deserializer among the N deserializers is located is selected, a high-speed signal from the sensor is transmitted to the data processing device through the second data transmission channel where the second deserializer is located based on a data protocol supported by the second deserializer.
[0029] In the above embodiment, data can be normally transmitted between the second deserializer and the sensor only when the data processing device successfully communicates with the sensor through the second deserializer adapted to the sensor.
[0030] In another possible implementation, the deserialization control circuit includes a high-speed transmission interface, and the deserialization control circuit is connected to the sensor via the high-speed transmission interface.
[0031] In a third aspect, the present application provides a data transmission method, applied to a data processing device, wherein the data processing device is connected to one end of a deserialization control circuit, the other end of which is connected to a sensor, the deserialization control circuit comprising a switch module and N deserializers, where N is an integer and N ≥ 2, and at least two of the N deserializers support different data protocols. The N deserializers are respectively located in N data transmission channels, each of which is located between the sensor and the data processing device.
[0032] The method includes attempting to communicate with the sensor via a first data transmission channel currently selected by the switch module, the first data transmission channel passing through a first deserializer among the N deserializers. If communication with the sensor via the first data transmission channel fails, outputting a first control signal to the switch module, the first control signal being used to instruct the switch module to switch from the currently selected first data transmission channel to a second data transmission channel passing through a second deserializer among the N deserializers. Communication with the sensor is attempted via the switched second data transmission channel.
[0033] In a possible embodiment, the method further includes: in the event that communication with the sensor fails through the second data transmission channel, continuing to output a control signal instructing switching of the data transmission channel to the switch module until communication with the sensor through the data transmission channel selected by the switch module is successful or the number of times the control signal is sent reaches a preset value.
[0034] In the above embodiment, if communication between the data processing device and the sensor fails, the data processing device continues to output a control signal to the switch module instructing it to switch to another data transmission channel until the data processing device successfully communicates with the sensor through the data transmission channel selected by the switch module. Alternatively, if communication between the data processing device and the sensor fails after switching multiple deserializers, the data processing device stops sending control signals when the number of control signal transmissions reaches a preset value.
[0035] In another possible implementation, the second data transmission channel selected by the switch module attempts to communicate with the sensor, including: when communication with the sensor through the second data transmission channel is successful, obtaining data from the sensor transmitted through the second deserializer through the second data transmission channel.
[0036] In a fourth aspect, the present application provides a data processing device, which includes a module or unit for implementing the method described in the third aspect or any possible implementation of the third aspect. The module can be a software module or a hardware module.
[0037] In a fifth aspect, the present application provides a chip, which includes the deserialization control circuit described in the first aspect or any possible implementation method.
[0038] In one possible implementation, the chip further includes a processing circuit, which includes a module or unit for implementing the method described in the third aspect or any possible implementation of the third aspect. The module may be a software module or a hardware module.
[0039] In a sixth aspect, the present application provides an in-vehicle computing device, which includes the deserialization control circuit described in the first aspect or any possible implementation method.
[0040] In a seventh aspect, the present application provides a vehicle comprising the in-vehicle computing device described in the sixth aspect.
[0041] In an eighth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores instructions. When the instructions are executed on at least one processor, the method described in any aspect or any possible implementation method of the aforementioned second to third aspects can be implemented.
[0042] In a ninth aspect, the present application provides a computer program product, comprising computer instructions that, when executed on at least one processor, can implement the method described in any of the second to third aspects or any possible implementation thereof. The computer program product can be a software installation package, which can be downloaded and executed on a computing device when the method is to be used.
[0043] The beneficial effects of the technical solutions provided in aspects 4 to 9 of this application can refer to the beneficial effects of the technical solutions in aspects 1 to 3, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0044] The following is a brief introduction to the drawings used in describing the embodiments.
[0045] FIG1 is a schematic diagram of the architecture of a perception system provided in an embodiment of the present application;
[0046] FIG2 is a schematic diagram of an application scenario provided by an embodiment of the present application;
[0047] FIG3 is a schematic structural diagram of a deserialization control circuit 30 provided in an embodiment of the present application;
[0048] FIG4 is a schematic diagram of the structure of a computing device including a deserialization control circuit provided in an embodiment of the present application;
[0049] FIG5 is a schematic diagram of the architecture of a perception system 50 provided in an embodiment of the present application;
[0050] FIG6 is a flow diagram of an interaction of a deserialization control method provided in an embodiment of the present application;
[0051] FIG7 is a schematic diagram of a connection method between a sensor and a data processing device provided in an embodiment of the present application;
[0052] FIG8 is a flow chart of a data transmission method provided in an embodiment of the present application;
[0053] FIG9 is a schematic structural diagram of a data processing device 90 provided in an embodiment of the present application. DETAILED DESCRIPTION
[0054] Please refer to Figure 1, which is a schematic diagram of the architecture of a perception system provided in an embodiment of the present application. The perception system includes a computing device and multiple cameras, wherein the multiple cameras are, for example, camera A, camera B, camera C and camera D shown in Figure 1. A serial adder is provided in the camera to transmit data. Exemplarily, the serial adder can be provided in a transmitter (transmit, TX).
[0055] The computing device is used to process data from multiple cameras. The computing device includes a deserializer and a data processing device. The deserializer can be provided in a receiver (RX) shown in FIG1 , and the data processing device and the deserializer can be connected via a bus, such as a CSI bus. Exemplarily, the data processing device can be a system on a chip (SoC).
[0056] In a perception system, when the deserializer in the computing device matches the serializer in the camera, the processing device in the computing device can successfully obtain camera data. For example, if cameras A and B support the same transmission protocol, such as protocol A, and the deserializer in the computing device also supports protocol A, the data processing device can successfully transmit data to and from cameras A and B via the deserializer that supports protocol A.
[0057] Because transmission protocols are largely proprietary, a single computing device typically only works with cameras from the same manufacturer and is incompatible with cameras from other manufacturers. For example, if cameras C and D support different transmission protocols, such as Protocol B and Protocol C, respectively, the data processing device cannot transmit data to cameras C or D using a deserializer supporting Protocol A. To achieve compatibility with camera C, the computing device would need to be redeveloped and equipped with a deserializer supporting Protocol B, resulting in high development costs.
[0058] In view of this, the present application provides a deserialization control circuit, a data processing device and a related method, which can improve the compatibility of the perception system with the sensor and reduce the development cost of the system. The deserialization control circuit provided in the present application can be deployed on an intelligent driving terminal. The intelligent driving terminal may include land vehicles, water vehicles, air vehicles, industrial equipment, agricultural equipment, or entertainment equipment, etc. For example, the intelligent driving terminal can be a vehicle, which is a vehicle in a broad sense, and can be a vehicle (such as a commercial vehicle, a passenger car, a motorcycle, a flying car, a train, etc.), an industrial vehicle (such as a forklift, a trailer, a tractor, etc.), an engineering vehicle (such as an excavator, a bulldozer, a crane, etc.), agricultural equipment (such as a mower, a harvester, etc.), amusement equipment, a toy vehicle, etc. The embodiment of the present application does not specifically limit the type of vehicle. For another example, the intelligent driving terminal can be a vehicle such as an airplane or a ship.
[0059] Figure 2 illustrates an application scenario of the present application using an example in which a deserialization control circuit is deployed in an onboard computing device 10 of a perception system. Referring to Figure 2, which is a schematic diagram of an application scenario provided by an embodiment of the present application, the perception system includes sensors and an onboard computing device 10. The number of sensors may be one or more, such as camera 11a, camera 11b, camera 11c, and camera 11d shown in Figure 2. The onboard computing device 10 can run algorithms to process the data collected by the sensors, optionally combining one or more location data from a high-precision map, navigation system, or positioning system to make driving decisions. Furthermore, the perception system also includes an actuator. The onboard computing device 10 can output control instructions to the actuator, which, based on the control instructions, executes control functions on the vehicle or its internal components, including executing control decisions and responding to control decisions made by the user. For example, the actuator may include one or more of a steering actuator 12, a throttle actuator 13, or a brake actuator 14.
[0060] It should be understood that the application scenario shown in Figure 2 and the deployment location of the aforementioned deserialization control circuit are only examples. In specific embodiments, the perception system and deserialization control circuit can be applied to a variety of scenarios, such as intelligent driving, smart transportation, smart campuses, smart cities, smart buildings, and smart homes.
[0061] The following is an introduction to the deserialization control circuit of an embodiment of the present application.
[0062] Please refer to FIG3 , which is a schematic diagram of the structure of a deserialization control circuit 30 provided in an embodiment of the present application. The deserialization control circuit 30 may include a switch module and N deserializers 31 , where N is an integer and N ≥ 2.
[0063] The deserializer 31 is the inverse operation device of the serializer. It can decompose a high-speed serial data stream into multiple parallel data streams to adapt to different computing requirements. In computer network communications, the deserializer 31 can split a data frame into multiple data streams for further processing or storage on the target computer or network device. Exemplarily, the N deserializers 31 may include one or more of the deserializer A, deserializer B, deserializer C or deserializer D as shown in Figure 3. Each of the N deserializers 31 is respectively set on a data transmission channel. At least two of the N deserializers 31 support different data protocols and support the selection of data transmission channels where different deserializers are located through a switch module.
[0064] Exemplarily, when the data transmission channel in which deserializer A is located is enabled, deserializer A is configured to perform data conversion based on a data protocol supported by the deserializer via the data transmission channel in which it is located. For example, when deserializer A is enabled, data from a sensor can be converted into a high-speed signal. Optionally, the high-speed signal includes, but is not limited to, any one of a MIPI signal, a CSI signal, or a DSI signal.
[0065] The data transmission channel selected by the switch module forms a path through the selected deserializer 31 among the N deserializers 31. In one possible design, the switch module can switch the selected data transmission channel in response to an input control signal. For example, the control signal can come from a data processing device.
[0066] The switch module may include one or more switches. For example, the switch module may include only one switch, which is used to select the data transmission channel where the first deserializer is located to form a path between the sensor and the first deserializer among the N deserializers. Each of the N deserializers in the deserialization control circuit is connected to a device on one side, such as the data processing device shown in Figure 3, via a different high-speed signal bus. Taking the data processing device as an example, each deserializer is connected to the data processing device via a one-to-one high-speed signal bus.
[0067] The following continues to take the example of the two ends of the deserialization control circuit being connected to the sensor and the data processing device respectively to illustrate the case where more switches are included.
[0068] For another example, the switch module may include two switches, one of which (referred to as the first switch for easy distinction) is used to select the data transmission channel of the first deserializer to form a path between the sensor and the first deserializer among the N deserializers. The N deserializers and the data processing device are connected by switching the corresponding high-speed signal bus via another switch (referred to as the second switch for easy distinction).
[0069] Those skilled in the art will appreciate that one or more switches may be independent of each other in hardware, or may be an integrated structure, or may implement multiple logical functions through software, and this application does not specifically limit this. For example, as shown in FIG3 , the switch module may include switch 32 and switch 33 .
[0070] In some embodiments, the two ends of the deserialization control circuit 30 can be connected to two devices respectively, so the deserialization control circuit 30 can transmit data between the two devices through the selected data transmission channel. For example, the deserialization control circuit 30 can be arranged between the sensor and the data processing device, one end of the deserialization control circuit 30 is connected to the data processing device, and the other end is connected to the sensor. The N deserializers 31 are respectively located in the N data transmission channels. When any one of the N data transmission channels is selected by the switch module, a path can be formed between the sensor and the data processing device. For example, the deserialization control circuit 30 selects the data transmission channel where the A deserializer (which can be regarded as the first deserializer) is located. At this time, the sensor and the data processing device can communicate through the data transmission channel where the A deserializer is located. For example, the A deserializer can convert the data from the sensor (described below) and provide the converted data to the data processing device, and / or the A deserializer provides the data from the data processing device to the sensor. It should be understood that the number of deserializers shown in FIG3 is only an example, and the selected A deserializer is also only an example. In a specific implementation, the first deserializer selected may be any one of the N deserializers 31 .
[0071] In some possible implementations, the protocols supported by the N deserializers 31 are different. The protocols supported by the deserializers include, but are not limited to, any one of the inter-integrated circuit (I2C) protocol, the serial peripheral interface (SPI) protocol, the universal asynchronous receiver / transmitter (UART) protocol, and the musical instrument digital interface (MIDI) protocol. It can be understood that at least two of the N deserializers 31 support different data protocols. For example, deserializer A and deserializer B support different protocols.
[0072] In some possible implementations, N deserializers 31 are packaged in the same deserializer group. The deserializers 31 in the same deserializer group support different data protocols. However, the deserializers in different deserializer groups may support the same data protocols.
[0073] The following introduces several application examples of deserialization control circuits.
[0074] Please refer to Figure 4, which is a schematic diagram of the structure of a computing device including a deserialization control circuit according to an embodiment of the present application. In particular, one end of the deserialization control circuit 30 is connected to a data processing device, and the other end is connected to a sensor. The term "connection" here refers to a communication connection, including but not limited to wired, wireless, and hybrid connections.
[0075] Among them, the sensor is a device that can collect information about the environment, including but not limited to any one of a camera, a lidar, or an ultrasonic radar.
[0076] A data processing device is a device with data processing capabilities, such as a SoC, an image signal processor (ISP), a software module, or an integrated circuit.
[0077] Alternatively, the deserialization control circuit 30 may be provided independently of the data processing device, or the deserialization control circuit 30 may be integrated with the data processing device. As shown in FIG4 , the deserialization control circuit 30 and the data processing device may be integrated into a computing device 40. In some embodiments, the computing device 40 may be the aforementioned in-vehicle computing device 10.
[0078] The following takes a camera as an example to further introduce the perception system including the deserialization control circuit 30.
[0079] Please refer to Figure 5, which is a schematic diagram of the architecture of a perception system 50 provided in an embodiment of the present application, including a camera, a deserialization control circuit 30, and a data processing device. Detailed descriptions of each module are as follows:
[0080] The deserialization control circuit 30 has been described above and will not be described again here.
[0081] Cameras, such as camera 11a, camera 11b, camera 11c, and camera 11d shown in Figure 5, can be equipped with a serializer. The serializer is used to merge multiple parallel data streams into a single high-speed serial data stream, thereby reducing the number of cables required for transmission and the cost of communication media. In computer network communications, the serializer can sequentially package data from different computers or network devices into a single data frame, which is then transmitted to the destination via the network. This reduces the number of communication links and improves data transmission efficiency. The camera is used to capture images and / or videos of the driving scene and provide them to a data processing device for calculation and analysis, so that timely decisions can be made based on the vehicle's surrounding environment, effectively improving the comfort and safety of driving the vehicle. Optionally, at least two of cameras 11a, camera 11b, camera 11c, and camera 11d are from different manufacturers and support different data protocols. For example, cameras 11a and camera 11b are from a first manufacturer and support a first data protocol, camera 11c is from a second manufacturer and supports a second data protocol, and camera 11d is from a third manufacturer and supports a third data protocol.
[0082] The data processing device is configured to attempt to communicate with the camera via a first data transmission channel among the N data transmission channels currently selected by the switch module of the deserialization control circuit 30. If communication with the camera via the first data transmission channel fails, the data processing device is further configured to control some or all components in the deserialization control circuit 30. For example, the data processing device is configured to control the switch module and the N deserializers 31 in the deserialization control circuit 30.
[0083] Optionally, the data processing device and the deserialization control circuit 30 can be integrated together. As a possible implementation, the deserialization control circuit 30 and the data processing device can be included in a computing device, such as the aforementioned computing device 40 or the in-vehicle computing device 10. In one possible design, the deserialization control circuit 30 includes a high-speed transmission interface. The deserialization control circuit 30 is connected to the sensor 510 via the high-speed transmission interface.
[0084] In one design, if the data processing device fails to communicate with the camera through the first data transmission channel, a control signal can be generated and sent to one or more switches in the switch module, thereby controlling the one or more switches to switch the data channel. For example, the data processing device can output a first control signal to the first switch and the second switch. In response to the first control signal, the first switch and the second switch control the switch module to switch the data transmission channel selected from the first data transmission channel to the second data transmission channel. The first data transmission channel passes through the first deserializer among the N deserializers 31, and the second data transmission channel passes through the second deserializer among the N deserializers.
[0085] Based on the above-mentioned perception system, an embodiment of the present application provides a deserialization control method. The method provided by the embodiment of the present application is described below.
[0086] Please refer to Figure 6, which is a process interaction diagram of a deserialization control method provided by an embodiment of the present application. The deserialization control method can also be called a data transmission method. It should be understood that the names of the methods, devices, messages, information, and modules in this application are only examples. During the specific implementation process, their names can be replaced arbitrarily. The deserialization control method is explained from the perspective of the interaction between the data processing device and the deserialization control circuit. Optionally, the deserialization control method can be applied to the aforementioned perception system, such as the perception system shown in Figures 1, 2, 4, and 5.
[0087] The deserialization control method includes one or more steps from step S601 to step S606. It should be understood that for the convenience of description, the order of steps S601 to S606 is described here, and it is not intended to limit the execution to the above order. The embodiment of the present application does not limit the order of execution, execution time, number of executions, etc. of the above one or more steps, and other steps can be interspersed between or before and after these steps as needed. Among them, steps S601 to S606 are specifically as follows:
[0088] Step S601: The data processing device attempts to communicate with the sensor through the first data transmission channel currently enabled by the switch module.
[0089] The data processing device is a device with data processing capabilities, including but not limited to SoC, ISP, software module or integrated circuit, etc.
[0090] The switch module, data transmission channel, etc. are included in the deserialization control circuit, which includes N deserializers, and at least two of the N deserializers support different data protocols. Each of the N deserializers is set on a data transmission channel. In other words, the deserialization control circuit can form N data transmission channels between the sensor and the data processing device, and support the selection of any one of them through the switch module. The first data transmission channel is any data transmission channel of the N data transmission channels. Taking Figure 5 as an example, the first data transmission channel is a data transmission channel passing through deserializer A among the N deserializers. For the description of the deserialization control circuit, please refer to the above and will not be explained here one by one.
[0091] Optionally, the switch module may include one or more switches. For example, please refer to Figure 7, which is a schematic diagram of a connection method between a sensor and a data processing device provided in an embodiment of the present application. As shown in (a) in Figure 7, the switch module may include only one switch, which is used to select the data transmission channel where the first deserializer is located to form a path between the sensor and the data processing device through the A deserializer. The deserialization control circuit includes a high-speed transmission interface. The deserialization control circuit is connected to the sensor through a high-speed transmission interface. Each of the N deserializers of the deserialization control circuit is connected to the data processing device through a different high-speed signal bus.
[0092] For another example, continuing with FIG. 7 , the switch module shown in FIG. 7 (b) may include two switches, one of which (referred to as the first switch for ease of distinction) is used to select the data transmission channel of the first deserializer, thereby forming a path between the sensor and the first deserializer. The deserialization control circuit includes a high-speed transmission interface. The deserialization control circuit is connected to the sensor via the high-speed transmission interface. The N deserializers and the data processing device are connected via another switch (referred to as the second switch for ease of distinction) to switch the corresponding high-speed signal bus.
[0093] Optionally, the high-speed signal includes but is not limited to any one of a mobile communications industry processor interface MIPI signal, a CSI signal, or a DSI signal.
[0094] As a possible implementation, when the data processing device attempts to communicate with the sensor, the data processing device can specifically perform one or more of the following operations: configuring the sensor (for example, one or more of power-on control, shooting angle control, or acquisition frequency control), or sending an indication message to the sensor and receiving ACK or NACK information, or instructing the sensor to report device information, etc.
[0095] As a possible implementation, the data processing device in this application may attempt to communicate with the sensor using a serial communication protocol. A serial communication protocol is a specification or convention for serial data transmission. A serial communication protocol defines rules for data transmission format, communication timing, and error detection to ensure that data can be correctly transmitted and parsed between serial ports. Serial communication protocols are typically used to connect computers and external devices for data transmission. Several serial communication protocols are listed below.
[0096] RS-232 is a common serial communication protocol used to transmit data between computers and external devices. It defines parameters such as connection, signal level, data bits, parity, and stop bits.
[0097] Controller Area Network (CAN): CAN is widely used in automotive and industrial control systems. It supports multiple devices to communicate through a shared bus and has high anti-interference and reliability.
[0098] FireWire (IEEE1394): FireWire is a serial communication protocol and interface standard that supports high-speed data transmission and hot-plug functionality, and is suitable for devices such as video cameras and hard drives.
[0099] Serial Digital Interface (SDI): SDI is a serial digital video interface protocol widely used in broadcasting, television production, and the video industry. It supports high-quality digital video transmission, including HD and ultra-HD video.
[0100] It should be noted that, in addition to the serial communication protocols listed above, other existing serial communication protocols, or other serial communication protocols that may appear in the future with the evolution of communication technology, may also be applicable to this solution.
[0101] Step S602: When the data processing device fails to communicate with the sensor through the first data transmission channel, the data processing device outputs a first control signal to the switch module.
[0102] Exemplarily, the first control signal is used to instruct the switch module to switch from the data transmission channel where the currently selected A deserializer is located (which can be regarded as the first data transmission channel) to the data transmission channel where the B deserializer (which can be regarded as the second deserializer) is located (which can be regarded as the second data transmission channel).
[0103] As a possible implementation, when the data processing device fails to communicate with the sensor through the first data transmission channel, the perception system can generate a control signal through the data processing device and send it to one or more switches in the switch module, thereby controlling the one or more switches.
[0104] In some possible scenarios, the sensing system may output a first control signal to a first switch in the switch module.
[0105] In some possible scenarios, the sensing system may output a first control signal to a first switch and a second switch in the switch module.
[0106] Optionally, the perception system may be connected to an external controller (or external processor). For example, the data processing device in the perception system may be connected to an external domain controller or other possible external controller. The external controller may send instructions to the data processing device in the perception system, and the data processing device may output control signals to the switch module according to the instructions.
[0107] Accordingly, the switch module can receive a first control signal from the data processing device.
[0108] In some embodiments, the first switch in the switch module receives a first control signal from a data processing device.
[0109] In some embodiments, the first switch and the second switch in the switch module receive a first control signal from a data processing device.
[0110] Step S603: The switch module controls the data transmission channel selected by the switch module to switch from the first data transmission channel to the second data transmission channel in response to the first control signal.
[0111] As a possible implementation, one or more switches in the switch module switch the selected data transmission channel in response to a control signal from the data processing device.
[0112] In some embodiments, a first switch in the switch module, in response to a first control signal, controls the switch module to switch the data transmission channel selected by the switch module from the data transmission channel for deserializer A to the data transmission channel for deserializer B. The data processing device uses the first switch to select the data transmission channel for deserializer B, thereby forming a path between the sensor and deserializer B. Deserializer B of the deserialization control circuit is connected to the data processing device via a high-speed signal bus.
[0113] In some embodiments, the first and second switches in the switch module, in response to a first control signal, control the switch module to switch the selected data transmission channel from the data transmission channel of deserializer A to the data transmission channel of deserializer B. The data processing device uses the first switch to select the data transmission channel of deserializer B, thereby forming a path between the sensor and deserializer B. Deserializer B and the data processing device are connected via the corresponding high-speed signal bus switched by the second switch.
[0114] Step S604: the data processing device attempts to communicate with the sensor through the switched second data transmission channel.
[0115] Since the communication method between the data processing device and the sensor has been described in detail in step S601 , it will not be repeated here.
[0116] Step S605: When the data processing device successfully communicates with the sensor through the second data transmission channel, the data processing device obtains the data from the sensor transmitted through the second deserializer through the second data transmission channel.
[0117] For example, a sensor can use an internal serializer to combine multiple parallel data streams into a single high-speed serial data stream, which is then transmitted over the network to the destination. A deserializer is the inverse of a serializer, breaking down a high-speed serial data stream into multiple parallel data streams to accommodate different computational needs. In computer network communications, a deserializer can split a data frame into multiple data streams for further processing or storage on the destination computer or network device.
[0118] In the present application, the data from the sensor transmitted by the B deserializer and obtained by the data processing device may be obtained through parallel-to-serial conversion.
[0119] Accordingly, when the data transmission channel where the B deserializer among the N deserializers is located is selected, the B deserializer transmits the high-speed signal from the sensor to the data processing device through the data transmission channel where the B deserializer is located based on the data protocol supported by the B deserializer.
[0120] Step S606: When the data processing device fails to communicate with the sensor through the second data transmission channel, the data processing device continues to output a control signal instructing the switch module to switch the data transmission channel until the data transmission channel selected by the switch module successfully communicates with the sensor or the number of times the control signal is sent reaches a preset value.
[0121] For example, if communication with the sensor fails via the data transmission channel containing deserializer B, the data processing device continues to output control signals to the switch module instructing it to switch to another data transmission channel (for example, instructing it to switch to the data transmission channel containing deserializer C) until the data processing device successfully communicates with the sensor via the data transmission channel selected by the switch module. Alternatively, after traversing multiple deserializers, if the number of control signal transmissions reaches a preset value and the data processing device fails to communicate with the sensor via the corresponding data transmission channel, the data processing device may stop switching data transmission channels and terminate sending control signals to conserve resources.
[0122] Among them, the preset value is related to the number of deserializers. For example, it is assumed that the deserialization control circuit includes 4 deserializers. Since the deserializer control circuit will initially select any one of the deserializers, such as the data transmission channel where the A deserializer (which can be regarded as the first deserializer) is located. At this time, the sensor and the data processing device can be transmitted through the data transmission channel where the A deserializer is located. When the communication with the sensor through the data transmission channel where the A deserializer is located fails, the data processing device will output a control signal indicating the switching of the data transmission channel (that is, the first switching process). Therefore, when the deserialization control circuit includes 4 deserializers, the maximum number of times the control signal is output is 3 times. If the communication fails 3 times, the data transmission channel will no longer be switched for communication.
[0123] Accordingly, the switch module switches the data transmission channel selected by the switch module in response to the control signal from the data processing device until communication with the sensor is successful through the data transmission channel selected by the switch module or the number of times the data transmission channel is switched in response to the control signal reaches a preset value.
[0124] In the present application, the deserialization control circuit includes multiple deserializers that support different data protocols, and supports the selection of paths where different deserializers are located through a switch module. The deserializer control circuit can be set between the sensor and the data processing device, and select the data transmission channel where the first deserializer is located. The data of the sensor can be transmitted through the data transmission channel where the first deserializer is located. The first deserializer can convert the data from the sensor and provide it to the data processing device and / or provide the data from the data processing device to the sensor. In addition, the switch module can also switch the deserializer, thereby supporting the conversion of data transmitted between the sensor and the data processing device using multiple data protocols, so that the data processing device can successfully obtain data collected by sensors using different data protocols, without the need to develop different data processing devices to adapt to sensors that support different data protocols, thereby improving the compatibility of the perception system with the sensor and reducing the cost of perception system development.
[0125] In addition, the present application achieves compatibility with multiple sensors through a combination of software and hardware. In terms of hardware, the present application sets up multiple deserializers that support different data protocols and uses a switch module to switch the data transmission channel. In terms of software, the data processing device outputs a control signal to realize the active switching of multiple deserializers, and attempts to communicate with the sensor before and after the switch to improve the success rate of communication. For example, the switch module selects the first data transmission channel where the A deserializer is located among the N deserializers to form a path through the A deserializer between the sensor and the data processing device, so that the data processing device can try to communicate with the sensor through the first data transmission channel. If the communication fails, the second data transmission channel where the B deserializer is located among the N deserializers is selected through the switch module to form a path through the B deserializer between the sensor and the data processing device, so that the data processing device can try to communicate with the sensor through the second data transmission channel. The above process of switching different data transmission channels is also the process of matching and screening between deserializers and sensors of different data protocols.
[0126] FIG6 above describes the process of the deserialization control method from the perspective of system interaction and provides multiple optional solutions. A possible implementation method is exemplarily introduced below in conjunction with FIG8.
[0127] Please refer to Figure 8, which is a flow chart of a data transmission method provided in an embodiment of the present application. Optionally, the data transmission method can be applied to the aforementioned perception system, such as the perception system shown in Figures 1, 2, 4, and 5.
[0128] The data transmission method includes one or more steps from step S801 to step S804. It should be understood that for the convenience of description, the description is given in the order of step S801 to step S804, and it is not intended to limit the execution to the above order. The embodiment of the present application does not limit the order of execution, execution time, number of executions, etc. of the above one or more steps, and other steps can be interspersed between or before and after these steps as needed. Among them, steps S801 to step S804 are as follows:
[0129] Step S801: the computing device attempts to communicate with the sensor through the data transmission channel where the first deserializer is located.
[0130] Optionally, the computing device can be the main intelligent driving system, or it can be a central device in the perception system with relatively concentrated computing power, used to analyze data from the sensors. The computing device includes a data processing device and a deserialization control circuit. The deserialization control circuit includes a switch module and multiple data transmission channels that pass through different deserializers. For related descriptions, please refer to Figures 3 and 5, etc.
[0131] As a possible implementation, when a computing device attempts to communicate with a sensor, the computing device may specifically perform one or more of the following operations: configuring the sensor (e.g., power-on control, shooting angle control, acquisition frequency control), sending an indication message to the sensor, and receiving ACK or NACK information.
[0132] For example, when a computing device is connected to multiple sensors, the computing device can use deserializer A (which can be regarded as the first deserializer) to try to communicate with different sensors, that is, traverse different sensors until communication with a certain sensor (such as sensor B) is successful, and then determine that sensor B transmits data to the data processing device through deserializer A.
[0133] Optionally, the A deserializer may be a default deserializer among the multiple deserializers, that is, the computing device traverses all sensors starting from the A deserializer by default.
[0134] In some possible scenarios, if the computing device successfully matches a sensor with which it can communicate after traversing the sensor using deserializer A, the computing device is initialized successfully and can perform its corresponding services normally. For example, the computing device can obtain data from sensor B transmitted through deserializer A through the data transmission channel where deserializer A is located.
[0135] In some other possible situations, the computing device fails to communicate with the sensor through the data transmission channel where deserializer A (i.e., the first deserializer) is located. In this case, the computing device can switch the deserializer. This possible situation is described below in conjunction with step S802:
[0136] Step S802: When communication with the sensor via the data transmission channel where the first deserializer is located fails, the computing device switches to the data transmission channel where the second deserializer is located and attempts to communicate with the sensor.
[0137] For example, the computing device can traverse different sensors through deserializer A and determine whether initialization is successful (i.e., whether communication with a sensor is successful through deserializer A). If initialization is unsuccessful, the computing device can control the switch in the switch module by outputting a first control signal. The switch in the switch module responds to the first control signal and controls the data transmission channel selected by the switch module to switch from the data transmission channel where deserializer A is located to the data transmission channel where deserializer B (which can be regarded as a second deserializer) is located.
[0138] In some possible scenarios, the computing device uses the B deserializer to traverse different sensors and determine whether initialization is successful (i.e., whether communication with a sensor via the B deserializer is successful). If the computing device is initialized successfully, the corresponding service is carried out normally. For example, the computing device can obtain sensor data transmitted by the B deserializer through the data transmission channel where the B deserializer is located.
[0139] In some other possible situations, the computing device fails to communicate with the sensor through the data transmission channel where the B deserializer is located. In this case, the computing device can switch the deserializer again. This possible situation is described below in conjunction with step S803:
[0140] Step S803: When communication with the sensor via the data transmission channel where the second deserializer is located fails, the computing device switches to the data transmission channel where the third deserializer is located and attempts to communicate with the sensor.
[0141] For example, the computing device can traverse different sensors through the C deserializer and determine whether initialization is successful. If initialization is unsuccessful, the computing device can control the switch in the switch module by outputting a second control signal. The switch in the switch module responds to the second control signal and controls the data transmission channel selected by the switch module to switch from the data transmission channel where the B deserializer is located to the data transmission channel where the C deserializer (which can be regarded as a third deserializer) is located.
[0142] In some possible scenarios, the computing device uses the C deserializer to traverse different sensors and determine whether initialization is successful (i.e., whether communication with a sensor is successful via the C deserializer). If the computing device is initialized successfully, the corresponding business is carried out normally. For example, the computing device can obtain data from the sensor transmitted by the C deserializer through the data transmission channel where the C deserializer is located.
[0143] In some other possible situations, the computing device fails to communicate with the sensor through the data transmission channel where the third deserializer is located. In this case, the computing device can switch the deserializer. This possible situation is described below in conjunction with step S804:
[0144] Step S804: when communication with the sensor fails through the data transmission channel where the third deserializer is located, the computing device switches to the data transmission channel where the next deserializer is located and attempts to communicate with the sensor.
[0145] Optionally, if the computing device fails to initialize all the time or succeeds once, the initialization process ends.
[0146] Exemplarily, the computing device continues to output the control signal instructing the switch module to switch the data transmission channel until the data transmission channel selected by the switch module successfully communicates with the sensor or the number of times the control signal is sent reaches a preset value.
[0147] Among them, the preset value is related to the number of deserializers. For example, it is assumed that the deserialization control circuit includes 4 deserializers. Since the deserializer control circuit will initially select any one of the deserializers, such as the data transmission channel where the A deserializer (which can be regarded as the first deserializer) is located. At this time, the sensor and the data processing device can be transmitted through the data transmission channel where the A deserializer is located. When the communication with the sensor through the data transmission channel where the A deserializer is located fails, the data processing device will output a control signal indicating the switching of the data transmission channel (that is, the first switching process). Therefore, when the deserialization control circuit includes 4 deserializers, the maximum number of times the control signal is output is 3 times. If the communication fails 3 times, the data transmission channel will no longer be switched for communication.
[0148] It should be noted that the detailed explanation of the above steps S801-S804 can be found in the embodiment described in FIG6 , and will not be repeated here.
[0149] In order to implement the method of the embodiment of the present application, the device of the embodiment of the present application is provided below.
[0150] It can be understood that the multiple devices provided in the embodiments of the present application, such as data processing devices, are for implementing the functions in the above-mentioned method embodiments, and include hardware structures, software modules, or a combination of hardware structures and software structures corresponding to executing each function.
[0151] Those skilled in the art should easily appreciate that the units and algorithm steps of each example described in the embodiments disclosed herein can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different device implementations to implement the aforementioned method embodiments in different usage scenarios, and different implementations of the device should not be considered to exceed the scope of the embodiments of the present application.
[0152] The embodiments of the present application may divide the device into functional modules. For example, each functional module may be divided according to each function, or two or more functions may be integrated into one functional module. The above-mentioned integrated modules may be implemented in the form of hardware or software functional modules. It should be noted that the division of modules in the embodiments of the present application is schematic and is only a logical functional division. In actual implementation, other division methods may be used.
[0153] For example, in the case of dividing the functional modules of the device in an integrated manner, the present application cites several possible data processing devices.
[0154] Please refer to Figure 9, which is a schematic diagram of the structure of a data processing device 90 provided in an embodiment of the present application. The data processing device 90 can be a perception system or a component in the perception system, such as an SoC, an ISP module, a software module, or an integrated circuit. The data processing device 90 has the function of implementing the data transmission method described in the embodiment of the present application. In one possible design, the data processing device 90 includes a transceiver unit 901 and a processing unit 902, wherein:
[0155] The transceiver unit 901 is configured to attempt to communicate with the sensor through a first data transmission channel currently selected by the switch module, where the first data transmission channel passes through a first deserializer among the N deserializers.
[0156] The processing unit 902 is used to output a first control signal to the switch module when communication with the sensor through the first data transmission channel fails. The first control signal is used to instruct the switch module to switch from the currently selected first data transmission channel to the second data transmission channel, and the second data transmission channel passes through the second deserializer among the N deserializers.
[0157] The transceiver unit 901 is further configured to attempt to communicate with the sensor through the second data transmission channel switched by the switch module.
[0158] In an optional embodiment, the processing unit 902 is also used to continue to output a control signal to the switch module indicating switching the data transmission channel when communication with the sensor through the second data transmission channel fails until the data transmission channel selected by the switch module successfully communicates with the sensor or the number of switching times of the data transmission channel for sending the control signal reaches a preset value.
[0159] In another optional embodiment, when the second data transmission channel selected by the switch module attempts to communicate with the sensor, the transceiver unit 901 is specifically used to: when the attempt to communicate with the sensor through the second data transmission channel is successful, obtain the data from the sensor transmitted through the second deserializer through the second data transmission channel.
[0160] The embodiments of the present application and the above-mentioned method embodiments are based on the same concept, and the technical effects they bring are also the same. For the specific principles, please refer to the description of the above-mentioned embodiments, which will not be repeated here.
[0161] The present application also provides a chip, which includes a deserialization control circuit and an interface, wherein the deserialization control circuit and the interface are coupled; the interface is used to input and / or output information, and the deserialization control circuit is used to execute the aforementioned deserialization control method and data transmission method, such as the method described in Figure 6 or Figure 8.
[0162] The present application also provides an in-vehicle computing device, which includes a deserialization control circuit and an interface, wherein the deserialization control circuit and the interface are coupled; the interface is used to input and / or output information, and the deserialization control circuit is used to execute the aforementioned deserialization control method and data transmission method, such as the method described in Figure 6 or Figure 8.
[0163] The present application also provides a vehicle, which includes an on-board computing device.
[0164] The present application also provides a computer-readable storage medium, which stores instructions. When the instructions are executed on at least one processor, the aforementioned deserialization control method and data transmission method are implemented, such as the method described in Figure 6 or Figure 8.
[0165] The present application also provides a computer program product, which includes computer instructions. When executed by a computing device, the computer program product implements the aforementioned deserialization control method and data transmission method, such as the method described in Figure 6 or Figure 8.
[0166] In the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.
[0167] Furthermore, unless otherwise specified, ordinal numbers such as "first" and "second" in the embodiments of this application are used to distinguish multiple objects and are not used to limit the order, timing, priority, or importance of multiple objects. For example, the first deserializer and the second deserializer are only for ease of description and do not indicate differences in structure, importance, etc. between the first and second deserializers. In some embodiments, the first deserializer and the second deserializer can also be the same deserializer.
[0168] In the above embodiments, the term "in the case of..." can be interpreted to mean "if...", "after...", "in response to determining...", or "in response to detecting...", depending on the context. The above are merely optional embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the concepts and principles of the present application shall be included in the scope of protection of the present application.
[0169] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A deserialization control circuit, characterized in that, one end of the deserialization control circuit is connected to a data processing device, and the other end is connected to a sensor. The deserialization control circuit includes a switch module and N deserializers, where N is an integer and N≥2, and at least two of the N deserializers support different data protocols, the N deserializers are respectively located in N data transmission channels, and the N data transmission channels are located between the sensor and the data processing device, the switch module is configured to select and enable the data transmission channel where the first deserializer among the N deserializers is located to form a path passing through the first deserializer between the sensor and the data processing device, and switch the selected data transmission channel in response to a control signal from the data processing device, and the first deserializer is any one of the N deserializers.
2. The circuit according to claim 1, characterized in that, when the data transmission channel where the first deserializer is located is selected and enabled, the first deserializer is configured to transmit a high-speed signal from the sensor to the data processing device through the data transmission channel where the first deserializer is located, based on the data protocol supported by the first deserializer, and the high-speed signal includes a Mobile Industry Processor Interface (MIPI) signal.
3. The circuit according to claim 1 or 2, characterized in that, the deserialization control circuit includes a high-speed transmission interface; the deserialization control circuit is connected to the sensor through the high-speed transmission interface.
4. The circuit according to any one of claims 1-3, characterized in that, the switch module includes a first switch; the first switch is configured to select and enable the data transmission channel where the first deserializer is located to form a path between the sensor and the first deserializer.
5. The circuit according to any one of claims 1-4, characterized in that, each of the N deserializers is respectively connected to the data processing device through different high-speed signal buses; or the switch module further includes a second switch, and the N deserializers and the data processing device are connected by switching the corresponding high-speed signal buses through the second switch.
6. A deserialization control method, characterized in that, applied to a deserialization control circuit, one end of the deserialization control circuit is connected to a data processing device, and the other end is connected to a sensor. The deserialization control circuit includes a switch module and N deserializers, where N is an integer and N≥2, and at least two of the N deserializers support different data protocols, the N deserializers are respectively located in N data transmission channels, and the N data transmission channels are located between the sensor and the data processing device, the switch module is configured to select and enable the data transmission channel where the first deserializer among the N deserializers is located to form a path passing through the first deserializer between the sensor and the data processing device, and the first deserializer is any one of the N deserializers; the method includes: receiving a first control signal from the data processing device; In response to the first control signal, control the data transmission channel selected by the switch module to be switched from the first data transmission channel to the second data transmission channel. The first data transmission channel passes through the first deserialization unit among the N deserialization units, and the second data transmission channel passes through the second deserialization unit among the N deserialization units.
7. The method according to claim 6, wherein, the method further includes: continuing to respond to the control signal from the data processing device, and switching the data transmission channel selected by the switch module until the data transmission channel selected by the switch module communicates successfully with the sensor or the number of times of switching the data transmission channel in response to the control signal reaches a preset value.
8. The method according to claim 6 or 7, wherein, the switch module includes a first switch; Select the data transmission channel where the first deserialization unit is located through the first switch to form a path between the sensor and the first deserialization unit.
9. The method according to claim 8, wherein, each of the N deserialization units is respectively connected to the data processing device through different high-speed signal buses, and the high-speed signals include Mobile Industry Processor Interface (MIPI) signals; or the switch module further includes a second switch, and the N deserialization units and the data processing device are connected by switching the corresponding high-speed signal buses through the second switch.
10. The method according to any one of claims 6-9, wherein, When the data transmission channel where the second deserialization unit among the N deserialization units is located is selected, transmit the high-speed signal from the sensor to the data processing device based on the data protocol supported by the second deserialization unit through the second data transmission channel where the second deserialization unit is located.
11. The method according to any one of claims 6-10, wherein, the deserialization control circuit includes a high-speed transmission interface; the deserialization control circuit is connected to the sensor through the high-speed transmission interface.
12. A data transmission method, wherein, applied to a data processing device, the data processing device is connected to one end of a deserialization control circuit, the other end of the deserialization control circuit is connected to a sensor, the deserialization control circuit includes a switch module and N deserialization units, N is an integer and N≥2, and at least two of the N deserialization units support different data protocols, the N deserialization units are respectively located in N data transmission channels, and the N data transmission channels are located between the sensor and the data processing device; the method includes: attempt to communicate with the sensor through the first data transmission channel currently selected by the switch module, and the first data transmission channel passes through the first deserialization unit among the N deserialization units; In the case of communication failure with the sensor through the first data transmission channel, output a first control signal to the switch module, and the first control signal is used to instruct the switch module to switch from the currently selected first data transmission channel to the second data transmission channel, and the second data transmission channel passes through the second deserialization unit among the N deserialization units; Attempt to communicate with the sensor via the switched second data transmission channel.
13. The method according to claim 12, wherein, the method further comprises: in the case of communication failure with the sensor via the second data transmission channel, continue to output a control signal indicating a switched data transmission channel to the switch module until communication with the sensor via the data transmission channel selected by the switch module is successful or the number of times the control signal is sent reaches a preset value.
14. The method according to claim 12 or 13, wherein, the attempt to communicate with the sensor via the second data transmission channel selected by the switch module comprises: in the case of successful communication with the sensor via the second data transmission channel, obtain data from the sensor transmitted through the second deserialiser via the second data transmission channel.
15. A data processing device, wherein, the data processing device comprises a module for implementing the method according to any one of claims 12 - 14.
16. A chip, wherein, the chip comprises the deserialisation control circuit according to any one of claims 1 - 5.
17. The chip according to claim 16, wherein, it further comprises a processing circuit, and the processing circuit comprises a module for implementing the method according to any one of claims 12 - 14.
18. A vehicle-mounted computing device, wherein, the vehicle-mounted computing device comprises the deserialisation control circuit according to any one of claims 1 - 5.
19. A vehicle, wherein, the vehicle comprises the vehicle-mounted computing device according to claim 18.