A data transmission method, apparatus, device, and readable storage medium

Abstract

The present application provides a data transmission method, apparatus, device and readable storage medium. The method includes: when receiving real-time image data collected by an image sensor through a mobile industry processing interface, obtaining the output priority of the real-time image data; wherein, different types of image data have different output priorities; determining a time-sharing output node corresponding to the real-time image data according to the output priority; wherein, the time-sharing output node is used for the mobile industry processing interface to output a single type of image data; controlling the mobile industry processing interface to output the real-time image data according to the time-sharing output node. Through the implementation of the solution of the present application, time-sharing output of different types of data is performed using the same MIPI according to the output priority of the real-time received data, which can effectively save hardware space and reduce data transmission power consumption compared with configuring multiple MIPIs.

Description

Technical Field

[0001] This application relates to the field of electronic technologies, and in particular, to a data transmission method, apparatus, device, and readable storage medium. Background Art

[0002] The MIPI Alliance, i.e., the Mobile Industry Processor Interface (MIPI) Alliance. The Mobile Industry Processor Interface is an open standard and a specification initiated by the MIPI Alliance for mobile application processors.

[0003] That is to say, MIPI is not only an alliance but also the name of a set of interface protocol specifications. It has different working groups under its jurisdiction to meet the different requirements of each subsystem of the terminal device. Different working groups are responsible for formulating specific protocols and defining a set of internal interface standards for different hardware devices respectively, such as the Camera Serial Interface (CSI), the Display Serial Interface (DSI), the Radio Frequency Interface (DigRF), etc.

[0004] Currently, in the actual data transmission process, for the transmission requirements of different types of data, related technologies usually use multiple MIPIs to achieve the separate transmission of different types of data, resulting in a larger hardware space size and a larger data transmission power consumption. Summary of the Invention

[0005] Embodiments of this application provide a data transmission method, apparatus, device, and readable storage medium, which can at least solve the problem that related technologies use multiple MIPIs to achieve the separate transmission of different types of data, resulting in a larger hardware space size and a larger data transmission power consumption.

[0006] The first aspect of the embodiments of this application provides a data transmission method, including:

[0007] When receiving real-time image data collected by an image sensor through the Mobile Industry Processor Interface, obtaining the output priority of the real-time image data; wherein, different types of image data have different output priorities;

[0008] Determining a time-sharing output node corresponding to the real-time image data according to the output priority; wherein, the time-sharing output node is used for the Mobile Industry Processor Interface to output a single type of image data;

[0009] Controlling the Mobile Industry Processor Interface to output the real-time image data according to the time-sharing output node.

[0010] The second aspect of the embodiments of this application provides a data transmission apparatus, including:

[0011] An acquisition module, configured to obtain the output priority of the real-time image data when receiving the real-time image data collected by an image sensor through a mobile industry processing interface; wherein, different types of image data have different output priorities;

[0012] A determination module, configured to determine a time-sharing output node corresponding to the real-time image data according to the output priority; wherein, the time-sharing output node is used for the mobile industry processing interface to output a single type of image data;

[0013] An output module, configured to control the mobile industry processing interface to output the real-time image data according to the time-sharing output node.

[0014] A third aspect of the embodiments of the present application provides a terminal device, including: a memory and a processor, wherein the processor is configured to execute a computer program stored on the memory, and when the processor executes the computer program, each step in the data transmission method provided in the first aspect of the embodiments of the present application is implemented.

[0015] A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, each step in the data transmission method provided in the first aspect of the embodiments of the present application is implemented.

[0016] As can be seen from the above, according to the data transmission method, device, equipment and readable storage medium provided by the solution of the present application, when receiving the real-time image data collected by an image sensor through a mobile industry processing interface, the output priority of the real-time image data is obtained; wherein, different types of image data have different output priorities; a time-sharing output node corresponding to the real-time image data is determined according to the output priority; wherein, the time-sharing output node is used for the mobile industry processing interface to output a single type of image data; the mobile industry processing interface is controlled to output the real-time image data according to the time-sharing output node. Through the implementation of the solution of the present application, different types of data are output in a time-sharing manner using the same MIPI according to the output priority of the real-time received data, which can effectively save hardware space compared with configuring multiple MIPIs and reduce the data transmission power consumption. Description of the Drawings

[0017] Figure 1 It is a basic process schematic diagram of a data transmission method provided in the first embodiment of the present application;

[0018] Figure 2 It is a data output schematic diagram provided in the first embodiment of the present application;

[0019] Figure 3 It is a schematic diagram of a data output form provided in the first embodiment of the present application;

[0020] Figure 4Another data output schematic diagram provided by the first embodiment of the present application;

[0021] Figure 5 Another data output schematic diagram provided by the first embodiment of the present application;

[0022] Figure 6 Another schematic diagram of the data output form provided by the first embodiment of the present application;

[0023] Figure 7 Schematic diagram of the program module of the data transmission device provided by the second embodiment of the present application;

[0024] Figure 8 Schematic diagram of the structure of the terminal device provided by the third embodiment of the present application. Detailed implementation manners

[0025] To make the invention objectives, features, and advantages of the present application more obvious and understandable, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative efforts fall within the protection scope of the present application.

[0026] In the description of the embodiments of the present application, it should be understood that the orientation or positional relationship indicated by the terms "length", "width", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the embodiments of the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the present invention.

[0027] In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of the embodiments of the present application, the meaning of "a plurality" is two or more, unless otherwise specifically defined.

[0028] In the embodiments of the present application, unless otherwise clearly defined and limited, terms such as "installation", "connection", "linkage", "fixation" and the like shall be understood in a broad sense. For example, it may be a fixed connection, a detachable connection, or an integral one; it may be a mechanical connection or an electrical connection; it may be a direct connection or an indirect connection through an intermediate medium, and it may be the communication inside two components or the interaction relationship between two components. For those of ordinary skill in the art, the specific meanings of the above terms in the embodiments of the present application can be understood according to specific situations.

[0029] The above are only the preferred embodiments of the present application, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

[0030] In order to solve the problems in the related art that multiple MIPIs are used to separately transmit different types of data, resulting in a large spatial size of the hardware and a large power consumption for data transmission, the first embodiment of the present application provides a data transmission method, as Figure 1 is the basic flowchart of the data transmission method provided in this embodiment. The data transmission method includes the following steps:

[0031] Step 101: When receiving the real-time image data collected by the image sensor through the mobile industry processing interface, obtain the output priority of the real-time image data.

[0032] Specifically, in this embodiment, the terminal device is provided with multiple different types of image sensors for collecting different types of image data. The image sensors can be integrally arranged or independently arranged. The integral arrangement means that different types of pixel arrays are integrated on a single image sensor, and the independent arrangement means that multiple image sensors with different pixel array types are respectively configured. The image sensors in this embodiment preferably integrate an EVS (Event-based Vision Sensor) pixel array and an APS (Active Pixel Sensor) pixel array for collecting EVS image data and APS image data respectively.

[0033] It should be noted that in this embodiment, different types of image data have different output priorities. The output priority can be preset in advance or specified in real time according to the application scenario in actual applications. This embodiment does not make a unique limitation on this. In actual applications, the output priority can be set with reference to the size of the single-frame data volume of each type of image data, and the output priority can be positively correlated with the single-frame data volume.

[0034] In an implementation manner of this embodiment, before the step of obtaining the output priority of the real-time image data, the following steps are further included: If the real-time image data is single-type image data, obtain the total data cache of the real-time image data; if the total data cache reaches a preset threshold, execute the step of obtaining the output priority of the real-time image data.

[0035] Specifically, in practical applications, the image data output by the mobile industry processing interface each time can be set to a fixed amount or an unfixed amount. To ensure the integrity of data output and reduce system power consumption, this embodiment sets a data output amount threshold, such as 1024 bytes. Then, after receiving the real-time image data, obtain the total cache of this type of image data, and determine whether the total amount of this type of image data meets the requirements. When the currently accumulated data volume reaches the required data output amount, trigger the subsequent data transmission process to uniformly output the same type of image data including the currently received real-time image data. Otherwise, cache the currently received real-time image data and trigger the execution of the subsequent data transmission process until the accumulated amount of this type of image data received in the next receiving period reaches the required data output amount. For example, if the size of the currently received real-time image data is 512 bytes, first cache this data and then uniformly output it after accumulating 1024 bytes in the next receiving period.

[0036] Step 102: Determine the time-sharing output node corresponding to the real-time image data according to the output priority.

[0037] Specifically, the time-sharing output node is used for the mobile industry processing interface to output single-type image data, that is, for a single period, the mobile industry processing interface only outputs one type of image data. In practical applications, according to the different output priorities of the image data, the image data can be output immediately or delayed. For the image data that needs to be output delayed, after receiving this image data, it can be first cached at the back end, and when its time-sharing output node arrives, then call this image data from the cache for output.

[0038] In an implementation manner of this embodiment, before the step of determining the time-sharing output node corresponding to the real-time image data according to the output priority, the following steps are further included: Obtain the current output function usage status of the mobile industry processing interface; where the output function usage status includes an occupied status and an idle status.

[0039] Correspondingly, the step of determining the time-sharing output node corresponding to the real-time image data according to the output priority includes: Combining the output function usage status and the output priority, determine the time-sharing output node corresponding to the real-time image data.

[0040] Specifically, in this embodiment, when the mobile industry processing interface is in an occupied state, it indicates that the mobile industry interface is currently in the process of data output. When the mobile industry processing interface is in an idle state, it indicates that the mobile industry processing interface is not currently performing data output.

[0041] Further, in one implementation manner of this embodiment, the step of determining the time-sharing output node corresponding to the real-time image data by combining the output function usage status and the output priority includes: when the output function usage status is in an occupied state, obtaining the priority comparison result of the real-time image data relative to the current output image data; determining the time-sharing output node corresponding to the real-time image data according to the priority comparison result.

[0042] Specifically, in this embodiment, the output priority of the real-time image data is compared with the output priority of the current output image data. If the priority comparison result is that the output priority of the real-time image data is less than or equal to the current output image data, the next output node of the current output node is determined as the time-sharing output node of the real-time image data, that is, the mobile industry processing interface outputs the real-time image data after the current output image data is output; if the priority comparison result is that the output priority of the real-time image data is greater than the current output image data, the current output node is updated to the time-sharing output node of the real-time image data, that is, the mobile industry processing interface pauses the output of the current output image data and immediately outputs the received real-time image data preferentially.

[0043] Further, in another implementation manner of this embodiment, the step of determining the time-sharing output node corresponding to the real-time image data by combining the output function usage status and the output priority includes: when the output function usage status is in an idle state, if the real-time image data is multiple different types of image data, obtaining the priority comparison result of the multiple different real-time image data; respectively determining the time-sharing output nodes corresponding to the different real-time image data according to the priority comparison result.

[0044] Specifically, in this embodiment, if the mobile industry processing interface is in an idle state and the real-time image data is of a single type, then the current output node is determined as the time-sharing output node of the real-time image data, and the mobile industry processing interface directly outputs the received real-time image data; if the real-time image data received when the mobile industry processing interface is in an idle state includes multiple different types of image data, then it is necessary to plan the time-sharing output nodes for the multiple different types of image data. In this embodiment, the time-sharing output priorities of different types of real-time image data are compared, and starting from the current output node, time-sharing output nodes are sequentially allocated to the corresponding real-time image data according to the order of decreasing output priority. For example, if the currently received real-time image data includes real-time image data A, real-time image data B, and real-time image data C, and their output priorities decrease in sequence, then the entire data transmission cycle is divided into three sequentially connected time-sharing output nodes: time-sharing output node A, time-sharing output node B, and time-sharing output node C. The mobile industry processing outputs real-time image data A at time-sharing output node A, real-time image data B at time-sharing output node B, and real-time image data C at time-sharing output node C.

[0045] Step 103, control the mobile industry processing interface to output the real-time image data according to the time-sharing output node.

[0046] Specifically, in this embodiment, according to the output priority of the real-time received data, the same mobile industry processing interface is used for time-sharing output of different types of data, which can effectively reduce the hardware space size and data transmission power consumption compared with configuring multiple mobile industry processing interfaces.

[0047] In an implementation manner of this embodiment, the mobile industry processing interface includes multiple data transmission channels corresponding to multiple different types of image data. Correspondingly, the above step of controlling the mobile industry processing interface to output the real-time image data according to the time-sharing output node includes: obtaining the target data output channel corresponding to the real-time image data; controlling the mobile industry processing interface to output the real-time image data using the target data transmission channel according to the time-sharing output node.

[0048] Specifically, in this embodiment, the mobile industry processing interface is configured with data transmission channels for different types of image data respectively. The mobile industry processing interface uses only one data transmission channel for data transmission at a single time-sharing output node, and different types of image data are transmitted using different data transmission channels in a time-sharing manner. This embodiment takes two data transmission channels as an example for illustration. As Figure 2 shown is a data output schematic diagram provided by this embodiment. Figure 2The virtual channel 1 and the virtual channel 2, namely two data transmission channels corresponding to APS image data and EVS image data respectively. In this embodiment, the t time period is divided into three output time nodes t1, t2, and t3. t1, t2, and t3 can be of equal length or unequal length, depending on the actual application scenario. Assume that in the t1 time, the mobile industry processing interface receives EVS image data but does not receive APS image data. If the mobile industry processing interface is in an idle state, then this frame of EVS image data is output from the virtual channel 2 until the transmission ends. When the mobile industry processing interface receives APS image data in the t2 time, if the mobile industry processing interface is in an idle state, then this frame of APS image data is output from the virtual channel 1. Thus, when the mobile industry processing interface is in an idle state and the currently received real-time image data is of a single type, the current output node is determined as the time-sharing output node of the real-time image data; in addition, if the mobile industry processing interface receives EVS image data while outputting APS image data from the virtual channel 1, assuming that the output priority of the EVS image data is lower than that of the APS image data, then this frame of EVS image data is cached at the backend. After this frame of APS image data is output from the virtual channel 1, the cached EVS image data is then output through the virtual channel 2 until the cached EVS frame data transmission ends, that is, the next output node after the current output node is determined as the time-sharing output node of the currently received EVS image data. It can be seen that in this embodiment, different types of image data are output from different data transmission channels in a frame interleaved form, specifically as Figure 3 shown.

[0049] In addition, it should also be noted that in some embodiments of this embodiment, before obtaining the output priority of the real-time image data, it further includes: obtaining the data reception frame rate of the mobile industry processing interface in the historical time period before the current moment; comparing the data reception frame rate with a preset frame rate threshold; if the data reception frame rate is lower than the frame rate threshold, then execute the step of obtaining the output priority of the real-time image data; if the data reception frame rate is higher than the frame rate threshold, then from multiple data transmission channels of the mobile industry processing interface, obtain the target data output channel corresponding to the data type of the real-time image data, and instantaneously output the real-time image data through the target data output channel.

[0050] Specifically, in practical applications, the image data acquisition behavior of an image sensor usually varies in different application scenarios. Correspondingly, the data reception frame rate of the mobile industry processing interface when receiving data from the image sensor also varies. The data reception frame rate is positively correlated with the data output response rate. When the data reception frame rate is relatively high, it is correspondingly required that the mobile industry processing interface has a high data output response rate, so as to quickly output high-volume image data to the main control chip for processing. Therefore, when the mobile industry processing interface in this embodiment receives real-time image data, it first compares the historical data reception frame rate before the current moment with the frame rate threshold. If it is determined according to the comparison result that the current is in a low-data-volume output scenario, then according to the output priority of the real-time image data, multiple data transmission channels of the mobile industry processing interface are used to output the real-time image data in a time-sharing manner. On the contrary, if it is determined according to the comparison result that the current is in a high-data-volume output scenario, then multiple data channels of the mobile industry processing interface are used to instantaneously output (i.e., real-time output) different types of image data in parallel.

[0051] As Figure 4 shown in another data output schematic diagram provided by this embodiment, APS image data and EVS image data respectively receive data through virtual channel 1 and virtual channel 2 of the same mobile industry processing interface, and then output APS image data and EVS image data from the two virtual channels respectively. It is worth noting that within time t, when the mobile industry processing interface receives APS image data, the APS image data is transmitted in real time from virtual channel 1 and then APS data is output. When the mobile industry processing interface receives EVS image data, the EVS image data is transmitted in real time from virtual channel 2 and then EVS data is output. That is, for different types of received image data, real-time transmission is performed through the virtual channels of different mobile industry processing interfaces, which can effectively improve the output response rate compared with time-sharing transmission.

[0052] In another implementation manner of this embodiment, the mobile industry processing interface includes a single data transmission channel. Correspondingly, the above step of respectively determining the time-sharing output nodes corresponding to different real-time image data according to the priority comparison result includes: dividing a single data transmission cycle of the single data transmission channel into multiple sequentially connected time-sharing output nodes; allocating the real-time image data with the highest output priority to at least the first and last time-sharing output nodes, and allocating the real-time image data with other output priorities to the time-sharing output nodes between the first and last time-sharing output nodes.

[0053] Specifically, different from the previous embodiment where the single-channel mobile industry processing interface outputs different types of image data in a time-sharing manner through multiple virtual channels, the single-channel mobile industry processing interface in this embodiment outputs different types of image data in a time-sharing manner through a single virtual channel. That is, when different types of image data are received simultaneously, the time-sharing output nodes of the image data with a lower output priority are embedded into the time-sharing output nodes of the image data with a higher output priority. It should be noted that the reception behavior of image data usually lasts for a certain period of time. The simultaneous reception of different types of image data referred to in this embodiment may mean that other types of image data are received simultaneously during the reception of a certain type of image data. More specifically, taking the real-time image data including two different types of image data as an example, a single data transmission cycle of a single data transmission channel is divided into a first time-sharing output node, a second time-sharing output node, and a third time-sharing output node that are sequentially connected in time series; the high-priority real-time image data is segmented and allocated to the first time-sharing output node and the third time-sharing output node, and the low-priority real-time image data is wholly allocated to the second time-sharing output node. In addition, it should also be understood that in actual applications, if the number N of different types of image data received simultaneously is greater than two, then N - 1 time-sharing output nodes are divided between the first and last time-sharing output nodes, and the multiple image data to be transmitted in an embedded manner respectively occupy one of the time-sharing output nodes.

[0054] This embodiment takes the output of APS image data and EVS image data through a single data transmission channel as an example for illustration. As Figure 5 shown is another data output schematic diagram provided by this embodiment. Figure 5 In it, virtual channel 1 is also the common data transmission channel for APS image data and EVS image data. In this embodiment, the APS image data and the EVS image data are output together from virtual channel 1 at time t4. Among them, the APS image data is allocated to the first and last output nodes for output, while the EVS image data is output at the middle output node. That is, the APS image data and the EVS image data are output in an embedded form. This embodiment assumes that the single data transmission cycle of the mobile industry processing interface is 33 ms, that is, a frame of APS image data is output every 33 ms and the EVS image data received within these 33 ms. Thus, it can be seen that different types of image data in this embodiment are output from the same data transmission channel in an embedded form, specifically as Figure 6 shown.

[0055] Furthermore, in an implementation manner of this embodiment, before the step of controlling the mobile industry processing interface to output real-time image data according to the time-sharing output nodes, it further includes: obtaining the total amount of image data to be output in a single output transmission cycle; setting the actual transmission rate of the data transmission channel with reference to the total amount of data.

[0056] Specifically, the data transmission channel in this embodiment can support a low-rate transmission mode and a high-rate transmission mode in practical applications, and adaptively adopt corresponding transmission rates for data transmission in different scenarios of data output volume, so as to balance the working efficiency and power consumption control of the mobile industry processing interface.

[0057] Based on the technical solution of the embodiment of the present application above, when receiving real-time image data collected by an image sensor through a mobile industry processing interface, obtain the output priority of the real-time image data; wherein, different types of image data have different output priorities; determine the time-sharing output node corresponding to the real-time image data according to the output priority; wherein, the time-sharing output node is used for the mobile industry processing interface to output a single type of image data; control the mobile industry processing interface to output the real-time image data according to the time-sharing output node. Through the implementation of the solution of the present application, different types of data are output in a time-sharing manner using the same MIPI according to the output priority of the real-time received data, which can effectively save hardware space compared with configuring multiple MIPIs and reduce the data transmission power consumption.

[0058] Figure 7 A data transmission device provided in the second embodiment of the present application. This data transmission device can be used to implement the data transmission method in the foregoing embodiment. As Figure 7 shown, this data transmission device mainly includes:

[0059] An acquisition module 701, configured to obtain the output priority of real-time image data when receiving real-time image data collected by an image sensor through a mobile industry processing interface; wherein, different types of image data have different output priorities;

[0060] A determination module 702, configured to determine the time-sharing output node corresponding to the real-time image data according to the output priority; wherein, the time-sharing output node is used for the mobile industry processing interface to output a single type of image data;

[0061] An output module 703, configured to control the mobile industry processing interface to output the real-time image data according to the time-sharing output node.

[0062] In some implementation manners of this embodiment, the acquisition module is further configured to: obtain the current output function usage status of the mobile industry processing interface; wherein, the output function usage status includes an occupied status and an idle status. Correspondingly, the determination module is specifically configured to: combine the output function usage status and the output priority to determine the time-sharing output node corresponding to the real-time image data.

[0063] Further, in some embodiments of the present embodiment, the determining module is specifically configured to: when the output function usage state is in the occupied state, obtain the priority comparison result of the real-time image data relative to the current output image data; determine the time-sharing output node corresponding to the real-time image data according to the priority comparison result.

[0064] Further, in some other embodiments of the present embodiment, the determining module is specifically configured to: when the output function usage state is in the idle state, if the real-time image data is multiple different types of image data, obtain the priority comparison result of the multiple different real-time image data; determine the time-sharing output nodes corresponding to the different real-time image data respectively according to the priority comparison result.

[0065] In some embodiments of the present embodiment, the mobile industry processing interface includes multiple data transmission channels corresponding to multiple different types of image data. Correspondingly, the output module is specifically configured to: obtain the target data output channel corresponding to the real-time image data; control the mobile industry processing interface to output the real-time image data by using the target data transmission channel according to the time-sharing output node.

[0066] Further, in some embodiments of the present embodiment, the data transmission device further includes: a comparison module, configured to obtain the data reception frame rate of the mobile industry processing interface within a historical time period before the current moment, and compare the data reception frame rate with a preset frame rate threshold. Correspondingly, the obtaining module is specifically configured to: if the data reception frame rate is lower than the frame rate threshold, obtain the output priority of the real-time image data; if the data reception frame rate is higher than the frame rate threshold, obtain the target data output channel corresponding to the data type of the real-time image data from the multiple data transmission channels of the mobile industry processing interface. The output module is further configured to: instantaneously output the real-time image data through the target data output channel.

[0067] In some other embodiments of the present embodiment, the mobile industry processing interface includes a single data transmission channel. Correspondingly, the determining module is specifically configured to: divide the single data transmission cycle of the single data transmission channel into multiple time-sharing output nodes connected in sequence; allocate the real-time image data with the highest output priority to at least the first and last time-sharing output nodes, and allocate the real-time image data with other output priorities to the time-sharing output nodes between the first and last time-sharing output nodes.

[0068] Further, in some embodiments of the present embodiment, the obtaining module is specifically configured to: when receiving the real-time image data collected by the image sensor through the mobile industry processing interface, if the real-time image data is single-type image data, obtain the total data cache of the real-time image data; if the total data cache reaches the preset threshold, obtain the output priority of the real-time image data.

[0069] It should be noted that the data transmission methods in the first embodiment can all be implemented based on the data transmission device provided in this embodiment. Those of ordinary skill in the art can clearly understand that for the convenience and brevity of description, the specific working process of the data transmission device described in this embodiment can refer to the corresponding process in the foregoing method embodiment, and will not be elaborated here.

[0070] According to the data transmission device provided in this embodiment, when receiving real-time image data collected by an image sensor through a mobile industry processing interface, the output priority of the real-time image data is obtained; wherein, different types of image data have different output priorities; according to the output priority, a time-sharing output node corresponding to the real-time image data is determined; wherein, the time-sharing output node is used for the mobile industry processing interface to output a single type of image data; and the mobile industry processing interface is controlled to output the real-time image data according to the time-sharing output node. Through the implementation of the solution of this application, different types of data are output in a time-sharing manner using the same MIPI according to the output priority of the real-time received data, which can effectively save hardware space and reduce data transmission power consumption compared with configuring multiple MIPIs.

[0071] Figure 8 A terminal device provided in the third embodiment of this application. This terminal device can be used to implement the data transmission method in the foregoing embodiment, and mainly includes:

[0072] A memory 801, a processor 802, and a computer program 803 stored on the memory 801 and executable on the processor 802. The memory 801 and the processor 802 are communicatively connected. When the processor 802 executes the computer program 803, the method in the first embodiment above is implemented. Among them, the number of processors can be one or more.

[0073] The memory 801 can be a high-speed random access memory (RAM, Random Access Memory), or a non-volatile memory, such as a disk memory. The memory 801 is used to store executable program code, and the processor 802 is coupled to the memory 801.

[0074] Furthermore, an embodiment of this application also provides a computer-readable storage medium, which can be set in the terminal device in the foregoing embodiment, and this computer-readable storage medium can be the memory in the foregoing Figure 8 illustrated embodiment.

[0075] A computer program is stored on the computer-readable storage medium, and when the program is executed by a processor, it implements the data transmission method in the foregoing embodiments. Further, the computer-readable storage medium may also be various media such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a RAM, a magnetic disk, or an optical disc that can store program codes.

[0076] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of devices or modules can be in electrical, mechanical, or other forms.

[0077] The modules described as separate components may or may not be physically separated. The components shown as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed to multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0078] In addition, in each embodiment of the present application, the functional modules can be integrated into one processing module, or each module can exist physically alone, or two or more modules can be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software functional modules.

[0079] If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. The computer software product is stored in a readable storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in each embodiment of the present application. And the foregoing readable storage medium includes: various media such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disc that can store program codes.

[0080] It should be noted that, for the foregoing method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations. However, those skilled in the art should be aware that this application is not limited by the described action sequence, because according to this application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0081] In the above embodiments, the descriptions of the respective embodiments have their own focuses. For the parts not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0082] The above is the description of the data transmission method, device, equipment, and readable storage medium provided by this application. For those skilled in the art, according to the idea of the embodiments of this application, there will be changes in the specific implementation manners and application scopes. In summary, the content of this specification should not be construed as a limitation to this application.

Claims

1. A data transmission method, characterized in that, Comprising: When receiving the real-time image data collected by the image sensor through the mobile industry processing interface, obtaining the output priority of the real-time image data; wherein, the mobile industry processing interface includes a single data transmission channel, and different types of image data have different output priorities; Obtaining the current output function usage status of the mobile industry processing interface; wherein, the output function usage status includes an occupied status and an idle status; Combining the output function usage status and the output priority to determine a time-sharing output node corresponding to the real-time image data; wherein, the time-sharing output node is used for the mobile industry processing interface to output a single type of image data; Controlling the mobile industry processing interface to output the real-time image data according to the time-sharing output node; The step of combining the output function usage status and the output priority to determine a time-sharing output node corresponding to the real-time image data includes: When the output function usage status is the idle status, if the real-time image data is multiple different types of image data, obtaining the priority comparison result of the multiple different real-time image data; Dividing a single data transmission cycle of the single data transmission channel into multiple sequentially connected time-sharing output nodes; Allocating the real-time image data with the highest output priority to at least the first and last time-sharing output nodes, and allocating the real-time image data with other output priorities to the time-sharing output nodes between the first and last time-sharing output nodes.

2. The data transmission method according to claim 1, wherein The step of combining the output function usage status and the output priority to determine a time-sharing output node corresponding to the real-time image data further includes: When the output function usage status is the occupied status, obtaining the priority comparison result of the real-time image data relative to the current output image data; Determining a time-sharing output node corresponding to the real-time image data according to the priority comparison result.

3. The data transmission method according to claim 1 or 2, characterized in that Before the step of obtaining the output priority of the real-time image data, further including: If the real-time image data is a single type of image data, obtaining the total data cache of the real-time image data; If the total data cache reaches a preset threshold, performing the step of obtaining the output priority of the real-time image data.

4. A data transmission device, characterized in that, Comprising: An obtaining module, configured to obtain the output priority of the real-time image data when receiving the real-time image data collected by the image sensor through the mobile industry processing interface; wherein, the mobile industry processing interface includes a single data transmission channel, and different types of image data have different output priorities; A determination module, configured to obtain the current output function usage status of the mobile industry processing interface; when the output function usage status is an idle status, if the real-time image data is multiple different types of image data, obtain the priority comparison result of the multiple different real-time image data; divide a single data transmission cycle of the single data transmission channel into multiple time-sharing output nodes connected in sequence; allocate the real-time image data with the highest output priority to at least the first and last time-sharing output nodes, and allocate the real-time image data with other output priorities to the time-sharing output nodes between the first and last time-sharing output nodes; wherein, the output function usage status includes an occupied status and an idle status, and the time-sharing output nodes are used for the mobile industry processing interface to output a single type of image data; An output module, configured to control the mobile industry processing interface to output the real-time image data according to the time-sharing output nodes.

5. A terminal device, characterized in that, It includes a memory and a processor, wherein: The processor is configured to execute a computer program stored on the memory; When the processor executes the computer program, it implements the steps in the method according to any one of claims 1 to 3.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps in the method according to any one of claims 1 to 3.

Images