Vehicle-mounted terminal, data transmission method, device and system thereof and storage medium

Abstract

The invention relates to a vehicle-mounted terminal, a data transmission method, device and system thereof and a storage medium. The method comprises the following steps: receiving target camera data of external camera equipment; under the condition that the controlled object is determined to be EVS camera equipment based on the operation command, sending the target camera data to a control component of the EVS camera equipment through a development tool component of the EVS camera equipment, and controlling the control component of the EVS camera equipment to send the target camera data to the EVS camera equipment for display; and under the condition that the controlled object is determined to be Android camera equipment of the vehicle-mounted terminal based on the operation command, sending target camera data to a shared memory component of the vehicle-mounted terminal, and sending the target camera data to a development tool component of the Android camera equipment through a virtual camera component, and sending the target camera shooting data to the Android camera shooting equipment for display through a development tool component of the Android camera shooting equipment. According to the invention, the camera data is transmitted in the form of network flow, and the diversification of application scenes is improved on the premise of not increasing hardware cost.

Description

Technical Field

[0001] The present invention relates to the technical field of data transmission, and in particular to a vehicle-mounted terminal and a data transmission method, device, system and storage medium thereof. Background Art

[0002] In the vehicle system design, the intelligent driving system and the central control entertainment system are two independent modules. Among them, the intelligent driving system will be connected to many cameras outside the car, and most of these cameras are inaccessible to the car's entertainment system.

[0003] In the related technology, the camera data is transmitted by adding a deserialization chip, a serialization chip and an LVDS (Low-Voltage Differential Signaling) harness between the intelligent driving system and the central control entertainment system. However, the application of this technical solution increases the hardware equipment and the application cost. Summary of the invention

[0004] One of the purposes of the present invention is to propose a data transmission method for a vehicle-mounted terminal, which transmits camera data in the form of a network stream through software, and connects the camera data to the Android native Camera system, so that the use scenarios of the camera in the central control entertainment system in the vehicle system are more diversified without increasing the hardware cost; the second purpose is to propose a data transmission device for a vehicle-mounted terminal; the third purpose is to propose a data transmission system for a vehicle-mounted terminal; the fourth purpose is to propose a computer-readable storage medium; the fifth purpose is to propose a vehicle-mounted terminal.

[0005] To achieve the above object, the technical solution adopted by the present invention is as follows:

[0006] A data transmission method for a vehicle-mounted terminal, the method comprising: receiving target camera data of an external camera device; when it is determined based on an operation command that the controlled object is an EVS (Exterior View System) camera device, sending the target camera data to a control component of the EVS camera device through a development tool component of the EVS camera device, and controlling the control component of the EVS camera device to send the target camera data to the EVS camera device for display; when it is determined based on the operation command that the controlled object is an Android camera device of a vehicle-mounted terminal, sending the target camera data to a shared memory component of the vehicle-mounted terminal, sending it to a development tool component of the Android camera device through a virtual camera component, and sending the target camera data to the Android camera device through the development tool component of the Android camera device for display.

[0007] According to the above technical means, first, the target camera data of the external camera device is received, and when it is determined based on the operation command that the controlled object is the EVS camera device, the target camera data is sent to the control component of the EVS camera device through the development tool component of the EVS camera device, and the control component of the EVS camera device is controlled to send the target camera data to the EVS camera device for display, and when it is determined based on the operation command that the controlled object is the Android camera device of the vehicle terminal, the target camera data is sent to the shared memory component of the vehicle terminal, and sent to the development tool component of the Android camera device through the virtual camera component, and the target camera data is sent to the Android camera device through the development tool component of the Android camera device for display. Thus, the method can transmit the camera data in the form of a network stream through software, and connect the camera data with the Android native Camera system, so that the use scenarios of the camera in the central control entertainment system in the vehicle system are more diversified without increasing the hardware cost.

[0008] In addition, the data transmission method of the vehicle terminal according to the above embodiment of the present application may also have the following additional technical features:

[0009] Furthermore, the data transmission method of the vehicle-mounted terminal also includes: receiving camera data from an external camera device; and decoding the camera data to obtain target camera data.

[0010] Furthermore, the data transmission method of the vehicle-mounted terminal also includes: responding to an operation command; determining an external camera device according to the operation command; and sending an opening command to the external camera device through a network channel when the external camera device is not turned on.

[0011] Furthermore, the virtual camera component is stored in the form of a virtual node in the Android system of the vehicle terminal and is sent to the development tool component of the Android camera device through the virtual camera component, including: transmitting the target camera data to the shared data reference component of the control component of the Android camera device through the virtual node of the virtual camera component; transmitting the data to the development tool component of the Android camera device through the shared data reference component.

[0012] Furthermore, the data transmission method of the vehicle-mounted terminal also includes: when it is determined based on the operation command that the controlled object is an EVS camera device, the operation command is received by the control component of the EVS camera device, and the operation command is sent to the management component of the Android camera device of the vehicle-mounted terminal; when it is determined based on the operation command that the controlled object is an Android camera device, the operation command is received by the control component of the Android camera device, and the operation command is sent to the management component of the Android camera device.

[0013] Furthermore, the video data is decoded, including: decoding the video data in a Media Codec hard decoding manner.

[0014] A data transmission device for a vehicle-mounted terminal comprises: a receiving module for receiving target camera data of an external camera device; a first data transmission module for, when it is determined based on an operation command that a controlled object is an EVS camera device, sending the target camera data to a control component of the EVS camera device through a development tool component of the EVS camera device, and controlling the control component of the EVS camera device to send the target camera data to the EVS camera device for display; a second data transmission module for, when it is determined based on an operation command that a controlled object is an Android camera device of a vehicle-mounted terminal, sending the target camera data to a shared memory component of the vehicle-mounted terminal, sending the data to a development tool component of the Android camera device through a virtual camera component, and sending the target camera data to the Android camera device for display through the development tool component of the Android camera device.

[0015] According to the above technical means, the target camera data of the external camera device is received by the receiving module. When the first data transmission module determines that the controlled object is the EVS camera device based on the operation command, the target camera data is sent to the control component of the EVS camera device through the development tool component of the EVS camera device, and the control component of the EVS camera device is controlled to send the target camera data to the EVS camera device for display. When the second data transmission module determines that the controlled object is the Android camera device of the vehicle terminal based on the operation command, the target camera data is sent to the shared memory component of the vehicle terminal, and sent to the development tool component of the Android camera device through the virtual camera component, and the target camera data is sent to the Android camera device through the development tool component of the Android camera device for display. Thus, the device can transmit the camera data in the form of a network stream through software, and connect the camera data with the Android native Camera system, so that the use scenarios of the camera in the central control entertainment system in the vehicle system are more diversified without increasing the hardware cost.

[0016] A data transmission system for a vehicle-mounted terminal comprises: an external domain system and an Android system, wherein an external camera device is connected to the external domain system, wherein the external domain system is used to obtain camera data of the external camera device and encode the camera data, and a data streaming component of the external domain system transmits the encoded camera data to the Android system; the Android system is used to receive target camera data of the external camera device, and when it is determined based on an operation command that the controlled object is an EVS camera device, the target camera data is sent to a control component of the EVS camera device through a development tool component of the EVS camera device, and the control component of the EVS camera device is controlled to send the target camera data to the EVS camera device for display; when it is determined based on an operation command that the controlled object is an Android camera device of a vehicle-mounted terminal, the target camera data is sent to a shared memory component of the vehicle-mounted terminal, and is sent to a development tool component of the Android camera device through a virtual camera component, and the target camera data is sent to the Android camera device through the development tool component of the Android camera device for display.

[0017] According to the above technical means, the external camera device is connected to the external domain system, the external domain system obtains the camera data of the external camera device, and encodes the camera data, and the data streaming component of the external domain system transmits the encoded camera data to the Android system, the Android system receives the target camera data of the external camera device, and when it is determined based on the operation command that the controlled object is the EVS camera device, the target camera data is sent to the control component of the EVS camera device through the development tool component of the EVS camera device, and the control component of the EVS camera device is controlled to send the target camera data to the EVS camera device for display, and when it is determined based on the operation command that the controlled object is the Android camera device of the vehicle-mounted terminal, the target camera data is sent to the shared memory component of the vehicle-mounted terminal, and sent to the development tool component of the Android camera device through the virtual camera component, and the target camera data is sent to the Android camera device for display through the development tool component of the Android camera device. Therefore, the system connects the external camera devices connected to the external domain system to the Android system in the form of network streams to provide more camera data to the Android car system, thereby enriching the functions of the Android car system and providing users with a safer driving experience.

[0018] In addition, the data transmission system of the vehicle terminal according to the above embodiment of the present application may also have the following additional technical features:

[0019] Furthermore, the operating system of the external camera device includes one of Android system, iOS system, Harmony OS system, Windows Phone system, and Fuchsia OS system.

[0020] Furthermore, the Android system uses Mediacodec hard decoding to decode the camera data.

[0021] A computer-readable storage medium stores a data transmission program for a vehicle-mounted terminal. When the data transmission program for the vehicle-mounted terminal is executed by a processor, the data transmission method for the vehicle-mounted terminal is as described above.

[0022] According to the above-mentioned technical means, a data transmission program of the vehicle-mounted terminal is stored thereon. When the data transmission program of the vehicle-mounted terminal is executed by the processor, the above-mentioned data transmission method of the vehicle-mounted terminal is used. Based on the above-mentioned data transmission method of the vehicle-mounted terminal, without increasing the hardware cost, the use scenarios of the camera in the central control entertainment system in the vehicle system are made more diversified.

[0023] A vehicle-mounted terminal comprises a memory, a processor and a data transmission program of the vehicle-mounted terminal stored in the memory and executable on the processor. When the processor executes the data transmission program of the vehicle-mounted terminal, the data transmission method of the vehicle-mounted terminal is implemented.

[0024] According to the above-mentioned technical means, when the processor executes the data transmission program of the vehicle terminal, the above-mentioned data transmission method of the vehicle terminal is implemented. Based on the above-mentioned data transmission method of the vehicle terminal, the use scenarios of the camera in the central control entertainment system in the vehicle system are more diversified without increasing the hardware cost.

[0025] Beneficial effects of the present invention:

[0026] (1) The present invention transmits the camera data on the external domain system to the Android system in the form of a network data stream through software, and connects the camera data with the Android native Camera system, so that the Camera application on the Android system can realize the operation of opening the Camera device on the external domain system without any feeling. This method can stably transmit all the required camera data between the two systems, making the use scenarios of the camera of the central control entertainment system in the car system more diversified, and also providing greater convenience for users in the car use scenario.

[0027] (2) The present invention performs data transmission based on compressed data. Specifically, the Camera data is encoded and compressed at the external end and then transmitted. The Android end decodes the data after receiving it. In this way, the transmission of the compressed data has low requirements on the network bandwidth, and the real-time performance of the Camera data is higher. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 is a flow chart of a data transmission method of a vehicle-mounted terminal according to an embodiment of the present application;

[0029] Figure 2 This is a schematic diagram of the overall technical architecture of the cross-domain transmission Camera according to a specific embodiment of the present application;

[0030] Figure 3 This is a schematic diagram of the design connection of Android-side Camera data access to Android native link according to a specific embodiment of the present application;

[0031] Figure 4 It is a flowchart of a data transmission method of a vehicle terminal according to a specific embodiment of the present application;

[0032] Figure 5 A connection diagram of a data transmission device of a vehicle-mounted terminal according to an embodiment of the present application;

[0033] Figure 6 A connection diagram of a data transmission system of a vehicle-mounted terminal according to an embodiment of the present application;

[0034] Figure 7 The figure is a block diagram of a vehicle terminal according to an embodiment of the present application.

[0035] Among them, 10-receiving module; 20-first data transmission module; 30-second data transmission module; 100-hardware device; 200-external domain system; 21-Camera Service module; 211-Camera data encoding module; 212-RTSP Server data streaming module; 213-Camera control command receiving module; 4-network channel; 300-Android system; 31-Android application module; 32-Camera HAL module; 321-Camera parameter channel; 322-Camera shared data reference module; 33-EVS HAL module; 34-Camera Manager module; 341-RTSP Client receiving module; 342-data decoding module; 343-control command transceiver module; 345-Camera parameter processing module; 346-shared memory; 347-Camera decoded data; 35-EVS Camera SDK component; 36-Android Camera SDK component; 37-V4l2 virtual camera device module; 400-vehicle terminal; 410-memory; 420-processor. DETAILED DESCRIPTION

[0036] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0037] The following describes, with reference to the accompanying drawings, a data transmission method for a vehicle-mounted terminal, a data transmission device for a vehicle-mounted terminal, a data transmission system for a vehicle-mounted terminal, a computer-readable storage medium, and a vehicle-mounted terminal proposed in the embodiments of the present application.

[0038] Figure 1 The present invention is a flowchart of a data transmission method for a vehicle terminal according to an embodiment of the present application.

[0039] The data transmission method of the vehicle terminal is applied in Figure 2 The cross-domain transmission Camera system shown is taken as an example, in which the Camera Service module 21 of the external domain system 200 (intelligent driving system) is connected to multiple cameras in the hardware device 100, and the Camera data is received through the Camera data encoding module 211, and the encoded data is sent to the RTSP Server data push module 212. Among them, RTSP refers to a real-time streaming protocol used in video data transmission, which is divided into a server (RTSP Server) and a client (RTSP Client) using a network channel to transmit data from the server to the client.

[0040] The Android system 300 (central control entertainment system) is connected to the external domain system 200. Based on the data transmission method of the vehicle terminal of the present application, the Camera devices on other systems other than the Android system 300 can be connected to the Android system 300, thereby providing the Android system 300 with more Camera data. These data can enrich the functions of the Android car machine and provide users with a safer driving experience.

[0041] The data transmission method of the vehicle-mounted terminal of the present application is described in detail below with reference to the accompanying drawings.

[0042] like Figure 1 As shown, the data transmission method of the vehicle terminal in the embodiment of the present application may include:

[0043] S1, receiving target camera data from an external camera device;

[0044] S2, when it is determined based on the operation command that the controlled object is an EVS camera device, the target camera data is sent to the control component of the EVS camera device through the development tool component of the EVS camera device, and the control component of the EVS camera device is controlled to send the target camera data to the EVS camera device for display;

[0045] S3, based on the operation command, determines that the controlled object is the Android camera device of the vehicle terminal, sends the target camera data to the shared memory component of the vehicle terminal, and sends it to the development tool component of the Android camera device through the virtual camera component, and sends the target camera data to the Android camera device for display through the development tool component of the Android camera device.

[0046] Specifically, EVS refers to an auxiliary function framework provided on the Android system for vehicle-mounted scenarios, which includes 360-degree panoramic views, driving recorders and other driving assistance-related camera applications.

[0047] Combination Figure 2 As shown, the camera data on the external domain system is transmitted to the Android system in the form of a network data stream through software. When the Android system receives the target camera data of the external camera device, it determines the device type of the controlled object according to the operation command. Among them, the target camera data determines the required camera data based on the user operation command.

[0048] If it is determined according to the operation command that the controlled object is an EVS camera device, the received target camera data is sent to the EVS HAL module, i.e., the control component of the EVS camera device, through the EVS Camera SDK component, i.e., the development tool component of the EVS camera device, and the EVS HAL module is controlled to send the target camera data to the EVS camera device for display.

[0049] If the controlled object is determined to be the Android camera device of the vehicle terminal according to the operation command, the target camera data is sent to the shared memory component of the vehicle terminal, and sent to the Android CameraSDK component, i.e. the development tool component of the Android camera device, through the virtual camera component, and the target camera data is sent to the Android camera device for display through the Android Camera SDK component. The received data is transmitted to the Android native Camera link through the virtual camera technology, without the need to customize and modify the native framework of the Android system, and the upper-layer application can use the external domain camera device without feeling.

[0050] Therefore, the method transmits the camera data on the external domain system to the Android system in the form of a network data stream through software, and connects the camera data with the Android native Camera system, so that the Camera application on the Android system can realize the operation of opening the Camera device on the external domain system without any feeling. This method can stably transmit all the required camera data between the two systems, making the central control entertainment system in the car system more diversified in the use scenarios of the camera, and also providing greater convenience for users in the car use scenario.

[0051] In one embodiment of the present application, the data transmission method of the vehicle-mounted terminal further includes: receiving camera data from an external camera device; and decoding the camera data to obtain target camera data.

[0052] Specifically, continue to combine Figure 2 and Figure 3 As shown, the hardware device 100 is connected to the external domain system 200. After the camera in the hardware device 100 is turned on, the external domain system 200 obtains the camera data. After the camera data is processed by the camera data encoding module 211, the camera data is compressed. The compressed camera data becomes smaller, which is conducive to transmission through the network channel. Then, the RTSP Server data push module 212 transmits the compressed camera data to the Android system 300 through the network channel 4, and then the RTSP Client receiving module 341 will obtain the compressed data. Specifically, the video, i.e., the camera data, can be transmitted based on the RTSP (Real Time Streaming Protocol) protocol. After obtaining the compressed camera data, the data decoding module 342 will use the decoding capability of the Android system to decode the camera data, thereby reducing CPU consumption and data delay. After decoding, the Camera data can be given to the Camera HAL module 32 or the EVS HAL module 33, and the Camera HAL module 32 or the EVS HAL module 33 will transmit the Camera data to the corresponding application through the Camera transmission method of the Android system 300 to display it to the user.

[0053] This embodiment performs data transmission based on compressed data. Specifically, the Camera data is encoded and compressed at the external domain end and then transmitted. The Android end decodes the data after receiving it. In this way, the transmission of the compressed data has low requirements on the network bandwidth, and the real-time performance of the Camera data is higher.

[0054] In one embodiment of the present application, the decoding operation on the video data includes: using Media codec hard decoding to decode the video data.

[0055] That is, after receiving the video data sent by the external domain system, the video data is decoded by Media codec hard decoding, which can reduce CPU (Central Processing Unit) consumption. At the same time, the hard decoding speed is fast and will not cause video data delay.

[0056] In one embodiment of the present application, a virtual camera component is stored in the form of a virtual node in the Android system of a vehicle-mounted terminal, and is sent to a development tool component of an Android camera device through the virtual camera component, including: transmitting target camera data to a shared data reference component of a control component of an Android camera device through the virtual node of the virtual camera component; transmitting data to the development tool component of the Android camera device through the shared data reference component.

[0057] Specifically, continue to combine Figure 2 and Figure 3 As shown, after the RTSP Client receiving module 341 receives the Camera encoded compressed data transmitted from the external domain system 200, the data decoding module 342 decodes the data to obtain Camera decoded data 347, and then copies the Camera decoded data 347 to the DMA shared memory, that is, the shared data reference component.

[0058] The camera data in the DMA shared memory is passed to the camera shared data reference module 322 in the CameraHAL module 32 through the virtual node of the virtual camera component. Then the data is transmitted to the Android Camera SDK component 36 using the Android native Camera link, and finally transmitted to the application in the Android application module 31 for display to the user.

[0059] In one embodiment of the present application, the data transmission method of the vehicle-mounted terminal also includes: responding to an operation command; determining an external camera device according to the operation command; and sending a start command to the external camera device through a network channel when the external camera device is not turned on.

[0060] That is, after receiving the operation command given by the user, the external camera device to be used is determined according to the operation command, and the status of the external camera device is obtained. If the external camera device has not been started, a start command is sent to the external domain system through the network channel to control the external camera device to start through the external domain device. If the external camera device has been turned on, the target camera data collected by the external camera device is obtained through the network channel.

[0061] In one embodiment of the present application, the data transmission method of the vehicle-mounted terminal also includes: when it is determined based on the operation command that the controlled object is an EVS camera device, the operation command is received by the control component of the EVS camera device, and the operation command is sent to the management component of the Android camera device of the vehicle-mounted terminal; when it is determined based on the operation command that the controlled object is an Android camera device, the operation command is received by the control component of the Android camera device, and the operation command is sent to the management component of the Android camera device.

[0062] In other words, continue to combine Figure 2 and Figure 3 As shown, when receiving the operation command from the user to turn on the camera application, the desired target controlled object, i.e., the external camera device, is determined. If the controlled object is an EVS camera device, the operation command is received through the EVS HAL module 33, the operation command is processed, and the processed operation command is sent to the Android CameraManager module 34. If the controlled object is an Android camera device, the operation command is received through the Camera HAL module 32, the operation command is processed, and the processed operation command is sent to the Android Camera Manager module 34. The Android Camera Manager module 34 determines whether the corresponding external camera device is turned on based on the operation command processed by each module.

[0063] As a specific embodiment of the present application, Figures 1 to 3As shown, the external device 100, the external domain system 200 and the Android system 300 are connected in sequence, wherein the Android system 300 may include an Android application module 31, a Camera HAL module 32, a Camera parameter channel 321, a Camera shared data reference module 322, an EVS HAL module 33, a Camera Manager module 34, an RTSP Client receiving module 341, a data decoding module 342, a control command transceiver module 343, a Camera parameter processing module 345, a shared memory 346, a Camera decoded data 347, an EVS Camera SDK component 35, an Android CameraSDK component 36 and a V4l2 virtual camera device module 37.

[0064] After the RTSP Client receiving module 341 receives the Camera encoded compressed data transmitted from the external domain system 200, it is necessary to use the data decoding module 342 on the Android system 300 to decode and obtain the Camera decoded data 347, and then copy the Camera decoded data 347 to the DMA shared memory. At this time, based on the controlled object determined by the operation command, the data is distributed in two ways, namely: EVS link transmission mode (mode one) and Camera native link transmission mode (mode two). The two data transmission modes are described in detail below.

[0065] Method 1: The camera data in DMA sharing is directly transferred to the EVS HAL module through the EVS Camera SDK component using the process communication technology inside the Android system, and then the data is given to the EVS framework application using the EVS framework link that comes with the Android system. In this way, there is no need to adapt a separate SDK component for the EVSHAL application, which has good platform performance. This method is to give the Camera data to the EVS framework. The application under the EVS framework is mainly to provide users with driving safety assistance, so there are requirements for real-time performance and the application needs to respond quickly.

[0066] Method 2: Transmitting DMA data to the Android native link. In order not to change the Android native Camera link, this application uses the technology of virtual camera, specifically creating some device nodes of cameras in the driver module of the Android system, and these device nodes are virtual camera devices. Thus, the Camera data in the DMA shared memory is passed to the Camera shared data reference module 322 in the Camera HAL module through the device node of the virtual camera device. Then the Android native Camera link is used to transmit the data to the Android Camera SDK component 36, and finally transmitted to the application in the Android application module to display it to the user. Among them, the channel for the virtual camera device to undertake the Camera data transmission in the DMA shared memory can be implemented based on V4l2Loopback. The open source software can create multiple virtual nodes corresponding to the camera device in the Android system window, and then use the Linux file access system API. The CameraManager module can communicate with the Camera HAL module through the created virtual device node. With this virtual node channel, all operations of the user on the camera on the Android native link can be transmitted to the Camera parameter processing module through the virtual node after being transmitted to the Camera parameter channel.

[0067] As a specific embodiment of the present application, the data transmission method of the vehicle terminal is applied to 2 and Figure 3 Take the Android system shown in the figure as an example. Figure 4 As shown, the method may include the following steps:

[0068] S101, receiving an operation command, and determining a controlled object based on the operation command, so as to determine whether the user turns on a camera application, such as 360-degree panoramic view, driving recorder, streaming media rearview mirror, turn signal triggered side vision assistance, and other applications.

[0069] S102, determining whether the controlled object is an EVS camera device. If yes, executing step S103; if no, executing step S104.

[0070] S103, sending the operation command to the EVS HAK module.

[0071] S104, the EVS HAK module receives the operation command and processes the user's operation command. Execute step S107.

[0072] S105, sending the operation command to the Camera HAL module through the Android Camera SDK.

[0073] S106: The Camera HAL module receives the operation command and processes the operation command.

[0074] S107, sending the processed user operation command to the Camera Manager module.

[0075] S108, the Camera Manager module determines whether the external camera device, ie the controlled object, is in an on state. If yes, step S109 is executed; if no, step S110 is executed.

[0076] S109, receiving the Camera data sent by the external domain system through the RTSP Client module, and processing the Camera data. Execute step S111.

[0077] S110, sending an opening command of the external camera device to the external domain system through the network channel. Execute step S108.

[0078] Specifically, the camera opening command is sent to the external domain system Camera control command receiving module 213 through the network channel, so that after receiving the command, the external domain system 200 will turn on the camera and encode and compress the camera data and transmit it to the RTSP Client receiving module 341 inside the Camera Manager module 34 of the Android end 300.

[0079] S111, the decoding module decodes the received Camera data. After decoding the Camera data, the decoding module determines which link currently needs to use the Camera data. If the EVS application uses the Camera data, step S112 is executed; if the Android Camera SDK application uses the Camera data, step S115 is executed.

[0080] S112, copy the Camera data to the EVS Camera SDK component on the EVS link.

[0081] S113, the EVS Camera SDK component sends the Camera data to the EVS HAL module.

[0082] S114, the EVS HAL module provides the data to the application under the EVS framework operated by the user through the Android native link for display, for example, a panoramic application, a driving recorder application, etc.

[0083] S115, copying the Camera data to the DMA shared memory.

[0084] S116, the camera data is transmitted to the Android Camera SDK component by using the virtual camera of the V4L2 framework.

[0085] S117, the Android Camera SDK component uses the Android native Camera link to transmit data to the user APP for display, that is, to display the Camera data to the camera-related application operated by the user.

[0086] Therefore, the data transmission method of the vehicle terminal has the following beneficial effects:

[0087] 1) Cheaper: The current cross-domain transmission of camera data by vehicle terminals is basically through hardware transmission, which requires the addition of camera deserialization and serialization chips, LVDS wiring harnesses, and some chip power supply modules. This solution uses a software solution and does not require the related hardware equipment in the above hardware solution to reduce costs.

[0088] 2) More stable: Compared with the solution in the patent, this solution uses the encoding and decoding capabilities of two independent systems to encode and decode video data, so that Camera data can be transmitted to Android devices more quickly, providing users with a user experience with lower latency and more stable video data.

[0089] 3) More universal: This solution does not customize the native Android system, and the requirements for external domain systems are relatively low. Basically, the external domain systems on the current vehicle terminal systems can meet them. This method can be directly applied to other vehicle terminal platforms based on intelligent driving systems and Android car systems.

[0090] In summary, according to the data transmission method of the vehicle terminal of the embodiment of the present application, first, the target camera data of the external camera device is received, and when it is determined based on the operation command that the controlled object is the EVS camera device, the target camera data is sent to the control component of the EVS camera device through the development tool component of the EVS camera device, and the control component of the EVS camera device is controlled to send the target camera data to the EVS camera device for display, and when it is determined based on the operation command that the controlled object is the Android camera device of the vehicle terminal, the target camera data is sent to the shared memory component of the vehicle terminal, and sent to the development tool component of the Android camera device through the virtual camera component, and the target camera data is sent to the Android camera device for display through the development tool component of the Android camera device. Thus, the method can transmit the camera data in the form of a network stream through software, and connect the camera data with the Android native Camera system, so that the use scenarios of the camera in the central control entertainment system in the vehicle system are more diversified without increasing the hardware cost.

[0091] Corresponding to the above-mentioned embodiment, the present application also proposes a data transmission device for a vehicle-mounted terminal.

[0092] like Figure 5 As shown, the data transmission device of the vehicle terminal in the embodiment of the present application may include: a receiving module 10, a first data transmission module 20 and a second data transmission module 30.

[0093] Among them, the receiving module 10 is used to receive the target camera data of the external camera device. The first data transmission module 20 is used to determine that the controlled object is an EVS camera device based on the operation command, and send the target camera data to the control component of the EVS camera device through the development tool component of the EVS camera device, and control the control component of the EVS camera device to send the target camera data to the EVS camera device for display. The second data transmission module 30 is used to determine that the controlled object is an Android camera device of the vehicle terminal based on the operation command, and send the target camera data to the shared memory component of the vehicle terminal, and send it to the development tool component of the Android camera device through the virtual camera component, and send the target camera data to the Android camera device through the development tool component of the Android camera device for display.

[0094] According to an embodiment of the present application, the receiving module 10 is further used to: receive camera data from an external camera device; and perform a decoding operation on the camera data to obtain target camera data.

[0095] According to one embodiment of the present application, the receiving module 10 is also used to: respond to an operation command; determine an external camera device according to the operation command; and send a start command to the external camera device through a network channel when the external camera device is not turned on.

[0096] According to one embodiment of the present application, the virtual camera component is stored in the Android system of the vehicle terminal in the form of a virtual node, and the second data transmission module 30 is sent to the development tool component of the Android camera device through the virtual camera component, and is specifically used for: transmitting the target camera data to the shared data reference component of the control component of the Android camera device through the virtual node of the virtual camera component; transmitting the data to the development tool component of the Android camera device through the shared data reference component.

[0097] According to one embodiment of the present application, the receiving module 10 is also used for: when it is determined based on the operation command that the controlled object is an EVS camera device, receiving the operation command through the control component of the EVS camera device, and sending the operation command to the management component of the Android camera device of the vehicle terminal; when it is determined based on the operation command that the controlled object is an Android camera device, receiving the operation command through the control component of the Android camera device, and sending the operation command to the management component of the Android camera device.

[0098] According to an embodiment of the present application, the receiving module 10 performs a decoding operation on the camera data, specifically for: performing a decoding operation on the camera data using a Media Codec hard decoding method.

[0099] It should be noted that for details not disclosed in the data transmission device of the vehicle-mounted terminal in the embodiment of the present application, please refer to the details disclosed in the data transmission method of the vehicle-mounted terminal in the above embodiment of the present application, and the details will not be repeated here.

[0100] According to the data transmission device of the vehicle terminal of the embodiment of the present application, the target camera data of the external camera device is received through the receiving module. When the first data transmission module determines that the controlled object is the EVS camera device based on the operation command, the target camera data is sent to the control component of the EVS camera device through the development tool component of the EVS camera device, and the control component of the EVS camera device is controlled to send the target camera data to the EVS camera device for display. When the second data transmission module determines that the controlled object is the Android camera device of the vehicle terminal based on the operation command, the target camera data is sent to the shared memory component of the vehicle terminal, and sent to the development tool component of the Android camera device through the virtual camera component, and the target camera data is sent to the Android camera device through the development tool component of the Android camera device for display. Thus, the device can transmit the camera data in the form of a network stream through software, and connect the camera data with the Android native Camera system, so that the use scenarios of the camera in the central control entertainment system in the vehicle system are more diversified without increasing the hardware cost.

[0101] Corresponding to the above-mentioned embodiment, the present application also proposes a data transmission system for a vehicle-mounted terminal.

[0102] like Figure 6 As shown, the data transmission system of the vehicle terminal of the embodiment of the present application includes: an external domain system 200 and an Android system 300, and the external camera device is connected to the external domain system 200.

[0103] Among them, the external domain system 200 is used to obtain the camera data of the external camera device, encode the camera data, and the data push component of the external domain system transmits the encoded camera data to the Android system 300. The Android system 300 is used to receive the target camera data of the external camera device, and when it is determined based on the operation command that the controlled object is the EVS camera device, the target camera data is sent to the control component of the EVS camera device through the development tool component of the EVS camera device, and the control component of the EVS camera device is controlled to send the target camera data to the EVS camera device for display; when it is determined based on the operation command that the controlled object is the Android camera device of the vehicle terminal, the target camera data is sent to the shared memory component of the vehicle terminal, and sent to the development tool component of the Android camera device through the virtual camera component, and the target camera data is sent to the Android camera device through the development tool component of the Android camera device for display.

[0104] In this embodiment, the camera connected to the external domain system (intelligent driving system) is shared with the Android system of the vehicle terminal. In this way, the external domain camera can be used on the Android system, and more functions can be realized. For example, the data of the left and right cameras on the intelligent driving system on the vehicle terminal can be transmitted to the Android system, so that the real-time images of the left and right perspectives can be provided on the vehicle screen of the vehicle terminal during driving, solving the problem of blind spots on the left and right sides of the user's driving, and providing safer protection for the user's driving. In addition to the above functions, since almost all the cameras on the intelligent driving system are outside the car, this embodiment can allow the vehicle system to obtain all camera data outside the car in the vehicle terminal scenario, which can also provide users with more playability and safety.

[0105] In one embodiment of the present application, the operating system of the external camera device includes one of an Android system, an iOS system, a Harmony OS system, a Windows Phone system, and a Fuchsia OS system.

[0106] In one embodiment of the present application, the Android system uses Mediacodec hard decoding to decode the camera data.

[0107] It should be noted that for details not disclosed in the data transmission system of the vehicle-mounted terminal in the embodiment of the present application, please refer to the details disclosed in the data transmission method of the vehicle-mounted terminal in the above embodiment of the present application. The details will not be repeated here. For details, please refer to the above Figure 2 and Figure 3 content.

[0108] According to the data transmission system of the vehicle terminal of the embodiment of the present application, the external camera device is connected to the external domain system, the external domain system obtains the camera data of the external camera device, and encodes the camera data, and the data streaming component of the external domain system transmits the encoded camera data to the Android system, the Android system receives the target camera data of the external camera device, and when it is determined based on the operation command that the controlled object is the EVS camera device, the target camera data is sent to the control component of the EVS camera device through the development tool component of the EVS camera device, and the control component of the EVS camera device is controlled to send the target camera data to the EVS camera device for display, and when it is determined based on the operation command that the controlled object is the Android camera device of the vehicle terminal, the target camera data is sent to the shared memory component of the vehicle terminal, and sent to the development tool component of the Android camera device through the virtual camera component, and the target camera data is sent to the Android camera device for display through the development tool component of the Android camera device. Therefore, the system connects the external camera devices connected to the external domain system to the Android system in the form of network streams to provide more camera data to the Android car system, thereby enriching the functions of the Android car system and providing users with a safer driving experience.

[0109] Corresponding to the above embodiments, the present application also proposes a computer-readable storage medium.

[0110] The computer-readable storage medium of the embodiment of the present application stores a data transmission program for the vehicle-mounted terminal, and the data transmission program for the vehicle-mounted terminal is the above-mentioned data transmission method for the vehicle-mounted terminal when executed by the processor.

[0111] According to the computer-readable storage medium of the embodiment of the present application, a data transmission program of the vehicle-mounted terminal is stored thereon. When the data transmission program of the vehicle-mounted terminal is executed by the processor, the above-mentioned data transmission method of the vehicle-mounted terminal is used. Based on the above-mentioned data transmission method of the vehicle-mounted terminal, the use scenarios of the camera of the central control entertainment system in the vehicle system are made more diversified without increasing the hardware cost.

[0112] Corresponding to the above embodiments, the present application also proposes a vehicle-mounted terminal.

[0113] like Figure 7 As shown, the vehicle-mounted terminal 400 of an embodiment of the present application includes a memory 410, a processor 420, and a data transmission program of the vehicle-mounted terminal stored in the memory 410 and executable on the processor 420. When the processor 420 executes the data transmission program of the vehicle-mounted terminal, the above-mentioned data transmission method of the vehicle-mounted terminal is implemented.

[0114] According to the vehicle terminal of the embodiment of the present application, when the processor executes the data transmission program of the vehicle terminal, the above-mentioned data transmission method of the vehicle terminal is implemented. Based on the above-mentioned data transmission method of the vehicle terminal, the use scenarios of the camera in the central control entertainment system in the car system are more diversified without increasing the hardware cost.

[0115] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0116] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0117] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0118] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0119] In this application, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0120] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A data transmission method for a vehicle-mounted terminal, characterized in that: The method comprises: Receiving target camera data from an external camera device; When it is determined based on the operation command that the controlled object is an EVS camera device, the target camera data is sent to the control component of the EVS camera device through the development tool component of the EVS camera device, and the control component of the EVS camera device is controlled to send the target camera data to the EVS camera device for display; When it is determined based on the operation command that the controlled object is the Android camera device of the vehicle-mounted terminal, the target camera data is sent to the shared memory component of the vehicle-mounted terminal, and sent to the development tool component of the Android camera device through the virtual camera component, and the target camera data is sent to the Android camera device for display through the development tool component of the Android camera device.

2. The data transmission method of the vehicle terminal according to claim 1, characterized in that: The method further comprises: Receiving camera data from the external camera device; A decoding operation is performed on the image data to obtain the target image data.

3. The data transmission method of the vehicle terminal according to claim 1, characterized in that: The method further comprises: responding to the operation command; determining the external camera device according to the operation command; When the external camera device is not turned on, a turn-on command is sent to the external camera device through a network channel.

4. The data transmission method of the vehicle terminal according to claim 1, characterized in that: The virtual camera component is stored in the Android system of the vehicle-mounted terminal in the form of a virtual node, and is sent to the development tool component of the Android camera device through the virtual camera component, including: Transmitting the target camera data to the shared data reference component of the control component of the Android camera device through the virtual node of the virtual camera component; The data is transmitted to the development tool component of the Android camera device through the shared data reference component.

5. The data transmission method of the vehicle terminal according to claim 1, characterized in that: The method further comprises: When it is determined based on the operation command that the controlled object is an EVS camera device, the operation command is received by a control component of the EVS camera device, and the operation command is sent to a management component of the Android camera device of the vehicle terminal; When it is determined based on the operation command that the controlled object is the Android camera device, the operation command is received by the control component of the Android camera device, and the operation command is sent to the management component of the Android camera device.

6. The data transmission method of the vehicle terminal according to claim 2, characterized in that: The decoding operation is performed on the camera data, comprising: The video data is decoded by using Media Codec hard decoding.

7. A data transmission device for a vehicle-mounted terminal, characterized in that: include: A receiving module, used for receiving target camera data from an external camera device; A first data transmission module, for determining, based on an operation command, that the controlled object is an EVS camera device, sending the target camera data to the control component of the EVS camera device through the development tool component of the EVS camera device, and controlling the control component of the EVS camera device to send the target camera data to the EVS camera device for display; The second data transmission module is used to determine based on the operation command that the controlled object is the Android camera device of the vehicle-mounted terminal, send the target camera data to the shared memory component of the vehicle-mounted terminal, and send it to the development tool component of the Android camera device through the virtual camera component, and send the target camera data to the Android camera device for display through the development tool component of the Android camera device.

8. A data transmission system for a vehicle-mounted terminal, characterized in that: include: An external domain system and an Android system, an external camera device is connected to the external domain system, wherein: The external domain system is used to obtain the camera data of the external camera device and encode the camera data, and the data streaming component of the external domain system transmits the encoded camera data to the Android system; The Android system is used to receive target camera data of an external camera device, and when it is determined based on an operation command that the controlled object is an EVS camera device, send the target camera data to the control component of the EVS camera device through the development tool component of the EVS camera device, and control the control component of the EVS camera device to send the target camera data to the EVS camera device for display; when it is determined based on an operation command that the controlled object is the Android camera device of the vehicle-mounted terminal, send the target camera data to the shared memory component of the vehicle-mounted terminal, send it to the development tool component of the Android camera device through the virtual camera component, and send the target camera data to the Android camera device through the development tool component of the Android camera device for display.

9. The data transmission system for the vehicle terminal according to claim 8, characterized in that: The operating system of the external camera device includes one of Android system, iOS system, Harmony OS system, Windows Phone system, and Fuchsia OS system.

10. The data transmission system for the vehicle-mounted terminal according to claim 8, characterized in that: The Android system uses Mediacodec hard decoding to decode the camera data.

11. A computer-readable storage medium, characterized in that: A data transmission program for the vehicle-mounted terminal is stored thereon, and when the data transmission program for the vehicle-mounted terminal is executed by the processor, the data transmission method for the vehicle-mounted terminal according to any one of claims 1-6 is implemented.

12. A vehicle-mounted terminal, characterized in that: The invention comprises a memory, a processor and a data transmission program for a vehicle-mounted terminal which is stored in the memory and can be run on the processor. When the processor executes the data transmission program for the vehicle-mounted terminal, the data transmission method for the vehicle-mounted terminal according to any one of claims 1 to 6 is implemented.

Images