A method for video call and an electronic device

Abstract

A method and an electronic device for video calls, which relate to the field of communication technologies, and realize the free switching of video calls between a mobile terminal and a vehicle-mounted terminal, meeting the different needs of users in various scenarios, ensuring the driving safety of users and improving the user experience. The method includes: establishing a communication connection between the mobile terminal and the vehicle-mounted terminal; the mobile terminal receiving first information sent by the vehicle-mounted terminal, where the first information is an indication from a first user to initiate a video call with a second user on the vehicle-mounted terminal; in response to the first information, the mobile terminal establishing a video call connection with the terminal of the second user and receiving video data of the second user; the mobile terminal sending the video data of the second user to the vehicle-mounted terminal and sending the video data of the first user collected by the camera of the vehicle-mounted terminal to the terminal of the second user.

Description

Technical Field

[0001] This application relates to the field of communication technologies, and in particular, to a method for video calls and an electronic device. Background Art

[0002] Currently, users can easily make video calls with other users using a mobile phone. However, when a user is in a car, if the user still uses the mobile phone to make a video call, it will be very inconvenient and even unsafe. Summary of the Invention

[0003] A method for video calls and an electronic device provided in this application can realize the free switching of video calls between a mobile terminal and a vehicle-mounted terminal, meet the different needs of users in various scenarios, ensure the driving safety of users, and improve the user experience.

[0004] In a first aspect, a method for video calls is provided, which is applied to a mobile terminal and a vehicle-mounted terminal. The vehicle-mounted terminal includes one or more display screens and one or more cameras. The method includes: establishing a communication connection between the mobile terminal and the vehicle-mounted terminal; the mobile terminal receiving first information sent by the vehicle-mounted terminal, where the first information is an indication that a first user initiates a video call with a second user on the vehicle-mounted terminal; in response to the first information, the mobile terminal establishing a video call connection with the second user's terminal and receiving video data of the second user; the mobile terminal sending the video data of the second user to the vehicle-mounted terminal and sending the video data of the first user collected by the camera of the vehicle-mounted terminal to the second user's terminal.

[0005] Since the first user starts a video call application on the vehicle-mounted terminal, indicating that the user is in the car, the mobile terminal can default to using the screen of the vehicle-mounted terminal for display and using the camera of the vehicle-mounted terminal to collect video information. That is to say, when the video call application of the mobile terminal calls the display driver for display, it can call the virtual driver corresponding to the display screen of the vehicle-mounted terminal, so that the interface drawn by the mobile terminal can be transmitted to the vehicle-mounted terminal for display. Similarly, when the video call application of the mobile terminal calls the camera driver to collect video information, it can call the virtual driver corresponding to the camera of the vehicle-mounted terminal, so that the vehicle-mounted terminal sends the video information collected by the camera of the vehicle-mounted terminal to the mobile terminal.

[0006] As can be seen from the above, when the first user is in the car, the video call running on the mobile terminal can call the display screen of the vehicle-mounted terminal to display the picture of the second user, or call the camera of the vehicle-mounted terminal to collect the picture of the second user, freeing the user's hands, facilitating the user to control the car, and improving driving safety.

[0007] Furthermore, since the entire video call runs on the mobile terminal side, and the in-vehicle terminal side only needs to provide corresponding hardware capabilities, such as providing a display screen for display, providing a camera to capture images, providing a microphone to capture audio, and playing audio, etc. Therefore, the method provided in the embodiments of the present application has low requirements for the system capabilities of the in-vehicle terminal. For example, the in-vehicle terminal may not have the capabilities to connect to a mobile communication network, the Internet, etc. The in-vehicle terminal may also not be required to be able to run a video call application, etc. In other words, the embodiments of the present application are applicable to most in-vehicle terminals.

[0008] In a possible implementation manner, the method further includes: after the mobile terminal receives the first information sent by the in-vehicle terminal, or after the mobile terminal establishes a video call with the terminal of the second user, the mobile terminal receives the video data of the first user captured by the camera of the in-vehicle terminal sent by the in-vehicle terminal.

[0009] In a possible implementation manner, the method further includes: after the mobile terminal establishes a video call with the terminal of the second user, the mobile terminal receives the video data of the second user sent by the terminal of the second user; the mobile terminal sends the video data of the second user to the in-vehicle terminal, specifically: the mobile terminal draws a first interface according to the video data of the second user and the video data of the first user captured by the camera of the in-vehicle terminal, and sends the first interface to the in-vehicle terminal; wherein, the first interface includes the video data of the first user and the video data of the second user captured by the camera of the in-vehicle terminal.

[0010] In a possible implementation manner, before the mobile terminal receives the first information sent by the in-vehicle terminal, the method further includes: the mobile terminal receives the second information sent by the in-vehicle terminal, and the second information includes the parameters of the display screen of the in-vehicle terminal and the parameters of the camera of the in-vehicle terminal; the mobile terminal registers the display screen of the in-vehicle terminal and the camera of the in-vehicle terminal according to the second information.

[0011] Among them, this registration process can be understood as the mobile terminal creating a virtual driver for each hardware of the in-vehicle terminal. Subsequently, when an application of the mobile terminal needs to call the hardware of the in-vehicle terminal, it can transmit data to the hardware of the in-vehicle terminal through the corresponding virtual driver. Thus, a method for the mobile terminal to call the hardware of the in-vehicle terminal is provided.

[0012] In a possible implementation manner, the in-vehicle terminal transmits the second information to the mobile terminal through Bluetooth Low Energy (BLE).

[0013] In some embodiments of the present application, after the vehicle-mounted terminal is powered on or the wireless connection function is turned on, it can send BLE broadcast messages via low-power Bluetooth so that the mobile terminal can scan the vehicle-mounted terminal and establish a communication connection with the vehicle-mounted terminal. The BLE broadcast message may carry the vehicle-mounted terminal identifier and the vehicle-mounted terminal capability information. Among them, the vehicle-mounted terminal identifier may be, for example, the vehicle model, which is used to identify the vehicle-mounted terminal. The vehicle-mounted terminal capability information may include the hardware capability information of the vehicle-mounted terminal, such as camera information, display screen information, audio information, GPS information, sensor information, etc.

[0014] In a possible implementation, the method further includes: after the mobile terminal receives the first information sent by the vehicle-mounted terminal, or after the mobile terminal establishes a video call connection with the terminal of the second user, the mobile terminal determines whether it has registered the camera of the vehicle-mounted terminal; if it is determined that the camera of the vehicle-mounted terminal has been registered, the mobile terminal sends an instruction to the vehicle-mounted terminal to turn on the camera of the vehicle-mounted terminal.

[0015] In a possible implementation, the method further includes: the mobile terminal receives the third information sent by the vehicle-mounted terminal, and the third information is an operation instruction of the first user to switch to the camera and display screen of the mobile terminal; or the mobile terminal detects that the communication connection between the mobile terminal and the vehicle-mounted terminal is disconnected; the display screen of the mobile terminal displays the video data of the second user and the video data of the first user collected by the camera of the mobile terminal.

[0016] It can be seen that during the video call, the user can freely switch the video call between the mobile terminal and the vehicle-mounted terminal to meet different requirements in different scenarios.

[0017] In a possible implementation, the method further includes: the mobile terminal receives the fourth information sent by the vehicle-mounted terminal, and the fourth information is an instruction of the first user to switch the current camera to another camera of the vehicle-mounted terminal; the mobile terminal instructs the vehicle-mounted terminal to turn off the current camera and turn on another camera of the vehicle-mounted terminal; the mobile terminal receives the video data of the first user collected by another camera of the vehicle-mounted terminal; the mobile terminal sends the video data of the second user and the video data of the first user collected by another camera of the vehicle-mounted terminal to the vehicle-mounted terminal.

[0018] It can be seen that during the video call, the user can switch between multiple cameras of the vehicle-mounted terminal to meet different requirements in different scenarios.

[0019] In a possible implementation, the method further includes: the mobile terminal receives fifth information sent by the vehicle-mounted terminal, where the fifth information is that a first user instructs to switch the current camera to the camera of the mobile terminal; the mobile terminal instructs the vehicle-mounted terminal to turn off the current camera and turn on the camera of the mobile terminal; the mobile terminal captures video data of the first user by the camera; the mobile terminal sends video data of a second user and the video data of the first user captured by the camera of the mobile terminal to the vehicle-mounted terminal.

[0020] It can be seen that during a video call, the user can switch from the camera of the vehicle-mounted terminal to the camera of the mobile terminal to meet different requirements in different scenarios.

[0021] In a possible implementation, the method further includes: when the mobile terminal and the vehicle-mounted terminal disconnect the communication connection, the mobile terminal cancels the registration of the display screen of the vehicle-mounted terminal and the camera of the vehicle-mounted terminal.

[0022] After the mobile terminal disconnects from the vehicle-mounted terminal, the mobile terminal cancels the registration of the hardware of the registered vehicle-mounted terminal, for example, deletes the virtual driver corresponding to the hardware of the vehicle-mounted terminal, or sets the virtual driver corresponding to the hardware of the vehicle-mounted terminal to unavailable.

[0023] In a second aspect, a video call method is provided, which is applied to a mobile terminal and a vehicle-mounted terminal. The vehicle-mounted terminal includes one or more display screens and one or more cameras. The method includes: the mobile terminal and the vehicle-mounted terminal establish a communication connection; the mobile terminal receives a video call request sent by the terminal of a second user; the mobile terminal receives video data of the second user sent by the server and receives video data of a first user captured by the camera of the vehicle-mounted terminal; the mobile terminal sends video data of the second user to the vehicle-mounted terminal and sends video data of the first user captured by the camera of the vehicle-mounted terminal to the terminal of the second user.

[0024] In a possible implementation, when the mobile terminal sends video data of a second user to the vehicle-mounted terminal, specifically: the mobile terminal draws a first interface according to the video data of the second user and the video data of the first user captured by the camera of the vehicle-mounted terminal, and sends the first interface to the vehicle-mounted terminal; where the first interface includes the video data of the first user and the video data of the second user captured by the camera of the vehicle-mounted terminal.

[0025] In a possible implementation, after the mobile terminal establishes a video call connection with the terminal of the second user, the method further includes: if the mobile terminal has registered the camera of the vehicle-mounted terminal, it sends an instruction to the vehicle-mounted terminal to turn on the camera of the vehicle-mounted terminal.

[0026] In a possible implementation, before establishing a video call connection between the mobile terminal and the terminal of the second user, the method further includes: the mobile terminal receives first information sent by the vehicle-mounted terminal, where the first information includes information about the display screen of the vehicle-mounted terminal and information about the camera of the vehicle-mounted terminal; the mobile terminal registers the display screen and the camera of the vehicle-mounted terminal according to the first information.

[0027] In a possible implementation, the vehicle-mounted terminal transmits the first information to the mobile terminal through Bluetooth Low Energy (BLE).

[0028] In a possible implementation, the method further includes: the mobile terminal receives second information sent by the vehicle-mounted terminal, where the second information is an operation for the first user to instruct to switch to the camera and display screen of the mobile terminal; or, the mobile terminal detects that the mobile terminal is disconnected from the vehicle-mounted terminal; the display screen of the mobile terminal displays the video data of the second user and the video data of the first user collected by the camera of the mobile terminal.

[0029] In a possible implementation, after the display screen of the mobile terminal displays the video data of the second user and the video data of the first user collected by the camera of the mobile terminal, the method further includes: the mobile terminal receives third information, where the third information is an operation for the first user to instruct to switch to the camera and display screen of the vehicle-mounted terminal, or the mobile terminal detects that the mobile terminal is connected to the vehicle-mounted terminal; if the mobile terminal determines that the camera of the vehicle-mounted terminal is registered, it sends an instruction to turn on the camera of the vehicle-mounted terminal to the vehicle-mounted terminal; the mobile terminal sends the video data of the second user received from the server to the vehicle-mounted terminal, and the video data of the first user collected by the camera of the vehicle-mounted terminal.

[0030] In a third aspect, a method for video call is provided, which is applied to a mobile terminal and a vehicle-mounted terminal. The vehicle-mounted terminal includes one or more display screens and one or more cameras. The method includes: the vehicle-mounted terminal and the mobile terminal establish a communication connection; the vehicle-mounted terminal receives a first operation of the first user, where the first operation is used to instruct to establish a video call with the terminal of the second user; the camera of the vehicle-mounted terminal collects the video data of the first user and sends the video data of the first user to the mobile terminal, and the vehicle-mounted terminal receives the video data of the second user sent by the mobile terminal and displays the video of the first user.

[0031] In a fourth aspect, an electronic device is provided, including: a processor, a memory, and a touch screen. The memory and the touch screen are coupled to the processor. The memory is used to store computer program code, and the computer program code includes computer instructions. When the processor reads the computer instructions from the memory, the electronic device is enabled to execute the method described in the above aspect and any one of its possible implementations.

[0032] In a fifth aspect, a device is provided. This device is included in an electronic device and has the function of implementing the behavior of the in-vehicle terminal in any of the methods in the above aspects and possible implementation manners. This function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes at least one module or unit corresponding to the above function. For example, a receiving module or unit, a display module or unit, a collection module or unit, a sending module or unit, etc.

[0033] In a sixth aspect, a computer storage medium is provided, including computer instructions. When the computer instructions run on a mobile terminal, the mobile terminal is caused to execute the method described in the above aspects and any of the possible implementation manners therein.

[0034] In a seventh aspect, a computer program product is provided. When the computer program product runs on a computer, the computer is caused to execute the method described in the above aspects and any of the possible implementation manners therein.

[0035] In an eighth aspect, a chip system is provided, including a processor. When the processor executes instructions, the processor executes the method described in the above aspects and any of the possible implementation manners therein. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 It is a schematic structural diagram of a communication system provided by an embodiment of the present application;

[0037] Figure 2A It is a schematic structural diagram of a mobile terminal provided by an embodiment of the present application Figure 1 ;

[0038] Figure 2B It is a second schematic structural diagram of a mobile terminal provided by an embodiment of the present application;

[0039] Figure 3A It is a schematic structural diagram of an in-vehicle terminal provided by an embodiment of the present application Figure 1 ;

[0040] Figure 3B It is a second schematic structural diagram of an in-vehicle terminal provided by an embodiment of the present application;

[0041] Figure 4 It is a schematic flowchart of a method for video call provided by an embodiment of the present application;

[0042] Figure 5 It is a schematic diagram of user interfaces of some mobile terminals provided by an embodiment of the present application;

[0043] Figure 6A It is a schematic diagram of user interfaces of some in-vehicle terminals provided by an embodiment of the present application;

[0044] Figure 6B Schematic diagrams of user interfaces of some vehicle-mounted terminals provided in the embodiments of the present application;

[0045] Figure 7 Schematic diagram of a method for a vehicle-mounted terminal and a mobile phone to transmit data provided in the embodiments of the present application;

[0046] Figure 8 Schematic flowchart of another method for video call provided in the embodiments of the present application;

[0047] Figure 9 Schematic flowchart of another method for video call provided in the embodiments of the present application;

[0048] Figure 10 Schematic flowchart of another method for video call provided in the embodiments of the present application;

[0049] Figure 11 Schematic diagram of the structure of a chip system provided in the embodiments of the present application;

[0050] Figure 12 Schematic diagram of the structure of another chip system provided in the embodiments of the present application. Detailed implementation manners

[0051] In the description of the embodiments of the present application, unless otherwise specified, " / " means "or". For example, A / B may mean A or B; herein, "and / or" is merely a description of the association relationship between associated objects, indicating that there can be three relationships. For example, A and / or B may mean: A exists alone, A and B exist simultaneously, and B exists alone. These three situations.

[0052] Hereinafter, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality" is two or more.

[0053] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner.

[0054] Currently, video call applications can also be installed on some in-vehicle terminals. Thus, when a user is inside a car, the user can use the video call application on the in-vehicle terminal. However, in some specific scenarios, the user experience of using only the video call application on the in-vehicle terminal or only the video call application on the mobile phone for video calls is not good. For example, when the user is making a video call using the mobile phone and enters the car, the user needs to hang up the video call on the mobile phone and start a new video call using the video call application on the in-vehicle terminal. Or, when the user is making a video call using the in-vehicle terminal and leaves the car, the user needs to hang up the video call on the in-vehicle terminal and start a new call using the video call application on the mobile phone.

[0055] For this reason, the embodiments of the present application provide a method for video calls, which enables the video call application running on the mobile phone to call the hardware on the connected in-vehicle terminal. For example, it can call the display screen of the in-vehicle terminal to display the video call interface, and can also call the camera of the in-vehicle terminal to capture the user's image. Of course, the mobile phone can still call its own display screen to display the video call interface and use its own camera to capture the user's image. In other words, the method provided by the embodiments of the present application can enable the video application on the mobile phone to freely call the camera on the mobile phone or the in-vehicle terminal to capture images, and freely call the display screen on the mobile phone or the in-vehicle terminal to display the interface, etc. Furthermore, it can realize that an ongoing video call can be freely switched between the mobile phone and the in-vehicle terminal, which can meet the different needs of users in different scenarios and improve the user experience.

[0056] As Figure 1 shown, it is a schematic structural diagram of a communication system provided by the embodiments of the present application, and the method for video calls provided by the embodiments of the present application can be applied to this communication system. Specifically, this communication system includes a mobile terminal 100 and an in-vehicle terminal 200.

[0057] Among them, the mobile terminal 100 and the in-vehicle terminal 200 can establish a communication connection in a wired or wireless manner. For example, a wired connection can be established through the USB interface on the in-vehicle terminal 200 and the mobile terminal 100 through a cable. Another example is that a wireless connection can be established through Bluetooth or WLAN, etc.

[0058] In this application, when the user is inside the vehicle (for example, when the user is driving or parked), the user can operate the in-vehicle terminal 200 to control the application installed on the mobile terminal 100 (such as a video call application), improving the safety when driving and the comfort of using the application while driving. In some embodiments, the mobile terminal 100 can send the interface of the application to the in-vehicle terminal 200 for display by the in-vehicle terminal 200. In some examples, parameters such as the size and resolution of the screen on the in-vehicle terminal 200 are different from those of the mobile terminal 100, and the mobile terminal 100 will draw a dedicated interface for the in-vehicle terminal 200. That is to say, the mobile terminal 100 will draw a specific interface for the in-vehicle terminal 200 according to the running status of the application, and send the drawn specific interface to the in-vehicle terminal 200 for display through the above-mentioned communication connection. Correspondingly, the user can also control the application through the in-vehicle terminal 200. For example, the user can control the application by touching the controls on the touch screen of the in-vehicle terminal 200, pressing the physical buttons on the in-vehicle terminal (including those on the steering wheel), or inputting voice commands through the microphone of the in-vehicle terminal, etc.

[0059] In this application, the in-vehicle terminal 200 can be understood as an external device of the mobile terminal 100. In other words, the mobile terminal 100 can call the screen of the in-vehicle terminal 200 to display the interface of the application running on the mobile terminal 100; the mobile terminal 100 can also call the images captured by the camera on the in-vehicle terminal 200 (including the externally connected camera on the in-vehicle terminal 200); the mobile terminal 100 can also call the microphone on the in-vehicle terminal 200 to collect voice and play voice, etc. Of course, the mobile terminal 100 can also call the sensors connected to the in-vehicle terminal 200. Among them, the specific implementation of the mobile terminal 100 calling the hardware and peripherals on the in-vehicle terminal 200 will be introduced below and will not be described here for the time being.

[0060] In some embodiments, the application installed on the mobile terminal 100 can also correspond to one or more application servers 400. That is to say, the application on the mobile terminal 100 communicates with the one or more application servers 400. For example, the application server can be the server of a video call application, which can provide video call functions for the mobile terminal 100, etc.

[0061] Specifically, the mobile terminal 100 can establish a connection with the application server 400 through one or more networks 300. Among them, the network 300 can be a local area network (LAN) or a wide area network (WAN), such as the Internet. The network 300 can be implemented using any known network communication protocol, and the above network communication protocols can be various wired or wireless communication protocols, such as Ethernet, universal serial bus (USB), FireWire, any cellular network communication protocol (such as 3G / 4G / 5G / future communication technology), Bluetooth, wireless fidelity (Wi-Fi), NFC, or any other suitable communication protocol.

[0062] In some embodiments, the communication system may further include an electronic device 500. The electronic device 500 can also establish a communication connection with the application server 400 through one or more networks 300.

[0063] For example: Taking the video call application as an example for illustration. The video call application can be, for example, an instant messaging application with video call function (such as WeChat application), FaceTime (a video call software), and other applications with video call function. For instance, user A can have a video call with user B (using the electronic device 500) through the video call application on the mobile terminal 100. That is, the mobile terminal 100 sends the video of user A to the electronic device 500 via the application server 400 for user B to view. Correspondingly, the electronic device 500 can also send the video of user B to the mobile terminal 100 via the application server 400 for user A to view.

[0064] When user A is inside the vehicle, the video call running on the mobile terminal 100 can call the display screen of the vehicle terminal 200 to display the picture of user B, and can also call the camera of the vehicle terminal 200 to capture the picture of user A, freeing the user's hands and facilitating the user to control the vehicle. When user A leaves the vehicle, the video call running on the mobile terminal 100 can switch to using the display screen of the mobile terminal 100 to display the picture of user B, and call the camera of the mobile terminal 100 to capture the picture of user A. That is to say, the user can switch the video call from the vehicle terminal to the mobile terminal without hanging up the call. Similarly, when user A enters the vehicle, the video call running on the mobile terminal 100 can switch to using the display screen of the vehicle terminal 200 to display the picture of user B, and can also call the camera of the vehicle terminal 200 to capture the picture of user A. That is to say, the user can switch the video call from the mobile terminal to the vehicle terminal without hanging up the call. It can be seen that the video method provided by the embodiments of the present application can meet the different needs of users in different scenarios.

[0065] Exemplarily, the above-mentioned mobile terminal 100 can be, for example, a mobile phone, a tablet computer, a personal computer (PC), a personal digital assistant (PDA), a smart watch, a netbook, a wearable electronic device, an augmented reality (AR) device, a virtual reality (VR) device, a vehicle-mounted device, a smart car, a smart speaker, a robot, etc. The present application does not impose special restrictions on the specific form of the mobile terminal 100. The electronic device 500 can be the same as or different from the mobile terminal 100. The structure of the electronic device 500 can refer to that of the mobile terminal 100 and will not be elaborated here.

[0066] Figure 2A Shows a schematic hardware structure diagram of the mobile terminal 100.

[0067] The mobile terminal 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0068] It can be understood that the structure schematically shown in the embodiments of the present invention does not constitute a specific limitation on the mobile terminal 100. In other embodiments of the present application, the mobile terminal 100 may include more or fewer components than shown in the figures, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figures may be implemented in hardware, software, or a combination of software and hardware.

[0069] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0070] The controller may generate operation control signals according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0071] A memory can also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can hold the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from the said memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0072] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0073] Among them, the USB interface 130 is an interface that conforms to the USB standard specification. Specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the mobile terminal 100, and can also be used for data transmission between the mobile terminal 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. This interface can also be used to connect other electronic devices, such as AR devices, etc.

[0074] In some embodiments of the present application, the mobile terminal 100 can be connected to the vehicle terminal 200 through the USB interface 130 to achieve data communication between the mobile terminal 100 and the vehicle terminal 200. Of course, the mobile terminal 100 may also be connected to the vehicle terminal 200 through other interfaces, or the mobile terminal 100 is connected to the vehicle terminal 200 through a wireless connection method.

[0075] It can be understood that the interface connection relationships among the modules illustrated in the embodiments of the present invention are only illustrative descriptions and do not constitute a structural limitation on the mobile terminal 100. In other embodiments of the present application, the mobile terminal 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0076] The charging management module 140 is configured to receive a charging input from a charger. Wherein, the charger may be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 may receive the charging input from the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 may receive the wireless charging input through the wireless charging coil of the mobile terminal 100. While charging the battery 142, the charging management module 140 may also supply power to the electronic device through the power management module 141.

[0077] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives the inputs from the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, the wireless communication module 160, etc. The power management module 141 may also be used to monitor parameters such as the battery capacity, the number of battery cycles, and the battery health status (leakage, impedance). In some other embodiments, the power management module 141 may also be disposed in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 may also be disposed in the same device.

[0078] The wireless communication function of the mobile terminal 100 may be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.

[0079] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the mobile terminal 100 may be used to cover a single or multiple communication frequency bands. Different antennas may also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 may be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna may be used in combination with a tuning switch.

[0080] The mobile communication module 150 may provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the mobile terminal 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 may receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least some functional modules of the mobile communication module 150 may be provided in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be provided in the same device.

[0081] The modulation and demodulation processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modulation and demodulation processor may be an independent device. In other embodiments, the modulation and demodulation processor may be independent of the processor 110 and provided in the same device as the mobile communication module 150 or other functional modules.

[0082] The wireless communication module 160 may provide solutions for wireless communications applied to the mobile terminal 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSSs), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive the signals to be sent from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.

[0083] In some embodiments of the present application, the mobile terminal 100 may establish a wireless connection with the vehicle-mounted terminal 200 through the wireless communication module 160 and the antenna 2 to achieve data communication between the mobile terminal 100 and the vehicle-mounted terminal 200.

[0084] In some embodiments, antenna 1 of the mobile terminal 100 is coupled to the mobile communication module 150, and antenna 2 is coupled to the wireless communication module 160, such that the mobile terminal 100 can communicate with the network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0085] In some embodiments of the present application, the mobile terminal 100 can establish a connection with the application server 400 through the mobile communication module 150 and antenna 1 to achieve data communication between the mobile terminal 100 and the application server 400.

[0086] The mobile terminal 100 realizes the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to execute mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change the display information.

[0087] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the mobile terminal 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0088] The mobile terminal 100 can implement the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, etc.

[0089] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light passes through the lens and is transmitted to the camera photosensitive element. The optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0090] The camera 193 is used to capture static images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, etc. format. In some embodiments, the mobile terminal 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0091] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the mobile terminal 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0092] The video codec is used to compress or decompress digital videos. The mobile terminal 100 can support one or more video codecs. In this way, the mobile terminal 100 can play or record videos in multiple coding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0093] The NPU is a neural-network (NN) computing processor. By learning from the biological neural network structure, such as learning from the transmission mode between human brain neurons, it can quickly process the input information and can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the mobile terminal 100 can be realized, such as: image recognition, face recognition, speech recognition, text understanding, etc.

[0094] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile terminal 100. The external memory card communicates with the processor 110 through the external memory interface 120 to achieve the data storage function. For example, files such as music and videos are saved in the external memory card.

[0095] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, image playback function, etc.). The data storage area can store the data created during the use of the mobile terminal 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 can include high-speed random access memory, and can also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the mobile terminal 100 by running the instructions stored in the internal memory 121 and / or the instructions stored in the memory provided in the processor.

[0096] The mobile terminal 100 can implement audio functions through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and the application processor, etc. Such as music playback, recording, etc.

[0097] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110.

[0098] The speaker 170A, also known as the "loudspeaker", is used to convert an audio electrical signal into a sound signal. The mobile terminal 100 can listen to music or hands-free calls through the speaker 170A.

[0099] The receiver 170B, also known as the "earpiece", is used to convert an audio electrical signal into a sound signal. When the mobile terminal 100 answers a call or a voice message, the user can listen to the voice by holding the receiver 170B close to the ear.

[0100] The microphone 170C, also known as the "microphone" or "transmitter", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak by bringing the mouth close to the microphone 170C to input the sound signal into the microphone 170C. The mobile terminal 100 can be provided with at least one microphone 170C. In some other embodiments, the mobile terminal 100 can be provided with two microphones 170C, which can not only collect sound signals but also implement a noise reduction function. In some other embodiments, the mobile terminal 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, and implement functions such as directional recording.

[0101] The headphone jack 170D is used to connect a wired headphone. The headphone jack 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0102] The keys 190 include a power-on key, volume keys, etc. The keys 190 can be mechanical keys or touch keys. The mobile terminal 100 can receive key inputs to generate key signal inputs related to the user settings and function controls of the mobile terminal 100.

[0103] The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration prompts and also for touch vibration feedback. For example, touch operations on different applications (such as taking pictures, audio playing, etc.) can correspond to different vibration feedback effects. For touch operations on different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects. Different application scenarios (such as time reminder, receiving messages, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0104] The indicator 192 can be an indicator light and can be used to indicate the charging state, power change, and can also be used to indicate messages, missed calls, notifications, etc.

[0105] The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation from the mobile terminal 100. The mobile terminal 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The mobile terminal 100 interacts with the network through the SIM card to implement functions such as calls and data communication. In some embodiments, the mobile terminal 100 uses an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the mobile terminal 100 and cannot be separated from the mobile terminal 100.

[0106] The software system of the mobile terminal 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of the present invention, the Android system with a layered architecture is taken as an example to exemplarily illustrate the software structure of the mobile terminal 100.

[0107] Figure 2B is the software structure block diagram of the mobile terminal 100 in the embodiments of the present invention.

[0108] The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0109] The application layer can include a series of application packages.

[0110] Such asFigure 2B As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0111] In some embodiments of the present application, the application package further includes a video call application with video call function, such as: WeChat application, QQ application, facetime, etc. The video call application may be a pre-installed application on the mobile terminal 100, or an application downloaded by the user through the application market or other means. The embodiments of the present application do not limit the video call application.

[0112] Optionally, the application package may further include a first application. For example, the HiCar application (a software for connecting a mobile phone and a vehicle terminal). Specifically, the first application can draw the relevant interface for the connection between the mobile terminal 100 and the vehicle terminal 200, and convert the application interface drawn by the application installed on the mobile terminal 100 into the interface displayed on the vehicle terminal 200, etc. For example, draw the display desktop of the vehicle terminal 200 according to the application installed on the mobile terminal 100, and the display desktop includes cards corresponding to all or part of the applications installed on the mobile terminal 100. Another example is that when a video call application is running on the mobile terminal 100, the first application converts the application interface (such as a video request interface, a video call interface, etc.) drawn by the video call application into the interface displayed on the vehicle terminal 200, etc.

[0113] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.

[0114] As Figure 2B shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.

[0115] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data, and enable these data to be accessible to application programs. The said data may include videos, images, audio, dialed and received calls, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build application programs. The display interface can be composed of one or more views. For example, a display interface including a short message notification icon may include a view for displaying text and a view for displaying pictures. The phone manager is used to provide the communication function of the mobile terminal 100. For example, the management of call states (including connection, hang-up, etc.). The resource manager provides various resources for application programs, such as localized strings, icons, pictures, layout files, video files, etc. The notification manager enables application programs to display notification information in the status bar, can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of a download, message reminder, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as a notification of a background-running application program, and can also be a notification that appears on the screen in the form of a dialogue window. For example, prompt text information in the status bar, emit a prompt sound, the electronic device vibrates, the indicator light flashes, etc.

[0116] In some embodiments of the present application, the application framework layer may further include a first module for communicating with other devices (such as the vehicle-mounted terminal 200). The first module is specifically used to discover the vehicle-mounted terminal 200, connect to the vehicle-mounted terminal 200; perform data transmission with the vehicle-mounted terminal 200 (such as sending the graphical interface on the vehicle-mounted terminal side to the vehicle-mounted terminal 200, receiving the image data collected by the camera of the vehicle-mounted terminal 200, receiving the input of the user on the vehicle-mounted terminal 200), and encode and decode the data during data transmission, etc.

[0117] Android Runtime includes a core library and a virtual machine. Android runtime is responsible for the scheduling and management of the Android system. The core library contains two parts: one part is the functional functions that need to be called by the Java language, and the other part is the core library of Android. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0118] The system library may include multiple functional modules. For example: a surface manager, Media Libraries, a 3D graphics processing library (e.g., OpenGL ES), a 2D graphics engine (e.g., SGL), etc. The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The Media Libraries support the playback and recording of multiple common audio and video formats, as well as static image files, etc. The Media Libraries can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc. The 2D graphics engine is a drawing engine for 2D drawing.

[0119] The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0120] In this application, the kernel layer further includes a second module for managing external devices of the mobile terminal 100. The second module can specifically be used to manage the hardware on the in-vehicle terminal 200 connected to the mobile terminal 100, such as: the screen, camera, microphone, and other devices such as sensors of the in-vehicle terminal 200.

[0121] Figure 3A The schematic diagram of the hardware structure of the in-vehicle terminal 200 is shown.

[0122] The in-vehicle terminal 200 may include a processor 210, a memory 220, a wireless communication module 230, a speaker 240, a microphone 250, a display screen 260, a camera 270, a USB interface 280, and a sensor module 290, etc. Among them, the sensor module 290 may include a pressure sensor 290A, a magnetic sensor 290B, an acceleration sensor 290C, a temperature sensor 290D, a touch sensor 290E, an ambient light sensor 290F, a positioning system 290G, etc.

[0123] The processor 210 may include one or more processing units. For example: the processor 210 may include an Electronic Control Unit (ECU) and a Telematics BOX, etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0124] A memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. This memory can save the instructions or data that the processor 210 has just used or recycled. If the processor 210 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.

[0125] The memory 220 can be used to store computer-executable program code, and the executable program code includes instructions. The internal memory 220 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, application programs required for at least one function (such as a sound playback function, an image playback function, etc.). The data storage area can store the data created during the use of the vehicle-mounted terminal 200 (such as audio data, video data, etc.). In addition, the memory 220 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 210 executes various functional applications and data processing of the vehicle-mounted terminal 200 by running the instructions stored in the memory 220 and / or the instructions stored in the memory provided in the processor.

[0126] The wireless communication module 230 can provide solutions for wireless communications including WLAN, such as Wi-Fi networks, Bluetooth, NFC, IR, etc., applied to the vehicle-mounted terminal 200. The wireless communication module 230 may be one or more devices integrating at least one communication processing module.

[0127] In some embodiments of the present application, the vehicle-mounted terminal 200 can establish a wireless communication connection with the mobile terminal 100 through the wireless communication module 230. Alternatively, the vehicle-mounted terminal 200 can also establish a wired communication connection with the mobile terminal 100 through the USB interface 280. The embodiments of the present application do not limit this.

[0128] The functions of components such as the speaker 240, the microphone 250, the display screen 260, and the camera 270 can refer to the relevant descriptions in the mobile terminal 100 and will not be elaborated here.

[0129] It can be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the vehicle-mounted terminal 200. In other embodiments of the present application, the vehicle-mounted terminal 200 may include more or fewer components than those illustrated, or combine certain components, or split certain components, or have different component arrangements. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0130] Figure 3B The schematic diagram of the software structure of the vehicle-mounted terminal 200 is shown.

[0131] Exemplarily, the software structure of the vehicle-mounted terminal 200 may include an application module, a control module, a human-machine interface module, a telematics module, an electronic control unit, and an operating system.

[0132] Among them, the application module is used for in-vehicle audio and video entertainment, vehicle information display, etc. The control module can control the operations of the vehicle and its components, such as controlling steering, throttle, braking, etc. The human-machine interface, also called the human-machine interface, is a medium for interaction and information exchange between the vehicle-mounted terminal 200 and the user, and it realizes the conversion between the internal form of information and the form acceptable to humans. The telematics module is mainly used to communicate with the background operating system / mobile phone APP to realize the vehicle information display and control of the mobile phone APP. The electronic control unit, also known as the "vehicle computer", "in-vehicle computer", etc., is a special microcomputer controller for automobiles in terms of its use.

[0133] In some embodiments of the present application, the vehicle-mounted terminal 200 further includes a third module for communicating with other electronic devices (such as the mobile terminal 100). It can be understood that the third module can be an independent functional module or a part of an existing module (such as the telematics module), and the embodiments of the present application do not limit this.

[0134] In the following, the mobile terminal 100 is taken as an example of a mobile phone, and the technical solutions provided by the embodiments of the present application are described in detail in combination with specific application scenarios.

[0135] Scenario 1: The mobile phone establishes a communication connection with the vehicle-mounted terminal, and user A initiates a video call with user B through the vehicle-mounted terminal. The mobile phone uses the camera of the vehicle-mounted terminal to capture images and uses the display screen of the vehicle-mounted terminal to display the interface.

[0136] As Figure 4 shown, it is a schematic diagram of the process of a video call provided by an embodiment of the present application. The process specifically includes:

[0137] S401. The vehicle-mounted terminal sends a BLE broadcast message, and the BLE broadcast message carries the vehicle-mounted terminal identifier and the vehicle-mounted terminal capability information.

[0138] In some embodiments of the present application, after the vehicle-mounted terminal is powered on or the wireless connection function is turned on, it can send BLE broadcast messages via low-power Bluetooth so that the mobile phone can scan the vehicle-mounted terminal and establish a communication connection with the vehicle-mounted terminal. The BLE broadcast message can carry the vehicle-mounted terminal identifier and the vehicle-mounted terminal capability information. Among them, the vehicle-mounted terminal identifier can be, for example, the vehicle model, which is used to identify the vehicle-mounted terminal. The vehicle-mounted terminal capability information can include the hardware capability information of the vehicle-mounted terminal, such as camera information, display screen information, audio information, GPS information, sensor information, etc.

[0139] Among them, the BLE broadcast message can adopt a format pre-agreed with the mobile phone. For example, the pre-agreed format can be: information header + model: + vehicle model name + capacitytype + capability type + capacityvalue + capability parameter. Among them, the capability type can refer to the hardware capabilities of the vehicle-mounted terminal, such as cameras, audio, display screens, GPS, etc.

[0140] Exemplarily, an example of the capability type value is given as follows:

[0141]

[0142] It means that when the capability type is a camera, the corresponding value of the capability type in the broadcast message is 1; when the capability type is audio, the corresponding value of the capability type in the broadcast message is 2; when the capability type is a display screen, the corresponding value of the capability type in the broadcast message is 3; when the capability type is GPS, the corresponding value of the capability type in the broadcast message is 4, and so on. It can be understood that the vehicle-mounted terminal can have multiple hardware under the same capability type. For example, it has multiple cameras, including cameras inside the vehicle and cameras outside the vehicle, etc. Then, the multiple hardware under the capability type can be numbered respectively to distinguish them.

[0143] In some examples, the vehicle-mounted terminal can also externally connect some hardware through an interface. Then, when the vehicle-mounted terminal broadcasts a message, it can also carry the capability information of the externally connected hardware. For example, the vehicle-mounted terminal can externally connect a camera through a USB interface. Then, the BLE broadcast message sent by the vehicle-mounted terminal in this step also carries the information of the camera externally connected to the vehicle-mounted terminal.

[0144] Among them, the capability parameter is the specific parameter corresponding to each capability type. Table 1 gives some examples of the parameters corresponding to each capability type.

[0145] Table 1

[0146] Serial number Capability type Capability parameter 1 Camera Resolution, acquisition frame rate, autofocus, zoom capability, etc. 2 Display screen Size, resolution, etc. 3 Microphone Sampling rate, etc.

[0147] In some other embodiments of the present application, after establishing a communication connection with the mobile phone, the vehicle-mounted terminal can also carry the vehicle-mounted terminal capability information and inform the mobile phone of the capabilities of the vehicle-mounted terminal. That is, the vehicle-mounted terminal identification can be carried in the BLE broadcast message sent by the vehicle-mounted terminal, but the vehicle-mounted terminal capability information is not carried.

[0148] Of course, considering information security, the BLE broadcast message is usually encrypted, and the mobile phone can perform corresponding decryption after receiving the BLE broadcast message.

[0149] In a specific implementation, the third module in the vehicle-mounted terminal can be used to collect information about the hardware capabilities of the vehicle-mounted terminal. For example, after the vehicle-mounted terminal is powered on or the wireless function is enabled, the third module can request each hardware of the vehicle-mounted terminal to report its own capability information. Or, each hardware of the vehicle-mounted terminal actively reports its own capability information to the third module. Then, the vehicle-mounted terminal broadcasts the capability information obtained by the third module in the BLE broadcast message. Another example is that after the vehicle-mounted terminal establishes a communication connection with the mobile phone, the vehicle-mounted terminal collects the hardware capability information of the vehicle-mounted terminal and reports it to the mobile phone to facilitate the mobile phone to register the hardware capabilities of the vehicle-mounted terminal. The relevant content of the registration will be described in detail below.

[0150] S402. The mobile phone performs a Bluetooth scan and displays a list of discovered devices. The vehicle-mounted terminal identification in the BLE broadcast message is displayed in the list of discovered devices.

[0151] In some embodiments, the mobile phone turns on the first application. The first application can display a prompt interface to prompt the user to manually turn on the Bluetooth and WIFI functions. Or, in response to the user turning on the first application, the mobile phone automatically turns on the Bluetooth and WIFI functions. The mobile phone starts a Bluetooth scan. After scanning and receiving the BLE broadcast message, the mobile phone parses the BLE broadcast message, obtains the vehicle-mounted terminal identification and the vehicle-mounted terminal capability information, and stores the vehicle-mounted terminal identification and the vehicle-mounted terminal capability information. Then, the mobile phone displays a list of discovered Bluetooth devices to prompt the user to select which Bluetooth device to connect to. The vehicle-mounted terminal identification carried in the BLE broadcast message is displayed on the list of the Bluetooth devices.

[0152] For example: As Figure 5 shown in the interface 501 in (1) below, it is an example of the list of discovered Bluetooth devices displayed on the mobile phone. A list 502 of Bluetooth devices is displayed on the interface 501. It can be seen that at this time, the mobile phone has scanned two Bluetooth devices, namely "SAIC-GM Buick Envision" and "SAIC-GM ATS-L".

[0153] Optionally, the mobile phone can also register the hardware capabilities of the vehicle terminal according to the vehicle terminal capability information in the BLE broadcast message. The registration process can be understood as the mobile phone creating a virtual driver for each hardware of the vehicle terminal. Later, when the mobile phone application needs to call the hardware of the vehicle terminal, it can transmit data to the hardware of the vehicle terminal through the corresponding virtual driver. In a specific implementation, please refer to Figure 2B When the first module of the mobile application framework layer discovers the BLE broadcast message of the vehicle terminal, it can request the second module of the kernel layer to register the various hardware of the vehicle terminal, that is, to create virtual drivers for the various hardware of the vehicle terminal. For example: the virtual camera driver corresponding to the camera of the vehicle terminal, the virtual audio driver corresponding to the microphone of the vehicle terminal, the virtual display driver corresponding to the display of the vehicle terminal, the sensor driver corresponding to the sensor of the vehicle terminal, etc. It should be noted that when the mobile phone is disconnected from the vehicle terminal, the mobile phone will deregister the registered hardware of the vehicle terminal, such as deleting the virtual driver corresponding to the hardware of the vehicle terminal, or setting the virtual driver corresponding to the hardware of the vehicle terminal to unavailable.

[0154] Of course, the mobile phone can also register the hardware capabilities of the vehicle terminal after the mobile phone and the vehicle terminal are connected, that is, after step S403. It can be seen that the mobile phone can complete the registration before calling the hardware of the vehicle terminal, and the embodiment of the application does not specifically limit the registration timing.

[0155] S403, the mobile phone receives the user's instruction to connect to the vehicle-mounted terminal (S403a), and the mobile phone establishes a WIFI connection with the vehicle-mounted terminal (S403b).

[0156] Exemplarily, in response to a user clicking Figure 5 On the interface 501 shown in (1), the operation of connecting to "SAIC-GM Buick Envision" is selected, and the mobile phone sends a connection command to the vehicle terminal corresponding to "SAIC-GM Buick Envision". For example, the mobile phone can use the generic attribute profile (GATT) of BLE to send commands. The content of the command can be a command header (cmd command) + a mobile phone identifier (such as a mobile phone name and / or an International Mobile Equipment Identity (IMEI)); wherein the cmd command is to open the WIFI connection of the vehicle terminal. After receiving the command, the vehicle terminal authenticates the mobile phone. After the authentication is successful, the WIFI function is turned on, and a request for WIFI connection is initiated to the mobile phone. When the mobile phone receives the WIFI connection request, the mobile phone establishes a WIFI connection with the vehicle terminal. Subsequently, the mobile phone and the vehicle terminal can communicate data through the WIFI connection.

[0157] For example, after the mobile phone establishes a WIFI connection with the vehicle terminal, the following is displayed: Figure 5 Interface 503 shown in (2) of FIG. 1 shows that the mobile phone is connected to the vehicle terminal corresponding to "SAIC-GM Buick Envision". Interface 503 may also include a setting control 504 corresponding to "SAIC-GM Buick Envision". The user may make relevant settings through the setting control 504. For example, in response to the user clicking the setting control 504, the mobile phone displays the following Figure 5 The setting interface 505 shown in (3) in FIG. The setting interface 505 includes multiple application icons displayed on the vehicle terminal, a control 506, a control 507, a control 508, and a control 509. The user can adjust the order of the application icons displayed on the vehicle terminal by pressing and dragging the application icon. Control 506 can be used to download new HiCar applications. The HiCar application here refers to the application displayed on the vehicle terminal. It should be noted that the application displayed on the vehicle terminal is an application that has been installed on the mobile phone. This is because these applications are actually running on the mobile phone, and the hardware required for these applications can be the hardware of the vehicle terminal. For example, the display screen of the vehicle terminal is used to display the interface, and the camera of the vehicle terminal is used to capture images. Of course, the vehicle terminal can also be used to receive user operation instructions, such as by touching the control of the display screen (usually a touch screen) of the vehicle terminal, or by collecting the user's voice command through the microphone of the vehicle terminal, or by pressing the physical buttons on the vehicle terminal (including the steering wheel). Control 507 can be used to enable the function of the mobile phone to automatically connect to the vehicle terminal wirelessly. Control 508 can be used to modify the vehicle name of the car. Control 509 can be used to release the binding relationship between the mobile phone and the vehicle-mounted terminal.

[0158] In a specific implementation, when the first module of the mobile phone discovers the BLE broadcast message of the vehicle terminal, it will determine whether the mobile phone is connected to the vehicle terminal for the first time. If it is the first time to connect to the vehicle terminal, or although it is not the first time to connect to the vehicle terminal, but the user has not turned on the wireless automatic connection function between the phone and the vehicle terminal, it will wait for the user's connection instruction. Optionally, the mobile phone can report to the first application, and the first application draws a prompt message to prompt the user whether to connect. If the user's connection instruction is received, connect to the vehicle terminal. Otherwise, do not connect to the vehicle terminal. If it is not the first time to connect to the vehicle terminal, and the user turns on the wireless automatic connection function between the mobile phone and the vehicle terminal, the vehicle terminal is automatically connected. The first module reports the successful connection message to the first application.

[0159] It should also be noted that the above steps S401 to S403 are described by taking the mobile phone discovering the vehicle-mounted terminal through low-power Bluetooth and establishing a WIFI connection with the vehicle-mounted terminal as an example. In some other embodiments of the present application, the mobile phone can also directly establish a connection with the vehicle-mounted terminal through a data cable of the USB interface, or the mobile phone directly establishes a connection with the vehicle-mounted terminal through WIFI, or the mobile phone and the vehicle-mounted terminal are connected through classic Bluetooth, etc. The embodiments of the present application do not specifically limit the connection method between the mobile phone and the vehicle-mounted terminal.

[0160] S404. The mobile phone draws the interface of the video call application of the vehicle-mounted terminal and sends it to the vehicle-mounted terminal for display.

[0161] In a specific implementation, after the first application of the mobile phone receives the message of successful connection sent by the application framework layer, the first application of the mobile phone can determine that the vehicle-mounted terminal has a display screen according to the obtained capability information of the vehicle-mounted terminal, and draw the desktop of the vehicle-mounted terminal according to the information of the display screen of the vehicle-mounted terminal, and send it to the vehicle-mounted terminal for display.

[0162] For example, as Figure 6A The interface 601 shown in (1) is an example of the desktop of the vehicle-mounted terminal. A quick menu bar 602, a status bar 603, and multiple application cards (such as a video call card 604) are displayed on the interface 601. Among them, the quick menu bar 602 can be used to quickly enter the corresponding interface or application. The status bar 603 displays time, battery power, signal, and a voice input box, etc. The user can enter each application through the application cards on the desktop. Similarly, the vehicle-mounted terminal sends the operations of the user on the application received to the mobile phone, and the corresponding application on the mobile phone responds, and draws the next interface of the vehicle-mounted terminal and sends it to the vehicle-mounted terminal for display.

[0163] Exemplarily, taking the user operating the video application on the mobile phone on the vehicle-mounted terminal as an example for description.

[0164] In response to the user Figure 6A clicking on the video call card 604 on the interface 601 shown in (1), the vehicle-mounted terminal sends the user operation to the mobile phone. The mobile phone starts the video call application, draws the next interface of the vehicle-mounted terminal, that is, the interface of the video call application, and sends it to the vehicle-mounted terminal. As Figure 6A The interface 605 shown in (2) is an example of the interface of a video call application displayed by the vehicle-mounted terminal.

[0165] S405. The vehicle-mounted terminal receives the operation of the user initiating a video call on the interface of the video call application (S405a), and sends the video call operation to the mobile phone (S405b).

[0166] S406. The mobile phone sends a video call request to the server (S406a), and draws and sends the video call interface of the vehicle-mounted terminal to the vehicle-mounted terminal for display (S406b).

[0167] Among them, the server can be an application server that provides video call services for the mobile phone.

[0168] Continuing with the above example, the user selects Andy on the interface 605 as shown in Figure 6A (2) above, that is, issues a video call instruction to Andy. The vehicle-mounted terminal sends this instruction to the mobile phone. After receiving it, on the one hand, the mobile phone then draws the video call interface of the vehicle-mounted terminal; on the other hand, the video call application of the mobile phone sends a video call request to the server. This video call request carries the identifier of Andy. The server sends a video call request to the terminal used by Andy according to the identifier of Andy. If Andy accepts this video call request, the server returns a video call establishment event to the mobile phone, and then step S407 is executed. If Andy rejects this video call request, the server returns a video call failure event to the mobile phone. The mobile phone draws the corresponding interface for the vehicle-mounted terminal to display to inform the user.

[0169] For example, as shown in Figure 6B (3) above, the interface 606 is an example of the video call interface displayed by the vehicle-mounted terminal. This interface 606 displays a prompt box 607 and a preview box 608. Among them, the prompt box 607 prompts "Calling Andy...". The preview box 608 is used to display the picture captured by the camera of the vehicle-mounted terminal. The interface 606 also displays a hang-up control 609 for hanging up the video call.

[0170] It should be noted that in this embodiment, since the user starts the video call application on the vehicle-mounted terminal, it indicates that the user is in the car. Then the mobile phone can default to using the screen of the vehicle-mounted terminal for display and using the camera of the vehicle-mounted terminal to collect video information. That is to say, when the video call application of the mobile phone calls the display driver for display, it can call the virtual driver corresponding to the vehicle-mounted terminal display screen so that the interface drawn by the mobile phone can be transmitted to the vehicle-mounted terminal for display. Similarly, when the video call application of the mobile phone calls the camera driver to collect video information, it can call the virtual driver corresponding to the vehicle-mounted terminal camera so that the vehicle-mounted terminal sends the video information collected by the vehicle-mounted terminal camera to the mobile phone.

[0171] In a specific implementation, after the video call application receives an indication from the user to initiate a video call, it can also query from the second module whether the mobile phone is registered with the camera of the in-vehicle terminal. If it is determined that the in-vehicle terminal is registered with a camera, the video call application sends an instruction to turn on the camera to the in-vehicle terminal through the second module and the first module. After receiving the instruction to turn on the camera, the in-vehicle terminal turns on the camera to capture images and returns them to the video call application. In one example, the mobile phone can, after receiving an indication from the in-vehicle terminal to initiate a video call, instruct the in-vehicle terminal to send an instruction to turn on the camera and start capturing images. In another example, the mobile phone can also, after receiving a message indicating successful video call connection sent by the server, instruct the in-vehicle terminal to send an instruction to turn on the camera and start capturing images. If it is determined that the in-vehicle terminal does not have a camera, the video call application needs to call the camera of the mobile phone to capture images.

[0172] S407. The mobile phone receives a message indicating the establishment of a video call sent by the server (S407a), draws the video call interface of the in-vehicle terminal, and sends it to the in-vehicle terminal for display (S407b).

[0173] Continuing with the above example, after Andy receives the current video call request, Andy's terminal will capture Andy's video information and send it to the mobile phone through the server. Then the mobile phone draws the interface of the in-vehicle terminal based on Andy's video information and sends it to the in-vehicle terminal for display. Among them, the video call interface of the in-vehicle terminal displays the video images captured by the camera of the in-vehicle terminal. For example, the interface 610 shown in (4) below is the video call interface displayed by the in-vehicle terminal after the video call is connected. Figure 6B As shown in the interface 610 in (4), it is the video call interface displayed by the in-vehicle terminal after the video call is connected.

[0174] In the embodiments of the present application, when the mobile phone and the in-vehicle terminal transmit application data (such as video call application data), it involves data transmission between multiple application programs (the first application and the video call application). Here, the process of transmitting application data (such as video call application data) between the mobile phone and the in-vehicle terminal will be described in detail.

[0175] As Figure 7As shown in the figure, it is a schematic diagram of the system structure including a mobile phone and a vehicle-mounted terminal. Among them, the video call service of the mobile phone is a module that provides services for video call applications in the framework layer and system library of the mobile phone. The device driver includes the drivers for the video call application to call the relevant hardware of the mobile phone. Among them, the first module includes: a device discovery module for performing functions related to the mobile phone discovering the vehicle-mounted terminal, etc. A device management module for registering with the second module according to the vehicle-mounted terminal hardware capability information reported by the received vehicle-mounted terminal, etc. The remote service module is used to send data to the vehicle-mounted terminal, receive data from the vehicle-mounted terminal, and perform encryption and decryption processing on the data, etc. Encoding and decoding are used to decode the received data and encode the data to be sent, etc. The functions of the remaining modules can be referred to Figure 2B the descriptions of the relevant modules in Figure 3B the descriptions of the relevant modules in

[0176] The process of the vehicle-mounted terminal transmitting application data to the mobile phone is as follows: The third module of the vehicle-mounted terminal encodes and encrypts the data to be transmitted (such as the operations of the user on the vehicle-mounted terminal, the images captured by the vehicle-mounted terminal camera, the audio captured by the microphone, etc.), and transmits the encoded and encrypted data to the first module in the mobile phone through the connection link with the mobile phone. The first module in the mobile phone decrypts and decodes the received data, and determines that the data is for the video call application. Then it is transmitted to the video call application through the second module, device driver, and video call service for processing by the video call application.

[0177] The process of the mobile phone transmitting application data to the vehicle-mounted terminal is as follows: The video call application sends the data (such as the application interface on the vehicle-mounted terminal side drawn, the data received from the server, etc.) to the first application through the video call service, device driver, second module, and first module. The first application converts the application interface on the mobile phone side into the application interface on the vehicle-mounted terminal side, and then the first module performs encryption and decryption, etc., and sends it to the vehicle-mounted terminal through the communication link between the mobile phone and the vehicle-mounted terminal. The third module of the vehicle-mounted terminal decrypts and decodes the received data and then displays it.

[0178] For example, the transmitted application data is an operation for the user to initiate a video call on the in-vehicle terminal. After the in-vehicle terminal transmits the application data to the first module of the mobile phone, if the first module of the mobile phone determines that the application data is an operation to initiate a video call, it will transmit the application data to the video call application through the second module, device driver, and video call service. The video call application, on the one hand, sends a video call request to the server, and on the other hand, draws a video call interface on the mobile phone side. The mobile phone sends the drawn video call interface on the mobile phone side to the first application through the video call service, device driver, second module, and first module. The first application converts the video call interface on the mobile phone side into a video call interface on the in-vehicle terminal side suitable for display on the in-vehicle terminal, and sends it to the in-vehicle terminal through the first module, the communication link between the mobile phone and the in-vehicle terminal, and is displayed on the display screen of the in-vehicle terminal.

[0179] Among them, the above-mentioned video call interface on the mobile phone side refers to the video call interface usually drawn by the video call application, and this interface is generally displayed on the display screen of the mobile phone. In this application, however, the video call application also needs to have a display interface on the in-vehicle terminal. Therefore, in order to distinguish the interface displayed on the in-vehicle terminal, the interface displayed on the mobile phone is called the display interface on the mobile phone side (such as the video call interface on the mobile phone side, etc.). It should be noted that in the embodiments of this application, when the mobile phone and the in-vehicle terminal are connected and the in-vehicle terminal displays the video call interface, the mobile phone may not display the interface related to the video call.

[0180] It should also be noted that in this application, when the mobile phone and the in-vehicle terminal are connected via Bluetooth, when the video call application of the mobile phone uses the display screen on the in-vehicle terminal side to display the interface, it can also use the screen mirroring method in the Bluetooth protocol to transmit the interface data, that is, the mobile phone can directly call the display screen of the in-vehicle terminal through the Bluetooth driver. When the video call application of the mobile phone uses the microphone of the in-vehicle terminal, it can also use the audio transmission method in the Bluetooth protocol to transmit the audio data, that is, the mobile phone can directly call the audio device of the in-vehicle terminal through the Bluetooth driver. However, it should be noted that there is currently no solution that supports the mobile phone to directly call the camera of the in-vehicle terminal and transmit the video data collected by the in-vehicle terminal camera to the mobile phone. However, by using the technical solution provided in this application, the mobile phone can call the camera of the in-vehicle terminal to collect images.

[0181] As Figure 8 shown, it is a schematic diagram of the discovery connection process and video call service process between the mobile phone and the in-vehicle terminal. This schematic diagram shows the interaction between each module in the mobile phone and the in-vehicle terminal. The specific interaction process has been described in detail in the above embodiments and will not be elaborated here.

[0182] As can be seen from the above, when user A is in the car, the video call running on the mobile phone can call the display screen of the vehicle-mounted terminal to display the picture of user B (i.e., the called party), and can also call the camera of the vehicle-mounted terminal to capture the picture of user A (i.e., the calling party), freeing the user's hands, facilitating the user to control the car, and improving driving safety.

[0183] Furthermore, since the entire video call runs on the mobile phone side, and the vehicle-mounted terminal side only needs to provide corresponding hardware capabilities, such as providing a display screen for display, providing a camera to capture pictures, providing a microphone to capture audio and play audio, etc. Therefore, the method provided by the embodiments of the present application has low requirements for the system capabilities of the vehicle-mounted terminal. For example, the vehicle-mounted terminal may not have the ability to connect to a mobile communication network, the Internet, etc. The vehicle-mounted terminal may also not be required to be able to run a video call application, etc. In other words, the embodiments of the present application are applicable to most vehicle-mounted terminals.

[0184] In addition, the mobile phone side mainly cooperates with the existing video call application through the first application, the first module, the second module, etc. to complete the video call by calling the hardware of the vehicle-mounted terminal. That is, in the method provided by the embodiments of the present application, it is not necessary to modify the code of the video call application to realize the video call by calling the hardware of the vehicle-mounted terminal. In this way, the embodiments of the present application can be compatible with the video call applications on the mobile phone.

[0185] In the present application, since the video call application running on the mobile phone can call the hardware (camera, display screen, etc.) of the vehicle-mounted terminal, the user can realize a video call on the vehicle-mounted terminal (watch a video and use the camera of the vehicle-mounted terminal to capture his own picture). Similarly, the video call application running on the mobile phone can still call the hardware of the mobile phone, that is, the user can still realize a video call on the mobile phone. Further, during the video call, the user can freely switch the video call between the mobile phone and the vehicle-mounted terminal to meet different needs in different scenarios. The following respectively shows the situations where the method provided by the embodiments of the present application is applied to other scenarios.

[0186] Scenario 2: User A uses the vehicle-mounted terminal in the car to make a video call with user B. At this time, if user A needs to leave the car, the video call is switched to the mobile phone.

[0187] In one embodiment, a switching control may be displayed on the interface displayed by the vehicle-mounted terminal. The switching control can be used to instruct the video call application on the mobile phone to switch the mode of calling the display screen and camera of the vehicle-mounted terminal (which may also include a microphone and an external camera, etc.) to calling the display screen and camera of the mobile phone, etc. Alternatively, the user can also achieve the switching through a voice command, a physical button on the steering wheel, etc. That is, the user can manually switch the video call from the vehicle-mounted terminal to the mobile phone.

[0188] In another embodiment, when user A leaves the car or turns off the in-vehicle terminal, the connection between the mobile phone and the in-vehicle terminal is disconnected, and the mobile phone automatically activates the display screen and camera of the mobile phone for a video call. That is, the mobile phone automatically switches the video call from the in-vehicle terminal to the mobile phone.

[0189] It can be understood that the user can set whether the mobile phone uses manual switching or automatic switching.

[0190] Scenario 3: User A uses the mobile phone to have a video call with user B. At this time, when the user enters the car, the video call can be switched to the in-vehicle terminal.

[0191] Similar to Scenario 2, a switching control can be displayed on the interface shown on the mobile phone, and the user can manually switch the video call to the in-vehicle terminal. Or, after the mobile phone detects the establishment of a connection with the in-vehicle terminal, it automatically switches the video call to the in-vehicle terminal.

[0192] Alternatively, the mobile phone can also intelligently determine whether to switch to the in-vehicle terminal. For example: when the camera of the in-vehicle terminal captures only one person in the car, the video call can be switched to the in-vehicle terminal. If it is detected that there are multiple people in the car, to ensure the privacy of the user, the video call may not be switched to the in-vehicle terminal or the user may be asked whether to switch to the in-vehicle terminal.

[0193] In Scenarios 2 and 3 above, when switching, the video call application simultaneously switches from using the display screen and camera on the mobile phone to using the display screen and camera on the in-vehicle terminal. Or vice versa. However, in actual scenarios, there are also some cases where only one or several of them need to be switched. For example: only switch the camera without switching the display screen, or only switch the display screen without switching the camera.

[0194] Scenario 4: User A uses the in-vehicle terminal in the car to have a video call with user B and uses the in-car camera to capture images. If the car is externally connected to an out-of-car camera, user A wants to use the out-of-car camera to capture out-of-car images.

[0195] As Figure 9 shown, it is a schematic diagram of the process of the mobile phone and the in-vehicle terminal discovering the connection process and switching the camera after the in-vehicle terminal accesses the external camera. Among them, the process of the mobile phone and the in-vehicle terminal discovering the connection is the same as Figure 8The same as above, so no further elaboration is provided. When an in-vehicle terminal is connected to an external camera, the third module of the in-vehicle terminal will inform the mobile phone of the information of the external camera. The first module of the mobile phone will register the external camera in the second module. Subsequently, after the in-vehicle terminal detects an instruction from the user to switch the camera (such as touching a relevant control on the display screen, inputting a voice command, pressing a physical button on the central control panel, etc.), the instruction to switch the camera will be sent to the video call application on the mobile phone. The video call application will send an instruction to the in-vehicle terminal to turn off the current camera and turn on the camera to be switched. In another example, if the instruction to switch the camera does not clearly specify which camera to switch to, the video call application can cycle through the existing cameras. The embodiments of this application do not make any limitations in this regard.

[0196] The method of switching other hardware on the in-vehicle terminal is similar to that of switching the camera, so no further elaboration is provided.

[0197] Similarly, the method of switching hardware on the mobile phone is also similar to the method of switching the camera on the in-vehicle terminal, so no further elaboration is provided.

[0198] Scenario 5: User A uses the in-vehicle terminal in the car to have a video call with User B. The mobile phone can also obtain data of other hardware in the in-vehicle terminal, such as sensor data. And perform corresponding operations according to the sensor data of the in-vehicle terminal.

[0199] For example, Figure 10 This is an interaction diagram of another video call method provided by the embodiments of this application. Specifically, sensors of the in-vehicle terminal can detect the driving state of the car in real time, such as vehicle speed, driving section, etc. If the sensor of the in-vehicle terminal detects that the vehicle speed of the car exceeds the threshold, the vehicle speed will be reported to the video call application of the in-vehicle terminal. In some examples, when the vehicle speed is too fast, to ensure driving safety, the video call application can instruct the display screen of the in-vehicle terminal to turn off the picture of the other end, or the video call application can directly end the video call. In other examples, due to the vehicle speed being too fast, the picture quality collected by the camera of the in-vehicle terminal may be reduced. Therefore, when the mobile phone's video call application receives the message that the vehicle speed is too fast, it can also send instructions such as increasing the acquisition frame rate to the camera of the in-vehicle terminal to improve the picture quality collected by the camera of the in-vehicle terminal.

[0200] It can be understood that this article takes the video call application running on the mobile phone switching between using the hardware on the mobile phone and using the hardware on the in-vehicle terminal as an example for illustration. It can be understood that according to the method provided by the embodiments of this application, other applications running on the mobile phone can also achieve any switching between using the hardware on the mobile phone and using the hardware on the in-vehicle terminal. The embodiments of this application will not elaborate one by one.

[0201] The embodiments of this application also provide a chip system, such as Figure 11As shown, the chip system includes at least one processor 1101 and at least one interface circuit 1102. The processor 1101 and the interface circuit 1102 can be interconnected by a line. For example, the interface circuit 1102 can be used to receive signals from other devices (such as the memory of the mobile terminal 100). Also for example, the interface circuit 1102 can be used to send signals to other devices (such as the processor 1101). Exemplarily, the interface circuit 1102 can read the instructions stored in the memory and send the instructions to the processor 1101. When the instructions are executed by the processor 1101, the electronic device can execute the various steps performed by the mobile terminal 100 (such as a mobile phone) in the above embodiments. Of course, the chip system can also include other discrete devices, and the embodiments of the present application do not make specific limitations on this.

[0202] An embodiment of the present application also provides a chip system, as Figure 12 As shown, the chip system includes at least one processor 1201 and at least one interface circuit 1202. The processor 1201 and the interface circuit 1202 can be interconnected by a line. For example, the interface circuit 1202 can be used to receive signals from other devices (such as the memory of the vehicle terminal 200). Also for example, the interface circuit 1202 can be used to send signals to other devices (such as the processor 1201). Exemplarily, the interface circuit 1202 can read the instructions stored in the memory and send the instructions to the processor 1201. When the instructions are executed by the processor 1201, the electronic device can execute the various steps performed by the vehicle terminal 200 in the above embodiments. Of course, the chip system can also include other discrete devices, and the embodiments of the present application do not make specific limitations on this.

[0203] It can be understood that in order to implement the above functions, the above terminals and the like include the corresponding hardware structures and / or software modules for performing each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of the examples described in the embodiments disclosed in this article, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving the hardware depends on the specific application and design constraint conditions of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present invention.

[0204] Embodiments of the present application can divide the above-mentioned terminals, etc. into functional modules according to the above method examples. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of a software functional module. It should be noted that the division of modules in the embodiments of the present invention is illustrative, only a logical function division, and there may be other division methods in actual implementation.

[0205] From the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of description, only the above division of each functional module is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. For the specific working processes of the systems, devices, and units described above, reference can be made to the corresponding processes in the foregoing method embodiments, and details are not described herein again.

[0206] In each embodiment of the present application, each functional unit can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0207] If the above integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiments of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in the embodiments of the present application. The foregoing storage medium includes: various media such as flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk, or optical disk that can store program codes.

[0208] The above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method for video call, characterized in that, The method includes: The mobile terminal and the vehicle-mounted terminal establish a communication connection; The mobile terminal sends sixth information to the vehicle-mounted terminal, and the sixth information instructs the vehicle-mounted terminal to display an interface including a first application; The mobile terminal receives first information sent by the vehicle-mounted terminal; In response to the first information, the mobile terminal establishes a video call connection with the terminal of a second user and receives video data of the second user; The mobile terminal sends the video data of the second user to the vehicle-mounted terminal, and sends the video data of a first user collected by the camera of the vehicle-mounted terminal to the terminal of the second user; The mobile terminal receives fifth information sent by the vehicle-mounted terminal; the fifth information is that the first user instructs to switch the current camera to the camera of the mobile terminal; The mobile terminal instructs the vehicle-mounted terminal to turn off the current camera and turn on the camera of the mobile terminal; The camera of the mobile terminal collects video data of the first user; The mobile terminal sends the video data of the second user, and the video data of the first user collected by the camera of the mobile terminal to the vehicle-mounted terminal.

2. The method according to claim 1, wherein The method further includes: After the mobile terminal receives the first information sent by the vehicle-mounted terminal, or after the mobile terminal establishes a video call with the terminal of the second user, the mobile terminal receives the video data of the first user collected by the camera of the vehicle-mounted terminal.

3. The method according to claim 2, wherein The mobile terminal sending the video data of the second user to the vehicle-mounted terminal specifically is: The mobile terminal draws a first interface according to the video data of the second user and the video data of the first user collected by the camera of the vehicle-mounted terminal, and sends the first interface to the vehicle-mounted terminal; wherein, the first interface includes the video data of the second user and the video data of the first user collected by the camera of the vehicle-mounted terminal.

4. The method according to any one of claims 1-3, characterized in that, Before the mobile terminal receives the first information sent by the vehicle-mounted terminal, the method further includes: The mobile terminal receives second information sent by the vehicle-mounted terminal, and the second information includes parameters of the display screen of the vehicle-mounted terminal and parameters of the camera of the vehicle-mounted terminal; The mobile terminal registers the display screen of the vehicle-mounted terminal and the camera of the vehicle-mounted terminal according to the second information.

5. The method according to claim 4, wherein The vehicle-mounted terminal transmits the second information to the mobile terminal through Bluetooth Low Energy (BLE).

6. The method according to any one of claims 1 to 3, characterized in that The method further includes: After the mobile terminal receives the first information sent by the vehicle-mounted terminal, or after the mobile terminal establishes a video call connection with the terminal of the second user, the mobile terminal determines whether the camera of the vehicle-mounted terminal is registered; If it is determined that the camera of the vehicle-mounted terminal is registered, the mobile terminal sends an instruction to turn on the camera of the vehicle-mounted terminal to the vehicle-mounted terminal.

7. The method according to any one of claims 1 to 3, characterized in that The method further includes: The mobile terminal receives third information sent by the vehicle-mounted terminal, where the third information is an operation for the first user to instruct switching to the camera and display screen of the mobile terminal; or, the mobile terminal detects that the communication connection between the mobile terminal and the vehicle-mounted terminal is disconnected; The display screen of the mobile terminal displays the video data of the second user and the video data of the first user collected by the camera of the mobile terminal.

8. The method according to any one of claims 1 to 3, characterized in that, The method further includes: The mobile terminal receives fourth information sent by the vehicle-mounted terminal, where the fourth information is an instruction from the first user to switch the current camera to another camera of the vehicle-mounted terminal; The mobile terminal instructs the vehicle-mounted terminal to turn off the current camera and turn on another camera of the vehicle-mounted terminal; The mobile terminal receives the video data of the first user collected by another camera of the vehicle-mounted terminal; The mobile terminal sends the video data of the second user and the video data of the first user collected by another camera of the vehicle-mounted terminal to the vehicle-mounted terminal.

9. The method according to any one of claims 1-3, characterized in that, The method further includes: When the communication connection between the mobile terminal and the vehicle-mounted terminal is disconnected, the mobile terminal cancels the registration of the display screen and the camera of the vehicle-mounted terminal.

10. A method for video call, characterized in that, The method includes: The mobile terminal and the vehicle-mounted terminal establish a communication connection; The mobile terminal receives a video call request sent by the terminal of the second user; The mobile terminal receives the video data of the second user sent by the terminal of the second user and receives the video data of the first user collected by the camera of the vehicle-mounted terminal; The mobile terminal sends the video data of the second user to the vehicle-mounted terminal and sends the video data of the first user collected by the camera of the vehicle-mounted terminal to the terminal of the second user; The mobile terminal receives fourth information sent by the vehicle-mounted terminal, where the fourth information is an instruction from the first user to switch the current camera to the camera of the mobile terminal; The mobile terminal instructs the vehicle-mounted terminal to turn off the current camera and turn on the camera of the mobile terminal; The camera of the mobile terminal collects the video data of the first user; The mobile terminal sends the video data of the second user and the video data of the first user collected by the camera of the mobile terminal to the vehicle-mounted terminal.

11. The method according to claim 10, wherein, The mobile terminal sends the video data of the second user to the vehicle-mounted terminal specifically as follows: The mobile terminal draws a first interface based on the video data of the second user and the video data of the first user collected by the camera of the vehicle-mounted terminal and sends the first interface to the vehicle-mounted terminal; where the first interface includes the video data of the second user and the video data of the first user collected by the camera of the vehicle-mounted terminal.

12. The method according to claim 10 or 11, characterized in that, After the mobile terminal establishes a video call connection with the terminal of the second user, the method further includes: If the mobile terminal has registered the camera of the vehicle-mounted terminal, it sends an instruction to the vehicle-mounted terminal to turn on the camera of the vehicle-mounted terminal.

13. The method according to claim 10 or 11, characterized in that, Before establishing a video call connection between the mobile terminal and the terminal of the second user, the method further includes: The mobile terminal receives first information sent by the vehicle-mounted terminal, where the first information includes parameters of the display screen of the vehicle-mounted terminal and parameters of the camera of the vehicle-mounted terminal; The mobile terminal registers the display screen and the camera of the vehicle-mounted terminal according to the first information.

14. The method according to claim 13, wherein The vehicle-mounted terminal transmits the first information to the mobile terminal through Bluetooth Low Energy (BLE).

15. The method according to claim 10 or 11, characterized in that The method further includes: The mobile terminal receives second information sent by the vehicle-mounted terminal, where the second information is an operation for the first user to instruct to switch to the camera and display screen of the mobile terminal; or, the mobile terminal detects that the mobile terminal is disconnected from the vehicle-mounted terminal; The display screen of the mobile terminal displays the video data of the second user and the video data of the first user collected by the camera of the mobile terminal.

16. The method according to claim 15, wherein After the display screen of the mobile terminal displays the video data of the second user and the video data of the first user collected by the camera of the mobile terminal, the method further includes: The mobile terminal receives third information, where the third information is an operation for the first user to instruct to switch to the camera and display screen of the vehicle-mounted terminal, or the mobile terminal detects that the mobile terminal is connected to the vehicle-mounted terminal; If the mobile terminal determines that the camera of the vehicle-mounted terminal is registered, it sends an instruction to the vehicle-mounted terminal to turn on the camera of the vehicle-mounted terminal; The mobile terminal sends the video data of the second user and the video data of the first user collected by the camera of the vehicle-mounted terminal to the vehicle-mounted terminal.

17. An electronic device, characterized in that, It includes: A processor, a memory, and a touch screen. The memory and the touch screen are coupled to the processor. The memory is used to store computer program code, and the computer program code includes computer instructions. When the processor reads the computer instructions from the memory, the electronic device is caused to execute the video call method according to any one of claims 1-9, or execute the video call method according to any one of claims 10-16.

18. A computer storage medium, characterized in that, It includes computer instructions. When the computer instructions run on the terminal, the terminal is caused to execute the video call method according to any one of claims 1-9, or execute the video call method according to any one of claims 10-16.

19. A computer program product, characterized in that, When the computer program product runs on the computer, the computer is caused to execute the video call method according to any one of claims 1-9, or execute the video call method according to any one of claims 10-16.

Images