A method and terminal for in-vehicle application flow transfer

Abstract

A method and terminal for in-vehicle application flow, relating to the field of smart terminals, automatically establishes a correspondence between in-vehicle passengers and mobile terminals, automatically transferring applications from the mobile terminals to the display screen in front of the passenger's seat, thus improving the user experience. The method includes: detecting the location of the mobile terminal via a UWB base station and the passenger's location via millimeter-wave radar; establishing a correspondence between the mobile terminal and the passenger when their locations coincide; continuously detecting the passenger's seat and transferring the applications running on the mobile terminal to the in-vehicle terminal, specifically to the display screen corresponding to the passenger's current seat.

Description

Technical Field

[0001] This application relates to the field of smart terminals, and in particular to a method and terminal for in-vehicle application flow. Background Technology

[0002] With the rapid development of electronic information technology, in-vehicle terminals are becoming increasingly intelligent. Unlike traditional car cockpits, smart cockpits offer more entertainment applications, more displays, and more features.

[0003] Outside the car, users use mobile devices such as smartphones to watch videos and make phone calls. Once inside the car, users tend to use the displays in the smart cockpit to watch videos and make calls. How to achieve seamless application transitions between mobile devices and the smart cockpit has become a hot research topic for industry professionals. Summary of the Invention

[0004] This application provides a method and terminal for in-vehicle application transfer, which can automatically establish a correspondence between in-vehicle passengers and mobile terminals, and automatically transfer applications on the mobile terminals to the display screen in front of the passenger's seat, thereby improving the user experience of the applications.

[0005] To achieve the above objectives, the embodiments of this application provide the following technical solutions:

[0006] In a first aspect, embodiments of this application provide a system for in-vehicle application flow, including a mobile terminal, an in-vehicle terminal, a UWB base station, and a millimeter-wave radar device; wherein, the in-vehicle terminal includes at least two displays; the in-vehicle terminal is used to receive a first location of the mobile terminal sent by the UWB base station, and to receive a second location of a first passenger sent by the millimeter-wave radar device; the in-vehicle terminal is further used to establish a first correspondence between the mobile terminal and the first passenger when the first location and the second location belong to the same seating area; when the second location of the first passenger corresponds to the area of ​​the first seat, the in-vehicle terminal establishes a second correspondence between the first passenger and the first seat; the in-vehicle terminal is further used to send the second correspondence to the mobile terminal; the mobile terminal is used to flow a first application running on the mobile terminal to a first display on the in-vehicle terminal according to the second correspondence, the first display being a display corresponding to the first seat.

[0007] The first passenger can be the driver or another passenger in the car.

[0008] In summary, the system provided in this application can automatically establish a first correspondence between a first passenger and a mobile terminal, and establish a second correspondence between the first passenger and a first seat based on the first passenger's location. Then, the application running on the mobile terminal corresponding to the first passenger can be transferred to a first display screen on the in-vehicle terminal. The first display screen is the display screen corresponding to the first seat of the first passenger. For example, the first display screen is the display screen in front of the first seat. Therefore, from the moment the first passenger enters the car with their mobile terminal, the system automatically transfers the first application from the mobile terminal to a specific display screen on the in-vehicle terminal, providing the first passenger with an immersive application experience.

[0009] It should be noted that in some other embodiments, besides the display screen, the first seat can also correspond to other hardware, such as a camera, audio output device, and audio input device. Similar to the display screen, the in-vehicle terminal can call upon other hardware corresponding to the first passenger's seat. For example, it can call upon the audio device corresponding to the first seat to play the first application. It is understood that the camera corresponding to the first seat can capture images of the area where the first seat is located (including the first passenger), eliminating the need for the first passenger to raise their mobile terminal or adjust their posture, thus improving the passenger's experience when using the application. The audio device corresponding to the first seat can ensure the first passenger's audio experience while seated.

[0010] In conjunction with the first aspect above, in one possible implementation, the vehicle-mounted terminal is further configured to send a first message to the mobile terminal when a first preset condition is met; the mobile terminal, according to a second correspondence, transfers the first application running on the mobile terminal to the first display screen on the vehicle-mounted terminal, specifically including: in response to receiving the first message, the mobile terminal requests information from the vehicle-mounted terminal about the first display screen corresponding to the first seat; the mobile terminal calls the first display screen to display the interface of the first application running on the mobile terminal according to the information of the first display screen.

[0011] This provides a specific implementation method for transferring the first application from a mobile terminal to an in-vehicle terminal.

[0012] In conjunction with the first aspect above, in one possible implementation, the vehicle-mounted terminal is further configured to send a first message to the mobile terminal when a first preset condition is met; the mobile terminal, according to a second correspondence, transfers the first application running on the mobile terminal to the first display screen on the vehicle-mounted terminal, the first display screen being the display screen corresponding to the first seat, specifically including: in response to receiving the first message, the mobile terminal sends information about the first application running on the mobile terminal to the vehicle-mounted terminal; the vehicle-mounted terminal launches the first application on the vehicle-mounted terminal according to the information about the first application, and calls the first display screen to display the interface of the first application according to the second correspondence.

[0013] This provides another specific way to transfer the first application from the mobile terminal to the vehicle terminal.

[0014] In conjunction with the first aspect above, in one possible implementation, the vehicle-mounted terminal is further configured to receive a second message sent by the millimeter-wave radar device that satisfies a first preset condition, the first preset condition including the millimeter-wave radar device detecting the action of the first passenger putting down the mobile terminal.

[0015] In other words, this system can detect the actions of the first passenger. When the system detects that the first passenger has put down the mobile terminal, it automatically transfers the first application on the mobile terminal to the in-vehicle terminal, freeing the first passenger's hands so that the first passenger can handle other things.

[0016] In conjunction with the first aspect above, in one possible implementation, the mobile terminal is further configured to stop transferring the first application to the first display screen on the vehicle terminal when the second preset condition is met; or, the vehicle terminal is further configured to stop transferring the first application to the first display screen on the vehicle terminal when the second preset condition is met.

[0017] Therefore, this system can also enable the first application, which is transferred to the vehicle terminal, to be transferred back to the mobile terminal.

[0018] In conjunction with the first aspect above, in one possible implementation, the vehicle terminal is further configured to receive a third message sent by the millimeter-wave radar device that satisfies a second preset condition, the second preset condition including: the millimeter-wave radar device detects the action of the first passenger picking up the mobile terminal; or, detects the first passenger leaving the vehicle.

[0019] In other words, when the system detects the first passenger picking up the mobile terminal, or when it detects the first passenger leaving the car, the system will transfer the first application from the in-vehicle terminal back to the mobile terminal.

[0020] In conjunction with the first aspect above, in one possible implementation, the vehicle terminal is further configured to establish a third correspondence between the first passenger and the second seat when the second position of the first passenger corresponds to the area of ​​the second seat; the vehicle terminal is further configured to send the third correspondence to the mobile terminal; the mobile terminal is configured to transfer the first application displayed on the first display screen of the vehicle terminal to the second display screen of the vehicle terminal according to the third correspondence, the second display screen being the display screen corresponding to the second seat.

[0021] In other words, this system can detect changes in the first passenger's seat in the car and automatically switch the display screen to show the first application based on these changes. This makes the application flow more intelligent and user-friendly, improving the user experience.

[0022] Secondly, this application also provides a method for in-vehicle application flow, applied to an in-vehicle terminal. The in-vehicle terminal establishes wired or wireless connections with a mobile terminal, a UWB base station, and a millimeter-wave radar device. The in-vehicle terminal includes at least two displays. The in-vehicle terminal receives a first location of the mobile terminal sent by the UWB base station and a second location of a first passenger sent by the millimeter-wave radar device. When the first and second locations belong to the same seating area, the in-vehicle terminal establishes a first correspondence between the mobile terminal and the first passenger. When the second location of the first passenger corresponds to the area of ​​the first seat, the in-vehicle terminal establishes a second correspondence between the first passenger and the first seat. The in-vehicle terminal sends the second correspondence to the mobile terminal. The second correspondence is used by the mobile terminal to flow a first application running on the mobile terminal to a first display on the in-vehicle terminal, where the first display is the display on the in-vehicle terminal corresponding to the first seat.

[0023] In conjunction with the second aspect above, in one possible implementation, when the first preset condition is met, the vehicle terminal sends a first message to the mobile terminal; wherein the first message is used to notify the mobile terminal to start application flow; a first request is received from the mobile terminal, the first request being used to request information from the first display screen corresponding to the first seat; the information from the first display screen corresponding to the first seat is returned to the mobile terminal, the information from the first display screen being used by the mobile terminal to call the first display screen of the vehicle terminal to display the interface of the first application running on the mobile terminal.

[0024] In conjunction with the second aspect above, in one possible implementation, when the first preset condition is met, the vehicle terminal sends a first message to the mobile terminal; wherein the first message is used to notify the mobile terminal to start the application flow; the vehicle terminal receives the information of the first application sent by the mobile terminal; the vehicle terminal starts the first application on the vehicle terminal according to the information of the first application, and calls the first display screen to display the interface of the first application according to the second correspondence.

[0025] In conjunction with the second aspect above, in one possible implementation, before the vehicle-mounted terminal sends the first message to the mobile terminal, the method further includes: the vehicle-mounted terminal receiving a second message sent by the millimeter-wave radar device that satisfies a first preset condition, the first preset condition including the millimeter-wave radar device detecting the action of the first passenger putting down the mobile terminal.

[0026] In conjunction with the second aspect above, in one possible implementation, after the mobile terminal transfers the first application running on the mobile terminal to the first display screen on the vehicle terminal according to the second correspondence, the method further includes: when the second preset condition is met, the vehicle terminal stops transferring the first application from the mobile terminal to the first display screen on the vehicle terminal; or, the vehicle terminal notifies the mobile terminal to stop transferring the first application to the first display screen on the vehicle terminal.

[0027] In conjunction with the second aspect above, in one possible implementation, before the vehicle terminal stops transferring the first application from the mobile terminal to the first display screen on the vehicle terminal, or before the vehicle terminal notifies the mobile terminal to stop transferring the first application to the first display screen on the vehicle terminal, the method further includes: the vehicle terminal receiving a third message from the millimeter-wave radar device that satisfies a second preset condition, the second preset condition including the millimeter-wave radar device detecting the action of the first passenger picking up the mobile terminal; or detecting the first passenger leaving the vehicle.

[0028] In conjunction with the second aspect above, in one possible implementation, after the mobile terminal transfers the first application running on the mobile terminal to the first display screen on the vehicle terminal according to the second correspondence, the method further includes: when the second position of the first passenger corresponds to the area of ​​the second seat, the vehicle terminal establishes a third correspondence between the first passenger and the second seat; the vehicle terminal sends the third correspondence to the mobile terminal; the third correspondence is used by the mobile terminal to transfer the first application displayed on the first display screen of the vehicle terminal to the second display screen of the vehicle terminal, the second display screen being the display screen corresponding to the second seat.

[0029] The technical effects corresponding to the second aspect and any implementation thereof are as described above, and will not be repeated here.

[0030] Thirdly, a vehicle-mounted terminal is provided, comprising: a processor, a memory, and a display screen, wherein the memory and the display screen are coupled to the processor, the memory is used to store computer program code, the computer program code including computer instructions, and when the processor reads the computer instructions from the memory, the vehicle-mounted terminal performs the method of the second aspect and any embodiment of the second aspect.

[0031] Fourthly, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program (also referred to as instructions or code) that, when executed by an in-vehicle terminal, causes the in-vehicle terminal to perform the methods of the second aspect and any one of the embodiments of the second aspect.

[0032] Fifthly, a computer program product is provided. This computer program product includes a computer program (also referred to as instructions or code) that, when executed by an in-vehicle terminal, causes the in-vehicle terminal to perform the method of the second aspect and any one of the embodiments of the second aspect.

[0033] It should be noted that the technical effects of the vehicle terminal provided in the third aspect, the computer-readable storage medium provided in the fourth aspect, and the computer program product provided in the fifth aspect can be referred to the technical effects corresponding to the second aspect and any implementation thereof, and will not be repeated here. Attached Figure Description

[0034] Figure 1 A schematic diagram illustrating an in-vehicle application flow scenario provided in an embodiment of this application;

[0035] Figure 2 This is a schematic diagram of the structure of a vehicle-mounted terminal provided in an embodiment of this application;

[0036] Figure 3 A schematic diagram of the antenna distribution in some UWB base stations provided in the embodiments of this application;

[0037] Figure 4 A schematic diagram showing the antenna distribution in some millimeter-wave radar devices provided for embodiments of this application;

[0038] Figure 5 A flowchart illustrating an application flow method provided in an embodiment of this application;

[0039] Figure 6 A flowchart illustrating another application flow method provided in this application embodiment;

[0040] Figure 7 A schematic diagram illustrating an application scenario provided in an embodiment of this application;

[0041] Figure 8 A schematic diagram illustrating yet another application scenario provided by an embodiment of this application;

[0042] Figure 9 A schematic diagram illustrating yet another application scenario provided by an embodiment of this application;

[0043] Figure 10 A schematic diagram illustrating yet another application scenario provided by an embodiment of this application;

[0044] Figure 11 This is a schematic diagram of a chip system provided in an embodiment of this application. Detailed Implementation

[0045] The technical solutions of the embodiments of this application are described below with reference to the accompanying drawings. In the description of the embodiments of this application, the terminology used in the following embodiments is for the purpose of describing specific embodiments only and is not intended to limit the application. As used in the specification and appended claims of this application, the singular expressions "a," "the," "the," "the," and "this" are intended to also include expressions such as "one or more," unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, "at least one" and "one or more" refer to one or more (including two). The term "and / or" is used to describe the relationship between related objects, indicating that three relationships can exist; for example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship.

[0046] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized. The term "connection" includes direct connections and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.

[0047] In the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.

[0048] For example, Figure 1 This is a schematic diagram illustrating a scenario of in-vehicle application flow provided in an embodiment of this application. For example... Figure 1 As shown, an in-vehicle terminal 100 is installed inside the vehicle. This in-vehicle terminal 100, for example, is a smart cockpit system and may include at least two displays, such as... Figure 1Screens 1, 2, 3, and 4 shown are respectively positioned in front of different seats in the vehicle (e.g., driver's seat, front passenger seat, rear seat 1, rear seat 2, etc.) for viewing by passengers in different seats. Optionally, the vehicle terminal 100 may also include at least two cameras, distributed in different locations within the vehicle, to capture images of passengers in different seats. For example, one camera may be installed on each seat in the vehicle to capture images of passengers in each seat. Another example is a camera installed on the front seats to capture images of front-seat passengers, and a camera installed on the rear seats to capture images of rear-seat passengers. Optionally, the vehicle terminal 100 may also include at least two speakers, respectively installed in different locations within the vehicle, to provide audio playback to passengers in different seats. Optionally, the vehicle terminal 100 may also include at least two microphones, respectively installed in different locations within the vehicle, to collect voice recordings from passengers in different seats.

[0049] The vehicle-mounted terminal 100 is also connected to at least one ultra-wideband (UWB) base station 200, which is used to measure the location of UWB tags (or devices equipped with UWB tags, such as mobile terminal 400) inside the vehicle. In one example, the vehicle-mounted terminal 100 is connected to at least three single-antenna UWB base stations 200. Understandably, a single-antenna UWB base station 200 can measure the distance between the UWB tag and the UWB base station 200. According to the principle of triangulation, at least three single-antenna UWB base stations work together to measure the location of the UWB tag. In another example, the vehicle-mounted terminal 100 is connected to at least one three-antenna (or more) UWB base station 200. Understandably, a three-antenna (or more) UWB base station 200 can independently measure the location of the UWB tag. In another example, the vehicle-mounted terminal 100 can connect to both at least one UWB base station 200 with a three-antenna structure (or more than three antenna structures) and at least one UWB base station 200 with a single antenna structure. In yet another example, the vehicle-mounted terminal 100 can also connect to at least one UWB base station 200 with a two-antenna structure and at least one UWB base station 200 with a single antenna structure. Thus, the location of the UWB tag can be measured by the combined operation of one two-antenna UWB base station 200 and one single-antenna UWB base station 200. This application embodiment does not limit the antenna structure, number, or deployment location of the UWB base stations 200 deployed in the vehicle.

[0050] In one specific implementation, at least one UWB base station 200 can be deployed in the center of the vehicle roof so that the UWB base station 200 can measure UWB tags near any seat inside the vehicle. It should be noted that in actual design, technicians can determine the number and specific locations of UWB base stations based on factors such as vehicle size, antenna structure of the UWB base station 200, positioning algorithm of the UWB base station 200, and measurement accuracy requirements. This application embodiment does not impose specific limitations in this regard.

[0051] The vehicle-mounted terminal 100 and the UWB base station 200 can communicate via wired or wireless connection. This embodiment does not limit the communication method between the vehicle-mounted terminal 100 and the UWB base station 200. In other embodiments, the vehicle-mounted terminal 100 and the UWB base station 200 can also be integrated into a single device.

[0052] The vehicle-mounted terminal 100 is also connected to at least one millimeter-wave radar device 300 for measuring the position of passengers inside the vehicle and their body movements. In one specific implementation, at least one millimeter-wave radar device 300 can be deployed in the middle of the vehicle roof so that it can accurately measure passengers near any seat inside the vehicle and their body movements. It should be noted that in actual design, technicians can determine the number and specific location of the millimeter-wave radar devices 300 based on the size of the vehicle and the required measurement accuracy; this application embodiment does not impose specific limitations on this.

[0053] The vehicle-mounted terminal 100 and the millimeter-wave radar device 300 can communicate via wired or wireless connection. This application embodiment does not limit the communication method between the vehicle-mounted terminal 100 and the millimeter-wave radar device 300.

[0054] In some other embodiments, the vehicle-mounted terminal 100 may also be integrated with the millimeter-wave radar device 300 on a single device. In still other embodiments, the UWB base station 200 and the millimeter-wave radar device 300 may also be integrated on a single device. In yet other embodiments, the UWB base station 200, the millimeter-wave radar device 300, and the vehicle-mounted terminal 100 may be integrated on a single device. This application does not specifically limit the particular form of the UWB base station 200, the millimeter-wave radar device 300, and the vehicle-mounted terminal 100.

[0055] Figure 1 The mobile terminal 400 is a portable device carried by the passenger, such as a mobile phone or smartwatch. In this embodiment, the mobile terminal 400 is equipped with a UWB module, enabling it to function as a UWB tag. In other words, the UWB base station 200 deployed inside the vehicle can measure the location of the mobile terminal 400 within the vehicle.

[0056] Furthermore, the millimeter-wave radar device 300 deployed inside the vehicle can measure the location of the user (i.e., passenger) of the mobile terminal 400 within the vehicle. The in-vehicle terminal 100 can establish a connection between the mobile terminal 400 and its user. As previously explained, the in-vehicle terminal 100 includes multiple displays, each positioned in front of a different seat in the vehicle, allowing passengers in different seats to view the information. Therefore, based on the location of the user of the mobile terminal 400, the in-vehicle terminal 100 automatically switches the application running on the mobile terminal 400 to the display screen in front of the user's location, facilitating the user's viewing and operation of the application.

[0057] like Figure 2 The diagram shown is a structural schematic of a vehicle-mounted terminal 100 provided in an embodiment of this application.

[0058] The vehicle terminal 100 may include a processor 110, a memory 120, a universal serial bus (USB) interface 130, at least two displays 140, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, and a camera 190, etc.

[0059] It is understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the vehicle terminal 100. In other embodiments of this application, the vehicle terminal 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0060] For example, in some other embodiments, the vehicle terminal 100 may further include a UWB module for implementing UWB base station functionality. The UWB module includes at least three UWB antennas for measuring the positioning of UWB tags (e.g., mobile terminal 400) within the vehicle. And / or, the vehicle terminal 100 may further include millimeter-wave radar for measuring the position and limb movements of passengers within the vehicle.

[0061] Furthermore, the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the vehicle terminal 100. In other embodiments of this application, the vehicle terminal 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0062] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0063] The memory 120 can be used to store computer executable program code, which includes instructions. The memory 120 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of the vehicle terminal 100 (such as audio data, phonebook, etc.). Furthermore, the memory 120 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the vehicle terminal 100 by running instructions stored in the memory 120 and / or instructions stored in memory located within the processor.

[0064] The wireless communication function of the vehicle terminal 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0065] Antennas 1 and 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the vehicle-mounted terminal 100 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0066] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the vehicle terminal 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0067] The wireless communication module 160 can provide solutions for wireless communication applications on the vehicle terminal 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0068] In some embodiments, antenna 1 of the vehicle terminal 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling the vehicle terminal 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0069] The vehicle terminal 100 implements display functions through a GPU, a display screen 140, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 140 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0070] The vehicle terminal 100 can implement audio functions, such as music playback and recording, through the audio module 170 and application processor.

[0071] For example, Figure 3 Several antenna distributions in the UWB base station 200 provided in this application embodiment are shown. Among them, Figure 3(a) Exemplarily illustrates two two-antenna structures. One is a lateral (e.g., horizontal) antenna structure, and the other is a longitudinal (e.g., vertical) antenna structure. Preferably, the distance between antenna 0 and antenna 1 is λ / 2, where λ is the wavelength of the UWB signal. The lateral antenna structure can be used to measure the lateral direction of arrival (e.g., horizontal) of the UWB signal, and the longitudinal antenna structure can be used to measure the longitudinal direction of arrival (e.g., vertical) of the UWB signal. In one embodiment, it can be achieved by... Figure 3 The UWB base station 200 on the left and the UWB base station 200 on the right, as shown in (a), cooperate with each other (for example, the two UWB base stations 200 are set at a certain angle) to detect the direction of a signal containing a UWB tag (e.g., mobile terminal 400).

[0072] Figure 3 (b) and Figure 3 (c) illustrates an exemplary three-antenna structure. (e.g.) Figure 3 (b) and Figure 3 As shown in (c), the three antennas form an L-shaped (or right-angled triangular) structural relationship. Among them, as... Figure 3 As shown in (b), antennas 0 and 1 are aligned in the lateral direction (e.g., horizontal direction), and antennas 0 and 2 are aligned in the longitudinal direction (e.g., vertical direction). That is, the plane containing antennas 0, 1, and 2 is a longitudinal plane (e.g., a vertical plane), and they exhibit an L-shaped distribution on the longitudinal plane. Figure 3 As shown in (c), the plane containing antennas 0, 1, and 2 is a transverse plane (e.g., a horizontal plane), and the line connecting antennas 0 and 1 (if they are connected) is perpendicular to the line connecting antennas 0 and 2 (if they are connected). That is, antennas 0, 1, and 2 are arranged in an L-shape on the transverse plane. For example, when antennas 0, 1, and 2 are arranged in an L-shape, the distance between antennas 0 and 1, and between antennas 0 and 2, can be less than or equal to λ / 2; where λ is the wavelength of the UWB signal. The distances between antennas 0 and 1, and between antennas 0 and 2, can be the same or different.

[0073] Figure 3 (d) exemplarily illustrates some other three-antenna structures. For example... Figure 3As shown in (d), the three antennas form a triangular (e.g., equilateral or isosceles) structural relationship. For example, the plane containing antennas 0, 1, and 2 is a longitudinal plane (e.g., a vertical plane), and they are arranged in a triangular pattern on this plane. Alternatively, antennas 0, 1, and 2 may be arranged in a triangular pattern on a transverse plane (e.g., a horizontal plane). Exemplarily, when antennas 0, 1, and 2 are arranged in a triangular pattern, the distance between any two antennas can be less than or equal to λ / 2; where λ is the wavelength of the UWB signal. Furthermore, the distance between any two antennas can be the same or different. For example, the distance between antennas 0 and 1 is λ / 2; the distance between antennas 0 and 2 is...

[0074] It is understood that cases with more than three antennas are also within the scope of this application. For example, such as... Figure 3 As shown in (e), antennas 0, 1, 2, and 3 are arranged in a rectangular configuration. Any three of these four antennas may be arranged in an L-shape or a triangle as described earlier.

[0075] For example, the UWB base station 200 obtains the lateral direction of arrival of the UWB signal based on the phase difference between the arrival times of the UWB signal transmitted from the mobile terminal 400 and its two lateral antennas; and obtains the longitudinal direction of arrival of the UWB signal based on the phase difference between the arrival times of the UWB signal transmitted from the mobile terminal 400 and its two longitudinal antennas. Furthermore, the UWB base station 200 obtains the direction of arrival of the UWB signal based on the lateral and longitudinal directions of arrival.

[0076] In other examples, the UWB base station 200 may consist of only one antenna. In this case, three or more UWB base stations 200 are needed, arranged in an L-shape or triangle, to cooperate in obtaining the direction of the UWB signal. The specific principle is similar to that described above and will not be repeated here.

[0077] This application embodiment does not limit the number and distribution of antennas in the UWB base station 200, as long as the direction of the UWB signal can be obtained.

[0078] It is understandable that the UWB base station 200 may also include other modules, such as a storage module, a communication module, and a processing module. Other structures can be referenced above. Figure 2 The description of the relevant modules in the vehicle-mounted terminal 100 shown is not repeated here. In some other embodiments, the UWB base station 200 may also be integrated into the vehicle-mounted terminal 100, and this application embodiment does not limit this.

[0079] For example, Figure 4 Several antenna configurations of the millimeter-wave radar device 300 provided in this application embodiment are illustrated. Exemplarily, the transmitting antennas of the millimeter-wave radar device 300 include transmitting antenna 0, transmitting antenna 1, and transmitting antenna 2. The receiving antennas of the millimeter-wave radar device 300 include receiving antenna 0, receiving antenna 1, receiving antenna 2, and receiving antenna 3. The configurations of transmitting antennas 0, 1, and 2, and receiving antennas 0, 1, 2, and 3 can be as follows: Figure 4 As shown in (a) or (b). The transmitting antenna transmits electromagnetic signals operating in the millimeter-wave band (e.g., LFMCW), and the receiving antenna receives the signals reflected by a reflector (object or human body) from the same electromagnetic signal operating in the millimeter-wave band. The millimeter-wave radar device 300 obtains a difference frequency signal based on the transmitted and received signals, and determines the position of the object or human body based on the difference frequency signal.

[0080] like Figure 4 As shown, three transmitting antennas and four receiving antennas are located in the same longitudinal plane (e.g., a vertical plane), with the three transmitting antennas arranged in a triangular pattern on the longitudinal plane. In one example, as... Figure 4 As shown in (a), transmitting antenna 0 and transmitting antenna 2 are located in the same transverse plane (e.g., a horizontal plane), and the four receiving antennas are located on the same transverse line (e.g., a horizontal line). Exemplarily, the distance between any two receiving antennas is equal (e.g., all are λ). L / 2); The distances between transmitting antenna 0 and transmitting antenna 2 are equal (e.g., both are 2λ). L The longitudinal distances between transmitting antenna 1 and transmitting antenna 0, and between transmitting antenna 1 and transmitting antenna 2, are all equal (e.g., both are λ). L / 2). λ L This is the wavelength of the highest frequency of a linearly frequency-modulated continuous signal. In another example, such as... Figure 4 As shown in (b), transmitting antenna 0 and transmitting antenna 2 are located on the same longitudinal line (e.g., a vertical line); the four receiving antennas are located on the same longitudinal line (e.g., a vertical line). The distance between any two receiving antennas is equal (e.g., λ). L / 2); The distances between transmitting antenna 0 and transmitting antenna 2 are equal (e.g., both are 2λ). L The transverse distances between transmitting antenna 1 and transmitting antenna 0, and between transmitting antenna 1 and transmitting antenna 2, are all equal (e.g., both are λ). L / 2). It is understood that the number and distribution of transmitting and / or receiving antennas may be other forms. The embodiments of this application are not limited in this respect.

[0081] Multiple transmitting and receiving antennas are used to accurately measure the direction of the reflected signal, i.e., the direction of arrival of the reflected signal, including the lateral direction of arrival (e.g., horizontal) and the longitudinal direction of arrival (e.g., vertical), and to maximize the receiving aperture of the millimeter-wave radar. The millimeter-wave radar device 300 can calculate the lateral direction of arrival of the target based on the phase difference of the reflected signal from multiple receiving antennas in the lateral direction (e.g., horizontal direction); and calculate the longitudinal direction of arrival of the target based on the phase difference of the reflected signal from multiple receiving antennas in the longitudinal direction (e.g., vertical direction).

[0082] Optionally, the number of transmitting antennas may be more or less than 3. Optionally, the number of receiving antennas may be more than 4 or less than 4. This application does not limit this. In one embodiment, the number of transmitting antennas is at least one, and the number of receiving antennas is at least three.

[0083] In one embodiment, there is one transmitting antenna and three receiving antennas. The three receiving antennas—receiving antenna 0, receiving antenna 1, and receiving antenna 2—are arranged in a triangle. For ease of explanation, it is assumed that the line connecting receiving antenna 0 and receiving antenna 1 (which is not actually a line) is in the horizontal direction, and the line connecting receiving antenna 0 and receiving antenna 2 (which is not actually a line) is in the vertical direction. Thus, after the transmitted signal from the transmitting antenna is reflected by a reflective object (object or human body), the three receiving antennas respectively receive the reflected signal. The millimeter-wave radar device 300 can obtain the lateral direction of arrival (e.g., horizontal direction) of the reflected signal based on the phase difference between the reflected signals received by receiving antennas 0 and 1, and the longitudinal direction of arrival (e.g., vertical direction) of the reflected signal based on the phase difference between the reflected signals received by receiving antennas 0 and 2. Furthermore, the direction of arrival of the reflected signal can be determined based on the lateral and longitudinal directions.

[0084] In another embodiment, the number of transmitting antennas is at least two, and the number of receiving antennas is at least two. Taking two transmitting antennas—transmitting antenna 0 and transmitting antenna 1—and two receiving antennas—receiving antenna 0 and receiving antenna 1—as an example, assuming the line connecting transmitting antenna 0 and transmitting antenna 1 (which is actually not a connection) is in the horizontal direction, and the line connecting receiving antenna 0 and receiving antenna 1 (which is actually not a connection) is in the vertical direction, the transmitted signals from both transmitting antennas 0 and 1 are reflected by a reflective object (object or human body), and at least one receiving antenna receives the reflected signal. The millimeter-wave radar device 300 can calculate the lateral direction of arrival (e.g., horizontal direction) of the reflected signal (which can also be called the reflected signal) based on the phase difference between the signals transmitted by transmitting antennas 0 and 1 reaching the same receiving antenna. After the transmitted signal from the transmitting antenna is reflected by a reflective object (object or human body), the two receiving antennas receive the reflected signal; based on the phase difference between the reflected signals received by receiving antennas 0 and 1, the vertical direction of arrival (e.g., vertical direction) of the reflected signal is obtained. Furthermore, the direction of the reflected signal can be determined based on its lateral and longitudinal directions.

[0085] In another embodiment, the number of transmitting antennas is at least two, and the number of receiving antennas is at least two. Taking two transmitting antennas—transmitting antenna 0 and transmitting antenna 1—and two receiving antennas—receiving antenna 0 and receiving antenna 1—as an example, assuming the line connecting transmitting antenna 0 and transmitting antenna 1 (which is actually not a connection) is in the longitudinal direction, and the line connecting receiving antenna 0 and receiving antenna 1 (which is actually not a connection) is in the transverse direction, the transmitted signals from the two transmitting antennas are reflected by a reflective object (object or human body), and at least one receiving antenna receives the reflected signal. The millimeter-wave radar device 300 can calculate the longitudinal direction of arrival (e.g., horizontal direction) of the reflected signal (which can also be called the reflected signal) based on the phase difference between the signals transmitted by transmitting antenna 0 and transmitting antenna 1 reaching the same receiving antenna; and obtain the transverse direction of arrival (e.g., horizontal direction) of the reflected signal based on the phase difference between the reflected signals received by receiving antenna 0 and receiving antenna 1. Furthermore, the direction of arrival of the reflected signal can be determined based on the transverse and longitudinal directions.

[0086] In another implementation, the number of transmitting antennas is at least three, and the number of receiving antennas is at least one. Taking three transmitting antennas—transmitting antenna 0, transmitting antenna 1, and transmitting antenna 2—and one receiving antenna—receiving antenna 0—as an example, transmitting antennas 0, 1, and 2 are arranged in a triangle. Assume that the line connecting transmitting antenna 0 and 1 (which is not actually a line) is in the transverse direction (e.g., horizontal), and the line connecting transmitting antenna 0 and 2 (which is not actually a line) is in the longitudinal direction. The transmitted signals from transmitting antennas 0, 1, and 2 are reflected by reflective objects (objects or human bodies), and the reflected signals are received by receiving antenna 0. The millimeter-wave radar device 300 can calculate the lateral direction of the transmitted signal (also known as the reflected signal) based on the phase difference between the signals transmitted by transmitting antenna 0 and transmitting antenna 1 reaching the same receiving antenna; and calculate the longitudinal direction of the transmitted signal (also known as the reflected signal) based on the phase difference between the signals transmitted by transmitting antenna 0 and transmitting antenna 2 reaching the same receiving antenna.

[0087] It is understood that the millimeter-wave radar device 300 may also include other modules, such as a storage module, a communication module, a processing module, etc. Other structures can be referenced above. Figure 2 The description of the relevant modules in the vehicle terminal 100 shown is not repeated here. In some other embodiments, the millimeter-wave radar device 300 may also be integrated into the vehicle terminal 100, and this application does not limit this.

[0088] The mobile terminal 400 described above includes a UWB module for implementing the function of a UWB tag. The UWB module of the mobile terminal 400 includes at least one UWB antenna for receiving or transmitting UWB signals. Other structures of the mobile terminal 400 can refer to the structure of the vehicle-mounted terminal 100. It is understood that the mobile terminal 400 may include more or fewer components than the vehicle-mounted terminal 100, or combine some components, or split some components, or have different component arrangements. This application does not limit the structure of the mobile terminal 400.

[0089] The technical solutions provided in the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0090] Figure 5 This is a flowchart illustrating a method for in-vehicle application flow provided in this application. Figure 5 As shown, the method includes:

[0091] S501, the vehicle terminal and mobile terminal 1 establish a communication connection.

[0092] When a passenger enters the vehicle with mobile terminal 1, mobile terminal 1 establishes a communication connection with the in-vehicle terminal. This communication connection can be wired or wireless. For example, a wireless connection can be Bluetooth (classic or BLE) or Wi-Fi.

[0093] In one example, mobile terminal 1 establishes a communication connection with the vehicle terminal for the first time, and the vehicle terminal requests authorization from the vehicle owner. For example, the vehicle terminal displays a relevant authorization interface or plays a voice prompt, allowing the vehicle owner to perform operations on the authorization interface (such as fingerprint authentication, facial recognition, or password authentication) or send relevant voice commands. Alternatively, the vehicle terminal sends an authorization request to mobile terminal 1 (e.g., the vehicle owner's mobile phone) linked to the vehicle owner, and the vehicle owner can also remotely authorize mobile terminal 1 through a mobile terminal already linked to the car (e.g., the vehicle owner's mobile phone). In another example, mobile terminal 1 and the vehicle terminal are not establishing a communication connection for the first time. In this case, when mobile terminal 1 approaches the vehicle terminal, mobile terminal 1 and the vehicle terminal automatically establish a communication connection and automatically complete identity authentication.

[0094] S502, the vehicle terminal receives the location of mobile terminal 1 detected by the UWB base station, and the location of passenger 1 detected by the millimeter-wave radar device.

[0095] The vehicle-mounted terminal is connected to a UWB base station, or the vehicle-mounted terminal contains a UWB module, which can be used to implement the functions of a UWB base station. This explanation will focus on an vehicle-mounted terminal connected to a UWB base station.

[0096] The vehicle-mounted terminal is also connected to a millimeter-wave radar device, or the vehicle-mounted terminal may also include a millimeter-wave radar module. The millimeter-wave radar module of the vehicle-mounted terminal can be used to measure the position and movements of passengers inside the vehicle. This explanation takes an vehicle-mounted terminal connected to a millimeter-wave radar device as an example.

[0097] In some embodiments, after mobile terminal 1 establishes a communication connection with the vehicle-mounted terminal, mobile terminal 1 sends a UWB ranging request through its own UWB module to request the UWB base station in the vehicle to measure the location of mobile terminal 1. Alternatively, the UWB base station in the vehicle continuously sends UWB measurement requests. When mobile terminal 1 receives the UWB measurement request from the UWB base station, it sends a UWB signal for the UWB base station to measure the location of mobile terminal 1. Then, the UWB base station sends the measured location of mobile terminal 1 to the vehicle-mounted terminal.

[0098] In addition, the millimeter-wave radar device inside the vehicle monitors the position of passengers in real time and sends the detected passenger positions to the vehicle terminal. Optionally, the millimeter-wave radar device can also monitor passenger actions, such as putting down or picking up mobile terminal 1. Optionally, the millimeter-wave radar device can also track passenger positions in real time to determine whether passengers have changed seats or returned to the vehicle after leaving it.

[0099] S503. When the location of mobile terminal 1 and the location of passenger 1 belong to the same seating area, the vehicle terminal establishes a correspondence between mobile terminal 1 and passenger 1, and establishes a correspondence between passenger 1 and seat 1 based on the location of passenger 1.

[0100] In some embodiments, when the location of mobile terminal 1 and the location of passenger 1 belong to the same seating area, it can be determined that mobile terminal 1 is a device carried by passenger 1, and a correspondence between mobile terminal 1 and passenger 1 can be established. It is understood that when passenger 1 first enters the vehicle, they are carrying mobile terminal 1. Therefore, the location of mobile terminal 1 detected by the UWB base station coincides with the location of passenger 1 detected by the millimeter-wave radar device (or belongs to the same seating area), thus establishing a correspondence between mobile terminal 1 and passenger 1. Subsequently, the location of passenger 1 will determine which display screen on the in-vehicle terminal will be redirected to by the application running on mobile terminal 1. Optionally, after passenger 1 enters the vehicle, mobile terminal 1 can be placed on another seat, meaning that the location of mobile terminal 1 may not coincide with the location of passenger 1 (or belong to a different seating area). In this case, the in-vehicle terminal will not change the correspondence between mobile terminal 1 and passenger 1 based on the location of mobile terminal 1.

[0101] Furthermore, the in-vehicle terminal can utilize millimeter-wave radar to monitor the real-time location of passenger 1, and then determine the corresponding seat based on passenger 1's location. For example, if passenger 1's current location corresponds to seat 1, then a correspondence between passenger 1 and seat 1 is established. It is understood that this application will determine the application flow on mobile terminal 1 based on passenger 1's real-time location, and redirect it to the display screen corresponding to passenger 1's real-time location, so that passenger 1 can continue using the applications on mobile terminal 1, such as watching videos played by video applications, or operating applications running on mobile terminal 1. Therefore, the millimeter-wave radar device will monitor passenger 1's location in real-time, and when passenger 1's location changes, the in-vehicle terminal will determine the corresponding seat based on the changed passenger 1 location. For example, when it detects that passenger 1's location has changed to seat 2, the correspondence between passenger 1 and seat 1 will be changed to a correspondence between passenger 1 and seat 2.

[0102] S504, The vehicle terminal sends the correspondence between passenger 1 and seat 1 to the mobile terminal 1.

[0103] Correspondingly, mobile terminal 1 receives the correspondence between passenger 1 and seat 1 sent by the vehicle terminal.

[0104] S505. When the preset conditions for application flow are met, the vehicle terminal sends an application flow instruction message to the mobile terminal 1.

[0105] In some embodiments, the preset conditions for application flow include detecting that passenger 1 performs a preset action. For example, when mobile terminal 1 is a mobile phone, the preset action could be passenger 1 putting down the phone, or passenger 1 placing the phone on a phone holder. Or, for example, when mobile terminal 1 is a smartwatch and the smartwatch is worn on passenger 1's wrist, the preset action could be passenger 1 placing their wrist on the steering wheel (driving), or passenger 1 not raising their wrist. For example, after detecting passenger 1, the millimeter-wave radar device continuously monitors passenger 1's state (including passenger 1's actions and position changes). When the millimeter-wave radar device detects passenger 1 putting down mobile terminal 1, the vehicle terminal sends an application flow instruction message to mobile terminal 1.

[0106] In other embodiments, after the vehicle terminal determines the correspondence between passenger 1 and seat 1, it can display a user prompt on the screen corresponding to seat 1 or play a voice prompt, asking the user whether they agree to application flow. Upon receiving a user's action of agreeing to application flow on the screen, or upon receiving a user's voice input agreeing to application flow, the vehicle terminal sends an application flow instruction message to mobile terminal 1. In this example, the preset conditions for meeting the application flow include receiving a user's action of agreeing to application flow on the screen, or receiving a user's voice input agreeing to application flow, etc.

[0107] In some other embodiments, if a user (such as passenger 1 or vehicle owner) enables the automatic application flow function on the in-vehicle terminal, then the in-vehicle terminal sends an application flow instruction message to mobile terminal 1. In this example, the preset conditions for application flow include that the user has previously enabled the automatic application flow function on the in-vehicle terminal.

[0108] It should be noted that step S505 can be executed after, before, or simultaneously with step S504, and this application embodiment does not limit this.

[0109] It should also be noted that "application flow" in the embodiments of this application can also be expressed as "interface flow," "screen sharing," "combined display," "screen collaboration," "component collaboration," "distributed display," "page separation," "collaborative interaction," "screen splicing," "collaborative display," and other terms. In short, the definition of "application flow" in the embodiments of this application does not constitute a special limitation on the technical solutions provided in the embodiments of this application.

[0110] S506. Based on the correspondence between passenger 1 and seat 1, mobile terminal 1 requests the hardware capabilities corresponding to seat 1 from the vehicle terminal.

[0111] The hardware capabilities corresponding to seat 1 include, but are not limited to, the identification of the display screen corresponding to seat 1 and its display parameters (e.g., display resolution), the identification of the camera corresponding to seat 1 and its video parameters (e.g., video output mode, capture rate, frame rate), and the identification of the audio device corresponding to seat 1 and its audio parameters (e.g., audio encoding method, bit rate, sampling rate, channels). The display screen corresponding to seat 1 is, for example, the display screen in front of seat 1. The camera corresponding to seat 1 is, for example, a camera in front of seat 1, or a camera capable of capturing images of the area where seat 1 is located. The audio device corresponding to seat 2 is, for example, an audio device that can provide specific audio playback effects for passengers in the area where seat 1 is located, and / or a device that captures audio from passengers in the area where seat 1 is located. In some examples, the audio device corresponding to seat 1 is not necessarily deployed in the area where seat 1 is located. For example, if seat 1 is any of the rear seats, the audio device corresponding to seat 1 may be one or two audio devices located in the rear row near the side doors.

[0112] In some embodiments, after receiving an application transfer instruction message from the vehicle-mounted terminal, mobile terminal 1 requests the hardware capabilities corresponding to seat 1 from the vehicle-mounted terminal based on the correspondence between passenger 1 and seat 1. Optionally, in some examples, after receiving the application transfer instruction message from the vehicle-mounted terminal, mobile terminal 1 may also display a user prompt, asking passenger 1 whether they agree to the application transfer. After receiving the passenger 1's indication of agreement to the application transfer, mobile terminal 1 requests the hardware capabilities corresponding to seat 1 from the vehicle-mounted terminal.

[0113] In some other embodiments, if passenger 1 has enabled the automatic transfer function of the application on mobile terminal 1, then in step S504, after mobile terminal 1 receives the correspondence between passenger 1 and seat 1 sent by the vehicle terminal, mobile terminal 1 can also directly request the hardware capabilities corresponding to seat 1 from the vehicle terminal. That is, after step S504, step S505 is not executed, and step S506 is executed directly.

[0114] S507, The vehicle terminal returns the hardware capabilities corresponding to seat 1 to the mobile terminal 1.

[0115] Correspondingly, mobile terminal 1 receives the hardware capabilities corresponding to seat 1 returned by the vehicle terminal.

[0116] Optionally, when the vehicle-mounted terminal receives a request from mobile terminal 1 for the hardware capabilities corresponding to seat 1, it may display a user prompt, asking the user whether they agree to allow mobile terminal 1 to access the hardware capabilities corresponding to seat 1. In some examples, the vehicle-mounted terminal may display the user prompt on a display screen in front of the driver, or provide a voice prompt requesting the driver's authorization. Alternatively, the vehicle-mounted terminal may also display the user prompt on a display screen in front of seat 1, requesting authorization from the passenger in front of seat 1. Alternatively, the vehicle-mounted terminal may also send the user prompt to a mobile terminal (e.g., the owner's mobile phone) that the owner has bound, requesting the owner's authorization. This application embodiment does not limit the method of user prompting.

[0117] S508, during the operation of application A, mobile terminal 1 calls upon the hardware capabilities corresponding to seat 1.

[0118] In some embodiments, both the mobile terminal 1 and the vehicle terminal can be equipped with the HarmonyOS operating system, enabling cross-device application flow based on the distributed soft bus technology of the HarmonyOS operating system. The distributed soft bus provides a unified distributed communication capability for interconnection between multiple terminals, creating conditions for seamless discovery and zero-wait transmission between terminals.

[0119] For example, after the mobile terminal receives the hardware capabilities corresponding to seat 1, it will utilize these capabilities while running application A. This includes, for instance, displaying the application interface of application A on the screen corresponding to seat 1, and / or capturing images of the area where seat 1 is located using the camera corresponding to seat 1, and / or playing the current application using the audio device corresponding to seat 1. Understandably, when passenger 1 is seated in seat 1, the interface of application A running on mobile terminal 1 is displayed on the screen corresponding to seat 1 (the screen closest to passenger 1), facilitating passenger 1's viewing and execution of related application operations. The camera corresponding to seat 1 can capture images of the area where seat 1 is located (including passenger 1), eliminating the need for passenger 1 to lift the mobile terminal 1 or adjust their posture, thus improving the application user experience. The audio device corresponding to seat 1 ensures a good audio experience for passenger 1 while seated in seat 1.

[0120] In summary, as passenger 1 enters the vehicle, the application on passenger 1's mobile terminal 1 can be automatically transferred to the in-vehicle terminal, specifically to the hardware on the in-vehicle terminal corresponding to passenger 1's seat, bringing passenger 1 an immersive application experience.

[0121] In other embodiments, after mobile terminal 1 transfers application A to the in-vehicle terminal, mobile terminal 1 may display an interface prompt indicating that application A has been transferred to the in-vehicle terminal or play a voice prompt indicating that application A has been transferred to the in-vehicle terminal. Afterward, mobile terminal 1 will no longer display the interface of application A. Optionally, mobile terminal 1 may also turn off the screen after a preset time (e.g., 1 minute), but this embodiment does not limit this.

[0122] It should also be noted that steps S506 to S508 above illustrate the process of mobile terminal 1 calling the hardware capabilities corresponding to seat 1 on the vehicle terminal to realize the application flow from mobile terminal 1 to the vehicle terminal. In some other embodiments, other technical solutions can also be used to realize the application flow from mobile terminal 1 to the vehicle terminal.

[0123] For example, steps S506 to S508 above can be replaced by steps S601 to S602, such as... Figure 6 The diagram shown is a schematic representation of another application flow method provided in this application embodiment. The method includes the above-mentioned steps S501 to S503, step S505, and steps S601 to S602, as follows:

[0124] For details regarding steps S501 to S503 and step S505, please refer to the descriptions above; they will not be repeated here.

[0125] S601, Mobile terminal 1 sends information about the currently running application A to the vehicle terminal.

[0126] Correspondingly, the vehicle terminal receives information about application A sent by mobile terminal 1.

[0127] S602, The vehicle terminal starts application A based on the information from application A. Furthermore, during the operation of application A, the vehicle terminal utilizes the hardware capabilities corresponding to seat 1.

[0128] The information for application A includes one or more of the following: application A's identifier, running status, and background snapshots.

[0129] In some embodiments, application A is pre-installed on the vehicle terminal. When the vehicle terminal receives the identifier of application A sent by mobile terminal 1, it launches application A on the vehicle terminal. Optionally, the vehicle terminal also receives the running status of application A sent by mobile terminal 1. Then, application A on the vehicle terminal continues running from the running status of application A on mobile terminal 1, achieving a seamless transfer of application A from mobile terminal 1 to the vehicle terminal. Optionally, the vehicle terminal can also receive a background snapshot of application A sent by mobile terminal 1. The vehicle terminal can then directly use the background snapshot of application A to speed up the running rate of application A and quickly update the running status of application A.

[0130] Furthermore, during the operation of application A on the in-vehicle terminal, the terminal utilizes the hardware capabilities corresponding to seat 1. For example, it may use the display screen corresponding to seat 1 to display the application interface, and / or use the camera corresponding to seat 1 to capture images of the area where seat 1 is located, and / or use the audio device corresponding to seat 1 to play the application. Understandably, when passenger 1 is seated, the interface of application A running on mobile terminal 1 is displayed on the display screen corresponding to seat 1 (the screen closest to passenger 1), facilitating passenger 1's viewing and execution of related application operations. The camera corresponding to seat 1 can capture images of the area where seat 1 is located (including passenger 1), eliminating the need for passenger 1 to lift mobile terminal 1 or adjust their posture, thus improving the application user experience. The audio device corresponding to seat 1 ensures a good audio experience for passenger 1 while seated.

[0131] In other embodiments, application A is not pre-installed on the vehicle terminal. When the vehicle terminal receives the identifier of application A sent by mobile terminal 1, it can download the installation package of application A from the network, install and launch application A. Other details are as described above and will not be repeated here.

[0132] Additionally, it should be noted that after mobile terminal 1 transfers application A to the in-vehicle terminal, mobile terminal 1 may display an interface prompt indicating that application A has been transferred to the in-vehicle terminal or play a voice prompt indicating that application A has been transferred to the in-vehicle terminal. Afterward, mobile terminal 1 will no longer display the interface of application A. Optionally, mobile terminal 1 may also turn off the screen after a preset time (e.g., 1 minute), but this embodiment does not limit this.

[0133] In summary, the embodiments of this application do not limit the specific process of application flow from mobile terminal 1 to vehicle terminal.

[0134] In some embodiments of this application, the vehicle-mounted terminal can continuously detect the actions of passenger 1 using a millimeter-wave radar device. When it detects that passenger 1 picks up mobile terminal 1 or continues to operate mobile terminal 1, the vehicle-mounted terminal can transfer application A from the vehicle-mounted terminal back to the mobile terminal. In some examples, the vehicle-mounted terminal instructs mobile terminal 1 to end the application transfer. In this case, mobile terminal 1 no longer calls the hardware capabilities of the vehicle-mounted terminal, but directly calls its own hardware capabilities, thereby realizing the transfer of application A back to mobile terminal 1. In other examples, the vehicle-mounted terminal can send information about application A on the vehicle-mounted terminal (the identifier of application A, its current running status, background services, etc.) to mobile terminal 1, so that mobile terminal 1 can continue running application A, thereby realizing the transfer of application A back to mobile terminal 1. Thus, it can be seen that the vehicle-mounted terminal can use a millimeter-wave radar device to detect the actions of passenger 1, infer the passenger 1's intention (to transfer the application to the vehicle-mounted terminal or to mobile terminal 1) from the passenger 1's actions, and thus realize the automatic transfer of the application according to the intention.

[0135] In some embodiments of this application, the vehicle-mounted terminal can continuously detect the position of passenger 1 using a millimeter-wave radar device. When a change in the position of passenger 1 is detected, such as when the passenger moves from seat 1 to seat 2, the vehicle-mounted terminal can update the correspondence between passenger 1 and seat 2, for example, updating the correspondence between passenger 1 and seat 1 to passenger 1 and seat 2. In some examples, the vehicle-mounted terminal sends the correspondence between passenger 1 and seat 2 to mobile terminal 1. Then, mobile terminal 1 requests the hardware capabilities corresponding to seat 2 from the vehicle-mounted terminal based on the correspondence between passenger 1 and seat 2. Furthermore, during the operation of application A, the vehicle-mounted terminal invokes the hardware capabilities corresponding to seat 2. For example, it invokes the display screen corresponding to seat 2 to display the relevant application interface of application A, and / or invokes the camera corresponding to seat 2 to capture images of the area where seat 2 is located, and / or invokes the audio device corresponding to seat 2 to play the sound of application A. Therefore, when passenger 1 changes seats in the vehicle, the in-vehicle terminal automatically transfers application A from the hardware corresponding to the previous seat to the hardware corresponding to the new seat. The user is unaware of the transfer process, providing an immersive application experience.

[0136] In some embodiments of this application, the vehicle-mounted terminal can continuously detect the location of passenger 1 using a millimeter-wave radar device. When passenger 1 is detected to have exited the vehicle, the vehicle-mounted terminal can instruct mobile terminal 1 to terminate the application flow. In some examples, mobile terminal 1 no longer calls the hardware capabilities of the vehicle-mounted terminal, but directly calls the hardware capabilities of mobile terminal 1 itself, thereby realizing the flow of application A back to mobile terminal 1. In other examples, the vehicle-mounted terminal can send the information of application A on the vehicle-mounted terminal (the identifier of application A, its current running status, background services, etc.) to mobile terminal 1, so that mobile terminal 1 can continue running application A, thereby realizing the flow of application A back to mobile terminal 1.

[0137] In some other embodiments of this application, if passenger 1 returns to the vehicle shortly after exiting (changing seats or not), the vehicle-mounted terminal can re-establish the correspondence between mobile terminal 1 and passenger 1, as well as the correspondence between passenger 1 and their current seat, based on the location of mobile terminal 1 detected by the UWB base station and the location of passenger 1 detected by the millimeter-wave radar device. The application on the mobile terminal can then be routed to the hardware corresponding to the specific seat. This process can be referred to the above. Figure 5 or Figure 6 The relevant content will not be described again here.

[0138] The following example uses a mobile phone as the mobile terminal and the application is transferred across different displays on an in-vehicle terminal to illustrate the technical solution provided in the embodiments of this application.

[0139] like Figure 7 As shown, when passenger 1 enters the driver's seat of the car with mobile phone 1, mobile phone 1 establishes a communication connection with the vehicle's in-vehicle terminal. Furthermore, mobile phone 1 is equipped with a UWB module, enabling it to function as a UWB tag. The UWB base station (not shown in the figure) inside the car can then measure the location of mobile phone 1. The millimeter-wave radar device (not shown in the figure) inside the car can detect the location of passenger 1. Since passenger 1's location overlaps with the location of mobile phone 1, belonging to the same seating area, the in-vehicle terminal establishes a correspondence between mobile phone 1 and passenger 1. Further, the in-vehicle terminal establishes a correspondence between passenger 1 and the driver's seat. The millimeter-wave radar device continuously monitors passenger 1's actions. When it detects that passenger 1 puts down mobile phone 1 (e.g., placing mobile phone 1 on the passenger seat), the in-vehicle terminal can instruct mobile phone 1 to transfer its running applications (e.g., calling applications or navigation applications) to the display screen (such as screen 1) in front of the driver's seat.

[0140] Optionally, the in-vehicle millimeter-wave radar device continuously monitors the position and movements of passenger 1. When the millimeter-wave radar device detects that passenger 1 picks up mobile phone 1, the in-vehicle terminal can switch the application displayed on the screen in front of the driver (such as screen 1) back to mobile phone 1.

[0141] When passenger 2 enters the back seat 2 with mobile phone 2, similar to the previous steps, the in-vehicle terminal establishes a correspondence between passenger 2 and mobile phone 2, and also establishes a correspondence between passenger 2 and back seat 2. Then, when it detects that passenger 2 puts down mobile phone 2 (e.g., puts mobile phone 2 in a pocket), the in-vehicle terminal can instruct mobile phone 2 to transfer the application running on it (e.g., a calling application, or a navigation application, etc.) to the display screen (such as screen 4) in front of the back seat 2.

[0142] The vehicle's in-vehicle millimeter-wave radar continuously monitors the position and movements of passenger 1 and passenger 2.

[0143] like Figure 8 As shown, when the millimeter-wave radar device detects that passenger 2 has moved from rear seat 2 to rear seat 1, the application displayed on the display screen (such as screen 4) in front of the vehicle terminal rear seat 2 is transferred to the display screen (such as screen 3) in front of the rear seat 1.

[0144] like Figure 9 As shown, when the millimeter-wave radar device detects that passenger 2 is exiting the vehicle from the rear seat 1, the onboard terminal can redirect the application displayed on the screen (such as screen 3) in front of the rear seat 1 back to mobile phone 2. In some examples, such as Figure 10 As shown, when passenger 2 exits from the rear seat 1 and returns to the front passenger seat, the onboard terminal re-establishes the correspondence between passenger 2 and mobile phone 2, as well as the correspondence between passenger 2 and the front passenger seat, based on the location of mobile phone 2 detected by the UWB base station and the location of passenger 2 detected by the millimeter-wave radar device. Then, the onboard terminal can instruct mobile phone 2 to transfer its running applications (e.g., calling applications or navigation applications) to the display screen (such as screen 2) in front of the front passenger seat.

[0145] In some other examples, if a millimeter-wave radar device is also installed on the outside of the car, when passenger 2 gets out of the rear seat 1 and returns to the front passenger seat within a preset time (e.g., 3 minutes), the millimeter-wave radar device on the outside of the car can continuously track the position change of passenger 2. Then the vehicle terminal can directly transfer the application displayed on the display screen (e.g., screen 3) in front of the rear seat 1 back to the display screen (e.g., screen 2) in front of the front passenger seat.

[0146] This application also provides a chip system, such as... Figure 11As shown, the chip system includes at least one processor 1101 and at least one interface circuit 1102. The processor 1101 and the interface circuit 1102 are interconnected via wiring. For example, the interface circuit 1102 can be used to receive signals from other devices (e.g., the memory of the vehicle terminal 100). As another example, the interface circuit 1102 can be used to send signals to other devices (e.g., the processor 1101). Exemplarily, the interface circuit 1102 can read instructions stored in the memory and send those instructions to the processor 1101. When the instructions are executed by the processor 1101, the electronic device can perform the various steps executed by the vehicle terminal 100 in the above embodiments. Of course, the chip system may also include other discrete components, which are not specifically limited in this application embodiment.

[0147] This application also provides an apparatus included in a vehicle-mounted terminal / mobile terminal, which has the function of implementing the behavior of the vehicle-mounted terminal / mobile terminal in any of the methods described in the above embodiments. This function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes at least one module or unit corresponding to the above function. For example, a detection module or unit, a display module or unit, a determination module or unit, and a calculation module or unit, etc.

[0148] This application also provides a computer storage medium including computer instructions that, when executed on an electronic device, cause the electronic device to perform any of the methods described in the above embodiments.

[0149] This application also provides a computer program product that, when run on a computer, causes the computer to perform any of the methods described in the above embodiments.

[0150] It is understood that the aforementioned vehicle-mounted terminals / mobile terminals, etc., include corresponding hardware structures and / or software modules for performing each function in order to achieve the above-mentioned functions. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein, the embodiments of this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this invention.

[0151] This application embodiment can divide the above-mentioned vehicle terminal / mobile terminal, etc., into functional modules according to the above method examples. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0152] Through the above description of the embodiments, those skilled in the art will clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device, and unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0153] In the embodiments of this application, the functional units can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0154] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as flash memory, portable hard disk, read-only memory, random access memory, magnetic disk, or optical disk.

[0155] It should be noted that all or part of any step or feature in the various embodiments of this application can be freely combined, and the combined technical solution is also within the scope of this application. The technical solution of this application is not limited to vehicles; it can be applied to any means of transportation (such as trains, airplanes, etc.).

[0156] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A system for in-vehicle application flow, characterized in that, It includes a mobile terminal, a vehicle-mounted terminal, an ultra-wideband (UWB) base station, and a millimeter-wave radar device; wherein the vehicle-mounted terminal includes at least two displays. The vehicle-mounted terminal is used to receive the first location of the mobile terminal sent by the UWB base station, and to receive the second location of the first passenger sent by the millimeter-wave radar device. The vehicle-mounted terminal is further configured to establish a first correspondence between the mobile terminal and the first passenger when the first position and the second position belong to the same seating area; and to establish a second correspondence between the first passenger and the first seat when the second position of the first passenger corresponds to the area of ​​the first seat. The vehicle-mounted terminal is also used to send the second correspondence relationship to the mobile terminal; The mobile terminal is used to transfer the first application running on the mobile terminal to the first display screen on the vehicle terminal according to the second correspondence relationship, wherein the first display screen is the display screen corresponding to the first seat.

2. The system according to claim 1, characterized in that, The vehicle-mounted terminal is also used to send a first message to the mobile terminal when a first preset condition is met; The mobile terminal, according to the second correspondence, transfers the first application running on the mobile terminal to the first display screen on the vehicle terminal, specifically including: In response to receiving the first message, the mobile terminal requests information from the vehicle terminal about the first display screen corresponding to the first seat; The mobile terminal invokes the first display screen to display the interface of the first application running on the mobile terminal based on the information from the first display screen.

3. The system according to claim 1, characterized in that, The vehicle-mounted terminal is also used to send a first message to the mobile terminal when a first preset condition is met; According to the second correspondence, the mobile terminal transfers the first application running on the mobile terminal to the first display screen on the in-vehicle terminal. The first display screen is a display screen corresponding to the first seat, specifically including: In response to receiving the first message, the mobile terminal sends information about the first application running on the mobile terminal to the vehicle terminal. The vehicle terminal launches the first application on the vehicle terminal according to the information of the first application, and calls the first display screen to display the interface of the first application according to the second correspondence.

4. The system according to any one of claims 1-3, characterized in that, The vehicle-mounted terminal is also used to receive a second message sent by the millimeter-wave radar device that meets a first preset condition, the first preset condition including the millimeter-wave radar device detecting the action of the first passenger putting down the mobile terminal.

5. The system according to any one of claims 1-3, characterized in that, The mobile terminal is also used to stop transferring the first application to the first display screen on the vehicle terminal when the second preset condition is met. Alternatively, the vehicle terminal is further configured to stop transferring the first application to the first display screen on the vehicle terminal when a second preset condition is met.

6. The system according to claim 5, characterized in that, The vehicle-mounted terminal is also configured to receive a third message sent by the millimeter-wave radar device that satisfies the second preset condition, the second preset condition including: the millimeter-wave radar device detects the action of the first passenger picking up the mobile terminal; or, detects the first passenger leaving the vehicle.

7. The system according to any one of claims 1-3, characterized in that, The vehicle terminal is also used to establish a third correspondence between the first passenger and the second seat when the second position of the first passenger corresponds to the area of ​​the second seat; The vehicle-mounted terminal is also used to send the third correspondence relationship to the mobile terminal; The mobile terminal is further configured to transfer the first application displayed on the first display screen of the vehicle terminal to the second display screen of the vehicle terminal according to the third correspondence relationship, wherein the second display screen is the display screen corresponding to the second seat.

8. A method for in-vehicle application circulation, characterized in that, The device is used in vehicle-mounted terminals, which establish wired or wireless connections with mobile terminals, UWB base stations, and millimeter-wave radar devices, respectively; and the vehicle-mounted terminal includes at least two displays. The vehicle-mounted terminal receives the first location of the mobile terminal sent by the UWB base station, and receives the second location of the first passenger sent by the millimeter-wave radar device. When the first position and the second position belong to the same seating area, the vehicle terminal establishes a first correspondence between the mobile terminal and the first passenger; when the second position of the first passenger corresponds to the area of ​​the first seat, the vehicle terminal establishes a second correspondence between the first passenger and the first seat. The vehicle-mounted terminal sends the second correspondence to the mobile terminal; The second correspondence is used for the mobile terminal to transfer the first application running on the mobile terminal to the first display screen on the vehicle terminal, where the first display screen is the display screen on the vehicle terminal corresponding to the first seat.

9. The method according to claim 8, characterized in that, Also includes: When the first preset condition is met, the vehicle terminal sends a first message to the mobile terminal; The first message is used to notify the mobile terminal to start the application flow; The mobile terminal sends a first request, which requests information from the first display screen corresponding to the first seat. The mobile terminal returns information about the first display screen corresponding to the first seat. The information about the first display screen is used by the mobile terminal to call the first display screen of the vehicle terminal to display the interface of the first application running on the mobile terminal.

10. The method according to claim 8, characterized in that, Also includes: When the first preset condition is met, the vehicle terminal sends a first message to the mobile terminal; The first message is used to notify the mobile terminal to start the application flow; Receive information from the first application sent by the mobile terminal; The vehicle terminal launches the first application on the vehicle terminal according to the information of the first application, and calls the first display screen to display the interface of the first application according to the second correspondence.

11. The method according to claim 9 or 10, characterized in that, Before the vehicle-mounted terminal sends the first message to the mobile terminal, the method further includes: The vehicle-mounted terminal receives a second message from the millimeter-wave radar device that satisfies the first preset condition, the first preset condition including the millimeter-wave radar device detecting the action of the first passenger putting down the mobile terminal.

12. The method according to any one of claims 8-10, characterized in that, After the mobile terminal transfers the first application running on the mobile terminal to the first display screen on the vehicle terminal according to the second correspondence, the method further includes: When the second preset condition is met, the vehicle terminal stops transferring the first application from the mobile terminal to the first display screen on the vehicle terminal; or, the vehicle terminal notifies the mobile terminal to stop transferring the first application to the first display screen on the vehicle terminal.

13. The method according to claim 12, characterized in that, Before the in-vehicle terminal stops transferring the first application from the mobile terminal to the first display screen on the in-vehicle terminal, or before the in-vehicle terminal notifies the mobile terminal to stop transferring the first application to the first display screen on the in-vehicle terminal, the method further includes: The vehicle terminal receives a third message from the millimeter-wave radar device that satisfies the second preset condition. The second preset condition includes the millimeter-wave radar device detecting the action of the first passenger picking up the mobile terminal; or detecting the first passenger leaving the vehicle.

14. The method according to any one of claims 8-10, characterized in that, After the mobile terminal transfers the first application running on the mobile terminal to the first display screen on the vehicle terminal according to the second correspondence, the method further includes: When the second position of the first passenger corresponds to the area of ​​the second seat, the vehicle terminal establishes a third correspondence between the first passenger and the second seat; The vehicle-mounted terminal sends the third correspondence relationship to the mobile terminal; the third correspondence relationship is used by the mobile terminal to transfer the first application displayed on the first display screen of the vehicle-mounted terminal to the second display screen of the vehicle-mounted terminal, the second display screen being the display screen corresponding to the second seat.

15. A vehicle-mounted terminal, characterized in that, include: The system includes a processor, a memory, and a display screen, wherein the memory and the display screen are coupled to the processor, the memory being used to store computer program code, the computer program code including computer instructions, and the processor reading the computer instructions from the memory to cause the vehicle terminal to perform the application flow method as described in any one of claims 8-14.

16. A computer-readable storage medium, characterized in that, Includes computer instructions that, when executed on an in-vehicle terminal, cause the in-vehicle terminal to perform the application flow method as described in any one of claims 8-14.

17. A chip system, characterized in that, It includes one or more processors, which, when executing instructions, perform the application flow method as described in any one of claims 8-14.

Images