Interaction method based on in-vehicle central control screen and vehicle-mounted terminal

Abstract

The embodiment of the invention is suitable for the technical field of vehicles, and provides an interaction method based on an in-vehicle central control screen and a vehicle-mounted terminal, by applying the method, radar signal intensity data in an in-vehicle environment can be detected through a radar configured in the vehicle-mounted terminal, and when the vehicle-mounted terminal detects an operation acting on the central control screen, the vehicle-mounted terminal performs interaction with the central control screen. By acquiring the radar signal intensity data, the vehicle-mounted terminal can determine where the target user executing the operation is. In this way, the vehicle-mounted terminal can display the information or the interaction control on the position, relatively closer to the target user, of the central control screen, and interacts with the target user. By applying the method, the efficiency of interaction between the user and the central control screen can be improved, and the difficulty of operation on the central control screen by the user is reduced.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of vehicle technology, and in particular to an interaction method based on a central control screen in a vehicle and a vehicle-mounted terminal. Background Art

[0002] The central control screen in a vehicle is a display screen installed on the center console of the vehicle, which can be used to display car audio, navigation, vehicle information, reversing images, etc. At present, the central control screens in most vehicles are touch screens, and the driver and passengers can use gestures to operate directly on the central control screen.

[0003] When the central control screen is displaying content, the driver and passengers in the car may want to perform some operations on the central control screen. For example, input information on the central control screen. Since the central control screen is usually fixedly installed in the car, the convenience of the operation may be affected by the different positions of the driver and passengers in the process of implementing the above operations. For example, during the driving of the vehicle, navigation information can be displayed on the central control screen. If the driver and passengers want to modify the navigation destination, they need to enter the new destination information on the central control screen. This operation can be completed by the driver in the main driving position or by the passenger in the co-pilot position. However, due to the different positions, the actual experience of the driver and passengers in completing the above operations is different. The central control screen cannot be adjusted according to the actual needs of the drivers and passengers in different positions, and cannot effectively improve the convenience of the driver and passengers' operation. Summary of the invention

[0004] An interactive method and a vehicle-mounted terminal based on a central control screen in a vehicle are provided in an embodiment of the present application, which are used to identify the specific location of a user operating on the central control screen, and display information on the central control screen according to the location, so that the displayed information can be closer to the user who actually operates the central control screen, thereby improving the convenience of the user operating the central control screen.

[0005] In order to achieve the above objectives, this application adopts the following technical solutions:

[0006] In the first aspect, an embodiment of the present application provides an interaction method based on a central control screen in a vehicle, which can be applied to a vehicle-mounted terminal. The method may include the following steps: the vehicle-mounted terminal detects an operation acting on the central control screen, and based on the operation, the vehicle-mounted terminal may obtain radar signal strength data, which is obtained by a radar detection configured in the vehicle-mounted terminal. Based on the acquired radar signal strength data, the vehicle-mounted terminal may determine the target user who performs the operation, and interact with the target user at the target position of the central control screen. The target position may be a position on the central control screen close to the target user.

[0007] The embodiment of the present application configures a radar in the vehicle terminal, and can use the radar to detect objects in various positions or areas in the vehicle. Specifically, when the radar signal strength data in a certain area changes, it can be considered that there may be moving objects in the area. In the vehicle scenario, based on the signal strength data obtained by radar detection, the vehicle terminal can accurately determine the target user who performs the current operation. In this way, the vehicle terminal can distinguish whether the operation is performed by the driver in the main driving position in the car or by the passenger in the co-pilot position. By distinguishing the target user who performs the aforementioned operation, the vehicle terminal can interact with the user at a position close to the target user on the central control screen. For example, the vehicle terminal can display the corresponding information at a position close to the user for the user to view; or, the vehicle terminal can display the interactive controls at a relatively convenient position for the user to interact with the central control screen. The application of this method can improve the interaction efficiency between the user and the central control screen and reduce the difficulty of the user operating on the central control screen.

[0008] It should be noted that the central control screen is just a common name for easy understanding. It is usually used to indicate the display screen that can be operated by the front driver and the front passenger in the car, and can also refer to the display screen that can be operated by the rear seat. In addition, the "central" control screen is not used to limit the screen to be located in the "middle" in the strict mathematical sense.

[0009] In a possible implementation of the first aspect, when the vehicle-mounted terminal obtains the radar signal strength data based on the operation, it can determine a target time period, where the target time period can be a period of time ending at the time when the vehicle-mounted terminal detects the operation. The vehicle-mounted terminal can respectively obtain the radar signal strength data of multiple areas in the vehicle within the target time period.

[0010] It should be understood that the target time period is the period of time before the vehicle terminal detects the operation on the central control screen. During this period, the user in the vehicle needs to move his hand from a certain position in the vehicle to the central control screen to perform an operation on the central control screen, which will cause the radar signal strength data on the moving route to change. By obtaining the radar signal strength data in the target time period, the target user can be identified more accurately.

[0011] In a possible implementation of the first aspect, the vehicle-mounted terminal respectively obtains radar signal strength data of multiple areas in the vehicle within a target time period, including: the vehicle-mounted terminal respectively obtains a change in radar signal strength data of each area in the vehicle within the target time period.

[0012] It should be understood that the amount of change in radar signal strength data can represent the magnitude of the change in radar signal strength in each area during the target time period. By determining the magnitude of the change in radar signal strength, the change in radar signal strength caused by external influences in each area during the target time period can be accurately identified. For example, when an object moves in a certain area, the signal strength detected by the radar will change significantly. By determining the change in radar signal strength, it is possible to more conveniently identify areas that are more affected by external influences, thereby determining these areas as the areas where the user's hand moved before performing the operation, and then accurately determining the target user performing the operation.

[0013] In a possible implementation of the first aspect, the vehicle-mounted terminal respectively obtains the change in radar signal strength data of each area in the vehicle within a target time period, including: the vehicle-mounted terminal determines multiple time periods within the target time period; the vehicle-mounted terminal respectively obtains the radar signal strength data of each area in the vehicle at each time; the vehicle-mounted terminal determines the change in radar signal strength data of each area based on the radar signal strength data of each area in the vehicle at each time.

[0014] Since the target time period is a continuous period of time and may include multiple moments, by determining multiple moments in the target time period and determining the radar signal strength data at each moment, the variation of the radar signal strength data may be determined more easily.

[0015] In a possible implementation of the first aspect, before the vehicle-mounted terminal respectively obtains radar signal strength data of multiple areas in the vehicle within the target time period, the method further includes: the vehicle-mounted terminal determines multiple areas in the vehicle, wherein any area can be a sector area with a point on the central control screen as the center.

[0016] For example, a point on the central control screen may be a point on the central control screen corresponding to the installation position of the radar in the vehicle terminal. The vehicle terminal may determine an area based on the point, and the area may be the area mainly detected by the radar. In this area, the vehicle terminal may divide it into a plurality of sector areas, each of which has the same point on the central control screen as the center. When detecting the signal strength, the radar may perform detection based on each sector area.

[0017] It should be understood that the accuracy of the signal strength detected by the radar varies depending on the distance from the radar. Therefore, when the vehicle-mounted terminal determines multiple areas in the vehicle, each sector area can be divided into at least two sub-areas according to a preset distance threshold. The above distance threshold can be a distance value that distinguishes the radar detection accuracy. Among them, in the area where the distance from the radar is less than the above distance threshold, the radar detection accuracy is higher.

[0018] In a possible implementation of the first aspect, the vehicle-mounted terminal determines the target user who performs the operation based on the radar signal strength data, including: the vehicle-mounted terminal determines multiple target areas from multiple areas in the vehicle based on the radar signal strength data; wherein each target area is an area where a change in the radar signal strength data is greater than a preset threshold; the vehicle-mounted terminal determines the target user who performs the operation based on the multiple target areas.

[0019] It should be understood that the radar signal strength is more likely to change significantly in the area where the user's hand passes before performing the operation. Therefore, the area where the change in radar signal strength data is greater than the preset threshold is more likely to be the area where the user's hand passed before performing the operation. By determining multiple target areas in multiple areas in the vehicle where the change is greater than the preset threshold, it is easier to determine which areas the user's hand passed before performing the operation, so that the target user performing the operation can be determined based on the location of these target areas.

[0020] In a possible implementation of the first aspect, the vehicle terminal determines the target user who performs the operation based on multiple target areas, including: the vehicle terminal determines the position of each target area respectively, and the position may include a first position and a second position, and the first position and the second position may be located on the left and right sides of the vehicle terminal respectively. Exemplarily, the first position may be located on the left side of the vehicle terminal, and the second position may be located on the right side of the vehicle terminal. In this way, the vehicle terminal can determine the target user who performs the operation based on the number of target areas respectively located in the first position or the second position. Among them, the position where the target user is located is the same as the position where the target area with a larger number is located.

[0021] In another possible implementation of the first aspect, the vehicle-mounted terminal determines the target user who performs the operation based on the radar signal strength data, and also includes: the vehicle-mounted terminal uses a pre-trained classification model to classify the radar signal strength data; the vehicle-mounted terminal determines the target user who performs the operation based on the classification result.

[0022] It should be understood that the classification result may include the result corresponding to the radar signal strength data detected by the radar when the user in different positions performs an operation on the central control screen. Therefore, when the vehicle terminal determines the target user for performing the operation according to the classification result, it can determine the user in the position as the target user for performing the operation according to the position corresponding to the classification result.

[0023] Exemplarily, the signal strength data detected by the radar when the driver in the main driving seat operates on the central control screen, and the signal strength data detected by the radar when the passenger in the co-pilot seat operates on the central control screen can be used as label data respectively. By performing machine learning on the label data, a classification model can be trained, and the classification model can classify the signal strength data detected by the radar to obtain which type of label data the currently detected signal strength data is more similar to. In this way, the type of the currently detected signal strength data can be determined according to the similarity with the label data, so as to determine who is the target user performing the operation. For example, if the currently detected radar signal strength data is more similar to the signal strength data detected by the radar when the driver in the main driving seat operates on the central control screen, it can be determined that the driver in the main driving seat is currently performing the operation on the central control screen; conversely, if the currently detected radar signal strength data is more similar to the signal strength data detected by the radar when the passenger in the co-pilot seat operates on the central control screen, it can be determined that the passenger in the co-pilot seat is currently performing the operation on the central control screen.

[0024] In a possible implementation of the first aspect, the vehicle terminal interacts with the target user at a target position of the central control screen, including: the vehicle terminal determines target content to be displayed corresponding to the operation; and the vehicle terminal displays the target content at the target position.

[0025] It should be understood that the target content to be displayed corresponding to the user's operation on the central control screen may include videos, information, interactive controls and other content. The vehicle-mounted terminal can display the target content to be displayed at a position on the central control screen that is closer to the target user. In this way, the target user can interact with the central control screen more conveniently. For example, if the target content to be displayed is content such as videos or information, displaying these contents at a position closer to the target user can enable the target user to obtain a better field of view and more easily view the above content clearly. For another example, if the target content to be displayed is an interactive control that requires user operation, displaying these interactive controls at a position closer to the target user can facilitate the user's operation and reduce the distance the user's hand moves when operating.

[0026] In a possible implementation of the first aspect, the vehicle terminal displays the target content at the target position, including: the vehicle terminal splits the content displayed on the central control screen; and the vehicle terminal displays the target content on the screen near the target user after the split screen. By displaying different contents on the split screen, mutual interference between the target content to be displayed and other contents displayed on the central control screen can be prevented, thereby satisfying the viewing needs of the driver in the main driving seat and the passenger in the co-pilot seat for different contents.

[0027] In a second aspect, an embodiment of the present application provides an interactive device based on a central control screen in a vehicle, which can be applied to a vehicle-mounted terminal and may include the following modules:

[0028] A detection module, used to detect operations performed on the central control screen;

[0029] An acquisition module, used to acquire radar signal strength data based on the detected operation, wherein the radar signal strength data is obtained by detecting a radar configured in the vehicle-mounted terminal;

[0030] A determination module, used to determine a target user for performing an operation based on radar signal strength data;

[0031] The interaction module is used to interact with the target user at the target position of the central control screen, and the above-mentioned target position is a position on the central control screen close to the target user.

[0032] In a third aspect, an embodiment of the present application provides an interactive device based on an in-vehicle central control screen, which may be a vehicle-mounted terminal for implementing the various methods of the first aspect described above.

[0033] In a fourth aspect, a vehicle-mounted terminal is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, an interaction method based on the in-vehicle central control screen as described in any one of the first aspects above is implemented.

[0034] In a fifth aspect, a computer-readable storage medium is provided, wherein computer instructions are stored in the computer-readable storage medium, and when the computer instructions are executed on a terminal or a computer, the terminal or the computer executes the above-mentioned related method steps to implement the interaction method based on the in-vehicle central control screen as described in any one of the above-mentioned first aspects. Exemplarily, the terminal may be a vehicle-mounted terminal.

[0035] In a sixth aspect, a computer program product is provided, which, when executed on a terminal or a computer, enables the terminal or the computer to execute the above-mentioned related steps to implement the interaction method based on the in-vehicle central control screen as described in any one of the above-mentioned first aspects. Exemplarily, the terminal may be a vehicle-mounted terminal.

[0036] In a seventh aspect, a chip is provided, the chip comprising a memory and a processor, the processor executing a computer program stored in the memory to implement the interaction method based on the in-vehicle central control screen as described in any one of the first aspects above. Exemplarily, the chip can be applied to a vehicle-mounted terminal. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0038] Figure 2 is a schematic diagram of the installation position of a radar provided in an embodiment of the present application;

[0039] Figure 3 It is a schematic diagram of the signal transmission and transmission process of a millimeter wave radar provided in an embodiment of the present application;

[0040] Figure 4 This is a schematic diagram of a millimeter wave radar flight distance estimation provided in an embodiment of the present application;

[0041] Figure 5(a) to Figure 5(c) is a schematic diagram of a millimeter wave radar detection area provided in an embodiment of the present application;

[0042] Figure 6 is a schematic diagram of operating a central control screen provided in an embodiment of the present application;

[0043] Figure 7 is a schematic diagram of a change in radar signal strength data provided by an embodiment of the present application;

[0044] Figure 8(a) to Figure 8(c) is a schematic diagram of the intensity change of radar signals in each sub-area detected by the millimeter-wave radar under different conditions provided in an embodiment of the present application;

[0045] Figure 9(a) to Figure 9(d) It is a schematic diagram of a split-screen display of a vehicle-mounted terminal provided in an embodiment of the present application;

[0046] Figure 10(a) to Figure 10(f) It is a schematic diagram of an operation process of displaying an input box on a central control screen provided by an embodiment of the present application;

[0047] Fig.11 It is a flowchart of an interactive method based on a central control screen in a vehicle provided in an embodiment of the present application;

[0048] Fig.12 It is a flowchart of an interactive method based on a central control screen in a vehicle provided in an embodiment of the present application;

[0049] Fig.13 It is a schematic diagram of an interactive device based on an in-vehicle central control screen provided in an embodiment of the present application. DETAILED DESCRIPTION

[0050] In order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second" and the like are used to distinguish the same items or similar items with substantially the same functions and effects. For example, the first area, the second area, etc. are only used to distinguish different locations in the vehicle and do not impose any other limitations thereon.

[0051] It should be noted that, in the embodiments of the present application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0052] The business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Ordinary technicians in this field can know that with the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0053] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0054] The steps involved in the interactive method based on the in-vehicle central control screen provided in the embodiment of the present application are only examples. Not all steps must be executed, or not all contents in each step are mandatory. They can be increased or reduced as needed during use.

[0055] The same step or steps or contents with the same functions in different embodiments of the present application can be referenced to each other.

[0056] The central control screen in the vehicle can be used to display navigation information and provide a guide for the driver during the driving process; the central control screen can also be used to play movies, music and other entertainment information to add fun to the driver and passengers. The central control screen is usually touchable, and the driver and passengers can operate on the central control screen through gestures to interact with the central control screen. For example, when the central control screen displays navigation information, if the driver wants to change the navigation destination, the driver can enter the new destination information on the central control screen, and the central control screen can re-plan the driving route according to the new destination information and display the new route on the screen. Or, when the central control screen plays a movie, if the passenger wants the central control screen to play another movie, the passenger can enter the name of the new movie on the central control screen to search. Then, the central control screen can play the new movie found.

[0057] Usually, the installation position of the central control screen in the car is fixed. For example, the central control screen can be installed between the front main and co-driver seats. In this way, the driver in the main driving seat and the passenger in the co-driver seat can both operate on the central control screen. However, the actual experience of the driver in the main driving seat and the passenger in the co-driver seat when operating the central control screen is not the same. For example, if the main driving seat is located on the left side of the car, when displaying navigation information and other content, the driver prefers that the navigation information can be displayed in the area relatively close to the right of the central control screen, so that the driver's field of vision will be better. However, if the driver needs to operate on the central control screen, for example, the driver enters text on the central control screen through the input box, if the corresponding operation area can be located at a relatively left position of the central control screen, since the position is closer to the driver's hand, operating the central control screen at this position can also reduce the driver's operating difficulty. On the other hand, for the passenger in the co-driver seat, due to the different positions, the passenger's operation requirements for the central control screen are opposite to those of the driver. For example, if a passenger wants to enter text on the central control screen, the passenger prefers that the corresponding input box can be displayed at a relatively right position of the central control screen.

[0058] At present, when the central control screen in the car displays various types of information or responds to the interactive needs of the driver and passengers, it displays content or interactive controls in a fixed area, and cannot be automatically adjusted according to the actual needs of the driver and passengers, requiring the driver or passenger to manually switch the control position. In response to the above problems, the embodiment of the present application provides an interactive method based on the central control screen in the car. By applying this method, the central control screen can display the corresponding content or controls in different positions of different central control screens according to the actual position of the driver and passenger operating on the screen. For example, when the driver in the left main driving seat in the car wants to enter text on the central control screen to change the navigation destination, the input box displayed on the central control screen can be located at a relatively left position on the screen to reduce the distance the driver's hand moves; when the passenger in the right co-pilot seat in the car wants to enter text on the central control screen to find a movie, the input box displayed on the central control screen can be located at a relatively right position on the screen. In this way, it is more convenient for passengers to input. By applying this method, it can be convenient for drivers and passengers, reduce the difficulty of operating the central control screen, and improve the convenience of drivers and passengers to operate the central control screen.

[0059] The interactive method provided in the embodiment of the present application can be applied to a vehicle-mounted terminal with a display screen, and the display screen of the vehicle-mounted terminal can be used as an in-vehicle central control screen in a vehicle-mounted scenario. That is, the executor of the embodiment of the present application can be a vehicle-mounted terminal, and the vehicle-mounted terminal can accurately identify the position of the driver and passenger operating the central control screen by implementing the various steps in this method, thereby displaying the information, content or interactive controls to be displayed in an area closer to the position of the driver and passenger. When the central control screen of the embodiment of the present application identifies the position of the driver and passenger operating the central control screen, it can be implemented based on a radar installed in the central control screen. Exemplarily, the above-mentioned radar can be a millimeter wave radar.

[0060] The vehicle-mounted terminal in the embodiment of the present application may be an electronic device equipped with a radar. Alternatively, when a mobile phone, tablet computer or other device has a radar installed inside, its screen may also be used as the aforementioned central control screen in the vehicle-mounted scenario. The embodiment of the present application does not limit this.

[0061] For example, Figure 1 FIG. 1 is a schematic diagram showing the structure of an electronic device 100 . The structure of the vehicle-mounted terminal may refer to the structure of the electronic device 100 .

[0062] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a communication module 150, an audio module 160, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, an indicator 191, a camera 192, a display screen 193, and a radar 195, etc. Among them, the sensor module 180 may include a touch sensor 180A, etc.

[0063] It is understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In some embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0064] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0065] Among them, the controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and execution.

[0066] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments of the present application, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0067] In some embodiments of the present application, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0068] Among them, the I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments of the present application, the processor 110 may include multiple groups of I2C buses. The processor 110 can be coupled to the touch sensor 180A, the charger, the flash, the camera 192, etc. through different I2C bus interfaces. For example, the processor 110 can be coupled to the touch sensor 180A through the I2C interface, so that the processor 110 communicates with the touch sensor 180A through the I2C bus interface to realize the touch function of the electronic device 100.

[0069] The I2S interface can be used for audio communication. In some embodiments of the present application, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 160 via the I2S bus to achieve communication between the processor 110 and the audio module 160. In some embodiments of the present application, the audio module 160 can transmit an audio signal to the communication module 150 via the I2S interface to achieve the function of playing music.

[0070] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments of the present application, the audio module 160 and the communication module 150 can be coupled via a PCM bus interface. In some embodiments of the present application, the audio module 160 can also transmit audio signals to the communication module 150 via the PCM interface to achieve the function of playing music.

[0071] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments of the present application, the UART interface is generally used to connect the processor 110 and the communication module 150. For example, the processor 110 communicates with the Bluetooth module in the communication module 150 through the UART interface to implement the Bluetooth function. In some embodiments of the present application, the audio module 160 can transmit an audio signal to the communication module 150 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0072] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 193 and the camera 192. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), and the like.

[0073] In some embodiments of the present application, the processor 110 and the camera 192 communicate via a CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 193 communicate via a DSI interface to implement the display function of the electronic device 100.

[0074] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments of the present application, the GPIO interface can be used to connect the processor 110 with the camera 192, the display screen 193, the communication module 150, the audio module 160, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0075] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. The USB interface 130 can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0076] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0077] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0078] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 193, the camera 192, the communication module 150, etc. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, and battery health status (leakage, impedance).

[0079] In some other embodiments, the power management module 141 may also be disposed in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 may also be disposed in the same device.

[0080] The communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the communication module 150, the modem processor, the baseband processor, etc.

[0081] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0082] The communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1.

[0083] In some embodiments of the present application, at least some functional modules of the communication module 150 may be arranged in the processor 110. In some embodiments of the present application, at least some functional modules of the communication module 150 may be arranged in the same device as at least some modules of the processor 110.

[0084] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 193.

[0085] In some embodiments of the present application, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and may be provided in the same device as the communication module 150 or other functional modules.

[0086] The communication module 150 can also provide wireless communication solutions for application in the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The communication module 150 can be one or more devices integrating at least one communication processing module. The communication module 150 receives electromagnetic waves via the antenna 2, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The communication module 150 can also receive the signal to be sent from the processor 110, modulate and amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0087] In some embodiments of the present application, the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0088] The electronic device 100 implements the display function through a GPU, a display screen 193, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 193 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0089] The display screen 193 is used to display images, videos, etc. The display screen 193 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments of the present application, the electronic device 100 may include 1 or N display screens 193, where N is a positive integer greater than 1.

[0090] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0091] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc.

[0092] In addition, the internal memory 121 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), and the like.

[0093] The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0094] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 160, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0095] The touch sensor 180A is also called a "touch control device". The touch sensor 180A can be set on the display screen 193, and the touch sensor 180A and the display screen 193 form a touch screen, also called a "touch control screen". The touch sensor 180A is used to detect a touch operation acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 193.

[0096] The radar 195 can be used to detect the user's operation on the display screen 193. The radar 195 may include a transmitter and at least one receiver. The transmitter in the radar 195 can transmit radar signals, and the receiver can receive radar signals transmitted by other external objects. Based on the transmitted and received radar signals, the radar 195 can estimate data such as the flight time of the radar signal and the arrival angle of the reflected signal. These data can be provided to the processor 110, and the processor 110 can identify the approximate position of the user operating on the display screen 193 based on these data.

[0097] like Figure 2 FIG. 1 is a schematic diagram of the installation position of a radar in an embodiment of the present application. Figure 2 In (a) of FIG. 1 , the installation position of the radar 21 in the vehicle terminal 20 with a display screen is shown. The installation position can be located at the lower middle of the screen of the vehicle terminal 20. The installation position of the radar 21 in the vehicle terminal 20 is affected by the hardware architecture of the vehicle terminal 20. Figure 2 In addition to the installation position shown in (a) in FIG. 1 , the radar 21 can also be installed at other positions of the vehicle-mounted terminal 20 . Figure 2 (b) shows the radar 21 installed on Figure 2 A top view of a vehicle when the vehicle-mounted terminal 20 is installed in the vehicle in the position shown in (a). Figure 2 In (b), the front row of the vehicle includes a main driving seat and a co-driver seat. The vehicle-mounted terminal 20 with a radar 21 installed inside can be installed between the main driving seat and the co-driver seat in the vehicle. In this way, the driver of the main driving seat and the passenger of the co-driver seat can both operate on the display screen (i.e., the central control screen) of the vehicle-mounted terminal.

[0098] In a possible implementation of the embodiment of the present application, the radar installed in the vehicle terminal may be a millimeter-wave radar. Millimeter-wave radar is a radar that detects in the millimeter wave band (millimeter wave). The wavelength of millimeter waves is between microwaves and centimeter waves. Generally, waves with a frequency range of 30 to 300 GHz or a wavelength of 1 to 10 mm are called millimeter waves. Millimeter-wave radar has some advantages of both microwave radar and photoelectric radar. It can distinguish and identify very small targets, and can identify multiple targets at the same time, with strong imaging capabilities.

[0099] To facilitate understanding, we first introduce the angle and distance estimation principles of millimeter-wave radar.

[0100] like Figure 3 The figure shows a schematic diagram of the signal transmission and transmission process of a millimeter wave radar. Figure 3 The millimeter wave radar shown in (a) includes a transmitter (TX antenna) and two receivers (RX antennas). When performing detection, the transmitter of the millimeter wave radar can emit millimeter waves, and after being reflected by other external objects, the two receivers can receive the reflected radar waves. The angle at which the receiver receives the radar waves reflected by other objects is called the angle of arrival. The angle of arrival can be estimated by data such as the antenna distance between the two receivers in the millimeter wave radar and the wavelength of the millimeter wave emitted by the transmitter.

[0101] like Figure 3 As shown in (b), it is known that the antenna distance between the two receivers of the millimeter-wave radar is l, the wavelength is λ, and the phase change measured by the millimeter-wave radar is △φ, then the phase change △φ can be expressed as:

[0102]

[0103] Therefore, when the antenna distance l and wavelength λ between the two receivers of the millimeter-wave radar are known, when the phase change measured by the millimeter-wave radar is △φ, the arrival angle of the radar signal received by the receiver can be estimated using the following formula:

[0104]

[0105] The angle of arrival estimated using the above formula can be used to determine the angle range that the millimeter-wave radar can detect in a vehicle-mounted scenario.

[0106] On the other hand, the flight time of the radar signal emitted by the millimeter-wave radar in the air can be determined by measuring the frequency shift. Figure 4 The figure shows a schematic diagram of the flight distance estimation of a millimeter wave radar. Figure 4The figure shows a schematic diagram of two curves of a millimeter wave transmitter transmitting a radar signal and a receiver receiving the transmitted signal. The two curves are Figure 4 The spacing on the horizontal axis of the coordinate system in is the flight time τ of the radar signal in the air. According to the above flight time τ, the flight distance Sτ of the radar signal in the air can be determined.

[0107] The flight distance of the radar signal estimated in the above manner can be used to determine the ranging accuracy of the millimeter wave radar. In this way, in the vehicle-mounted scenario to which the interactive method provided in the embodiment of the present application is applicable, the detectable angle range of the millimeter wave radar can be more accurately divided into multiple different detection areas.

[0108] like Figure 5(a) to Figure 5(c) FIG. 5 is a schematic diagram of a millimeter wave radar detection area provided in an embodiment of the present application. In the embodiment of the present application, based on the angle estimation principle of the millimeter wave radar introduced above, the angle range that the millimeter wave radar installed in the vehicle terminal can detect in the vehicle scene can be calculated, that is, the fan-shaped area S400 in the vehicle top view in FIG. 5(a).

[0109] In a possible implementation of the embodiment of the present application, the above-mentioned sector area S400 can be divided into multiple sub-areas, and each sub-area can be a sector area with the position of the millimeter wave radar as the center. For example, as shown in FIG5(b), the sector area S400 in FIG5(a) can be evenly divided into 20 sub-areas, and each sub-area can be numbered 0 to 19 from left to right.

[0110] On the other hand, the accuracy of the millimeter-wave radar during detection varies depending on the distance between the object and the millimeter-wave radar. Therefore, after dividing the detectable angle range of the millimeter-wave radar into multiple sub-areas shown in Figure 5(b), each sub-area can also be divided into two parts according to the distance from the millimeter-wave radar. One part is closer to the millimeter-wave radar, and the other part is relatively farther from the millimeter-wave radar. For example, each sub-area can be divided into two parts based on a certain distance value. The distance between any position point in one part of the area and the millimeter-wave radar is less than the distance value, while the distance between any position point in the other part of the area and the millimeter-wave radar is greater than or equal to the distance value. If the area closer to the millimeter-wave radar is numbered as area A, and the area relatively far from the millimeter-wave radar is numbered as area B, combined with the aforementioned numbering of each sub-area from left to right as 0 to 19, the area detectable by the millimeter-wave radar can be divided into 40 sub-areas A0-A19 and B0-B19. These 40 sub-areas can be shown in Figure 5(c).

[0111] When the object is located in the above 40 sub-areas, the millimeter wave radar can detect the intensity change of the radar signal in these sub-areas. In a possible implementation of the embodiment of the present application, an array can be used to store the radar signal strength in each sub-area.

[0112] For example, in the aforementioned example, the array storing the radar signal strengths in 40 sub-areas can be expressed as:

[0113] [BinA0, BinA1, BinA2, ..., BinA18, BinA19, BinB0, BinB1, ..., BinB18, BinB19]

[0114] Among them, BinA0 in the array indicates that the radar signal strength in the sub-area A0 is stored, and BinA1 in the array indicates that the radar signal strength in the sub-area A1 is stored, which will not be described one by one.

[0115] When the driver and passengers in the car want to operate on the central control screen, they need to move their hands from a certain position to the central control screen. This process will cause the intensity of the radar signal detected by the millimeter-wave radar to change. Specifically, when an object moves in the area detected by the millimeter-wave radar, the intensity of the radar signal detected by the millimeter-wave radar in the area will increase.

[0116] like Figure 6 The figure shows a schematic diagram of operating a central control screen provided in an embodiment of the present application. Figure 6 The figure shows the process of the driver in the main driving seat moving his hand to the central control screen. Figure 6 The black arrow H1 in the figure indicates the path of the driver in the main driving seat moving his hand to the central control screen. In this process, the area passed by the driver's hand is roughly the B0-B9 and A0-A9 areas shown in Figure 5(c). Accordingly, the intensity of the radar signal detected by the millimeter-wave radar in these areas will increase. In areas such as A10-A19 and B10-B19 where no objects move, the intensity of the radar signal detected by the millimeter-wave radar may remain unchanged or change slightly. At this time, in the array used to store the radar signal strength, the values ​​in positions such as BinB0-BinB9 and BinA0-BinA9 will also change greatly, and the values ​​in positions such as BinB10-BinB19 and BinA10-BinA19 may remain unchanged or change slightly.

[0117] In a possible implementation of the embodiment of the present application, since the user's hand approaches the central control screen for a period of time, when the vehicle terminal detects an operation on the display screen, the radar signal strength data for a period of time before the operation can be obtained. For example, the radar signal strength data of each sub-area within Δt = 500ms (milliseconds) can be obtained.

[0118] In one example, the above 500ms time can be evenly divided to obtain radar signal strength data at 11 moments during this period. The above 11 moments are 50ms apart from each other. Therefore, when an operation acting on the display screen is detected, radar signal strength data at 11 moments such as 50ms, 100ms, 150ms, ..., 500ms can be obtained.

[0119] Combined with the above array representation, the radar signal strength data at these 11 moments can be expressed as:

[0120] [BinA0, BinA1, BinA2, ..., BinA18, BinA19, BinB0, BinB1, ..., BinB18, BinB19]t0;

[0121] [BinA0, BinA1, BinA2, ..., BinA18, BinA19, BinB0, BinB1, ..., BinB18, BinB19]t1;

[0122] [BinA0, BinA1, BinA2, ..., BinA18, BinA19, BinB0, BinB1, ..., BinB18, BinB19]t2;

[0123] …

[0124] …

[0125] [BinA0, BinA1, BinA2, ..., BinA18, BinA19, BinB0, BinB1, ..., BinB18, BinB19]t9;

[0126] [BinA0, BinA1, BinA2, ..., BinA18, BinA19, BinB0, BinB1, ..., BinB18, BinB19]t10.

[0127] Among them, the array at time t0 represents the radar signal strength data in each sub-area at the moment when the operation acting on the display screen is detected; the array at time t1 represents the radar signal strength data in each sub-area 50 ms before the operation acting on the display screen is detected; the array at time t10 represents the radar signal strength data in each sub-area 500 ms before the operation acting on the display screen is detected.

[0128] like Figure 7 , which is a schematic diagram of the change of radar signal strength data provided in an embodiment of the present application. Figure 7 The horizontal axis in represents time, wherein t0 represents the time when the vehicle-mounted terminal detects an operation acting on the display screen. Figure 7 The ordinate in represents each sub-region, that is, A0-A19, B0-B19 in FIG5(c), a total of 40 sub-regions. Figure 7 Each rectangular grid in represents the change data of the radar signal strength detected by the millimeter-wave radar in each sub-area at different time points, and the rectangular grid filled with diagonal lines represents the situation where the radar signal strength changes greatly. Figure 7 It can be seen from the figure that the period of time before the vehicle terminal detects an operation on the display screen, that is, Figure 7 In the time period of t0-t0, the radar signal strength detected by the millimeter-wave radar in areas such as B0-B3 and A0-A8 varies greatly. As shown in Figure 5(c), areas such as B0-B3 and A0-A8 are located on the side of the car close to the driver. Therefore, the vehicle terminal can identify that the user currently operating the central control screen is the driver on the left main driving seat in the car based on the changes in the values ​​in the array.

[0129] In a possible implementation of the embodiment of the present application, the behavior of the user operating the central control screen can be divided into three categories, namely, the main driver's approach, the co-driver's approach and no approach. Among them, the main driver's approach can refer to a behavior of the driver in the main driver's seat operating the central control screen. When the main driver's seat is located on the left side of the car, the main driver's approach mainly affects the B0-B9 and A0-A9 areas in Figure 5 (c), that is, the area on the left side of the central control screen. Correspondingly, the intensity of the radar signal detected by the millimeter-wave radar in the above-mentioned B0-B9 and A0-A9 areas varies greatly. The co-driver's approach can refer to a behavior of the passenger in the co-driver's seat operating the central control screen. When the co-driver's seat is located on the right side of the car, the co-driver's approach mainly affects the B10-B19 and A10-A19 areas in Figure 5 (c), that is, the area on the right side of the central control screen. Correspondingly, the intensity of the radar signal detected by the millimeter-wave radar in the above-mentioned B10-B19 and A10-A19 areas varies greatly. No approach can refer to a behavior in which the approach of the driver and the front passenger is not obviously detected. Affected by the detection accuracy of the millimeter-wave radar, the millimeter-wave radar may still detect changes in the intensity of the radar signal in each area when there is no approach of the driver or the front passenger. However, compared with the two situations of the driver and the front passenger approaching, the intensity change of the radar signal in each area in this case is smaller.

[0130] like Figure 8(a) to Figure 8(c) As shown, the intensity changes of radar signals in each sub-area detected by the millimeter-wave radar are respectively shown in the three cases of the main driver approaching, the co-driver approaching or no approaching. Figure 8(a) to Figure 8(c) The horizontal axes in the diagram all represent time, wherein t0 represents the time when the vehicle-mounted terminal detects an operation on the display screen. Figure 8(a) to Figure 8(c) The ordinate in represents each sub-region, that is, A0-A19, B0-B19 in FIG5(c), a total of 40 sub-regions. Figure 8(a) to Figure 8(c) Each rectangular grid in the figure represents the change data of the radar signal strength detected by the millimeter-wave radar in each sub-area at different time points. The rectangular grid filled with black oblique lines represents the situation where the radar signal strength changes greatly, and the rectangular grid filled with vertical lines represents the situation where the radar signal strength changes less. Figure 8(a) to Figure 8(c) It can be seen that Figure 8(a) shows the situation where the driver is approaching, that is, the areas with large changes in radar signal strength are mainly B0-B3 and A0-A8, which are located on the left side of the central control screen. Figure 8(b) shows the situation where the co-driver is approaching, that is, the areas with large changes in radar signal strength are mainly B16-B19 and A13-A18, which are located on the right side of the central control screen. Figure 8(c) shows the situation where there is no approach, that is, there is no area with large changes in radar signal strength, or, although there are changes in radar signal strength in individual areas, there are no continuous areas with large changes in radar signal strength within the duration.

[0131] In an embodiment of the present application, a classification algorithm can be used to divide the radar signal strength change data within a period of time before each operation on the central control screen into the three categories mentioned above: driver approaching, passenger approaching, or no approach.

[0132] In a possible implementation of the embodiment of the present application, the radar signal strength data detected by the millimeter-wave radar during the three operations of the driver approaching, the co-driver approaching, and no approaching can be collected, and the classification model can be trained by machine learning. The classification model can be configured in the vehicle terminal to identify which category the user's operation belongs to based on the subsequent actual detected radar signal strength data.

[0133] In another possible implementation of the embodiment of the present application, a threshold can be set to distinguish which data of the signal is data with large changes and which data is data with small changes. For data with large changes, it is possible to identify whether the user's operation belongs to the main driver approaching, the co-driver approaching, or no approach by comparing whether the data with large changes appear more in the area on the left side of the central control screen or more in the area on the right side of the central control screen. The embodiment of the present application does not limit how to apply the classification algorithm to identify which category the user's operation belongs to.

[0134] In the embodiment of the present application, the millimeter-wave radar can be used to detect which type of operation on the central control screen belongs to. For different types of operations, the vehicle terminal can perform different information processing steps. Specifically, for the three types of operations in the above example, namely, the driver's approach, the co-driver's approach, and no approach, the vehicle terminal can adopt different strategies to process the displayed content or information.

[0135] In a possible implementation of an embodiment of the present application, when it is identified that the current operation type is the main driver approaching or the co-driver approaching, the vehicle terminal can determine whether the current scene is a scene that needs to distinguish different operation types. If the current scene is a scene that needs to distinguish different operation types, the vehicle terminal can process them separately according to the two situations of the main driver approaching or the co-driver approaching. Among them, the scene that needs to distinguish different operation types may refer to the scene that the vehicle terminal can split the screen. In the split-screen scene, the vehicle terminal can display different information or content on the display screen in split screen.

[0136] For example, Figure 9(a) to Figure 9(d)As shown, it is a schematic diagram of a split-screen display of a vehicle terminal provided by an embodiment of the present application. Among them, FIG9(a) shows a schematic diagram of a driver in the main driving seat operating on the central control screen, that is, the driver performs a click operation on the central control screen and hopes to open the video player. For example, a navigation interface 902 is displayed on the central control screen, and the driver clicks the control 901 in FIG9(a) to open the video player. At this time, the vehicle terminal can identify the current operation as the main driver approaching according to the steps described in the aforementioned embodiments. When the main driver approaches, the vehicle terminal can open the video player and display the playback interface of the video player on the side relatively closer to the driver, that is, on the relatively left side of the central control screen. As shown in FIG9(b), the central control screen can split the navigation interface 902 and the video playback interface 903, and place the navigation interface 902 on the right side of the central control screen, and the video playback interface 903 on the left side of the central control screen closer to the driver.

[0137] For another example, as shown in FIG9(c), the user who is currently performing a click operation on the central control screen and wishes to open the video player is a passenger in the co-pilot seat. At this time, the vehicle terminal can identify the current operation as the co-pilot is approaching according to the steps described in the aforementioned embodiments. When the co-pilot is approaching, as shown in FIG9(d), the vehicle terminal can open the video player and display the playback interface 903 of the video player on the side that is relatively closer to the passenger, that is, the relatively right side of the central control screen, and display the navigation interface 902 on the left side of the central control screen. By comparing the two display interfaces shown in FIG9(b) and FIG9(d), it can be found that by applying this method, by identifying the type of operation performed by the user on the central control screen, the vehicle terminal can display the newly opened application on the side that is closer to the user who actually performs the current operation.

[0138] In another possible implementation of the embodiment of the present application, the scene that needs to distinguish different operation types can also be a scene that can display interactive controls. Specifically, when the driver or passenger performs an operation on the central control screen, the vehicle terminal should display an interactive control on the central control screen based on the operation. The vehicle terminal can identify whether the operation is performed by the driver or the passenger, that is, identify whether the operation belongs to the main driver approaching or the co-driver approaching.

[0139] Exemplarily, the interactive control to be displayed may be an input box of an input method. For example, when a user clicks on a search box on the central control screen, the vehicle terminal may display an input box on the central control screen for the user to input information. At this time, the vehicle terminal may apply the methods described in the aforementioned embodiments to identify whether the operation of clicking on the search box is performed by the driver or the passenger, and then use different strategies to display the input box after distinguishing the operation as the main driver approaching or the co-driver approaching.

[0140] In one example, if Figure 10(a) to Figure 10(f) As shown, it is a schematic diagram of an operation process of displaying an input box on a central control screen provided by an embodiment of the present application. Among them, FIG10(a) shows a schematic diagram of a driver in the main driving seat operating on the central control screen, that is, the driver clicks the comment box 1001 on the central control screen, and the comment box 1001 can be a control in the video playback interface 1002 of the central control screen. At this time, the vehicle terminal can identify the current operation as the main driver approaching. In one possible implementation, when the main driver approaches, as shown in FIG10(b), the vehicle terminal can display an input box 1003, and display the input box 1003 on the side relatively closer to the driver, that is, on the relatively left side of the central control screen, for the driver to input text. FIG10(b) shows that the vehicle terminal displays the input box 1003 on the video playback interface 1002 and on the side close to the driver. In another possible implementation, as shown in FIG10(c), when the input box 1003 is displayed, the central control screen can be split-screen, and the originally displayed video playback interface 1002 is reduced and displayed on the right split screen of the central control screen. The input box 1003 is displayed on the left split screen 1004 of the central control screen. In this way, after the input box 1003 is displayed close to the driver's side, the input box 1003 and the video playback interface 1002 do not affect each other.

[0141] For another example, as shown in FIG10(d), the user who is currently performing a click operation on the central control screen and wishes to input information is a passenger in the co-pilot seat. At this time, the vehicle-mounted terminal can identify the current operation as the co-pilot is approaching. In the case where the co-pilot is approaching, in one possible implementation, as shown in FIG10(e), the vehicle-mounted terminal can display an input box 1003, and display the input box 1003 on the side relatively closer to the passenger, that is, on the relatively right side of the central control screen, for the passenger to input text. In the display interface shown in FIG10(e), when the vehicle-mounted terminal displays the input box 1003, it can directly display the input box 1003 on the side close to the passenger in the original video playback interface 1002. In another possible implementation, as shown in FIG10(f), when the vehicle-mounted terminal displays the input box 1003, it can also display it in split screen. For example, as shown in Figure 10(f), the vehicle terminal displays the video playback interface 1002 in a split screen on the left side of the central control screen, and displays the input box 1003 on the right side, that is, in the split screen 1004 close to the passenger side. In this way, the input box 1003 displayed on the passenger side does not affect the video playback interface 1002. By comparing Figures 10(b) and 10(e), and the display interfaces shown in Figures 10(c) and 10(f), it can be found that by applying this method, by identifying the user's operation type on the central control screen, the vehicle terminal can display the input box on the side closer to the user who actually performs the current operation. In this way, it can be convenient for users who actually need to input information or text.

[0142] Combined with the introduction of the above embodiments, Fig.11 As shown, a flow chart of an interaction method based on a central control screen in a vehicle provided by an embodiment of the present application is shown, and the method may include the following process:

[0143] S1101. Check whether there is anyone in the driver and passenger seats?

[0144] In an embodiment of the present application, after the central control screen in the car is started, it can detect whether there are people in the main and co-pilot seats according to the seat sensors. If only the main driver's seat is detected to be occupied, that is, there is only one driver in the main driver's seat in the current car, then each operation acting on the central control screen can be regarded as an operation performed by the driver in the main driver's seat. The vehicle terminal can identify this operation as an operation when the main driver is approaching. On the contrary, if only the co-pilot seat is detected to be occupied, that is, there is only one passenger in the co-pilot seat in the current car, then each operation acting on the central control screen can be regarded as an operation performed by the passenger in the co-pilot seat. The vehicle terminal can identify this operation as an operation when the co-pilot is approaching. If it is detected according to the seat sensors that there are people in both the main and co-pilot seats, it means that there is a driver in the main driver's seat and a passenger in the co-pilot seat in the car. At this time, the vehicle terminal can execute S1102.

[0145] S1102: Start the millimeter wave radar for detection.

[0146] In the embodiment of the present application, after the central control screen is started, the millimeter wave radar installed in the central control screen can detect the area in front of the central control screen to obtain the strength data of the radar signal in each sub-area. The sub-areas detected by the millimeter wave radar can be the sub-areas shown in Figure 5(c).

[0147] S1103: Detect a click operation and obtain radar signal strength data.

[0148] When the vehicle terminal detects a click operation on the central control screen, the vehicle terminal can obtain the radar signal strength data of each sub-area within a period of time before the corresponding moment of the click operation, that is, obtain the radar signal strength data stored in the array in the aforementioned embodiments.

[0149] Exemplarily, the following radar signal strength data in the aforementioned example may be obtained:

[0150] [BinA0, BinA1, BinA2, ..., BinA18, BinA19, BinB0, BinB1, ..., BinB18, BinB19]t0;

[0151] [BinA0, BinA1, BinA2, ..., BinA18, BinA19, BinB0, BinB1, ..., BinB18, BinB19]t1;

[0152] [BinA0, BinA1, BinA2, ..., BinA18, BinA19, BinB0, BinB1, ..., BinB18, BinB19]t2;

[0153] …

[0154] …

[0155] [BinA0, BinA1, BinA2, ..., BinA18, BinA19, BinB0, BinB1, ..., BinB18, BinB19]t9;

[0156] [BinA0, BinA1, BinA2, ..., BinA18, BinA19, BinB0, BinB1, ..., BinB18, BinB19]t10.

[0157] S1104: Identify operation behavior according to radar signal strength data.

[0158] In an embodiment of the present application, after acquiring the above-mentioned radar signal strength data, a classification algorithm can be used to process the above-mentioned data, so as to identify the user's operation as an operation of the main driver approaching, the co-driver approaching, or no approach.

[0159] S1105: Determine whether this is the first click operation?

[0160] If the user's current operation is the first click operation on the central control screen, then when the classification and identification is that the main driver is approaching according to S1104, the current operation can be determined as the main driver operation, that is, the current operation is the operation performed by the driver in the main driver's seat on the central control screen; when the classification result is that the co-driver is approaching, the current operation can be determined as the co-driver operation, that is, the current operation is the operation performed by the passenger in the co-driver's seat on the central control screen; when the classification result is that there is no approach, the current operation can be determined as the default operation.

[0161] If the user's current operation is not the first click operation on the central control screen, S1106 can be executed.

[0162] S1106: Calculate the time interval between click operations.

[0163] S1107: If the time interval is greater than or equal to the threshold, update the classification result; otherwise, determine that the current operation is the same as the previous operation.

[0164] Calculating the time interval of the click operation may be calculating the time interval between the current click operation and the last click operation. If the time interval is less than a certain threshold, it can be considered that the current click operation and the last click operation belong to the same type of operation. For example, the current operation is not the first click operation on the central control screen. If the time interval between the current operation and the last click operation is less than the threshold, the type of the current operation can be identified as the same as the last click operation. Assuming that the last click operation was an operation when the main driver was approaching, the current operation is also an operation when the main driver was approaching, that is, a main driver operation. According to statistics, the time interval between two clicks has a probability of more than 90% falling within 3 seconds, so the above threshold can be set to 3 seconds. That is, if the time interval between the current click operation and the last click operation is less than or equal to 3 seconds, it can be considered that the current click operation and the last click operation belong to the same type of operation.

[0165] If the time interval between the current click operation and the last click operation is greater than the above threshold, the vehicle terminal can update the classification result. That is, if the classification result is that the driver is approaching, the current operation can be determined as the driver's operation; if the classification result is that the co-driver is approaching, the current operation can be determined as the co-driver's operation; if the classification result is that there is no approach, the current operation can be determined to be the same as the last operation.

[0166] S1108. Different display modes are used according to different operation types.

[0167] When the current operation type is identified as the main driver approaching or the co-driver approaching, the vehicle terminal can determine whether the current scene is a scene that requires different operation types to be distinguished. If the current scene is a scene that requires different operation types to be distinguished, the vehicle terminal can process the two situations separately according to the main driver approaching or the co-driver approaching.

[0168] In one example, different display modes may include split-screen display. For example, in a navigation scenario, if the current operation is a click operation performed by the driver on the central control screen to open a video player, since the operation is a main driver operation, the vehicle-mounted terminal can open the video player and display the playback interface of the video player on the side relatively closer to the driver, that is, the relatively left side of the central control screen. If the current operation is a click operation performed by a passenger on the central control screen to open a video player, the operation is a co-driver operation. The vehicle-mounted terminal can open the video player and display the playback interface of the video player on the side relatively closer to the passenger, that is, the relatively right side of the central control screen.

[0169] In another example, different display modes may also include displaying interactive controls in different locations. For example, in a search scenario, if the current operation is the driver clicking on the search box on the central control screen, since the operation is a main driver operation, the vehicle terminal can open the input box and display the input box on the side relatively closer to the driver, that is, on the relatively left side of the central control screen. If the current operation is the passenger clicking on the search box on the central control screen, the operation is a co-driver operation. The vehicle terminal can open the input box and display the input box on the side relatively closer to the passenger, that is, on the relatively right side of the central control screen.

[0170] Based on the various embodiments described above, Fig.12 FIG. 1 is a schematic diagram showing a step diagram of an interaction method based on a central control screen in a vehicle provided by an embodiment of the present application. The method may include the following steps:

[0171] S1201: The vehicle-mounted terminal detects an operation performed on the central control screen.

[0172] The vehicle-mounted terminal in the embodiment of the present application may be a Figure 1 The electronic device of the result shown, the vehicle terminal can be installed on the center console in the car, and the center control screen is the display screen of the vehicle terminal.

[0173] The operation on the central control screen may be a gesture operation of the user on the central control screen, for example, a click, a slide, etc. on the central control screen. The above-mentioned users may include drivers and passengers.

[0174] S1202: Based on the above operations, the vehicle-mounted terminal obtains radar signal strength data, where the radar signal strength data is obtained by detection of a radar configured in the vehicle-mounted terminal.

[0175] In the embodiment of the present application, a radar may be configured in the vehicle terminal, and the radar may be a millimeter wave radar or other types of radar. By configuring the radar in the vehicle terminal, radar signal strength data of multiple areas in the vehicle may be obtained. The multiple areas in the vehicle may be the aforementioned embodiments and FIG. 5(c), Figure 6 The various sub-areas described in .

[0176] In a possible implementation, when acquiring radar signal strength data, the vehicle terminal may first determine a target time period based on the detected operation, and then respectively acquire radar signal strength data of multiple areas in the vehicle within the target time period. The target time period may be a period of time ending at the moment when the vehicle terminal detects the operation acting on the central control screen. That is, the radar signal strength data acquired by the vehicle terminal may be radar signal strength data within a period of time before the operation is detected.

[0177] In the embodiment of the present application, the radar signal strength data of multiple areas in the vehicle during the target time period may be the variation of the radar signal strength data of each area in the vehicle during the target time period. The variation is the variation data of the radar signal strength in the aforementioned embodiments.

[0178] In a specific implementation, the vehicle-mounted terminal can determine multiple moments within the target time period based on the target time period. For example, the 11 moments from t0 to t10 in the aforementioned embodiment. Then, the vehicle-mounted terminal can obtain the radar signal strength data of each area in the vehicle at each moment, and determine the change in the radar signal strength data of each area based on the radar signal strength data of each area in the vehicle at each moment. The change can be used to represent the change in the radar signal strength data of each area at each moment in the target time period. For example, the change in the radar signal strength data in a certain area from moment t0 to moment t10.

[0179] S1203: The vehicle-mounted terminal determines the target user who performs the above operation according to the radar signal strength data.

[0180] In an embodiment of the present application, the purpose of the vehicle-mounted terminal determining the target user performing the operation based on the radar signal strength data may be to determine the type of operation to be performed, that is, the operation types such as main driver approaching, co-driver approaching, or no approaching in the aforementioned embodiments. Among them, when the operation type is determined to be main driver approaching, it can be considered that the target user performing the operation is the user in the main driver's seat, that is, the driver. When the operation type is determined to be co-driver approaching, it can be considered that the target user performing the operation is the user in the co-driver's seat, that is, the passenger. When the operation type is determined to be no approaching, it can be considered that the target user performing the operation cannot be accurately distinguished.

[0181] In a possible implementation of the embodiment of the present application, the target user can be determined based on the radar signal strength data of multiple areas in the vehicle. Specifically, the vehicle-mounted terminal can determine multiple target areas from multiple areas in the vehicle based on the radar signal strength data; wherein each target area is an area where the change in radar signal strength data is greater than a preset threshold. By determining the target area, the area with a large change in radar signal strength data can be identified.

[0182] Then, the vehicle terminal can determine the target user who performs the operation based on multiple target areas. Specifically, the vehicle terminal can determine the orientation of each target area respectively, and the orientation may include a first orientation and a second orientation, and the first orientation and the second orientation are respectively located on the left and right sides of the vehicle terminal. Exemplarily, the first orientation may be located on the left side of the vehicle terminal, and the second orientation may be located on the right side of the vehicle terminal. If the vehicle terminal is installed on the center console relatively in the middle of the vehicle, when the driver's position is on the left side of the vehicle, the first orientation is the orientation of the driver on the main driver's seat, and the second orientation is the orientation of the passenger on the co-driver's seat.

[0183] Usually, when the driver on the main driving seat or the passenger on the co-pilot operates the central control screen, the radar signal strength data of each area in the position will be different depending on the position of the user who initiated the operation. For example, when the driver operates the central control screen, in the process of the driver's hand moving from a certain position to the central control screen, the change in the radar signal strength data in each area in the same position as the driver is usually larger. Therefore, the vehicle terminal can determine the target user who performs the operation according to the number of target areas located in the first position or the second position respectively. Among them, the position where the target user is located is the same as the position where the target area with a larger number is located. For example, if the target area with a larger change in radar signal strength data is more located in the first position, that is, on the left side of the vehicle terminal, it can be considered that the operation is initiated by the driver on the left. If the target area is more located in the second position, that is, on the right side of the vehicle terminal, it can be considered that the operation is initiated by the passenger on the right.

[0184] In another possible implementation of the embodiment of the present application, the target user can also be determined by classifying the radar signal strength data. The vehicle-mounted terminal can classify the radar signal strength data using a pre-trained classification model, and the vehicle-mounted terminal can determine the target user who performs the operation based on the classification result. The classification result may include the results corresponding to the radar signal strength data detected by the radar when users in different orientations perform operations on the central control screen. In this way, the vehicle-mounted terminal can determine that the user in the orientation is the target user who performs the operation based on the orientation corresponding to the classification result.

[0185] Specifically, users in different positions can perform operations on the central control screen, and the radar signal strength data in this process can be collected by radar. For example, a user in the vehicle terminal or the left side of the central control screen performs multiple operations on the central control screen, and the radar in the vehicle terminal can collect radar signal strength data during each operation; correspondingly, a user in the vehicle terminal or the right side of the central control screen performs multiple operations on the central control screen, and the radar in the vehicle terminal can also collect radar signal strength data during each operation. In this way, the radar signal strength data collected each time can correspond to a certain position to form labeled data. By training the labeled radar signal strength data, a classification model can be obtained. In actual application, when the vehicle terminal detects the operation acting on the central control screen, the radar signal strength data collected by the radar can be obtained, and the classification model can be applied for classification. The classification result can be used to indicate the user in which position the currently detected operation comes from, and the user is the target user.

[0186] S1204. The vehicle-mounted terminal interacts with the target user at a target position on the central control screen, where the target position is a position on the central control screen close to the target user.

[0187] The target position on the central control screen may refer to a position on the central control screen that is closer to the target user, and the target user can more conveniently operate the central control screen at the target position. For example, if the target user is a driver, the target position on the central control screen may be a position that is closer to the driver, and the driver can more conveniently operate the central control screen at the target position. For example, since the target position is closer to the driver, the distance that the driver's hand moves during operation is shorter.

[0188] In a possible implementation of the embodiment of the present application, the vehicle terminal interacts with the target user at the target position of the central control screen, which may include the vehicle terminal displaying the corresponding target content at the target position, and the target content may be content corresponding to the operation acting on the central control screen. For example, assuming that the operation performed by a certain user on the central control screen is an operation of opening an input box, after the vehicle terminal detects the operation and determines the target user who performs the operation based on the steps described above, the input box can be displayed at a position closer to the target user. In this way, it is more convenient for the target user to enter text or information in the input box.

[0189] In another possible implementation of the embodiment of the present application, when the vehicle-mounted terminal displays the target content at the target location, the content displayed on the central control screen can be split first, and then the target content can be displayed on the screen close to the target user after the split screen. Exemplarily, navigation information is originally displayed on the central control screen. When the driver wants to change the navigation destination, the driver can operate on the central control screen to trigger the central control screen to display an input box for entering new destination information. After the vehicle-mounted terminal determines that the target user is the driver based on the steps described above, the content displayed on the central control screen can be split, and the input box can be displayed on the screen closer to the driver. The original navigation information can be displayed on the screen on the other side. In this way, through the split-screen display, it is possible to avoid superimposing different content or information, and each content or information can be fully displayed on the screen.

[0190] The embodiment of the present application can divide the electronic device or vehicle-mounted terminal into functional modules according to the above method example. For example, each functional module can be divided corresponding to each function, or one or more functions can be integrated into one functional module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. The following is an example of dividing each functional module corresponding to each function.

[0191] Corresponding to the above embodiments, refer to Fig.13 , shows a structural block diagram of an interactive device based on an in-vehicle central control screen provided in an embodiment of the present application. The device can be applied to the in-vehicle terminal in each of the aforementioned embodiments. The device may specifically include the following modules: a detection module 1301, an acquisition module 1302, a determination module 1303, and an interaction module 1304, wherein:

[0192] A detection module 1301 is used to detect an operation performed on the central control screen;

[0193] An acquisition module 1302 is used to acquire radar signal strength data based on the detected operation, where the radar signal strength data is obtained by detection of a radar configured in the vehicle-mounted terminal;

[0194] A determination module 1303 is used to determine a target user who performs an operation according to the radar signal strength data;

[0195] The interaction module 1304 is used to interact with the target user at a target position on the central control screen, where the target position is a position on the central control screen close to the target user.

[0196] In a possible implementation of an embodiment of the present application, the acquisition module 1302 can be specifically used to: determine a target time period based on the operation, wherein the target time period is a period of time starting from the moment when the vehicle-mounted terminal detects the operation; and obtain radar signal strength data of multiple areas in the vehicle within the target time period.

[0197] In a possible implementation of the embodiment of the present application, the acquisition module 1302 may also be used to: respectively acquire the amount of change in radar signal strength data of each area in the vehicle within the target time period.

[0198] In a possible implementation of an embodiment of the present application, the acquisition module 1302 can also be used to: determine multiple moments within the target time period; respectively obtain the radar signal strength data of each area in the vehicle at each moment; and determine the change in the radar signal strength data of each area based on the radar signal strength data of each area in the vehicle at each moment.

[0199] In a possible implementation of the embodiment of the present application, the device may further include an area determination module. The area determination module is specifically used to: determine a plurality of areas in the vehicle, any of which is a sector area with a point on the central control screen as the center.

[0200] In a possible implementation manner of the embodiment of the present application, the area determination module may also be used to: divide each of the sector-shaped areas into at least two sub-areas according to a preset distance threshold.

[0201] In a possible implementation of an embodiment of the present application, the determination module 1303 can be specifically used to: determine multiple target areas from multiple areas in the vehicle based on the radar signal strength data; wherein each of the target areas is an area where a change in the radar signal strength data is greater than a preset threshold; based on the multiple target areas, determine a target user who performs the operation.

[0202] In a possible implementation method of an embodiment of the present application, the determination module 1303 can also be used to: respectively determine the position of each of the target areas, the positions including a first position and a second position, the first position and the second position are respectively located on the left and right sides of the vehicle-mounted terminal; determine the target user who performs the operation according to the number of the target areas respectively located at the first position or the second position; wherein the position of the target user is the same as the position of the target areas with a larger number.

[0203] In another possible implementation of the embodiment of the present application, the determination module 1303 may be specifically used to: classify the radar signal strength data using a pre-trained classification model; and determine a target user who performs the operation according to the classification result.

[0204] In a possible implementation of an embodiment of the present application, the classification result includes the results corresponding to the radar signal strength data detected by the radar when users in different positions perform operations on the central control screen. The determination module 1303 can also be used to: determine, based on the position corresponding to the classification result, that the user in the position is the target user performing the operation.

[0205] In a possible implementation manner of the embodiment of the present application, the interaction module 1304 may be specifically configured to: determine target content to be displayed corresponding to the operation; and display the target content at the target position.

[0206] In a possible implementation of the embodiment of the present application, the interaction module 1304 can also be used to: split the content displayed on the central control screen; and display the target content on the screen close to the target user after the split screen.

[0207] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0208] Finally, it should be noted that the above is only a specific implementation method of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application.

Claims

1. An interactive method based on a central control screen in a vehicle, characterized in that: Applied to a vehicle-mounted terminal, the method comprises: The vehicle terminal detects an operation performed on the central control screen; The vehicle-mounted terminal acquires radar signal strength data based on the operation, wherein the radar signal strength data is obtained by detection of a radar configured in the vehicle-mounted terminal; The vehicle-mounted terminal determines a target user who performs the operation according to the radar signal strength data; The vehicle-mounted terminal interacts with the target user at a target position of the central control screen, where the target position is a position on the central control screen close to the target user.

2. The method according to claim 1, characterized in that: The vehicle-mounted terminal obtains radar signal strength data based on the operation, including: The vehicle terminal determines a target time period based on the operation, wherein the target time period is a period of time starting from the moment when the vehicle terminal detects the operation and ending at the time; The vehicle-mounted terminal respectively obtains radar signal strength data of multiple areas in the vehicle within the target time period.

3. The method according to claim 2, characterized in that The vehicle-mounted terminal respectively obtains radar signal strength data of multiple areas in the vehicle during the target time period, including: The vehicle-mounted terminal respectively obtains the change amount of the radar signal strength data of each area in the vehicle during the target time period.

4. The method according to claim 3, characterized in that: The vehicle-mounted terminal obtains the change in radar signal strength data of each area in the vehicle during the target time period, including: The vehicle-mounted terminal determines a plurality of time points within the target time period; The vehicle-mounted terminal respectively obtains radar signal strength data of each area in the vehicle at each moment; The vehicle-mounted terminal determines the change amount of the radar signal strength data of each area according to the radar signal strength data of each area in the vehicle at each moment.

5. The method according to any one of claims 2 to 4, characterized in that: Before the vehicle-mounted terminal respectively obtains radar signal strength data of multiple areas in the vehicle within the target time period, the method further includes: The vehicle-mounted terminal determines a plurality of areas in the vehicle, any of which is a sector-shaped area with a point on the central control screen as the center.

6. The method according to claim 5, characterized in that The vehicle-mounted terminal determines the plurality of areas in the vehicle, including: The vehicle-mounted terminal divides each of the sector-shaped areas into at least two sub-areas according to a preset distance threshold.

7. The method according to any one of claims 1 to 6, characterized in that: The vehicle-mounted terminal determines, according to the radar signal strength data, a target user who performs the operation, including: The vehicle-mounted terminal determines multiple target areas from multiple areas in the vehicle according to the radar signal strength data; wherein each of the target areas is an area where the change in the radar signal strength data is greater than a preset threshold; The vehicle-mounted terminal determines a target user who performs the operation based on the multiple target areas.

8. The method according to claim 7, characterized in that The vehicle-mounted terminal determines a target user who performs the operation based on the multiple target areas, including: The vehicle-mounted terminal determines the position of each target area, the position includes a first position and a second position, and the first position and the second position are respectively located on the left and right sides of the vehicle-mounted terminal; The vehicle terminal determines a target user who performs the operation according to the number of the target areas respectively located at the first position or the second position; wherein the position where the target user is located is the same as the position where the target areas with a larger number are located.

9. The method according to any one of claims 1 to 6, characterized in that: The vehicle-mounted terminal determines, according to the radar signal strength data, a target user who performs the operation, including: The vehicle-mounted terminal uses a pre-trained classification model to classify the radar signal strength data; The vehicle-mounted terminal determines a target user for executing the operation according to the classification result.

10. The method according to claim 9, characterized in that The classification result includes the result corresponding to the radar signal strength data detected by the radar when the users in different positions perform the operation on the central control screen, and the vehicle terminal determines the target user who performs the operation according to the classification result, including: The vehicle-mounted terminal determines, based on the direction corresponding to the classification result, that a user at the direction is a target user for executing the operation.

11. The method according to any one of claims 1 to 10, characterized in that: The vehicle-mounted terminal interacts with the target user at the target position of the central control screen, including: The vehicle-mounted terminal determines target content to be displayed corresponding to the operation; The vehicle-mounted terminal displays the target content at the target location.

12. The method according to claim 11, characterized in that The vehicle-mounted terminal displays the target content at the target location, including: The vehicle-mounted terminal splits the content displayed on the central control screen; The vehicle-mounted terminal displays the target content on the screen close to the target user after the screen is split.

13. A vehicle-mounted terminal, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: The vehicle-mounted terminal is configured with a radar, and when the processor executes the computer program, the interaction method based on the in-vehicle central control screen as described in any one of claims 1 to 12 is implemented.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a memory and a processor, and the processor executes a computer program stored in the memory to implement the interaction method based on the in-vehicle central control screen as described in any one of claims 1-12.

Images