Vehicle display terminal interaction method and device, vehicle, medium and program product

Abstract

The application relates to the technical field of vehicle control, in particular to an interaction method and device of a vehicle-mounted display terminal, a vehicle, a medium and a program product, wherein the method comprises the following steps: collecting driving state parameters, gear signals and passenger sensing information of a driver's seat of a vehicle; in response to a screen interaction instruction of the vehicle, screening a target vehicle-mounted display terminal matched with the driving state parameters, the gear signals and the passenger sensing information of the driver's seat from vehicle-mounted display terminals of the vehicle; and determining adaptive target screen projection position information based on screen characteristics of the target vehicle-mounted display terminal, and displaying to-be-projected information by using the target screen projection position information. Thus, the problems in the prior art that an interaction system lacks screen self-adaptive adaptation capability, is difficult to adapt to different forms of vehicle-mounted display screens, cannot automatically generate a layout, driving information and entertainment information are easily displayed on the same screen to interfere with driving, resource scheduling based on content priority is lacked in multi-screen cooperation, power and traffic distribution is unbalanced, and system energy efficiency is low are solved.

Description

Technical Field

[0001] This application relates to the field of vehicle control technology, and in particular to an interaction method, device, vehicle, medium, and program product for an in-vehicle display terminal. Background Technology

[0002] In related technologies, in-vehicle mobile phone interconnection systems generally adopt a single-channel video stream projection architecture or a multi-screen linkage projection mode. Among them, single-channel video stream projection is achieved by transmitting the screen to the vehicle's central control screen unidirectionally after the mobile phone completes full interface rendering, through a single data channel; multi-screen linkage projection enables mirror projection for specific applications preset by the system, and completes multi-screen synchronous display based on a fixed layout style.

[0003] However, in related technologies, the screen adaptation capability of the interconnected system is weak, unable to adapt to the size and layout differences of various irregular screens of different car models, and it is difficult to adaptively output the optimal projection interface; the human-computer interaction design has defects, with key driving information and redundant entertainment information being displayed on the same screen, which can easily distract the driver and pose a driving safety hazard; in the multi-screen working mode, there is no differentiated resource allocation strategy, and it is impossible to dynamically allocate traffic and computing resources according to the priority of the projection content, resulting in unbalanced device resource allocation and low operating efficiency, which urgently needs to be improved. Summary of the Invention

[0004] This application provides an interaction method, device, vehicle, medium, and program product for an in-vehicle display terminal to solve the following problems in related technologies: the interconnection system lacks screen adaptive adaptation capabilities, making it difficult to adapt to the layout differences of various vehicle models and different display screen shapes, and it cannot automatically output the optimal projection layout; core driving information and entertainment information are displayed on the same screen, which can easily distract the driver and pose a driving safety hazard; multi-screen collaboration lacks a dynamic resource scheduling strategy based on content priority, resulting in an imbalance in traffic and computing power allocation and low system operating efficiency.

[0005] The first aspect of this application provides an interaction method for an in-vehicle display terminal, comprising the following steps: collecting vehicle driving status parameters, gear position signals, and passenger-side occupant perception information; responding to a screen interaction command from the vehicle, selecting a target in-vehicle display terminal from the in-vehicle display terminals that matches the driving status parameters, gear position signals, and passenger-side occupant perception information; determining a target projection location information of the target in-vehicle display terminal that is compatible with the information to be projected, based on the screen characteristics of the target in-vehicle display terminal; and displaying the information to be projected using the target projection location information.

[0006] Optionally, in one embodiment of this application, the step of filtering target in-vehicle display terminals that match the driving status parameters, the gear position signal, and the passenger-side occupant perception information from the vehicle's in-vehicle display terminals includes: obtaining the projection tag of the information to be projected; determining the priority of the projection tag based on the tag characteristics of the projection tag; and determining the target in-vehicle display terminal based on the priority, the in-vehicle display terminal, the driving status parameters, the gear position signal, and the passenger-side occupant perception information.

[0007] Optionally, in one embodiment of this application, determining the target vehicle display terminal based on the priority, the vehicle display terminal, the driving status parameters, the gear signal, and the passenger's perception information includes: if the driving speed obtained based on the driving status parameters is greater than a preset speed threshold, then the target vehicle display terminal is determined to be the first vehicle display terminal among the vehicle display terminals; if the driving speed is less than or equal to the preset speed threshold, then the target vehicle display terminal is determined to be the second vehicle display terminal among the vehicle display terminals, wherein the first vehicle display terminal and the second vehicle display terminal are respectively adapted to the driver's different viewing angles.

[0008] Optionally, in one embodiment of this application, determining the target vehicle display terminal based on the priority, the vehicle display terminal, the driving status parameters, the gear position signal, and the passenger's perception information includes: if the passenger seat is unoccupied based on the passenger's perception information, then the third vehicle display terminal is turned off, and it is determined that the target vehicle display terminal is not the third vehicle display terminal, wherein the third vehicle display terminal is adapted to the passenger's viewing angle; if the passenger seat is not unoccupied, then the target vehicle display terminal is determined based on the priority, the vehicle display terminal, the driving status parameters, the gear position signal, and the passenger's perception information.

[0009] Optionally, in one embodiment of this application, determining the target vehicle display terminal based on the priority, the vehicle display terminal, the driving status parameters, the gear signal, and the passenger-side occupant's perception information includes: if the gear signal is not a reverse gear signal, then determining the target vehicle display terminal based on the priority, the vehicle display terminal, the driving status parameters, the gear signal, and the passenger-side occupant's perception information; if the gear signal is the reverse gear signal, then determining the target vehicle display terminal as the second vehicle display terminal.

[0010] Optionally, in one embodiment of this application, determining the target projection location information of the target vehicle display terminal that is compatible with the projection information based on the screen features of the target vehicle display terminal includes: determining candidate projection location information based on the target vehicle display terminal; extracting candidate screen features corresponding to the candidate projection location information, and calculating screen scores corresponding to different candidate projection locations based on the candidate screen features; filtering out target projection locations that meet preset location conditions from the candidate projection locations based on the screen scores, and determining the target projection location information based on the target projection location.

[0011] A second aspect of this application provides an interactive device for an in-vehicle display terminal, comprising: a data acquisition module for acquiring vehicle driving status parameters, gear position signals, and passenger-side occupant perception information; a filtering module for, in response to a screen interaction command from the vehicle, filtering from the in-vehicle display terminals of the vehicle, a target in-vehicle display terminal that matches the driving status parameters, the gear position signals, and the passenger-side occupant perception information; and a determination module for, based on the screen characteristics of the target in-vehicle display terminal, determining target projection location information of the target in-vehicle display terminal that is compatible with the information to be projected, and displaying the information to be projected using the target projection location information.

[0012] Optionally, in one embodiment of this application, the filtering module includes: an acquisition unit for acquiring the projection tag of the information to be projected; a first determination unit for determining the priority of the projection tag based on the tag characteristics of the projection tag; and a second determination unit for determining the target vehicle display terminal based on the priority, the vehicle display terminal, the driving status parameters, the gear signal, and the passenger perception information.

[0013] Optionally, in one embodiment of this application, the second determining unit includes: a first determining subunit, configured to determine that the target vehicle display terminal is the first vehicle display terminal among the vehicle display terminals when the driving speed obtained based on the driving state parameters is greater than a preset speed threshold; and a second determining subunit, configured to determine that the target vehicle display terminal is the second vehicle display terminal among the vehicle display terminals when the driving speed is less than or equal to the preset speed threshold, wherein the first vehicle display terminal and the second vehicle display terminal are adapted to different viewing angles of the driver.

[0014] Optionally, in one embodiment of this application, the second determining unit includes: a first determining subunit, configured to turn off the third vehicle display terminal and determine that the target vehicle display terminal is not the third vehicle display terminal when the passenger seat is unoccupied based on the passenger seat occupant perception information; wherein the third vehicle display terminal is adapted to the passenger seat occupant's viewing angle; and a second determining subunit, configured to determine the target vehicle display terminal based on the priority, the vehicle display terminal, the driving status parameters, the gear signal, and the passenger seat occupant perception information when the passenger seat is not unoccupied.

[0015] Optionally, in one embodiment of this application, the second determining unit includes: a third determining subunit, configured to determine the target vehicle display terminal based on the priority, the vehicle display terminal, the driving status parameters, the gear signal, and the passenger-side occupant's perception information when the gear signal is not a reverse gear signal; and a fourth determining subunit, configured to determine the target vehicle display terminal as the second vehicle display terminal when the gear signal is the reverse gear signal.

[0016] Optionally, in one embodiment of this application, the determining module includes: a third determining unit, configured to determine candidate projection location information based on the target vehicle-mounted display terminal; a calculation unit, configured to extract candidate screen features corresponding to the candidate projection location information, and calculate screen scores corresponding to different candidate projection locations based on the candidate screen features; and a fourth determining unit, configured to filter out target projection locations that meet preset location conditions from the candidate projection locations based on the screen scores, and determine the target projection location information based on the target projection location.

[0017] A third aspect of this application provides a vehicle, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the interaction method of the in-vehicle display terminal as described in the above embodiments.

[0018] A fourth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described interaction method of an in-vehicle display terminal.

[0019] A fifth aspect of this application provides a computer program product, including a computer program that, when executed, implements the interaction method of the vehicle-mounted display terminal described above.

[0020] This application embodiment can first collect vehicle driving status parameters, gear signals, and passenger perception information. Using these parameters as the basis for screen projection decisions, it can combine real-time vehicle operating conditions and passenger distribution to manage screen projection, achieving scenario-based dynamic adjustment of the projection strategy. Upon receiving screen interaction commands from the vehicle, it filters target in-vehicle display terminals based on driving status parameters, gear signals, and passenger perception information. It can distribute the corresponding projection content to appropriate displays, preventing irrelevant screens from randomly displaying projection images and reducing visual interference to the driver. Furthermore, based on the screen characteristics of the target in-vehicle display terminal, it determines the target projection position information of the target in-vehicle display terminal that is compatible with the information to be projected, thereby displaying the information to be projected. It can adapt to in-vehicle screens of different sizes and shapes, achieving adaptive layout display of the projection image, improving the integrity and visual effect of the image display, and taking into account both driving safety and the viewing needs of multiple passengers in the vehicle. This solves several problems in related technologies, such as the lack of screen adaptive adaptation capabilities in interconnected systems, making it difficult to adapt to the layout differences of various vehicle models and different display screen types, and failing to automatically output the optimal projection layout; the simultaneous display of core driving information and entertainment information on the same screen, which can easily distract the driver and pose a driving safety hazard; and the lack of dynamic resource scheduling strategies based on content priority in multi-screen collaboration, resulting in an imbalance in traffic and computing power allocation and low system operating efficiency.

[0021] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0022] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein: Figure 1 This is a flowchart illustrating an interaction method for an in-vehicle display terminal according to an embodiment of this application; Figure 2 This is a block diagram of an in-vehicle display terminal architecture according to an embodiment of this application; Figure 3 A flowchart illustrating the working principle of an interaction method for an in-vehicle display terminal according to an embodiment of this application; Figure 4 This is a block diagram of the interactive device of the vehicle-mounted display terminal provided according to an embodiment of this application; Figure 5 This is a structural schematic diagram of a vehicle provided according to an embodiment of this application. Detailed Implementation

[0023] The embodiments of this application are described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0024] The following description, with reference to the accompanying drawings, describes an interaction method, device, vehicle, medium, and program product for an in-vehicle display terminal according to embodiments of this application. Addressing the issues mentioned in the background art, such as the lack of screen adaptive adaptation capabilities in interconnected systems, difficulty in adapting to the layout differences of various vehicle models and different display screen types, and the inability to automatically output the optimal projection layout; the simultaneous display of core driving information and entertainment information on the same screen, which easily distracts the driver and poses a driving safety hazard; and the lack of dynamic resource scheduling strategies based on content priority in multi-screen collaboration, resulting in an imbalance between traffic and computing power allocation and low system operating efficiency, this application provides an interaction method for an in-vehicle display terminal. In this method, vehicle driving status parameters, gear signals, and passenger-side occupant perception information are first collected. These parameters are then used as the basis for projection decisions, combining real-time vehicle operating conditions with… The system manages screen projection based on the distribution of occupants within the vehicle, enabling dynamic adjustment of projection strategies across different scenarios. Upon receiving screen interaction commands from the vehicle, it filters target in-vehicle display terminals based on driving status parameters, gear position signals, and the perception information of the front passenger. It distributes corresponding projection content to appropriate displays, preventing irrelevant screens from randomly displaying projection images and reducing visual interference to the driver. Furthermore, based on the screen characteristics of the target in-vehicle display terminal, it determines the target projection position information of the terminal compatible with the information to be projected, thus displaying the information. This system can adapt to in-vehicle screens of different sizes and shapes, achieving adaptive layout display of the projection image, improving the integrity and visual effect of the image, and balancing driving safety with the viewing needs of multiple occupants. This solves problems in related technologies, such as the lack of screen adaptive adaptation capabilities in interconnected systems, difficulty in adapting to the layout differences of various vehicle models and display types, and the inability to automatically output the optimal projection layout; the overlapping display of core driving information and entertainment information on the same screen, which easily distracts the driver and poses a driving safety hazard; and the lack of dynamic resource scheduling strategies based on content priority in multi-screen collaboration, resulting in an imbalance in traffic and computing power allocation and low system operating efficiency.

[0025] Specifically, Figure 1 This is a flowchart of an interaction method for an in-vehicle display terminal provided according to an embodiment of this application.

[0026] like Figure 1 As shown, the interaction method of this in-vehicle display terminal includes the following steps: In step S101, vehicle driving status parameters, gear signals, and passenger perception information are collected.

[0027] It is understood that, in the embodiments of this application, the driving state parameters are a set of state parameters used to characterize the real-time driving conditions of the vehicle, which may include, but are not limited to, driving speed, driving direction, turn signal, etc.

[0028] Furthermore, driving status parameters can be obtained from the vehicle CAN (Controller Area Network) bus, vehicle Ethernet, etc., and output by the vehicle controller, ESP (Electronic Stability Program), and transmission controller.

[0029] The gear position signal is a bus signal used to indicate the current gear position of the vehicle. It may include, but is not limited to, parking signal, reverse gear signal, neutral gear signal, and drive gear signal.

[0030] Passenger perception information is used to determine whether there is a passenger in the passenger seat. It may include, but is not limited to, pressure information and visual information of the passenger seat.

[0031] In some embodiments, the present application can collect vehicle driving status parameters, gear signals, and passenger perception information in real time.

[0032] In step S102, in response to the vehicle's screen interaction command, a target vehicle display terminal that matches the driving status parameters, gear signal, and passenger perception information is selected from the vehicle's in-vehicle display terminals.

[0033] It is understood that, in the embodiments of this application, the vehicle-mounted display terminal may include, but is not limited to, a first vehicle-mounted display terminal, such as an instrument panel display, a HUD (Head-Up Display) unit, etc.; a second vehicle-mounted display terminal, such as a central control display; and a third vehicle-mounted display terminal, such as a passenger-side display, etc., the architecture of which is shown in the figure below. Figure 2 As shown.

[0034] Screen interaction commands can be understood as trigger commands initiated from inside the vehicle, requesting the application screen or navigation content to be projected onto the in-vehicle display terminal. They can be divided into active triggering and automatic triggering. Active triggering can be understood as the user initiating a screen projection request through touch dragging, voice commands, or button operations; automatic commands can be understood as display requests such as navigation startup or automatically activating the 360-degree surround view when the vehicle is in reverse gear.

[0035] The target vehicle display terminal can be understood as the cockpit display carrier that has been screened and finally determined to be used to display the projected content.

[0036] In some embodiments of this application, when the vehicle receives a screen interaction command, it traverses all in-vehicle display terminals in the cabin based on driving status parameters, gear signals, and passenger perception information, thereby selecting the target in-vehicle display terminal.

[0037] For example, in the embodiments of this application, when a screen interaction command is received, if the driving speed is greater than 60km / h, only the instrument display screen and the HUD head-up display unit can be used as the target vehicle display terminal; if the passenger seat is unoccupied, the passenger seat display screen is turned off; if a reverse gear signal is received, the terminal capable of displaying 360-degree surround view images is used as the target vehicle display terminal.

[0038] Optionally, in one embodiment of this application, selecting target in-vehicle display terminals from the vehicle's in-vehicle display terminals that match driving status parameters, gear position signals, and passenger perception information includes: obtaining a projection tag for the information to be projected; determining the priority of the projection tag based on its tag characteristics; and determining the target in-vehicle display terminal based on the priority, the in-vehicle display terminal, driving status parameters, gear position signals, and passenger perception information.

[0039] It is understood that, in the embodiments of this application, the information to be projected can be understood as images, videos, user interfaces, navigation data streams, etc., to be distributed to the vehicle display terminal for screen display, which may include, but is not limited to, next turn navigation guidance information, 360° surround view images, multimedia entertainment videos, etc.

[0040] Screen mirroring tags may include, but are not limited to, navigation tags, communication tags, and entertainment tags; this application does not impose specific restrictions.

[0041] Furthermore, in this embodiment, the tag features of the screen casting tag can be understood as the attribute information inherent to the screen casting tag, which may include, but is not limited to, content security level, service type identifier, urgency level, and scene attributes. For example, the tag features corresponding to navigation tags may include, but are not limited to, turning vector icons, distance data, and current road names; the tag features corresponding to communication tags may include, but are not limited to, caller ID pictures, SMS text, and voice call status; and the tag features corresponding to entertainment tags may include, but are not limited to, album covers, lyrics stream, and progress bars.

[0042] The priority of the screen casting tag can be understood as a quantitative level obtained by assigning values ​​based on the tag characteristics. It is used to represent the importance of the information to be cast. It may include, but is not limited to, high priority and low priority. For example, navigation and reversing camera are high priority, while audio and video entertainment are low priority.

[0043] In some embodiments, the present application can first read the projection tag bound to the projection information, then extract the tag features corresponding to the projection tag, and assign priority to the projection information according to the tag features, thereby integrating priority, vehicle display terminal, driving status parameters, gear signal and passenger perception information, etc., to select the target vehicle display terminal for displaying the projection information.

[0044] For example, embodiments of this application can perform deep packet inspection on the received screen projection information to be projected, and parse out the projection tags of the application layer protocol, such as navigation tags, communication tags, and entertainment tags, and then extract the tag features corresponding to each projection tag, such as the turning vector icon, distance data, and current road name corresponding to the navigation tag; the caller ID picture, SMS text, and voice call status corresponding to the communication tag; and the album cover, lyrics stream, and progress bar corresponding to the entertainment tag.

[0045] Then, the priority of the information to be projected is determined based on the tag characteristics. For example, navigation and reversing camera are high priority, while audio and video entertainment are low priority. Then, based on the priority, the vehicle display terminal, driving status parameters, gear position signal and passenger perception information, the target vehicle display terminal for displaying the information to be projected is determined.

[0046] Optionally, in one embodiment of this application, determining the target vehicle display terminal based on priority, vehicle display terminal, driving status parameters, gear position signal, and passenger perception information includes: if the driving speed obtained based on the driving status parameters is greater than a preset speed threshold, then the target vehicle display terminal is determined to be the first vehicle display terminal among vehicle display terminals; if the driving speed is less than or equal to the preset speed threshold, then the target vehicle display terminal is determined to be the second vehicle display terminal among vehicle display terminals, wherein the first vehicle display terminal and the second vehicle display terminal are respectively adapted to the driver's different observation angles.

[0047] It is understood that, in the embodiments of this application, the first vehicle display terminal is used to describe the target vehicle display terminal selected under the high-speed condition of the vehicle, which may include, but is not limited to, the left side area of ​​the instrument display screen, the HUD head-up display unit, etc.; the second vehicle display terminal is used to describe the target vehicle display terminal selected under the low-speed condition of the vehicle, which may include, but is not limited to, the central control display screen, etc.

[0048] The first and second vehicle-mounted display terminals are installed in different positions, and their deviation angles relative to the driver's center line of sight are different. The first vehicle-mounted display terminal is closer to the driver's center line of sight, while the second vehicle-mounted display terminal has a greater offset relative to the driver's center line of sight. The specific settings can be made by those skilled in the art according to the actual situation, and this application does not impose any specific limitations.

[0049] In some embodiments, the present application can analyze driving state parameters to determine the vehicle speed and compare it with a preset speed threshold: if the vehicle speed is greater than the preset speed threshold, it is determined that the vehicle is in a high-speed condition, and a first in-vehicle display terminal adapted to the driver's head-up view, such as the left area of ​​the instrument display screen or the HUD head-up display unit, is identified as the target in-vehicle display terminal; if the vehicle speed is less than or equal to the preset speed threshold, it is determined that the vehicle is in a low-speed condition, and a second in-vehicle display terminal with a larger observation line offset, such as the central control display screen, is identified as the target in-vehicle display terminal. The preset speed threshold can be set by those skilled in the art according to actual conditions, and this application does not impose specific limitations.

[0050] For example, in this embodiment of the application, when the vehicle speed obtained via the CAN bus exceeds 60 km / h, a "safety redundancy mode" can be triggered. At this time, the next turn navigation guidance information extracted from the navigation stream is converted into 200... A simplified image stream with a resolution of 200 is used to identify the target in-vehicle display terminals as the left area of ​​the instrument panel display and the HUD head-up display unit. Then, through rendering processing, the information to be projected is mapped to the left area of ​​the instrument panel display and the HUD head-up display unit, thereby ensuring that the driver can obtain key intersection information without deviating from the driver's line of sight. At the same time, the rendering frequency of non-critical animations on the central control display can be automatically reduced (e.g., from 60fps to 30fps), effectively reducing the power consumption of the domain controller and improving driving safety.

[0051] Optionally, in one embodiment of this application, determining the target vehicle display terminal based on priority, vehicle display terminal, driving status parameters, gear position signal, and passenger perception information includes: if the passenger seat is unoccupied based on the passenger perception information, then the third vehicle display terminal is turned off, and the target vehicle display terminal is determined not to be the third vehicle display terminal, wherein the third vehicle display terminal is adapted to the passenger's viewing angle; if the passenger seat is not unoccupied, then the target vehicle display terminal is determined based on priority, vehicle display terminal, driving status parameters, gear position signal, and passenger perception information.

[0052] It is understood that in the embodiments of this application, the front passenger seat may or may not be in an unoccupied state, and this application does not impose specific restrictions. Here, "unoccupied state" can be understood as no occupant being detected in the front passenger seat.

[0053] The third in-vehicle display terminal can be understood as an in-vehicle display terminal adapted to the viewing angle of the front passenger, which can be the front passenger display screen. Its constraint logic can be: when the front passenger is unoccupied, the front passenger display screen stops working and no longer distributes the information to be projected to the front passenger display screen, that is, the target in-vehicle display terminal is not the third in-vehicle display terminal.

[0054] In some embodiments, this application can detect whether the passenger seat is unoccupied based on the passenger's perception information. If the passenger seat is unoccupied, the third vehicle display terminal is turned off, and in the subsequent process of selecting target vehicle display terminals, the third vehicle display terminal is directly excluded and no more screen projection content is distributed to it.

[0055] In addition, in this embodiment of the application, when the passenger seat is not unoccupied, that is, when it is determined that there is a passenger in the passenger seat, the third vehicle display terminal can be retained as an optional projection carrier. Then, the target vehicle display terminal carrying the projection information is determined by comprehensively considering the priority, vehicle display terminal, driving status parameters, gear position signal and passenger perception information.

[0056] For example, in embodiments of this application, when the passenger-side display screen is not unattended and has physically rounded corners, this embodiment implements a pre-clipping technology based on edge perception to determine the target vehicle display terminal. The main content includes: first, determining the dead zone coordinate range of the four corners of the passenger-side display screen based on a screen image library; then, calling a nonlinear rendering interpolation algorithm to perform safe zone displacement on interactive controls within the passenger-side display screen interface, such as the song change button and the exit button. Specifically, in embodiments of this application, when the button center of an interactive control is detected to be within a rounded corner occlusion area of ​​radius R, the perpendicular distance d from the button center to the tangent of the physical boundary of the passenger-side display screen is calculated, and the user interface component is then translated inward by D, where D = R - d + buffer, and buffer is a safety margin, which can be set by those skilled in the art according to actual conditions; this application does not impose specific limitations. This solves the problem of interactive dead zones that occur when projecting a mobile phone screen onto a non-standard irregularly shaped screen, achieving perfect adaptive alignment of the user interface and improving user convenience.

[0057] Optionally, in one embodiment of this application, determining the target vehicle display terminal based on priority, vehicle display terminal, driving status parameters, gear signal, and passenger perception information includes: if the gear signal is not a reverse gear signal, then determining the target vehicle display terminal based on priority, vehicle display terminal, driving status parameters, gear signal, and passenger perception information; if the gear signal is a reverse gear signal, then determining the target vehicle display terminal as a second vehicle display terminal.

[0058] In some embodiments, the present application can use the gear position signal as a branch judgment to perform display scheduling: when the gear position signal is not a reverse gear signal, such as when the vehicle is in forward or parked conditions, the target vehicle display terminal can be determined by comprehensively considering the priority, the vehicle display terminal, driving status parameters, gear position signal, and the passenger's perception information; when the gear position signal is a reverse gear signal, it is determined that the vehicle is in a reversing condition. At this time, the multi-parameter comprehensive calculation process is skipped, and the second vehicle display terminal is determined as the target vehicle display terminal, giving priority to the display of 360-degree surround view images and avoiding other screens from occupying display resources.

[0059] For example, in this application embodiment, when the vehicle is in reverse gear, i.e. the gear signal is reverse, the native priority logic is entered: after the cockpit domain controller receives the screen interaction command, the interconnected video stream currently on the central control display is suspended in the background or scaled to the passenger screen in real time, releasing the bus bandwidth to the 360-degree surround view image. When reversing ends and the vehicle is switched back to drive, the distribution state of the interconnected content is restored through the breakpoint position register to ensure the continuity of interaction.

[0060] In step S103, based on the screen characteristics of the target vehicle display terminal, the target projection location information of the target vehicle display terminal that is compatible with the information to be projected is determined, and the information to be projected is displayed using the target projection location information.

[0061] It is understood that, in the embodiments of this application, screen features can be understood as a set of real-time display attributes inherent to the target vehicle display terminal, which may include, but are not limited to, screen resolution, display modal parameters (such as the width, height and radius of curvature of the screen), screen shape (such as rectangular, irregular rounded corner screen, etc.), physical coordinates (such as the position of the center point of the screen relative to the center of the driver's line of sight), field of view weight (such as the weight defined according to the angle between the screen and the driver's forward line of sight), four corner dead zone range, visible area (the current occlusion percentage of the screen or the remaining usable area), etc., and this application does not impose specific limitations.

[0062] The target projection location information can be understood as the set of coordinate parameters of the information to be projected in the display coordinate system of the target vehicle display terminal. It may include, but is not limited to, the interface starting coordinates, the width and height of the display area, the offset distance, the scaling ratio, and the translation amount of the user interface components.

[0063] In some embodiments, after selecting a target vehicle display terminal, the present application can obtain the screen features corresponding to the target vehicle display terminal, and then calculate the target projection location information that is compatible with the information to be projected based on the screen features, and display the information to be projected based on the target projection location information.

[0064] For example, in this embodiment of the application, after the cockpit domain controller is started, the screen features of the target vehicle display terminal can be obtained through the screen image library, such as physical coordinates, display modal parameters, field of view weights, four corner dead zones, and visible area. Then, by combining the screen features such as physical coordinates, display modal parameters, field of view weights, four corner dead zones, and visible area, the target projection position information that is adapted to the information to be projected can be calculated. The layout coordinates and interface offset of the information to be projected can be adjusted according to the target projection position information, so as to display the information to be projected, thereby realizing the adaptation of the projected content to the boundary of the irregular display screen and avoiding the dead zones of rounded corner interaction.

[0065] Optionally, in one embodiment of this application, determining the target projection location information of the target vehicle display terminal that is compatible with the information to be projected, based on the screen features of the target vehicle display terminal, includes: determining candidate projection location information based on the target vehicle display terminal; extracting candidate screen features corresponding to the candidate projection location information, and calculating screen scores corresponding to different candidate projection locations based on the candidate screen features; filtering out target projection locations that meet preset location conditions from the candidate projection locations based on the screen scores, and determining the target projection location information based on the target projection location.

[0066] It is understood that, in the embodiments of this application, the candidate projection position information can be understood as multiple sets of alternative layout parameters pre-generated within the display coordinate system of the target vehicle display terminal; each set of information represents a set of selectable projection placement schemes; and the candidate projection position can be understood as the candidate display area on the target vehicle display terminal corresponding to the candidate projection position information.

[0067] Furthermore, in the embodiments of this application, the candidate screen features can be understood as the display panel attribute parameters corresponding to any candidate projection position, which may include, but are not limited to, whether the candidate projection position falls within a rounded corner occlusion area, etc.

[0068] In some embodiments, after determining the target vehicle-mounted display terminal corresponding to the information to be projected, this application can determine several candidate projection location information based on the target vehicle-mounted display terminal, extract candidate screen features corresponding to each candidate projection location information, calculate the screen score corresponding to each candidate projection location using the candidate screen features, compare all screen scores, and filter out the target projection location that meets the preset location conditions from the candidate projection locations, thereby determining the corresponding target projection location information. The preset location conditions can be set by those skilled in the art according to actual conditions, and this application does not impose specific limitations.

[0069] The formula for calculating the screen score can be, but is not limited to, expressed as: , in, Priority (e.g., navigation is 0.9, entertainment is 0.2); This represents the current percentage of screen obstruction or the remaining usable area. The angle at which the screen deviates from the driver's center line of sight; , , These are the weighting coefficients.

[0070] The working principle of the interaction method of the vehicle-mounted display terminal proposed in this application will be introduced below with reference to a specific embodiment.

[0071] Figure 3 This is a flowchart illustrating the working principle of an interaction method for an in-vehicle display terminal according to an embodiment of this application.

[0072] Step S301: Collect vehicle driving status parameters, gear signals and passenger perception information to determine the vehicle's on-board display terminal.

[0073] Among them, driving status parameters may include, but are not limited to, driving speed, driving direction, turn signal, etc.; gear signals may include, but are not limited to, parking signal, reverse gear signal, neutral gear signal, drive gear signal, etc.; vehicle display terminals may include, but are not limited to, instrument display screen, HUD head-up display unit, central control display screen, passenger display screen, etc.

[0074] Step S302: Obtain the screen casting tag of the information to be cast and determine the priority.

[0075] Among them, screen mirroring tags may include, but are not limited to, navigation tags, communication tags, and entertainment tags.

[0076] Step S303: Logical judgment node.

[0077] The target vehicle-mounted display terminal can be a first vehicle-mounted display terminal, a second vehicle-mounted display terminal, or a third vehicle-mounted display terminal.

[0078] Step S304: Detect whether the vehicle speed is greater than the preset speed threshold.

[0079] In this embodiment of the application, step S305 can be executed if the vehicle speed is greater than a preset speed threshold; otherwise, step S306 can be executed.

[0080] Step S305: Determine the target vehicle display terminal as the first vehicle display terminal.

[0081] Step S306: Determine the target vehicle display terminal as the second vehicle display terminal.

[0082] Step S307: Detect whether the passenger seat is unoccupied.

[0083] In this embodiment of the application, step S308 can be executed if the passenger seat is unoccupied; otherwise, step S309 can be executed.

[0084] Step S308: Turn off the third vehicle-mounted display terminal.

[0085] Step S309: Determine the target vehicle display terminal based on priority, vehicle display terminal, driving status parameters, gear position signal and passenger perception information.

[0086] Step S310: Detect whether the gear signal is a reverse gear signal.

[0087] In this embodiment of the application, step S306 can be executed if the gear signal is a reverse gear signal; otherwise, step S309 can be executed.

[0088] Step S311: Determine the target projection location information of the target vehicle display terminal and display the information to be projected.

[0089] In this embodiment, the target projection position can be determined based on the screen score, and then the corresponding projection information can be displayed.

[0090] According to the interaction method of the vehicle display terminal proposed in the embodiments of this application, the vehicle's driving status parameters, gear signal, and passenger perception information can be collected first. The driving status parameters, gear signal, and passenger perception information are used as the basis for screen projection decision. The screen projection can be controlled by combining the vehicle's real-time operating conditions and the distribution of people in the vehicle, realizing scenario-based dynamic adjustment of the screen projection strategy. After receiving the vehicle's screen interaction command, the target vehicle display terminal is selected based on the driving status parameters, gear signal, and passenger perception information. The corresponding screen projection content can be distributed to a reasonable display screen to prevent irrelevant screens from randomly popping up screen projection images and reduce visual interference to the driver. Then, based on the screen characteristics of the target vehicle display terminal, the target screen projection position information of the target vehicle display terminal that is compatible with the screen projection information is determined, thereby displaying the screen projection information. It can adapt to vehicle screens of different sizes and shapes, realize adaptive layout display of screen projection images, improve the integrity and visual effect of the image display, and take into account driving safety and the viewing needs of multiple passengers in the vehicle. This solves several problems in related technologies, such as the lack of screen adaptive adaptation capabilities in interconnected systems, making it difficult to adapt to the layout differences of various vehicle models and different display screen types, and failing to automatically output the optimal projection layout; the simultaneous display of core driving information and entertainment information on the same screen, which can easily distract the driver and pose a driving safety hazard; and the lack of dynamic resource scheduling strategies based on content priority in multi-screen collaboration, resulting in an imbalance in traffic and computing power allocation and low system operating efficiency.

[0091] Next, referring to the accompanying drawings, an interactive device for an in-vehicle display terminal according to an embodiment of this application is described.

[0092] Figure 4 This is a block diagram of the interactive device of an in-vehicle display terminal provided according to an embodiment of this application.

[0093] like Figure 4 As shown, the interactive device 10 of the vehicle-mounted display terminal includes: a data acquisition module 100, a filtering module 200, and a determination module 300.

[0094] The acquisition module 100 is used to collect vehicle driving status parameters, gear signals, and passenger perception information.

[0095] The filtering module 200 is used to filter target in-vehicle display terminals that match driving status parameters, gear signals and passenger perception information from the vehicle's in-vehicle display terminals in response to the vehicle's screen interaction commands.

[0096] The determination module 300 is used to determine the target projection location information of the target vehicle display terminal that is compatible with the information to be projected, based on the screen characteristics of the target vehicle display terminal, and to display the information to be projected using the target projection location information.

[0097] Optionally, in one embodiment of this application, the filtering module 200 includes: an acquisition unit, a first determination unit, and a second determination unit.

[0098] The acquisition unit is used to acquire the projection tag of the information to be projected.

[0099] The first determining unit is used to determine the priority of the projection tag based on the tag characteristics of the projection tag.

[0100] The second determining unit is used to determine the target vehicle display terminal based on priority, vehicle display terminal, driving status parameters, gear position signal and passenger perception information.

[0101] Optionally, in one embodiment of this application, the second determining unit includes: a first determining subunit and a second determining subunit.

[0102] The first determination subunit is used to determine that the target vehicle display terminal is the first vehicle display terminal among vehicle display terminals when the driving speed obtained based on the driving state parameters is greater than a preset speed threshold.

[0103] The second determination subunit is used to determine that the target vehicle display terminal is the second vehicle display terminal among the vehicle display terminals when the vehicle speed is less than or equal to a preset speed threshold. The first vehicle display terminal and the second vehicle display terminal are respectively adapted to the driver's different observation angles.

[0104] Optionally, in one embodiment of this application, the second determining unit includes: a first determining subunit and a second determining subunit.

[0105] The first determining subunit is used to turn off the third vehicle display terminal when the passenger seat is unoccupied, based on the passenger's perception information. It also determines that the target vehicle display terminal is not the third vehicle display terminal, wherein the third vehicle display terminal is adapted to the passenger's observation perspective.

[0106] The second determining subunit is used to determine the target vehicle display terminal based on priority, vehicle display terminal, driving status parameters, gear signal and passenger perception information when the passenger seat is not unoccupied.

[0107] Optionally, in one embodiment of this application, the second determining unit includes a third determining subunit and a fourth determining subunit.

[0108] The third determining subunit is used to determine the target vehicle display terminal based on priority, vehicle display terminal, driving status parameters, gear signal and passenger perception information when the gear signal is not a reverse gear signal.

[0109] The fourth determining subunit is used to determine the target vehicle display terminal as the second vehicle display terminal when the gear signal is a reverse gear signal.

[0110] Optionally, in one embodiment of this application, the determining module 300 includes: a third determining unit, a calculation unit, and a fourth determining unit.

[0111] The third determining unit is used to determine the candidate projection location information based on the target vehicle-mounted display terminal.

[0112] The calculation unit is used to extract candidate screen features corresponding to candidate projection location information, and calculate the screen score corresponding to different candidate projection locations based on the candidate screen features.

[0113] The fourth determining unit is used to filter out target projection locations that meet preset location conditions from candidate projection locations based on screen scores, and determine target projection location information based on the target projection location.

[0114] It should be noted that the foregoing explanation of the interaction method embodiment for the vehicle-mounted display terminal also applies to the interaction device of the vehicle-mounted display terminal in this embodiment, and will not be repeated here.

[0115] The interactive device for the vehicle-mounted display terminal proposed in this application can first collect the vehicle's driving status parameters, gear signal, and passenger perception information. Using these parameters as the basis for screen projection decisions, it can combine the vehicle's real-time operating conditions and the distribution of occupants to manage screen projection, achieving scenario-based dynamic adjustment of the projection strategy. Upon receiving the vehicle's screen interaction command, it filters the target vehicle-mounted display terminal based on the driving status parameters, gear signal, and passenger perception information. It can distribute the corresponding projection content to a suitable display screen, preventing irrelevant screens from randomly displaying projection images and reducing visual interference to the driver. Furthermore, based on the screen characteristics of the target vehicle-mounted display terminal, it determines the target projection position information of the target vehicle-mounted display terminal that is compatible with the information to be projected, thereby displaying the information to be projected. It can adapt to vehicle-mounted screens of different sizes and shapes, achieving adaptive layout display of the projection image, improving the integrity and visual effect of the image display, and taking into account both driving safety and the viewing needs of multiple occupants in the vehicle. This solves several problems in related technologies, such as the lack of screen adaptive adaptation capabilities in interconnected systems, making it difficult to adapt to the layout differences of various vehicle models and different display screen types, and failing to automatically output the optimal projection layout; the simultaneous display of core driving information and entertainment information on the same screen, which can easily distract the driver and pose a driving safety hazard; and the lack of dynamic resource scheduling strategies based on content priority in multi-screen collaboration, resulting in an imbalance in traffic and computing power allocation and low system operating efficiency.

[0116] Figure 5 This is a schematic diagram of the structure of a vehicle according to an embodiment of this application. The vehicle may include: The memory 501, the processor 502, and the computer program stored on the memory 501 and capable of running on the processor 502.

[0117] When the processor 502 executes the program, it implements the interaction method of the vehicle display terminal provided in the above embodiments.

[0118] Furthermore, the vehicle also includes: Communication interface 503 is used for communication between memory 501 and processor 502.

[0119] The memory 501 is used to store computer programs that can run on the processor 502.

[0120] Memory 501 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0121] If the memory 501, processor 502, and communication interface 503 are implemented independently, then the communication interface 503, memory 501, and processor 502 can be interconnected via a bus to complete communication between them. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 5 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0122] Optionally, in a specific implementation, if the memory 501, processor 502, and communication interface 503 are integrated on a single chip, then the memory 501, processor 502, and communication interface 503 can communicate with each other through an internal interface.

[0123] Processor 502 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application.

[0124] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the above-described interaction method of the vehicle-mounted display terminal.

[0125] This application also provides a computer program product, including a computer program that, when executed, implements the above-described interaction method for an in-vehicle display terminal.

[0126] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0127] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0128] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or N executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.

[0129] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0130] It should be understood that the various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, it can be implemented using any one or more of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0131] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0132] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0133] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of this application.

Claims

1. An interaction method for an in-vehicle display terminal, characterized in that, Includes the following steps: Collect vehicle driving status parameters, gear signals, and passenger-side occupant perception information; In response to the screen interaction command of the vehicle, a target vehicle display terminal that matches the driving status parameters, the gear signal and the passenger perception information is selected from the vehicle's vehicle display terminals. Based on the screen characteristics of the target vehicle-mounted display terminal, the target projection location information of the target vehicle-mounted display terminal that is compatible with the information to be projected is determined, and the information to be projected is displayed using the target projection location information.

2. The method according to claim 1, characterized in that, The step of selecting target in-vehicle display terminals from the vehicle's in-vehicle display terminals that match the driving status parameters, the gear position signal, and the passenger-side occupant's perception information includes: Obtain the screen projection tag of the screen projection information to be projected; Based on the tag characteristics of the screen casting tag, the priority of the screen casting tag is determined; The target vehicle display terminal is determined based on the priority, the vehicle display terminal, the driving status parameters, the gear signal, and the passenger's perception information.

3. The method according to claim 2, characterized in that, The step of determining the target in-vehicle display terminal based on the priority, the in-vehicle display terminal, the driving status parameters, the gear position signal, and the passenger's perception information includes: If the driving speed obtained based on the driving status parameters is greater than a preset speed threshold, then the target vehicle display terminal is determined to be the first vehicle display terminal among the vehicle display terminals. If the vehicle speed is less than or equal to the preset speed threshold, the target vehicle display terminal is determined to be the second vehicle display terminal among the vehicle display terminals, wherein the first vehicle display terminal and the second vehicle display terminal are adapted to different viewing angles of the driver.

4. The method according to claim 3, characterized in that, The step of determining the target in-vehicle display terminal based on the priority, the in-vehicle display terminal, the driving status parameters, the gear position signal, and the passenger's perception information includes: If the front passenger seat is found to be unoccupied based on the front passenger's perception information, the third vehicle display terminal is turned off, and it is determined that the target vehicle display terminal is not the third vehicle display terminal, wherein the third vehicle display terminal is adapted to the front passenger's observation perspective. If the passenger seat is not in the unmanned state, the target passenger seat is determined based on the priority, the vehicle display terminal, the driving status parameters, the gear signal, and the passenger seat occupant's perception information.

5. The method according to claim 4, characterized in that, The step of determining the target in-vehicle display terminal based on the priority, the in-vehicle display terminal, the driving status parameters, the gear position signal, and the passenger's perception information includes: If the gear position signal is not a reverse gear signal, the target vehicle display terminal is determined based on the priority, the vehicle display terminal, the driving status parameters, the gear position signal, and the passenger's perception information. If the gear signal is the reverse gear signal, then the target vehicle display terminal is determined to be the second vehicle display terminal.

6. The method according to claim 1, characterized in that, The step of determining the target projection location information of the target vehicle-mounted display terminal, which is adapted to the information to be projected, based on the screen characteristics of the target vehicle-mounted display terminal includes: Based on the target vehicle-mounted display terminal, determine the candidate projection location information; Extract the candidate screen features corresponding to the candidate projection location information, and calculate the screen score corresponding to different candidate projection locations based on the candidate screen features; Based on the screen score, target projection locations that meet preset location conditions are selected from the candidate projection locations, and the target projection location information is determined based on the target projection location.

7. An interactive device for an in-vehicle display terminal, characterized in that, include: The data acquisition module is used to collect vehicle driving status parameters, gear signals, and passenger-side occupant perception information. The filtering module is used to respond to the screen interaction command of the vehicle and filter the vehicle's in-vehicle display terminals to select target in-vehicle display terminals that match the driving status parameters, the gear signal and the passenger's perception information. The determination module is used to determine the target projection location information of the target vehicle display terminal that is compatible with the projection information based on the screen characteristics of the target vehicle display terminal, and to display the projection information using the target projection location information.

8. A vehicle, characterized in that, include: A memory, a processor, and a computer program stored in the memory and executable on the processor, the processor executing the program to implement the interaction method of the vehicle-mounted display terminal as described in any one of claims 1-6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, The program is executed by the processor to implement the interaction method of the vehicle-mounted display terminal as described in any one of claims 1-6.

10. A computer program product, characterized in that, Includes a computer program, which, when executed, is used to implement the interaction method of the vehicle-mounted display terminal as described in any one of claims 1-6.

Images