Screen projection method and device, vehicle, computer program product and readable storage medium

Abstract

The application provides a screen projection method and device, a vehicle, a computer program product and a readable storage medium, relates to the technical field of intelligent control of vehicles, and the screen projection method comprises the following steps: after detecting a screen projection starting operation, acquiring current scene feature information; when a screen projection network mode is matched according to the current scene feature information, performing corresponding network connection configuration according to the matched screen projection network mode; after the network connection configuration is completed, starting a screen projection protocol to perform a screen projection operation. Through the screen projection method, the screen projection operation process can be simplified, and the driving safety can be improved.

Description

Technical Field

[0001] This application relates to the field of vehicle intelligent control technology, and in particular to projection methods, devices, vehicles, computer program products, and readable storage media. Background Technology

[0002] The front vehicle screen projection requires users to manually select the network connection mode and complete configuration operations such as hotspot activation, network search, and password input step by step. The process is cumbersome and distracts the driver, posing a safety hazard. Summary of the Invention

[0003] This application provides a screen projection method, device, vehicle, computer program product, and readable storage medium to simplify the screen projection operation process and improve driving safety.

[0004] Firstly, this application provides a screen projection method applied to a vehicle. The screen projection method includes: after detecting a screen projection initiation operation, obtaining current scene feature information; when a screen projection network mode is matched based on the current scene feature information, executing the corresponding network connection configuration according to the matched screen projection network mode; and after the network connection configuration is completed, starting the screen projection protocol to perform the screen projection operation.

[0005] This application obtains current scene feature information upon detecting a screen mirroring initiation operation, and automatically executes the corresponding network connection configuration when a screen mirroring network mode is matched based on this feature information. Then, the screen mirroring protocol is initiated after the network connection configuration is complete. Since the selection of the screen mirroring network mode is automatically matched by the system based on the current scene feature information, users do not need to manually determine and select the network mode each time they want to mirror, reducing operational complexity. Simultaneously, the automatic execution of network connection configuration enables the vehicle's infotainment system and mobile terminal to establish a connection in the optimal way within the current scene. After the network connection configuration is complete, the screen mirroring protocol is initiated uniformly, ensuring the stable establishment of the screen mirroring data channel. This improves user convenience while guaranteeing the smoothness and success rate of screen mirroring operations.

[0006] In some possible implementations, the screen casting method also includes: after obtaining the current scene feature information, matching the current scene feature information with the scene-mode mapping record, the scene-mode mapping record including the correspondence between the historical scene features associated with the historical screen casting operations and the screen casting network mode adopted.

[0007] By introducing a scene-pattern mapping record matching mechanism, the system can leverage users' past successful screen-casting experiences to guide the selection of the current screen-casting network mode. The scene-pattern mapping record, as a digital repository of historical experience, associates and stores historical scene characteristics with successful screen-casting network modes at the time, forming a dynamically growing "experience base." After acquiring current scene characteristic information, the system prioritizes querying this mapping record, enabling it to "memorize" and learn and reproduce users' screen-casting preferences in different scenarios, thereby improving the accuracy of matching decisions and user satisfaction.

[0008] In some possible implementations, the current scene feature information is matched with the scene-pattern mapping record. Specifically, this includes: calculating the similarity between the current scene feature information and each historical scene feature in the scene-pattern mapping record; and using the projection network pattern corresponding to the historical scene feature with a similarity exceeding a preset threshold as the projection network pattern matched by the current scene feature information.

[0009] The matching method described above achieves flexible reuse of historical experience through similarity calculation, rather than simple conditional matching. The preset threshold ensures that the corresponding projection network mode is adopted only when the historical scene is sufficiently similar to the current scene, avoiding the rigid application of historical experience when scene differences are significant, thus guaranteeing the reliability of the matching results. Similarity calculation can comprehensively consider multi-dimensional information such as geographical proximity, time window overlap, and network signal level similarity to achieve fine-grained scene matching.

[0010] In some possible implementations, when multiple projection network patterns are matched, the projection network pattern corresponding to the historical scene feature with the highest similarity is selected as the matched projection network pattern.

[0011] When there are multiple matching results exceeding the preset threshold, the system selects the record with the highest similarity and further narrows down the "candidate set" to a single optimal decision. This allows the system to select the projection network mode that is closest to the current scenario from multiple available experiences, thereby further improving the accuracy of matching.

[0012] In some possible implementations, the screen casting method also includes: after successful screen casting, associating the current scene feature information obtained when the screen casting was started with the screen casting network mode used and storing it in the scene-mode mapping record.

[0013] By associating and storing the scene characteristics of each successful screen mirroring session with the screen mirroring network mode used, the scene-mode mapping record can be continuously enriched and updated as the frequency of user use increases. This closed-loop learning mechanism enables the system's matching ability to continuously improve over time, gradually adapting to changes in users' personalized usage habits and preferences, and optimizing future matching decisions.

[0014] In some possible implementations, the screen casting method also includes associating and storing the current scene feature information obtained when the screen casting is started with the screen casting network mode adopted in the scene-mode mapping record. If there is already a record in the scene-mode mapping record that matches the current scene feature information, then the usage frequency of the historical record is increased or the corresponding screen casting network mode is updated to the screen casting network mode adopted this time.

[0015] By updating the frequency or pattern of existing records, the disorderly expansion of mapping records is avoided, while high-frequency usage patterns are reinforced and outdated patterns are corrected. When users' preferences change in the same scenario, the update mechanism ensures that the mapping records reflect the latest preferences in a timely manner, guaranteeing the dynamic adaptability of matching decisions.

[0016] In some possible implementations, when no matching projection network mode is found based on the current scene feature information, the target projection network mode is determined based on the current scene feature information; and the projection operation is performed based on the target projection network mode.

[0017] When a completely new scenario (such as a new parking space, a new time period, or a new combination of network environments) occurs, resulting in no historical records available for matching, the system does not simply report an error or revert to the default mode. Instead, it proactively determines the target projection network mode based on the current scenario's characteristic information. This mechanism ensures that the system still possesses effective decision-making capabilities when facing unknown scenarios, achieving a smooth transition from "experience-driven" to "reasoning-driven" approaches.

[0018] In some possible implementations, the target projection network mode is determined based on the current scene feature information. Specifically, this includes: determining a recommended projection network mode based on the current scene feature information, with the target projection network mode being the recommended projection network mode; or determining and displaying multiple selectable projection network modes based on the current scene feature information, and receiving the user's selection operation for the multiple selectable projection network modes to determine the target projection network mode.

[0019] The two determination methods described above provide flexible handling strategies for matching failure scenarios. The recommended mode is fully automated, requiring no user intervention and maintaining smooth operation; the selectable mode retains the user's autonomy in decision-making, allowing for mode selection through human-machine collaboration when the system's assessment is uncertain. The two methods can be used in combination, for example, prioritizing recommendations while simultaneously displaying alternatives, balancing intelligence and user autonomy.

[0020] Specifically, determining and displaying multiple selectable screen projection network modes based on the current scene characteristics involves showing users multiple selectable screen projection network modes through the vehicle's graphical interface or voice interaction for them to choose from.

[0021] In some possible implementations, the recommended screen-casting network mode is determined based on the current scene characteristics. Specifically, this includes: calculating the priority of each candidate screen-casting network mode based on at least one of the following factors: the cellular network signal strength of the vehicle and mobile terminal, the network attributes in the surrounding wireless network list, and the network tariff situation, and then selecting the candidate screen-casting network mode with the highest priority as the recommended screen-casting network mode.

[0022] This recommendation strategy comprehensively considers multiple objective factors, including network quality (signal strength), network availability (available list), and user economic costs (fees), ensuring the recommendation results are reasonable in both technical and economic terms. By prioritizing factors rather than using rigid rules, different factors can be flexibly balanced to accommodate varying user preferences.

[0023] In some possible implementations, the current scene feature information includes at least one of the following: vehicle geographical location, current time information, cellular network signal strength of the vehicle's infotainment system, cellular network signal strength of the mobile terminal, a list of surrounding wireless networks and their signal strengths, vehicle's infotainment system battery level, and mobile terminal battery level. The collection of multi-dimensional scene feature information allows for finer granularity and stronger differentiation in scene perception. Geographical location and time information reflect the user's location (home, office, business district) and usage time (commuting, lunch break, evening), network signal and Wi-Fi list reflect network environment quality, and battery information reflects the terminal's battery life. These dimensions complement each other, jointly depicting a complete projection scene profile, providing a sufficient data foundation for subsequent adaptive decision-making.

[0024] Among the possible implementation methods, the network modes for screen mirroring include: mobile terminal connecting to the vehicle's hotspot, vehicle's hotspot connecting to the mobile terminal's hotspot, and both the vehicle's hotspot and the mobile terminal connecting to the same third-party wireless network. These three modes cover the most common network connection topologies for in-vehicle screen mirroring and can adapt to users' different needs for data transmission paths and network resources in different network environments.

[0025] In some possible implementations, the corresponding network connection configurations include: when the matched projection network mode is a mobile terminal connecting to the vehicle's Wi-Fi hotspot, the vehicle's Wi-Fi hotspot is activated, and the mobile terminal is triggered to connect to that Wi-Fi hotspot; when the matched projection network mode is a vehicle-to-mobile terminal hotspot connection, the mobile terminal is triggered to activate its Wi-Fi hotspot, and the vehicle's Wi-Fi is controlled to connect to the mobile terminal's Wi-Fi hotspot; when the matched projection network mode is a shared connection to the same third-party wireless network, both the vehicle's Wi-Fi and the mobile terminal are controlled to connect to the matched third-party wireless network. The activation of the mobile terminal's operation can be achieved by sending control commands via Bluetooth or near-field communication between the vehicle and the mobile terminal, or by pushing commands to the mobile terminal from a cloud server, ensuring fully automatic execution of the network connection configuration.

[0026] In some possible implementations, the screen projection initiation operation is detected, including: detecting that the vehicle's voice assistant is activated and recognizes a voice command containing screen projection keywords, or detecting the user's triggering operation on the screen projection control in the vehicle's graphical interface. Voice activation and keyword recognition methods allow drivers to initiate screen projection without taking their eyes off the vehicle or their hands off the screen, improving driving safety; while the graphical interface touch control method provides a traditional and intuitive operation entry point. The two methods complement each other, covering different user habits and interaction scenarios.

[0027] In the above solution, after detecting the screen projection start operation, the current scene feature information is obtained. Based on the scene feature information, the historical successful experience is matched from the scene-mode mapping record to automatically determine the screen projection network mode. When the matching fails, a recommendation or candidate is provided based on a preset strategy. After the screen projection is successful, the mapping record is updated to form a closed-loop learning. The whole solution constructs a complete intelligent screen projection solution from scene perception to adaptive decision-making to experience accumulation. It effectively solves the problems of cumbersome manual configuration and inability to adapt to scene changes in the existing technology, and significantly improves the convenience, personalization and intelligence of in-vehicle screen projection.

[0028] Secondly, this application provides a screen projection device for use in a vehicle. The screen projection device includes: an acquisition module, used to acquire current scene feature information after detecting a screen projection start operation; an execution module, used to execute the corresponding network connection configuration according to the matched screen projection network mode when a screen projection network mode is matched according to the current scene feature information; and a startup module, used to start the screen projection protocol to perform the screen projection operation after the network connection configuration is completed.

[0029] This application obtains current scene feature information upon detecting a screen mirroring initiation operation, and automatically executes the corresponding network connection configuration when a screen mirroring network mode is matched based on this feature information. Then, the screen mirroring protocol is initiated after the network connection configuration is complete. Since the selection of the screen mirroring network mode is automatically matched by the system based on the current scene feature information, users do not need to manually determine and select the network mode each time they want to mirror, reducing operational complexity. Simultaneously, the automatic execution of network connection configuration enables the vehicle's infotainment system and mobile terminal to establish a connection in the optimal way within the current scene. After the network connection configuration is complete, the screen mirroring protocol is initiated uniformly, ensuring the stable establishment of the screen mirroring data channel. This improves user convenience while guaranteeing the smoothness and success rate of screen mirroring operations.

[0030] Thirdly, this application provides a control device, including: a memory and a processor; the memory and the processor are coupled; the memory is used to store a computer program; when the processor executes the computer program, it implements the screen projection method of any of the above embodiments.

[0031] Fourthly, this application provides a computer-readable storage medium storing computer program instructions that, when executed by a processor, implement the screen projection method of any of the above embodiments.

[0032] Fifthly, this application provides a computer program product, which includes computer program instructions that, when executed by a processor, implement the screen projection method of any of the above embodiments.

[0033] Sixthly, this application provides a vehicle including the projection device in any of the preceding embodiments; or the computer-readable storage medium in any of the preceding embodiments; or the computer program product in any of the preceding embodiments. Attached Figure Description

[0034] To more clearly illustrate the technical solutions in this application, the accompanying drawings used in some embodiments of this application will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings.

[0035] Figure 1 A schematic diagram of the intelligent cockpit adaptive projection system provided in this application; Figure 2 A flowchart illustrating a screen mirroring method provided in some embodiments of this application; Figure 3 A flowchart illustrating another screen mirroring method provided in some embodiments of this application; Figure 4This is a flowchart illustrating the screen mirroring method provided in a specific embodiment of this application; Figure 5 This diagram illustrates the user interface interaction process during a specific screen projection process. Figure 6 This diagram illustrates the data structure of the "scene-mode mapping table" in a specific embodiment. Figure 7 A schematic diagram of the structure of a screen projection device provided in some embodiments of this application. Figure 1 ; Figure 8 A schematic diagram of the structure of a control device provided in some embodiments of this application. Figure 2 . Detailed Implementation

[0036] The technical solutions of this application will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0037] It should be noted that, in this application, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0038] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0039] In the description of this application, unless otherwise stated, " / " means "or". For example, A / B can mean A or B. "And / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Furthermore, "at least one" means one or more, and "multiple" means two or more.

[0040] As mentioned in the background technology, wirelessly projecting smartphone content onto the large screen of an in-vehicle infotainment system (referred to as "vehicle infotainment system") has become one of the core functions of smart cockpits. Achieving screen projection requires establishing a local wireless network connection between the smartphone and the vehicle infotainment system, which mainly involves the following modes: 1. In-vehicle hotspot mode: The mobile phone connects to the Wi-Fi hotspot generated by the in-vehicle system. The screen mirroring process consumes the cellular data traffic of the in-vehicle system's built-in SIM card.

[0041] 2. Mobile Hotspot Mode: The car's infotainment system connects to a Wi-Fi hotspot generated by the phone, and the screen mirroring process consumes the phone's cellular data.

[0042] 3. Third-party network mode: The mobile phone and the car's system are connected to a third-party Wi-Fi network (such as in-car Wi-Fi, home or office Wi-Fi). The screen mirroring process consumes the traffic of the third-party network.

[0043] The relevant technologies primarily address device discovery, protocol matching, and screen rendering issues under a given network connection. Users need to manually complete network connection settings (such as manually enabling hotspots, searching for networks, and entering passwords) before they can activate the screen mirroring function.

[0044] The related technologies have at least the following drawbacks: 1. Cumbersome operation, affecting driving safety: Users need to connect to the network and perform screen projection in steps, which is complicated and poses a safety hazard when manually operated in a driving scenario.

[0045] 2. Lack of intelligent network selection: The system cannot intelligently recommend or automatically select the most suitable screen mirroring network mode (vehicle data, mobile data, or third-party network data) based on contextual information such as user habits, data balance, and network quality.

[0046] 3. Lack of a continuous experience: Each screen mirroring operation is an independent operation. The system cannot remember the user's preferred screen mirroring method in different scenarios (such as at home, at the office, or on the go), resulting in the inability to achieve a "set-up once, seamless connection afterwards" experience. Users need to make the same selection every time, making it impossible to achieve true "wireless screen mirroring, seamless connection".

[0047] 4. Low integration with smart cockpit voice interaction: The relevant solutions fail to fully utilize the voice interaction capabilities of the smart cockpit, simplifying complex multi-step operations into a single natural voice command.

[0048] This application aims to solve the aforementioned problems in related technologies and provides an adaptive screen projection solution for smart cockpits, mainly addressing the following technical issues: 1. How to simplify the screen projection process so that screen projection can be triggered by natural voice commands, thereby improving driving safety.

[0049] 2. How to enable the system to learn and remember users' screen casting mode preferences in different scenarios.

[0050] 3. How to automatically match historical preferences and complete network connection and screen casting protocol establishment when a user initiates screen casting again, so as to achieve "seamless connection".

[0051] 4. How to intelligently make the optimal choice among the three screen mirroring network modes (vehicle data, mobile data, and third-party network data).

[0052] To address the aforementioned technical issues, this application proposes an adaptive screen projection method and system for intelligent cockpits based on voice and scene memory.

[0053] The intelligent cockpit adaptive screen projection system provided in this application is mainly deployed on the in-vehicle infotainment system (vehicle unit) and works wirelessly with the user's mobile phone.

[0054] The vehicle infotainment system includes essential hardware, specifically: a central processing unit, memory, a cellular network module (such as a 4G / 5G module), a Wi-Fi / Bluetooth module, a GPS module, a microphone array, speakers, and a touchscreen display. This hardware provides the physical foundation for the operation of the system's various software functional modules.

[0055] The vehicle infotainment system runs an intelligent operating system and is equipped with the software function modules of this application, such as... Figure 1 As shown, the intelligent cockpit adaptive screen projection system provided in this application includes the following modules: Voice interaction module 110: Integrates or calls the vehicle's existing voice assistant engine to listen for wake-up words (such as "Hello XX") and recognize commands containing the semantics of "screen casting". When a voice command containing the keyword "screen casting" is recognized, it confirms that a screen casting initiation operation has been detected.

[0056] Multi-mode communication module 120: Used to manage the network connectivity of the vehicle's infotainment system. This module can function as a Wi-Fi hotspot (e.g., generating a wireless network with the SSID Car_Hotspot_XXX) for mobile devices to connect to; it can also act as a Wi-Fi client, scanning for and connecting to other hotspots (such as mobile device hotspots or third-party Wi-Fi networks). Furthermore, the multi-mode communication module supports cellular network communication (4G / 5G), providing the vehicle's infotainment system with independent mobile data connectivity. This module provides the underlying network capabilities to support flexible switching of screen projection network modes.

[0057] Scene perception module 130: Used to call system APIs to collect scene data periodically or triggeredly. Its data collection methods are as follows: It obtains precise geographical location (latitude and longitude) from the vehicle's GPS module, which can be converted into geofence identifiers (such as "home" or "company"); it obtains current time information from the system clock, including year-month-day, hour:minute, and day of the week; it obtains the surrounding wireless network environment through Wi-Fi scanning, generating data including a list of hotspot SSIDs and the signal strength of each network; and it reads the vehicle's own cellular network signal strength (e.g., -75dBm) from the cellular communication module. The cellular network signal strength and battery information of the mobile terminal are obtained through a pre-established Bluetooth connection between the vehicle and the mobile terminal. The scene perception module can operate in two modes: periodic or triggered. Normally, it collects data periodically at a low frequency to save resources; upon receiving a trigger signal from the decision control module, it immediately performs a real-time collection to ensure the real-time nature of scene feature information.

[0058] Memory Learning Module 140: This module maintains a local lightweight database, specifically an SQLite database. This database serves as the physical storage medium for the "Scene-Mode Mapping Table." Each record contains two main fields: "Scene Feature Vector" and "Screen Projection Mode." The module provides an efficient matching query interface, allowing the decision control module to quickly query for the existence of matching historical records after obtaining the current scene feature information.

[0059] Decision Control Module 150: This is the "brain" of the system. It receives trigger signals from the voice module, coordinates the scene perception module to acquire data, calls the memory learning module for matching, and executes decisions based on the results.

[0060] A screen mirroring proxy service component needs to be installed or integrated on the user's mobile terminal (such as a mobile phone). This screen mirroring proxy service receives control commands from the vehicle's decision control module and executes corresponding operations based on the commands, such as automatically turning on the mobile terminal's hotspot function or automatically connecting the mobile terminal to a specified Wi-Fi network. The screen mirroring proxy service transmits commands to the vehicle's system via a pre-established low-power Bluetooth connection, near-field communication connection, or cloud push channel. This service component enables the automatic execution of network connection configurations across devices, eliminating the need for manual operation of the mobile phone during screen mirroring.

[0061] Figure 2 This is a flowchart illustrating the screen projection method provided in an embodiment of this application.

[0062] like Figure 2 As shown, the screen projection method includes: S202, after detecting the screen projection start operation, obtaining the current scene feature information.

[0063] The user speaks a wake-up word and command, such as, "Hello Xiaowei, I want to cast my screen." The vehicle's voice interaction module recognizes this command, confirms the intent as "activate the screen casting function," and then sends an activation signal to the decision control module. This step can be executed through a trigger detection module configured in the vehicle's system, specifically the aforementioned voice interaction module. In addition, detecting the screen casting activation operation can also include detecting the user's trigger operation on the screen casting controls in the vehicle's graphical interface, such as clicking the screen casting application icon or shortcut on the vehicle's screen. In other words, voice wake-up and graphical interface touch control complement each other, covering different user habits and interaction scenarios.

[0064] Upon receiving the signal, the decision control module immediately activates the scene perception module, collects the current scene snapshot information, and generates current scene feature information. Current scene feature information is a multi-dimensional data set used to characterize the environmental conditions and operating status at the time of the current screen projection, including at least one of the following: vehicle geographical location, current time information, cellular network signal strength of the vehicle's infotainment system, cellular network signal strength of the mobile terminal, a list of surrounding wireless networks and their signal strengths, vehicle's infotainment system battery information, and mobile terminal battery information. For example, the scene perception module collects and generates current scene feature information with the following structure: {Location: “Latitude and Longitude (31.23, 121.47)”, Semantic Location: “Company”, Time: “2023-10-27 18:35 Friday”, Vehicle Signal: “-75dBm”, Surrounding Wi-Fi: [“Company_Guest” (-50dBm), “Car_Hotspot_ABC” (-60dBm)]}. It should be noted that, in order to protect user privacy, location information can be obfuscated, for example, by converting precise latitude and longitude into geofence tags (such as "company", "home", "frequently visited business districts").

[0065] The current scene feature information refers to a set of multi-dimensional environmental and state parameters collected by the vehicle-mounted system and its associated mobile terminals at the moment the screen projection initiation operation is detected. Vehicle geolocation reflects the type of location the vehicle is in (e.g., residential area, commercial area, highway, etc.), which can be obtained through the vehicle positioning system; current time information reflects the time and / or weekday attribute (e.g., 8 AM Monday), used to identify periodic scenarios such as commuting and weekend travel; the cellular network signal strength of the vehicle-mounted system and mobile terminals respectively reflects the availability and quality of their respective mobile networks; the list of surrounding wireless networks records the currently scannable Wi-Fi network identifiers and their signal strengths, reflecting the availability of the surrounding network environment; the battery information of the vehicle-mounted system and mobile terminals reflects their respective battery life status, used to assess the acceptable level of power consumption operations such as turning on a hotspot. This multi-dimensional information comprehensively depicts the screen projection scene from spatial, temporal, network, and battery perspectives, providing a sufficient information foundation for subsequent scene matching and decision-making. This multi-dimensional information can be encapsulated into feature vectors for subsequent similarity calculations.

[0066] In related technologies, screen mirroring solutions typically do not systematically collect scene features upon initiation, or only acquire single-dimensional network status information, resulting in a lack of comprehensive decision-making basis for subsequent network mode selection. This application systematically collects multi-dimensional current scene features, including geographical location, time, cellular signal strength, Wi-Fi availability list, and battery level, after detecting screen mirroring initiation, providing a rich data foundation for adaptive matching decisions. The information from each dimension forms a composite scene identifier, enabling effective differentiation between scenes with similar geographical locations but different network environments. This avoids misjudgments caused by coarse-grained matching based solely on single-dimensional information (such as location), improving the accuracy of scene perception and the reliability of subsequent decisions. Unlike existing technologies that passively detect only connection failures, this application actively collects multi-dimensional scene feature information when screen mirroring initiation is detected, ensuring that the scene feature information reflects the true environmental state at the time of screen mirroring.

[0067] like Figure 2 As shown, the screen casting method includes: S204, when a screen casting network mode is matched based on the current scene feature information, the corresponding network connection configuration is executed according to the matched screen casting network mode.

[0068] This step enables adaptive decision-making from scene characteristics to network modes. When a corresponding screen-casting network mode is successfully matched from existing experience records based on the current scene characteristic information, the system automatically executes the network connection configuration required for that mode, without requiring manual selection and settings by the user.

[0069] This step can be performed through the matching execution module configured in the vehicle's infotainment system. Specifically, the matching execution module can be the decision control module. The decision control module receives the current scene feature information output by the scene perception module, calls the scene-mode mapping record for matching query, and triggers the corresponding network connection configuration process based on the matching result when a match is successful.

[0070] Scene-pattern mapping records refer to a set of historical data stored locally in a lightweight database (such as SQLite) within the vehicle's infotainment system. Each record in this set contains the correspondence between the historical scene features collected when a previous screen-sharing operation occurred and the screen-sharing network mode used when the screen-sharing was successful. Scene-pattern mapping records are a digital storage of the system's historical experience, functioning similarly to an "experience knowledge base." This allows the system to directly reuse past successful experiences when facing similar scenarios, thereby achieving an adaptive effect of "learn once, reuse many times."

[0071] The screen mirroring network mode refers to the topology used when a vehicle-mounted infotainment system (V2XS) and a mobile terminal establish a local area network connection for screen mirroring data transmission. In this application, there are three screen mirroring network modes: 1) Mobile terminal connecting to the vehicle-mounted hotspot mode, where the V2XS has its Wi-Fi hotspot function enabled, and the mobile phone acts as a site connecting to the V2XS hotspot, with the V2XS as the network center; 2) V2XS connecting to the mobile terminal hotspot mode, where the mobile phone has its Wi-Fi hotspot function enabled, and the V2XS acts as a site connecting to the mobile phone hotspot, with the mobile phone as the network center; 3) V2XS and mobile terminal jointly connecting to the same third-party wireless network mode, where both parties act as sites simultaneously connecting to an external Wi-Fi router, with the third-party router as the network center. These three modes are suitable for different network environments and battery life requirements, and can be flexibly switched to adapt to diverse screen mirroring scenarios.

[0072] The matching process is as follows: Step 1: Match the current scene feature information with the scene-pattern mapping record.

[0073] After acquiring the current scene feature information, the decision control module transmits this information to the memory learning module. The memory learning module then uses a matching algorithm to search for historical records in the "scene-pattern mapping table." This step can be performed through the historical matching module configured in the vehicle's infotainment system, specifically the memory learning module.

[0074] Matching algorithms can employ multi-level matching strategies to improve matching efficiency and accuracy: The first layer, the precise matching layer, prioritizes precise matching based on "semantic location" (such as geofence tags like home and company) and key Wi-Fi SSIDs. If the semantic location of the current scene exactly matches the key identifier of a historical record in the surrounding Wi-Fi list, the match is successful. For example, if a historical record is matched: FV_history = {location: "company", time: "weekday evening", surrounding Wi-Fi: ["Company_Guest"]}, its corresponding screen mirroring mode is "Mode 2: Mobile Hotspot".

[0075] The second layer, the fuzzy matching layer, calculates the similarity between the current scene features and historical scene features in the scene-pattern mapping record if no precise match is found. The projection network pattern corresponding to the historical scene features with a similarity exceeding a preset threshold is selected as the projection network pattern matched to the current scene features. Similarity calculation can be achieved using distance metrics between multi-dimensional feature vectors (such as Euclidean distance, cosine similarity, etc.) or other similarity algorithms. Different weights can be assigned to each dimension to reflect its importance in scene differentiation. When multiple projection network patterns are matched, the projection network pattern corresponding to the historical scene feature with the highest similarity is selected as the final matched projection network pattern, achieving the optimal selection from multiple candidates to a single decision.

[0076] The third layer, the default strategy layer: If the fuzzy matching layer still fails to obtain a valid match, it will proceed to the matching failure handling process and execute the step of recommending a projection network mode based on the scenario.

[0077] This multi-level matching design enables the system to prioritize and quickly retrieve highly similar scenes, and only perform computationally intensive fuzzy matching when necessary, thus balancing matching efficiency and accuracy.

[0078] In related solutions, rule-based network selection relies on a single condition (e.g., "connect to home Wi-Fi if the vehicle is at home"), failing to handle complex scenarios with intertwined conditions (e.g., "prioritize using mobile hotspot when at home on weekends but with weak home Wi-Fi signal"). This application employs flexible matching by calculating multi-dimensional similarity between current scene features and historical scene features. This captures implicit correlations between various scene dimensions and identifies complex scene patterns such as "similar geographical locations but different time periods imply different network needs." The dual filtering mechanism of preset thresholds and selection based on the highest similarity ensures the reasonableness of matching results while avoiding mismatches due to data sparsity, enabling the system to strike a balance between "experience reuse" and "avoiding hasty matching."

[0079] Step 2: Configure the network connection according to the matched screen mirroring network mode.

[0080] After obtaining the matching result, the decision control module executes the following automatic operation sequence. The corresponding network connection configuration includes several scenarios: When the matched projection network mode is a mobile terminal connecting to the vehicle's hotspot, the vehicle's wireless hotspot is activated, and the mobile terminal is triggered to connect to it; when the matched projection network mode is a vehicle-to-mobile terminal hotspot connection, a command is sent to the projection proxy service on the mobile phone via a pre-established low-power Bluetooth connection between the vehicle and the mobile phone, triggering the mobile terminal to activate its wireless hotspot and controlling the vehicle's multi-mode communication module to connect to the mobile terminal's wireless hotspot; when the matched projection network mode is a shared connection to the same third-party wireless network, both the vehicle and the mobile terminal are controlled to connect to the matched third-party wireless network.

[0081] During the automatic network connection configuration process, a brief prompt may be displayed on the vehicle's screen. For example, a pop-up message may appear stating "Automatically matched to: Mobile Hotspot Mode." This pop-up message disappears automatically after 2-3 seconds, and the system then directly enters the screen mirroring mode. This prompt ensures that the user has a clear understanding of the automatically performed operation without adding any extra operational burden. The entire process requires no further user intervention.

[0082] In related screen mirroring solutions, determining the network connection method typically relies on manual judgment and operation by the user. For example, the user needs to decide whether to turn on a mobile hotspot or connect to Wi-Fi based on the current signal strength, a process that is lengthy and prone to errors. This application, by acquiring current scene feature information after detecting the screen mirroring initiation operation, and automatically matching the screen mirroring network mode based on this information, automatically executes the corresponding network connection configuration. This integrates scene perception, mode decision-making, and network configuration, eliminating manual intervention by the user. The unified management and flexible switching capability of the three screen mirroring network modes enable the system to automatically select the optimal connection topology in different scenarios, ensuring the stable establishment of the screen mirroring data channel and avoiding the safety risks caused by user distraction while driving due to operating a mobile phone or vehicle system.

[0083] like Figure 2 As shown, the screen mirroring method includes: S206, after the network connection configuration is completed, start the screen mirroring protocol to perform the screen mirroring operation.

[0084] This step, based on an established network connection, initiates the standard screen mirroring protocol process to complete the session establishment and media stream transmission between devices. It's worth noting that the screen mirroring protocol initiation process in this step is consistent across the three screen mirroring network modes, all based on the established IP network channel for protocol-level handshake and communication.

[0085] This step can be executed through the screen mirroring protocol module configured in the vehicle's infotainment system. Specifically, the screen mirroring protocol module can be the screen mirroring service on the vehicle's infotainment system (such as a DLNA receiver or a specific screen mirroring protocol stack). After the network connection is established, it will automatically start and notify the mobile device to begin pushing screen content.

[0086] This application separates network connection configuration and screen mirroring protocol startup into two independent steps. Network connection configuration is differentiated based on the matched screen mirroring network mode, while screen mirroring protocol startup is executed uniformly. This layered design follows the layered architecture principle of network communication, decoupling the underlying IP channel establishment from the upper-layer application protocol, so that the screen mirroring protocol itself does not need to be aware of the underlying network topology differences. When the system needs to support a new screen mirroring protocol or upgrade an existing protocol, there is no need to modify the network mode matching and configuration logic; conversely, adding a new network connection mode does not require adjusting the screen mirroring protocol layer. Each layer evolves independently and does not interfere with each other, improving the system's scalability and maintainability.

[0087] like Figure 2 and Figure 3 As shown, the projection method also includes: S208: when no projection network mode is matched according to the current scene feature information, the target projection network mode is determined according to the current scene feature information, and the corresponding network connection configuration is executed based on the target projection network mode.

[0088] If no matching network mode is found based on the current scene characteristics, the process proceeds to this step. Matching failures typically occur when a user uses the screen mirroring function for the first time in a new scene, such as a new parking space, a new time period, or a new network environment. In this case, the system uses preset strategies for intelligent recommendations to ensure an uninterrupted automated experience; or it provides simplified options for users to quickly select, preserving user autonomy while reducing operational complexity.

[0089] This step can be executed through the strategy decision module configured in the vehicle's infotainment system. Specifically, the strategy decision module can be an intelligent recommendation engine and / or an interactive selection component.

[0090] Determining the target screen-casting network mode involves two optional or combined strategies. First, a recommended screen-casting network mode is determined based on current scene characteristics, and this recommended mode is used as the target screen-casting network mode. Specifically, based on at least one factor—the cellular network signal strength of the vehicle and mobile terminal, network attributes in the surrounding wireless network list (such as whether it's a free network, a saved network, encryption method, etc.), and network pricing—a priority is calculated for each candidate screen-casting network mode, and the candidate with the highest priority is selected as the recommended screen-casting network mode. For example, when matching fails, the decision control module initiates a recommendation strategy for analysis: a known free Wi-Fi network "Company_Guest" is detected nearby, and its signal strength is -50dBm (a strong signal), while the current cellular network signals of the vehicle and mobile terminal are weak. Based on this analysis, the decision control module recommends "Mode 3: Vehicle and mobile terminal share a third-party Wi-Fi connection."

[0091] Secondly, based on the current scene characteristics, multiple selectable screen-casting network modes are determined and displayed. These candidate modes are presented to the user through the vehicle's graphical interface or voice interaction, and the user's selection is received to determine the target screen-casting network mode. For example, a selection interface is generated, and a selection card is displayed on the vehicle's screen, highlighting the recommended option as "Recommended to use 'Company_Guest' Wi-Fi for screen casting," while providing two other candidate mode option buttons for the user to choose from. The user can quickly complete the selection via touch or voice (such as saying "Use the first one").

[0092] Once the user selects or the system determines the recommended mode, the system will execute an automatic connection process, perform the corresponding network connection configuration according to the determined target screen casting network mode, and then start the screen casting protocol to perform the screen casting operation after the network connection configuration is completed.

[0093] Some related solutions simply revert to the default mode (e.g., only attempting to connect to the last used Wi-Fi) when an existing network configuration cannot be matched, lacking the ability to reason about the current scenario. This application does not simply revert when matching fails; instead, it prioritizes and recommends a mode based on actual characteristics of the current scenario, such as cellular signal strength, Wi-Fi availability, and pricing, making the decision-making in matching failure scenarios also scenario-aware. Furthermore, the mechanism of providing multiple candidate modes for users to choose from reflects the human-machine collaborative design concept. Introducing user judgment when the system is uncertain ensures the accuracy of the decision and provides valuable labeled data for subsequent learning. The user's choice in matching failure scenarios will be updated in the mapping record after successful screen mirroring, transforming it into future matching experience.

[0094] like Figure 3As shown, the projection method also includes: S210, learning and updating.

[0095] After successful screen mirroring, the current scene feature information acquired at the time of screen mirroring initiation is associated with the screen mirroring network mode used and stored in the scene-mode mapping record for optimizing future matching decisions. Whether executed automatically or selected by the user, once screen mirroring is successfully established, the decision control module will store the valid current scene feature information and the final screen mirroring network mode as a new entry in the "scene-mode mapping table" after the process ends. For example, if a user manually selects "mobile hotspot" for the first time in the company parking lot, the system will record the rule "Company parking lot + evening + Company_Guest Wi-Fi available -> mobile hotspot". This is the core mechanism for implementing the "remember last screen mirroring method" function.

[0096] This step can be performed through the learning and updating module configured in the vehicle's infotainment system, specifically the experience accumulation and updating component in the memory learning module.

[0097] The specific update strategy includes: if a record matching the current scene's features already exists in the scene-mode mapping record, the usage frequency of that historical record is increased (the Success_Count field is incremented by one), or the corresponding screen-casting network mode (Screen_Mode field) is updated to the screen-casting network mode used this time; if no matching record exists, a new mapping record is added. Increasing the usage frequency further strengthens the weight of high-frequency modes, giving commonly used screen-casting network modes a higher probability of being selected when similarity is close; updating the mode ensures that when a user's preferences change in the same scene, the mapping record can be updated in a timely manner to reflect the user's latest screen-casting habits, preventing the system from remaining stuck on outdated mode selections for a long time.

[0098] Existing screen-casting solutions lack a feedback learning mechanism; each casting operation is independent, preventing the system from accumulating experience from user history to optimize subsequent decisions. This application addresses this by associating scene features with the casting network pattern in a mapping record after each successful casting, and employing a dual update strategy of frequency reinforcement and pattern updating. This enables the system to continuously learn and adaptively evolve. This closed-loop learning mechanism allows the mapping record to gradually become more complete and accurate over time, leading to a progressively higher system matching success rate and a user experience that evolves from a "general default" to a "personalized customization," achieving self-optimization and long-term value growth in the screen-casting method.

[0099] The following describes a screen mirroring method in a specific embodiment, such as... Figure 4 As shown, it includes the following steps: Step S1: Voice wake-up and command recognition. In response to the user's wake-up of the vehicle's voice assistant and a command containing the keyword "cast screen", the casting process is triggered.

[0100] For example, the user speaks a wake-up word and command, such as, "Hello Xiaowei, I want to cast my screen." The vehicle's voice interaction module recognizes the command, confirms the intent as "start the screen casting function," and then sends a start signal to the decision control module.

[0101] Step S2: Scene Perception and Feature Extraction. Real-time acquisition and generation of current scene feature vectors, including: vehicle location, time information, cellular network signal strength of the vehicle and mobile phone, a list of available Wi-Fi networks in the vicinity, and battery information of the vehicle and mobile phone.

[0102] For example, upon receiving a signal, the decision control module immediately activates the scene perception module, collects current scene snapshot information, and constructs a standardized "scene feature vector". For instance: FV_current = {Location: “Latitude and Longitude (31.23, 121.47)”, Semantic Location: “Company”, Time: “2023-10-27 18:35 Friday”, Vehicle Signal: “-75dBm”, Surrounding Wi-Fi: [“Company_Guest” (-50), “Car_Hotspot_ABC” (-60)]}. To protect privacy, location information can be obfuscated (e.g., converted to geofence tags).

[0103] Step S3: Historical Preference Matching. Match the current scene feature vector with the locally stored "Scene-Mode Mapping Table". The mapping table records the scene features and the screen casting network mode used for each successful screen casting in history (Mode 1: Mobile phone connected to car hotspot; Mode 2: Car hotspot connected to mobile phone hotspot; Mode 3: Shared third-party Wi-Fi).

[0104] For example, the decision control module passes FV_current to the memory learning module. The memory learning module uses a matching algorithm (such as approximate matching based on geofencing and Wi-Fi SSID) to look up historical records in the "scene-mode mapping table". For example, a historical record is matched: FV_history = {location: "Company", time: "weekday evening", surrounding Wi-Fi: ["Company_Guest"]}, whose corresponding screen casting mode is "Mode 2: Mobile Hotspot".

[0105] Step S4: Determine if a historical record is matched. If yes, proceed to step S4A; otherwise, proceed to step S4B.

[0106] Step S4A: Automatically execute the history mode.

[0107] If the match is successful, the screen casting network mode in the history will be automatically selected, and the corresponding network connection configuration (such as automatically turning on the corresponding hotspot and automatically connecting to the specified Wi-Fi) and screen casting protocol will be automatically executed.

[0108] Step S4B: Intelligent recommendation or user selection.

[0109] Step S4C: User confirms or selects a mode.

[0110] If a match fails (e.g., in a completely new scenario), a mode will be intelligently recommended based on preset strategies (e.g., prioritizing free networks or selecting based on signal strength), or simplified options will be provided through a voice / graphical interface for users to quickly select.

[0111] S4, based on the decision result, includes two steps: Automatic execution of historical patterns (when a match is successful): The decision control module obtains the matching result "Pattern Two". It executes the following automatic operation sequence: Through the pre-established low-power Bluetooth connection between the car's infotainment system and the mobile phone, a command is sent to the "Screen Mirroring Proxy Service" on the mobile phone: "Please turn on the hotspot, SSID is MyPhone_hotspot, password is XXX".

[0112] At the same time, control the vehicle's multi-mode communication module to disconnect it from the current network (if necessary) and automatically scan for and connect to a Wi-Fi network called MyPhone_hotspot.

[0113] Once the network connection is established, the screen mirroring service on the vehicle's infotainment system (such as a DLNA receiver or a specific screen mirroring protocol stack) will be automatically started, and the mobile phone will be notified to start pushing screen content.

[0114] On the car's infotainment screen, a brief pop-up message appears saying "Automatically matched to: mobile hotspot mode," disappearing after 2-3 seconds, followed directly to the screen mirroring screen. The entire process requires no further user intervention.

[0115] Intelligent recommendation or user selection (when matching fails): If the current scenario is completely new and there are no matching records, the decision control module will activate the "recommendation strategy": Strategy Analysis: A known free Wi-Fi network, "Company_Guest," was detected nearby with a strong signal. Based on this, the decision-making module recommends "Mode 3: Connect to third-party Wi-Fi."

[0116] User interaction: A selection card pops up on the vehicle's infotainment screen, highlighting the recommended option: "Recommended to use 'Company_Guest' Wi-Fi for screen mirroring," while also providing two other option buttons.

[0117] Users can quickly select via touch or voice ("use the first one"). Once selected, the system executes an automated connection process similar to S4A.

[0118] Step S5: Automatically complete network connection and screen mirroring.

[0119] Step S6: Record the scene and mode of this instance in the mapping table. After each successful screen casting, update the "scene feature - screen casting mode" pair of this successful instance in the "scene - mode mapping table" to optimize future matching decisions.

[0120] Regardless of whether the screen mirroring is executed automatically (S4A) or selected by the user (S4B), once the screen mirroring is successfully established, the decision control module will store the valid FV_current and the final screen mirroring mode as a new entry in the "Scene-Mode Mapping Table" after the process ends. For example, if a user manually selects "Mobile Hotspot" for the first time in the company parking lot, the system will record the rule "Company Parking Lot + Evening + Company_Guest Wi-Fi Available -> Mobile Hotspot".

[0121] Figure 6 The diagram illustrates the data structure of the "Scene-Mode Mapping Table" in a specific embodiment.

[0122] The scenario-pattern mapping table is the system's knowledge base. Each record contains the following core fields: Record_ID: A unique identifier for a record (e.g., ...) Figure 6 (Record 1, Record 2, etc. in the records).

[0123] Scene_Vector: Scene feature vector, which can be stored as a JSON string or encoded binary data (e.g., ...). Figure 6 (Data such as scene features).

[0124] Screen_Mode: Screen mirroring mode enumeration values ​​(1, 2, 3).

[0125] Success_Count: The number of times this mode has been successfully used.

[0126] Last_Used_Time: The timestamp of the last successful use.

[0127] In this embodiment, during the screen projection process, the user interface interaction process is as follows: Figure 5 As shown.

[0128] go through Figure 4 The screen mirroring process shown can achieve the following technical effects: First: From "three manual steps" to "one voice command": the cognitive and operational burden on users is reduced to a minimum.

[0129] Second: From "asking every time" to "automatically guessing": The system has memory and learning capabilities, and the more it is used, the better it understands user habits.

[0130] Third: From "connection waiting" to "seamless access": The automated background process eliminates the feeling of waiting and disconnection during network configuration.

[0131] Fourth: Intelligent resource scheduling: Automatically selects the most economical (using free Wi-Fi) and most stable (using the side with the strongest signal to create a hotspot) traffic path.

[0132] It is understood that the application scenarios of the embodiments of this application are not limited. The system architecture and business scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. As those skilled in the art will know, with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided by the embodiments of this application are also applicable to similar technical problems.

[0133] The foregoing mainly describes the solutions of the embodiments of this application from a methodological perspective. It is understood that, in order to achieve the above functions, the projection device includes at least one of the hardware structures and software modules corresponding to each function. Those skilled in the art should readily recognize that, in conjunction with the units and algorithm steps of the various examples described in the embodiments disclosed herein, the embodiments of this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this application.

[0134] This application embodiment can divide the screen projection device into functional modules according to the above method embodiment. For example, each function can be divided into a separate functional module, or two or more functions can be integrated into one functional module. The integrated module can be implemented in hardware or software. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods. The following description uses the example of dividing each functional module according to each function.

[0135] Figure 7This is a schematic diagram of a screen projection device provided in an embodiment of this application. The screen projection device 700 is applied to a vehicle and can execute the screen projection method provided in the above-described method embodiment. The screen projection device 700 includes: an acquisition module 710, used to acquire current scene feature information after detecting a screen projection start operation; an execution module 720, used to execute the corresponding network connection configuration according to the matched screen projection network mode when a screen projection network mode is matched according to the current scene feature information; and a start module 730, used to start the screen projection protocol after the network connection configuration is completed to perform the screen projection operation.

[0136] This application obtains current scene feature information upon detecting a screen mirroring initiation operation, and automatically executes the corresponding network connection configuration when a screen mirroring network mode is matched based on this feature information. Then, the screen mirroring protocol is initiated after the network connection configuration is complete. Since the selection of the screen mirroring network mode is automatically matched by the system based on the current scene feature information, users do not need to manually determine and select the network mode each time they want to mirror, reducing operational complexity. Simultaneously, the automatic execution of network connection configuration enables the vehicle's infotainment system and mobile terminal to establish a connection in the optimal way within the current scene. After the network connection configuration is complete, the screen mirroring protocol is initiated uniformly, ensuring the stable establishment of the screen mirroring data channel. This improves user convenience while guaranteeing the smoothness and success rate of screen mirroring operations.

[0137] In the case of implementing the functions of the integrated modules described above in hardware, this application provides a possible structure for the screen projection device involved in the above embodiments.

[0138] like Figure 8 As shown, the projection device 800 includes: a processor 802 and a bus 804. Optionally, the projection device may also include a memory 801; optionally, the projection device 800 may also include a communication interface 803.

[0139] Optionally, the memory 801 and the processor 802 are coupled; the memory 801 is used to store computer programs; when the processor 802 executes the computer programs, it implements the screen projection method of any of the above embodiments.

[0140] Processor 802 may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this application. Processor 802 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this application. Processor 802 may also be a combination that implements computing functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.

[0141] The communication interface 803 is used to connect to other devices via a communication network. This communication network can be Ethernet, wireless access network, wireless local area network (WLAN), etc.

[0142] The memory 801 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), disk storage medium or other magnetic storage device, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto.

[0143] In one possible implementation, the memory 801 can exist independently of the processor 802. The memory 801 can be connected to the processor 802 via a bus 804 and is used to store instructions or program code. When the processor 802 calls and executes the instructions or program code stored in the memory 801, it can implement the screen projection method provided in this embodiment. In another possible implementation, the memory 801 can also be integrated with the processor 802.

[0144] The 804 bus can be an extended industry standard architecture (EISA) bus, etc. The 804 bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 8 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0145] Some embodiments of this application provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium) storing computer program instructions that, when executed by a processor, implement the screen projection method of any of the embodiments described above.

[0146] For example, the aforementioned computer-readable storage media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes), optical discs (e.g., compact disks (CDs), digital versatile disks (DVDs), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memory (EPROMs), cards, sticks, or key drives, etc.). The various computer-readable storage media described in this application may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.

[0147] This application provides a computer program product containing computer instructions. When the computer program instructions are executed by a processor, they implement the screen projection method of any of the above embodiments.

[0148] This application provides a vehicle, including the projection device in any of the preceding embodiments; or the control device in any of the preceding embodiments; or the computer-readable storage medium in any of the preceding embodiments; or the computer program product in any of the preceding embodiments.

[0149] The vehicle provided in this application may be a passenger vehicle or a freight vehicle, and may also be an electric vehicle or a hybrid vehicle. This application does not limit the specific purpose or power type of the vehicle, and the choice can be made according to actual needs.

[0150] In some possible examples, a vehicle consists of a body and wheels. The body is used for passengers and for carrying goods, while the wheels are mounted underneath the body to support it and to roll on the road surface, thus enabling the vehicle to move.

[0151] In some possible examples, the vehicle is equipped with a control system, which typically adopts a layered distributed architecture. From the bottom layer to the top layer, it can be roughly divided into a perception layer, a control layer, a coordination layer, and an interaction layer. The layers communicate with each other through an in-vehicle network.

[0152] The perception layer mainly consists of various sensors distributed inside and outside the vehicle, including but not limited to external environment cameras, millimeter-wave radar, lidar, ultrasonic sensors, in-vehicle driver monitoring cameras, microphone arrays, and various vehicle status sensors (such as wheel speed sensors, inertial measurement units, temperature sensors, etc.). The perception layer is responsible for collecting multi-dimensional data such as the vehicle's own operating status, driver behavior, and external driving environment in real time.

[0153] The control layer consists of dozens to hundreds of electronic control units (ECUs), distributed across multiple functional domains including powertrain, chassis, body, intelligent driving, and infotainment. Each ECU embeds real-time control software that performs closed-loop control of the vehicle's actuators based on preset control strategies or upper-level commands, and generates corresponding alarm signals when abnormal conditions are detected. Typical ECUs include the engine control unit, transmission control unit, brake control unit, steering control unit, vehicle stability control unit, airbag control unit, intelligent driving domain controller, and in-vehicle infotainment unit.

[0154] The coordination layer typically exists in the form of a domain controller or a central computing platform, responsible for cross-domain data fusion, global state management, and collaborative decision-making. The coordination layer centrally processes and schedules the sensing data and control commands that were originally scattered across various functional domains, connecting downwards to various electronic control units and supporting human-machine interaction functions upwards.

[0155] The interaction layer mainly includes in-cabin display devices (such as instrument panel, central control screen, head-up display), voice interaction system, haptic feedback device, etc., which are responsible for presenting vehicle status, warning information and driving suggestions to the driver in the form of visual, auditory or tactile, while receiving the driver's touch, voice and other input commands.

[0156] Data transmission and interaction between different layers are achieved through the vehicle bus network. Common vehicle bus protocols include CAN, CAN FD, LIN, FlexRay, and vehicle Ethernet, which supports high-bandwidth data transmission. Among them, CAN and CAN FD buses are widely used for communication in real-time control domains such as powertrain and chassis, while vehicle Ethernet is gradually being applied to high-bandwidth sensor data transmission in the intelligent driving domain and multimedia interaction scenarios in the cockpit domain.

[0157] In some possible examples, each electronic control unit continuously generates raw alarm data during operation. The cockpit domain controller, as the core of the in-vehicle computing platform, is equipped with a processor and memory to execute the screen projection method provided in the embodiments of this application.

[0158] For example, the projection device of this application is arranged in the cockpit domain controller.

[0159] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A screen projection method, characterized in that, For use in vehicles, the screen projection method includes: After detecting the screen mirroring start operation, obtain the current scene feature information; When a screen projection network mode is matched based on the current scene feature information, the corresponding network connection configuration is executed according to the matched screen projection network mode. After the network connection is configured, start the screen mirroring protocol to perform the screen mirroring operation.

2. The screen projection method according to claim 1, characterized in that, The screen mirroring method also includes: After obtaining the current scene feature information, the current scene feature information is matched with the scene-mode mapping record. The scene-mode mapping record includes the correspondence between the historical scene features associated with the historical screen casting operation and the screen casting network mode adopted.

3. The screen projection method according to claim 2, characterized in that, The step of matching the current scene feature information with the scene-pattern mapping record includes: Calculate the similarity between the current scene feature information and each historical scene feature in the scene-pattern mapping record; use the projection network pattern corresponding to the historical scene feature with a similarity exceeding a preset threshold as the projection network pattern matched by the current scene feature information.

4. The screen projection method according to claim 3, characterized in that, Also includes: When there are multiple matched projection network modes, the projection network mode corresponding to the historical scene feature with the highest similarity is selected as the matched projection network mode.

5. The screen projection method according to claim 2, characterized in that, The screen casting method further includes: after successful screen casting, associating the current scene feature information obtained when the screen casting is started with the screen casting network mode adopted and storing it in the scene-mode mapping record.

6. The screen projection method according to claim 5, characterized in that, The screen casting method further includes: when associating the current scene feature information obtained when the screen casting is started with the screen casting network mode adopted and storing it in the scene-mode mapping record, if there is already a record in the scene-mode mapping record that matches the current scene feature information, then the usage frequency of the historical record is increased or the corresponding screen casting network mode is updated to the screen casting network mode adopted this time.

7. The screen projection method according to claim 1, characterized in that, If no matching screen casting network mode is found based on the current scene feature information, a target screen casting network mode is determined based on the current scene feature information; and a screen casting operation is performed based on the target screen casting network mode.

8. The screen projection method according to claim 7, characterized in that, The step of determining the target projection network mode based on the current scene feature information includes: Based on the current scene feature information, a recommended screen casting network mode is determined, and the target screen casting network mode is the recommended screen casting network mode; or Based on the current scene feature information, determine and display multiple selectable screen casting network modes, receive the user's selection operation of multiple selectable screen casting network modes, and determine the target screen casting network mode.

9. The screen projection method according to claim 8, characterized in that, The step of determining the recommended screen-casting network mode based on the current scene feature information includes: The priority of each candidate screen-casting network mode is calculated based on at least one of the following factors: the cellular network signal strength of the vehicle and mobile terminal, the network attributes in the surrounding wireless network list, and the network tariff. The candidate screen-casting network mode with the highest priority is then recommended.

10. The screen projection method according to any one of claims 1 to 9, characterized in that, The current scene feature information includes at least one of the following: vehicle geographical location, current time information, cellular network signal strength of the vehicle's infotainment system, cellular network signal strength of the mobile terminal, a list of surrounding wireless networks and their signal strengths, vehicle's infotainment system battery information, and mobile terminal battery information; and / or The screen mirroring network modes include: mobile terminal connecting to vehicle hotspot mode, vehicle hotspot connecting to mobile terminal hotspot mode, and vehicle hotspot and mobile terminal both connecting to the same third-party wireless network mode; and / or The detection of screen casting initiation includes: detecting that the vehicle's voice assistant is woken up and recognizes a voice command containing screen casting keywords, or detecting a user's trigger operation on the screen casting control in the vehicle's graphical interface.

11. A screen projection device, characterized in that, For use in vehicles, the projection device includes: The acquisition module is used to acquire current scene feature information after detecting the screen casting start operation; The execution module is used to execute the corresponding network connection configuration according to the matched screen projection network mode when the screen projection network mode is matched according to the current scene feature information; The startup module is used to initiate the screen mirroring protocol after the network connection configuration is complete, so as to perform the screen mirroring operation.

12. A control device, characterized in that, include: Memory and processor; the memory and processor are coupled; The memory is used to store computer programs; When the processor executes the computer program, it implements the screen projection method as described in any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that, include: The computer-readable storage medium stores computer program instructions, which, when executed by a processor, implement the screen projection method as described in any one of claims 1 to 10.

14. A computer program product, characterized in that, include: The computer program product includes computer program instructions, which, when executed by a processor, implement the screen projection method as described in any one of claims 1 to 10.

15. A vehicle, characterized in that, include: The projection device as described in claim 11; or The control device as described in claim 12; or The computer-readable storage medium as claimed in claim 13; or The computer program product as described in claim 14.

Images