A vehicle-mounted projection system, method, electronic device, storage medium and vehicle
Patent Information
- Application Number
- CN202610691934.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-05-19
- Publication Date
- 2026-08-04
AI Technical Summary
[0005]核心技术问题：DLP技术的功能日益丰富，但应用形式单一匮乏问题
[0082] This application creates an interactive game specifically for pets outside the car, satisfying the interaction needs of users and pets, enhancing the fun of driving, and achieving interactive pet interaction outside the car.
Smart Images
Figure CN122507283A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of vehicle projection, and more particularly to vehicle projection systems, vehicle projection methods, electronic devices, storage media, and vehicles. Background Technology
[0002] With the rapid development of intelligent vehicle technology and the continuous upgrading of in-vehicle optical systems, Digital Light Processing (DLP) headlights and projection technology are gradually evolving from simple lighting functions to intelligent and immersive interactive experiences. Currently, the market offers increasingly diverse functionalities based on DLP technology, especially in entertainment scenarios, where applications of vehicle DLP projection as a game interaction medium are emerging in numerous forms. For example, by projecting game images onto the ground or wall, users are provided with a completely new entertainment experience.
[0003] Existing DLP projection functions are mostly limited to preset light shows or standalone entertainment games. These functions typically focus on functionality, failing to effectively link in-vehicle occupants with the external environment (such as people, pets, and wild animals outside the vehicle). They lack a systematic consideration of multi-dimensional interactive scenarios involving people, vehicles, and pets, and cannot achieve real-time, engaging interaction between in-vehicle occupants, pets, and the vehicle projection. Furthermore, they fail to fully utilize the vehicle's own actuators (such as in-vehicle occupant monitoring systems) in conjunction with projection functions, resulting in limited interaction methods and insufficient immersion and engagement. DLP projection technology can be used to break down the interaction barriers between people, vehicles, and pets, designing more engaging and emotionally connected interactive functions. Summary of the Invention
[0004] The purpose of this invention is to provide an in-vehicle projection system, an in-vehicle projection method, an electronic device, a storage medium, and a vehicle, thereby solving at least one of a number of technical problems.
[0005] Core technical issue: While DLP technology is becoming increasingly feature-rich, its application forms are limited and monotonous.
[0006] This invention provides the following solution:
[0007] According to a first aspect of the present invention, an in-vehicle projection system is provided, comprising:
[0008] Interaction module and control module;
[0009] The interaction module includes an input module and an output module; the control module includes an instruction generation module and an instruction execution module.
[0010] The input module includes a passive input module and an active input module;
[0011] The passive input module is used to sense the internal and external environment of the vehicle and identify preset targets and their signal states.
[0012] An active input module is used to capture input commands that are identified as having the necessary permissions.
[0013] The output module is used to output data status and works with the input module to form external data interaction.
[0014] The instruction generation module connects to the input module and obtains data from the input module.
[0015] The instruction generation module is used to generate execution instructions based on the data obtained from the input module;
[0016] The instruction execution module connects to the instruction generation module to obtain and execute the execution instructions.
[0017] The output module connects to the instruction execution module, instruction generation module, and / or input module, expressing the entire or partial process status from instruction generation to execution, and enabling data interaction with the input module to form external data.
[0018] The active input module includes a permission authentication module;
[0019] The permission authentication module is used to authenticate the permissions of input commands;
[0020] It also includes an instruction generation module that identifies preset targets and preset target signal states, and interprets and generates execution instructions;
[0021] The instruction generation module connects to the data connection permission authentication module to authenticate whether the execution instruction generated in association with the preset target and the preset target signal status has the permission to be executed.
[0022] If so, send it to the instruction execution module and the output module;
[0023] If not, then send to the output module;
[0024] The output module outputs the data status after adding annotations based on whether the execution instructions generated by identifying and associating with the preset target and the preset target status have the permission to be executed.
[0025] Furthermore, the control module also includes a communication module;
[0026] The communication module is used to acquire data locally and / or from the cloud.
[0027] The communication module connects the data input module, output module, and instruction generation module.
[0028] The instruction generation module generates execution instructions based on the data from the communication module.
[0029] After the execution instruction is authenticated by the permission authentication module under the input module, it is sent to the instruction execution module and / or the output module;
[0030] The output module adds annotations to the data status based on the results of permission authentication.
[0031] Furthermore, the instruction execution module includes a projection theme module;
[0032] The projection theme module is used to set the software, hardware and data resources associated with the vehicle projection to be called based on the preset functional theme, so as to ensure the execution of the execution instructions.
[0033] The projection theme module connects to the active input module and / or the instruction generation module;
[0034] Among them, according to the instruction of the active input module to activate the preset functional theme under the projection theme module, the preset software, hardware and data resources associated with the vehicle projection are called.
[0035] The instruction generation module generates execution instructions, including the instruction judgment conditions for activating the preset functional theme under the corresponding projection theme module.
[0036] If the condition for activating the preset function theme under the corresponding projection theme module is met, the command to activate the preset function theme under the projection theme module will call the preset software, hardware and data resources associated with the vehicle projection.
[0037] According to a second aspect of the present invention, a vehicle-mounted projection method is provided, comprising:
[0038] Based on the preset functional themes, the software, hardware, and data resources associated with the in-vehicle projection that need to be called in the package are set;
[0039] Activate the preset functional themes under the corresponding projection theme module and set the command judgment conditions;
[0040] The instruction judgment conditions include, corresponding to the preset function theme, setting judgment condition recognition features based on preset target recognition features and preset target signal state recognition features, and activating the preset function theme;
[0041] Set judgment thresholds based on the corresponding judgment conditions and features;
[0042] Based on the judgment threshold, scan the preset target recognition feature value and the preset target signal state recognition feature value;
[0043] If both the preset target identification feature value and the preset target signal state identification feature value meet the judgment criteria of the identification feature judgment threshold, then the preset functional theme under the output projection theme module can be activated conclusion data.
[0044] Based on the conclusion data that preset functional themes can be activated under the projection theme module, the associated software, hardware, and data resources of the vehicle projection are called up.
[0045] Furthermore, the judgment condition recognition features for activating the preset functional theme based on preset target recognition features and preset target signal state recognition features also include:
[0046] Based on the human-computer interaction terminal, the system captures input commands and identifies them as having permissions, using these as judgment condition recognition features for preset target recognition features. The system then directs the input commands to specific preset functional topics, using these as judgment condition recognition features for preset target signal state recognition features.
[0047] It also includes, based on the perception of the vehicle's internal and external environment, identifying the judgment condition recognition feature of the preset target recognition feature, starting to scan the preset function theme in the preset function theme library, comparing the preset target recognition feature value and the preset target signal state recognition feature value of the preset target to see if they both meet the judgment criteria of the judgment condition recognition feature under the recognition feature judgment threshold.
[0048] If the conditions are met, the software, hardware, and data resources associated with the vehicle projection under the selected preset function theme will be invoked.
[0049] Among them, the selected preset function themes have a priority order, specifically: the vehicle safety function theme takes precedence over the vehicle rescue function theme, and the vehicle rescue function theme takes precedence over the interactive game function theme, and the current preset function theme is selected.
[0050] Furthermore, the preset functional themes include: interactive game functional themes;
[0051] Based on the interactive game theme, the software, hardware, and data resources associated with the in-vehicle projection system are utilized, including:
[0052] The vehicle-mounted DLP projector and / or vehicle-mounted touchscreen serve as the interface output, while the vehicle-mounted camera and / or vehicle-mounted touchscreen serve as the command input.
[0053] The vehicle infotainment system is used for command generation and execution.
[0054] Among them, pixel coordinate instructions are generated based on the gestures of the person recognized by the vehicle camera and / or the touch commands of the vehicle's touch screen;
[0055] Based on pixel coordinate instructions, the vehicle system drives the in-vehicle DLP projector and / or the in-vehicle touchscreen to output the interface.
[0056] The interface output includes changing the position of the game character on the in-vehicle DLP projector and / or the in-vehicle touch screen according to preset pixel coordinate instructions.
[0057] Furthermore, the preset functional themes include: vehicle rescue functional themes;
[0058] Based on the functional theme of vehicle rescue, the software, hardware, and data resources associated with the in-vehicle projection are invoked, including:
[0059] The vehicle-mounted DLP projector and / or vehicle-mounted touchscreen serve as the interface output, while the vehicle-mounted camera and / or vehicle-mounted touchscreen serve as the command input.
[0060] The vehicle infotainment system is used for command generation and execution.
[0061] The vehicle infotainment system obtains map navigation data based on local and / or cloud data.
[0062] Map navigation data includes the vehicle's coordinates relative to the target area being searched, and the projectable orientation data of the onboard DLP;
[0063] The vehicle system drives the vehicle-mounted DLP projector and / or the vehicle-mounted touchscreen as the interface output based on the vehicle's relative coordinates to the target area being searched and the projectable orientation data of the vehicle-mounted DLP.
[0064] Among them, the vehicle-mounted DLP projection illuminates the map navigation data corresponding to the searched area, and simultaneously displays the map navigation data corresponding to the searched area illuminated by the vehicle-mounted DLP projection on the vehicle's touch screen.
[0065] Among them, pixel coordinate instructions are generated based on the gestures of the person recognized by the vehicle camera and / or the touch commands of the vehicle's touch screen;
[0066] Based on pixel coordinate instructions, the vehicle system drives the in-vehicle DLP projector and / or the in-vehicle touchscreen to output the interface.
[0067] The interface output includes using the map navigation data corresponding to the searched area as a background illuminated by the vehicle-mounted DLP projection, and driving the highlighted cursor to change position on the vehicle-mounted DLP projection and / or the vehicle touch screen following pixel coordinate instructions.
[0068] Calling the software, hardware, and data resources associated with the in-vehicle projection also includes calling the directional speakers and directional microphones;
[0069] The synchronously highlighted cursor follows pixel coordinate instructions to change position on the in-vehicle DLP projector and / or in-vehicle touch screen, driving the directional speaker and directional microphone to control the pointing.
[0070] Furthermore, the interface output also includes using the map navigation data corresponding to the searched area illuminated by the vehicle-mounted DLP projection as a background, outputting a preset rescue route, and driving a bright cursor or bright light bar to be displayed on the vehicle-mounted DLP projection and / or the vehicle touch screen in the form of pixel coordinate instructions.
[0071] Among them, it receives instructions from the vehicle's camera and / or the vehicle's touchscreen to adjust the rescue route;
[0072] Based on the adjusted rescue route, an analysis report comparing it with the original rescue route strategy is generated;
[0073] According to the analysis report, this assists in displaying on the vehicle's touchscreen and sharing with other synchronized devices.
[0074] According to a third aspect of the present invention, an electronic device is provided, comprising: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;
[0075] The memory stores a computer program, which, when executed by the processor, causes the processor to perform steps such as those in a vehicle projection method.
[0076] According to a fourth aspect of the present invention, a computer-readable storage medium is provided, comprising: storing a computer program executable by an electronic device, wherein when the computer program is run on the electronic device, the electronic device performs steps such as those of a vehicle projection method.
[0077] According to a fifth aspect of the present invention, a vehicle is provided, comprising:
[0078] Electronic devices used to implement steps such as vehicle-mounted projection methods;
[0079] The processor runs programs, and when the programs are running, they execute steps such as those of vehicle projection methods based on data output from electronic devices.
[0080] Storage medium used to store programs that, when run, perform steps such as vehicle projection methods on data output from electronic devices.
[0081] The above solution achieves the following beneficial technical effects:
[0082] This application creates an interactive game specifically for pets outside the car, satisfying the interaction needs of users and pets, enhancing the fun of driving, and achieving interactive pet interaction outside the car.
[0083] This application determines valid input by measuring the duration of the gesture, thus avoiding accidental touches, improving input accuracy, and achieving a filtering effect for gesture input.
[0084] This application automatically detects conflicts between custom gestures and system gestures, alerts the user in advance, avoids input confusion, and achieves the effect of custom gesture conflict detection.
[0085] This application uses vibration and sound effects to alert the user when the image reaches the boundary, improving the user's perception, optimizing the interactive experience, and achieving a clear indication of the interactive boundary.
[0086] This application can generate scores and reward feedback based on the actions of pets / users, which enhances the fun and interactivity of the game and achieves the effect of score feedback.
[0087] This application supports switching between multiple interactive images, meeting users' personalized needs and realizing the replaceable effect of interactive images.
[0088] This application plays corresponding sound effects based on the interactive content, enhancing the immersiveness of the interaction, improving the interactive experience between users and pets, and achieving matching interactive sound effects. Attached Figure Description
[0089] Figure 1 This is a flowchart of a vehicle-mounted projection method provided by one or more embodiments of the present invention.
[0090] Figure 2 This is a structural diagram of an in-vehicle projection system provided by one or more embodiments of the present invention.
[0091] Figure 3 This is a schematic diagram of the in-vehicle control projection mouse human-machine interface architecture provided in a specific embodiment of the present invention.
[0092] Figure 4 This is a schematic diagram of the in-vehicle control projection mouse execution terminal architecture provided in a specific embodiment of the present invention.
[0093] Figure 5 This is a schematic diagram of the vehicle projection solution architecture provided in a specific embodiment of the present invention.
[0094] Figure 6 This is a block diagram of an electronic device structure for an in-vehicle projection method provided in one or more embodiments of the present invention. Detailed Implementation
[0095] The technical solution of the present invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0096] Figure 1 This is a flowchart of a vehicle-mounted projection method provided by one or more embodiments of the present invention.
[0097] like Figure 1 The vehicle-mounted projection system shown includes:
[0098] Interaction module and control module;
[0099] The interaction module includes an input module and an output module; the control module includes an instruction generation module and an instruction execution module.
[0100] The input module includes a passive input module and an active input module;
[0101] The passive input module is used to sense the internal and external environment of the vehicle and identify preset targets and their signal states.
[0102] An active input module is used to capture input commands that are identified as having the necessary permissions.
[0103] The output module is used to output data status and works with the input module to form external data interaction.
[0104] The instruction generation module connects to the input module and obtains data from the input module.
[0105] The instruction generation module is used to generate execution instructions based on the data obtained from the input module;
[0106] The instruction execution module connects to the instruction generation module to obtain and execute the execution instructions.
[0107] The output module connects to the instruction execution module, instruction generation module, and / or input module, expressing the entire or partial process status from instruction generation to execution, and enabling data interaction with the input module to form external data.
[0108] The active input module includes a permission authentication module;
[0109] The permission authentication module is used to authenticate the permissions of input commands;
[0110] It also includes an instruction generation module that identifies preset targets and preset target signal states, and interprets and generates execution instructions;
[0111] The instruction generation module connects to the data connection permission authentication module to authenticate whether the execution instruction generated in association with the preset target and the preset target signal status has the permission to be executed.
[0112] If so, send it to the instruction execution module and the output module;
[0113] If not, then send to the output module;
[0114] The output module outputs the data status after adding annotations based on whether the execution instructions generated by identifying and associating with the preset target and the preset target status have the permission to be executed.
[0115] In this embodiment, the control module further includes a communication module:
[0116] The communication module is used to acquire data locally and / or from the cloud.
[0117] The communication module connects the data input module, output module, and instruction generation module.
[0118] The instruction generation module generates execution instructions based on the data from the communication module.
[0119] After the execution instruction is authenticated by the permission authentication module under the input module, it is sent to the instruction execution module and / or the output module;
[0120] The output module adds annotations to the data status based on the results of permission authentication.
[0121] In this embodiment, the instruction execution module includes a projection theme module;
[0122] The projection theme module is used to set the software, hardware and data resources associated with the vehicle projection to be called based on the preset functional theme, so as to ensure the execution of the execution instructions.
[0123] The projection theme module connects to the active input module and / or the instruction generation module;
[0124] Among them, according to the instruction of the active input module to activate the preset functional theme under the projection theme module, the preset software, hardware and data resources associated with the vehicle projection are called.
[0125] The instruction generation module generates execution instructions, including the instruction judgment conditions for activating the preset functional theme under the corresponding projection theme module.
[0126] If the condition for activating the preset function theme under the corresponding projection theme module is met, the command to activate the preset function theme under the projection theme module will call the preset software, hardware and data resources associated with the vehicle projection.
[0127] Specifically, this application divides the system into a classic layered architecture of "interaction module (input / output) + control module (instruction generation / execution)". At the same time, it divides the input into passive environmental perception (automatic triggering) + active user input (manual triggering), covering two core scenarios: "automatic perception triggering projection function" and "user manually activating projection function". The data flow between modules is completely smooth: input data is sent to the generation module, the generated instructions are sent to the execution module, and the output module synchronously provides feedback on the status of the entire process. There are no breaks in the entire data flow.
[0128] This application adopts a unified permission verification logic: whether it is a command actively entered by the user, an automatic command triggered by passive perception, or even a command issued by the cloud, all of them must be verified by the permission identification module; if there is permission, it will be executed and the status will be output; if there is no permission, only a marked prompt will be output, and no risky operation will be performed, which perfectly balances the convenience of automation and the security of operation.
[0129] The "projection theme module" in this application pre-packages the software, hardware, and data resources corresponding to different functional themes. Whether activated manually by the user or automatically triggered by the system, the corresponding resources can be called with one click without the need for separate configuration each time. At the same time, for the automatically triggered scenario, a priority mechanism of safety theme > rescue theme > entertainment theme is designed to solve the conflict problem of multiple themes being triggered at the same time, and to prioritize the safety requirements of the vehicle system scenario.
[0130] The vehicle-mounted projection system in this embodiment may further include a passive input module (sensing device), which is configured to detect the eye position of an external living being through a camera, an infrared sensor, and a millimeter-wave radar; when the eye of the living being is detected to be within the projection coverage area, the instruction execution module is triggered to reduce the projection brightness of the vehicle-mounted DLP projection (projection device) to below a preset safety threshold, or to adjust the emission angle of the vehicle-mounted DLP projection (projection device) to move the projected content to other areas.
[0131] It may also include: a projection theme module, which is also equipped with a wildlife repelling function theme; when the passive input module (sensing device) detects wildlife on the road, it automatically calls the corresponding projection resources and projects preset warning images through the vehicle-mounted DLP projector (projection device) to drive the wildlife away from the road area.
[0132] It may also include an instruction execution module, which is configured to dynamically plan a new projection path and adjust the projection content to an unobstructed continuous area when the projected content is detected to ensure the continuity of the interaction.
[0133] It may also include: an active input module, which also supports gesture input outside the vehicle. Specifically, it uses a passive input module (sensing device) to recognize the gesture commands of the user outside the vehicle, and controls the interactive image projected outside the vehicle by the in-vehicle DLP projector (projection device) to move accordingly based on the gesture of the user outside the vehicle.
[0134] It may also include interactive game themes and a scoring feedback unit, which generates game scores and reward feedback based on the location and movement of pets or people outside the vehicle, and displays them simultaneously through the in-vehicle display screen or the outside speakers.
[0135] It may also include a passive input module (sensing device), which is further configured to scan the projection target area, identify the flatness, color and lighting conditions of the target area, and adjust the projection parameters of the vehicle-mounted DLP projector (projection device) according to the identification results to ensure the display effect of the projected content.
[0136] It may also include: a control module (control device), and is also equipped with an AI large model unit, which is used to make autonomous decisions and recommend corresponding projection content based on the current environmental perception results and the user's historical operations.
[0137] It may also include an output module, which is configured to trigger the vehicle's external speakers to play sound effects corresponding to the projected content while performing the projection operation, thereby enhancing the immersive experience of the interaction.
[0138] It may also include: an active input module, which also supports user-defined gestures. Users can define gesture commands corresponding to the direction of projection movement, and the system controls the movement of the interactive image based on the user-defined gestures.
[0139] It may also include an instruction execution module, which is configured to automatically switch the projection type from ground projection mode to wall projection mode when adjusting the projection position cannot avoid the biological eye, so as to avoid the light source shining directly into the biological eye.
[0140] It may also include: interactive game functional themes, and is also equipped with boundary restriction units, which stop moving towards the edge when the interactive image moves to the edge of the projection area, so as to prevent the interactive image from moving out of the projection range.
[0141] It may also include: preset game characters for interactive game themes, supporting multiple replaceable types, including at least one of mice, toy cars, yarn balls, birds, and butterflies.
[0142] It may also include an output module, which is further configured to control the in-vehicle display screen while performing the projection operation, displaying the perceived images outside the vehicle and the interactive status of the projection, so that users inside the vehicle can view them.
[0143] It may also include a communication module that supports multi-vehicle interaction and is used to exchange data with the projection systems of other vehicles to achieve interactive interaction of projected content across multiple vehicles.
[0144] In this embodiment, the method further includes a preset safety threshold, which is a dynamic threshold that is adaptively adjusted according to the current ambient light intensity. When the ambient light intensity is higher than the preset threshold, the minimum safety threshold for projected brightness is increased to ensure the visibility of the projected content.
[0145] Furthermore, the active input module is also equipped with a gesture filtering unit to filter invalid gesture inputs. When the duration of a user's gesture is detected to be less than the preset minimum effective time, it is determined to be invalid input and the movement of the interactive image is not triggered.
[0146] Furthermore, the communication module requires permission verification by the permission authentication module when conducting multi-vehicle linkage interaction. Data interaction is only allowed after the identity of the paired vehicle is verified and the current user's authorization is obtained.
[0147] Furthermore, the wildlife deterrence function also includes an image selection unit, which selects the corresponding warning image based on the type of wildlife detected. Different types of wildlife correspond to different warning content, thereby improving the deterrence effect.
[0148] Furthermore, the passive input module (sensing device) is also equipped with a region adaptation prompt unit. When the flatness, color, or lighting conditions of the projection target area are detected to be outside the adjustment range of the projection parameters, the output module sends a prompt message to the user to guide the user to change the projection area.
[0149] Furthermore, the projected content recommended by the AI large model unit must also undergo permission verification by the permission authentication module. Only when the recommended content passes the permission verification will it be recommended to the user.
[0150] Furthermore, the active input module is also equipped with a gesture conflict detection unit. When the user defines a gesture, it automatically detects whether the defined gesture conflicts with the system's preset gesture. If a conflict exists, it sends a prompt message to the user.
[0151] Furthermore, it includes a boundary restriction unit that, when the interactive image moves to the edge of the projection area, also sends a boundary prompt to the user through the output module, including a vibration prompt or sound effect prompt, to inform the user that the projection boundary has been reached.
[0152] Furthermore, the instruction execution module detects the position and flatness of the wall surface through the passive input module (sensing device) before switching the projection mode. The mode switch is only executed when a wall surface that meets the requirements is detected.
[0153] Furthermore, it includes an external speaker that is a directional speaker, which directs the sound propagation direction towards the projection area when playing sound effects, thus avoiding noise interference to unrelated areas.
[0154] Furthermore, the output module, when displaying the perceived images outside the vehicle, also blurs the facial information of people outside the vehicle to protect their privacy.
[0155] Furthermore, the instruction execution module detects the duration of the obstruction when it detects that the projected content is obstructed. The projection path is only adjusted when the duration of the obstruction exceeds a preset minimum adjustment time, thus avoiding frequent adjustments caused by temporary obstruction.
[0156] Specifically, this application can also be understood as: an in-vehicle projection system, comprising: an input module for receiving active input commands from a user, or passive sensing signals from an environmental perception module (perception device); an instruction generation module for generating corresponding projection theme instructions based on the input commands / signals; an access verification module for verifying the access rights of the projection theme instructions; a projection theme module for calling corresponding projection theme resources based on the verified instructions, wherein preset projection themes include interactive games, vehicle rescue, safety tips, etc.; and an execution module for controlling a DLP projection device (projection device) to perform projection operations.
[0157] The environmental perception module (perception device) is also configured to: detect the eye position of an organism outside the vehicle through a camera, infrared sensor and millimeter-wave radar; when the organism's eye is detected to be within the projection coverage area, trigger the execution module to reduce the projection brightness to below a preset safety threshold, or adjust the emission angle of the DLP projection device (projection device) to move the projected content to other areas.
[0158] The projection theme module is also equipped with an interactive game theme that links the inside and outside of the vehicle. The interactive game theme specifically involves: calling the in-vehicle occupant monitoring system (OMS camera) to recognize the gesture commands of the users inside the vehicle; establishing a dynamic coordinate mapping between the gesture space inside the vehicle and the projection area on the ground outside the vehicle; and controlling the DLP projection device (projection device) to project interactive images outside the vehicle according to the user's gesture commands, guiding pets or people outside the vehicle to interact.
[0159] The input module also supports touch input, specifically: it receives touch input from the user on the in-vehicle central control screen, and controls the interactive image projected outside the vehicle by the DLP projection device (projection device) to move synchronously according to the user's click or drag operation.
[0160] The projection theme module is also equipped with multi-vehicle linkage themes. The system also includes a communication device that supports V2X, Bluetooth and Wi-Fi communication, which is used to interact with the projection systems of other vehicles and realize the linkage and interaction of projection content in multiple vehicles.
[0161] The projection theme module is also equipped with a wildlife removal theme. Specifically, when the environmental perception module (sensing device) detects wild animals on the road, it automatically calls up the corresponding projection resources and projects a preset warning image through the DLP projection device (projection device) to drive the wild animals away from the road area.
[0162] The execution module is also configured to dynamically plan a new projection path when the projected content is obscured, and adjust the projected content to an unobstructed continuous area to ensure the continuity of interaction.
[0163] The input module also supports gesture input from outside the vehicle. Specifically, the environmental perception module (sensing device) recognizes the gesture commands of the user outside the vehicle, and controls the interactive image projected outside the vehicle by the DLP projection device (projection device) to move accordingly. The DLP projection device can be understood as a type of output module.
[0164] The interactive game theme is also equipped with a scoring feedback unit, which generates game scores and reward feedback based on the location and movement of pets or people outside the vehicle, and displays them simultaneously through the in-vehicle display screen or the outside speakers.
[0165] The environmental perception module (sensing device) is also configured to: scan the projection target area, identify the flatness, color and lighting conditions of the target area, and adjust the projection parameters of the DLP projection device (projection device) according to the identification results to ensure the display effect of the projected content.
[0166] The vehicle's main unit (control device) is also equipped with an AI large model unit, which is used to make autonomous decisions and recommend corresponding projection content based on the current environmental perception results and the user's historical operations.
[0167] The execution module is also configured to trigger the external speakers while performing the projection operation to play sound effects corresponding to the projected content, thereby enhancing the immersive experience of the interaction.
[0168] The input module also supports user-defined gestures. Users can define gesture commands corresponding to the direction of projection movement, and the system controls the movement of the interactive image based on the user-defined gestures.
[0169] The execution module is also configured to automatically switch the projection type from ground projection mode to wall projection mode when adjusting the projection position cannot avoid the biological eyes, so as to avoid the light source shining directly into the biological eyes.
[0170] The interactive game theme is also equipped with a boundary restriction unit. When the interactive image moves to the edge of the projection area, it stops moving towards the edge to prevent the interactive image from moving out of the projection range.
[0171] Interactive video game themes that support multiple replaceable types, including at least one of the following: mouse, toy car, ball of yarn, bird, and butterfly.
[0172] The execution module is also configured to control the in-vehicle display screen while performing the projection operation, displaying the perceived images outside the vehicle and the interactive status of the projection, so that users inside the vehicle can view them.
[0173] Figure 2 This is a structural diagram of an in-vehicle projection system provided by one or more embodiments of the present invention.
[0174] like Figure 2 The vehicle-mounted projection methods shown include:
[0175] Step S1: Based on the preset functional theme, set the software, hardware and data resources associated with the vehicle projection to be called in the package;
[0176] Step S2: Activate the preset functional theme under the corresponding projection theme module and set the instruction judgment conditions;
[0177] Step S3, the instruction judgment conditions include, corresponding to the preset function theme, setting the judgment condition recognition features based on the preset target recognition features and the preset target signal state recognition features, and activating the judgment condition recognition features of the preset function theme;
[0178] Step S4: Set the judgment threshold for the features identified according to the judgment conditions;
[0179] Step S5: Based on the judgment threshold, scan the preset target recognition feature value and the preset target signal state recognition feature value;
[0180] Step S6: If both the preset target identification feature value and the preset target signal state identification feature value meet the judgment criteria of the identification feature judgment threshold, then the preset functional theme under the projection theme module can be activated conclusion data.
[0181] Step S7: Based on the conclusion data that preset functional themes can be activated under the projection theme module, call the software, hardware and data resources associated with the vehicle projection.
[0182] Specifically, the preset target can be understood as the car owner, disabled person, or other person or object with specific requirements related to the in-vehicle projection system. The preset target signal state can be understood as the state of certain signal data, such as body language, voice recognition, gesture language, or identity status. Preset targets and their signal states can be identified through visual recognition, microphone identity data recognition, etc. The judgment condition recognition feature can be understood as the generation of a preset function theme activation command by a person in a specific body language, voice recognition, gesture language, or identity status. The judgment threshold serves as the criterion for judging a person in a specific body language, voice recognition, gesture language, or identity status. For example, if the car owner points to the current cursor position for one second and then randomly rotates their shoulder joint to point in another direction, and the angle of the pointing change is greater than a preset angle threshold (indicating not jitter but a clear cursor following command), the cursor will follow the finger's pointing pixel position. Other similar scenarios apply.
[0183] In this embodiment, the judgment condition recognition feature for activating the preset functional theme based on preset target recognition features and preset target signal state recognition features further includes:
[0184] Based on the human-computer interaction terminal, the system captures input commands and identifies them as having permissions, using these as judgment condition recognition features for preset target recognition features. The system then directs the input commands to specific preset functional topics, using these as judgment condition recognition features for preset target signal state recognition features.
[0185] It also includes, based on the perception of the vehicle's internal and external environment, identifying the judgment condition recognition feature of the preset target recognition feature, starting to scan the preset function theme in the preset function theme library, comparing the preset target recognition feature value and the preset target signal state recognition feature value of the preset target to see if they both meet the judgment criteria of the judgment condition recognition feature under the recognition feature judgment threshold.
[0186] If the conditions are met, the software, hardware, and data resources associated with the vehicle projection under the selected preset function theme will be invoked.
[0187] Among them, the selected preset function themes have a priority order, specifically: the vehicle safety function theme takes precedence over the vehicle rescue function theme, and the vehicle rescue function theme takes precedence over the interactive game function theme, and the current preset function theme is selected.
[0188] In this embodiment, the preset functional themes include: interactive game functional themes;
[0189] Based on the interactive game theme, the software, hardware, and data resources associated with the in-vehicle projection system are utilized, including:
[0190] The vehicle-mounted DLP projector and / or vehicle-mounted touchscreen serve as the interface output, while the vehicle-mounted camera and / or vehicle-mounted touchscreen serve as the command input.
[0191] The vehicle infotainment system is used for command generation and execution.
[0192] Among them, pixel coordinate instructions are generated based on the gestures of the person recognized by the vehicle camera and / or the touch commands of the vehicle's touch screen;
[0193] Based on pixel coordinate instructions, the vehicle system drives the in-vehicle DLP projector and / or the in-vehicle touchscreen to output the interface.
[0194] The interface output includes changing the position of the game character on the in-vehicle DLP projector and / or the in-vehicle touch screen according to preset pixel coordinate instructions.
[0195] Specifically, an electrically controlled fishing rod can be added, with command data connected to the vehicle's infotainment system, allowing remote control of the rod via gestures from inside the vehicle. For example, during night fishing in rainy seasons or cold regions, the person stays inside the vehicle, while the fishing rod is set up outside. A DLP projector on the vehicle projects a virtual "bait" onto the pond. The person inside the vehicle watches the infotainment screen to observe the rod's status and then casts and reels the rod from inside the vehicle to complete the fishing. Because of the virtual "bait," there is no need to repeatedly bait the hook. A visual recognition module is also included to identify water surface movements, analyze fish bites, and provide feedback to the infotainment screen and in-vehicle speakers.
[0196] In this embodiment, the preset functional themes include: vehicle rescue functional themes;
[0197] Based on the functional theme of vehicle rescue, the software, hardware, and data resources associated with the in-vehicle projection are invoked, including:
[0198] The vehicle-mounted DLP projector and / or vehicle-mounted touchscreen serve as the interface output, while the vehicle-mounted camera and / or vehicle-mounted touchscreen serve as the command input.
[0199] The vehicle infotainment system is used for command generation and execution.
[0200] The vehicle infotainment system obtains map navigation data based on local and / or cloud data.
[0201] Map navigation data includes the vehicle's coordinates relative to the target area being searched, and the projectable orientation data of the onboard DLP;
[0202] The vehicle system drives the vehicle-mounted DLP projector and / or the vehicle-mounted touchscreen as the interface output based on the vehicle's relative coordinates to the target area being searched and the projectable orientation data of the vehicle-mounted DLP.
[0203] Among them, the vehicle-mounted DLP projection illuminates the map navigation data corresponding to the searched area, and simultaneously displays the map navigation data corresponding to the searched area illuminated by the vehicle-mounted DLP projection on the vehicle's touch screen.
[0204] Among them, pixel coordinate instructions are generated based on the gestures of the person recognized by the vehicle camera and / or the touch commands of the vehicle's touch screen;
[0205] Based on pixel coordinate instructions, the vehicle system drives the in-vehicle DLP projector and / or the in-vehicle touchscreen to output the interface.
[0206] The interface output includes using the map navigation data corresponding to the searched area as a background illuminated by the vehicle-mounted DLP projection, and driving the highlighted cursor to change position on the vehicle-mounted DLP projection and / or the vehicle touch screen following pixel coordinate instructions.
[0207] Calling the software, hardware, and data resources associated with the in-vehicle projection also includes calling the directional speakers and directional microphones;
[0208] The synchronously highlighted cursor follows pixel coordinate instructions to change position on the in-vehicle DLP projector and / or in-vehicle touch screen, driving the directional speaker and directional microphone to control the pointing.
[0209] Specifically, in wilderness rescue operations, it's common to encounter situations where movement is restricted and direction is unclear. Due to poor communication, efficient rescue operations are often impossible, frequently resulting in a lack of coordination between rescuers and those being rescued. In one rescue scenario, based on the vehicle's location, a vehicle-mounted DLP (Digital Light Source) projector illuminates the search area, allowing rescuers to see a cursor pointing to a specific location. Simultaneously, the person being rescued can follow the cursor on the DLP projection and be guided to a predetermined location. Both rescuers and those being rescued become disoriented when they lose their panoramic view. Projecting a vehicle-mounted DLP onto the search area creates a "lighthouse" and "guidance" effect. The light signal from the projected DLP provides synchronized signal guidance to those with a panoramic view and those without, improving rescue efficiency.
[0210] Specifically, the automatic triggering judgment logic in this application is designed for automatic triggering scenarios involving passive perception. This application designs a complete judgment process: perceiving the target → scanning the topic library → feature matching → threshold judgment → prioritizing topic selection → resource retrieval. The entire process is closed-loop, without any breakpoints, and can automatically match the most suitable projection function according to the environmental state.
[0211] This application includes two specific functional embodiments:
[0212] Interactive game theme: Using a projector / touchscreen as the output, a camera / touchscreen as the input, and gestures to control game characters, matching in-car interactive scenarios;
[0213] Vehicle rescue theme: Projecting a map onto the ground outside the vehicle, synchronizing the cursor and directional microphone, perfectly meets the user's interaction needs outside the vehicle in a rescue scenario, and the process is established.
[0214] The vehicle projection system in this embodiment may further include: detecting the eye position of an external living being through a passive input module (sensing device);
[0215] When a biological eye is detected to be within the projection coverage area, perform at least one of the following operations:
[0216] Reduce the projection brightness of the vehicle-mounted DLP projector (projection device) to below a preset safety threshold;
[0217] Adjust the projection angle of the vehicle-mounted DLP projector (projection device) to move the projected content to another area.
[0218] It may also include: when the projected content is detected to be obstructed, dynamically planning a new projection path and adjusting the projected content to a continuous area that is not obstructed, so as to ensure the continuity of interaction.
[0219] Receiving user input commands also includes:
[0220] It receives gesture commands from users outside the vehicle and controls the interactive images projected by the in-vehicle DLP projector (projection device) to move accordingly.
[0221] It may also include: generating game scores and reward feedback based on the location and movement of pets or people outside the vehicle, and displaying them simultaneously through the in-vehicle display screen or the outside speakers.
[0222] It may also include: scanning the projection target area through a passive input module (sensing device), identifying the flatness, color and lighting conditions of the target area, and adjusting the projection parameters of the vehicle-mounted DLP projector (projection device) according to the identification results to ensure the display effect of the projected content.
[0223] It can also include: using large AI models to autonomously make decisions and recommend corresponding projection content based on current environmental perception results and the user's historical operations.
[0224] It may also include: while controlling the in-vehicle DLP projector (projection device) to perform projection operations, triggering the external speakers to play sound effects corresponding to the projected content, thereby enhancing the immersive interactive experience.
[0225] Receiving user input commands also includes:
[0226] The system receives user-defined gesture commands, which correspond to the direction of projection movement. The system then controls the movement of the interactive image based on these user-defined gestures.
[0227] It may also include: when adjusting the projection position cannot avoid the eyes of the organism, automatically switching the projection type from ground projection mode to wall projection mode to avoid the light source shining directly into the eyes of the organism.
[0228] It may also include: when the interactive image moves to the edge of the projection area, it stops moving towards the edge to prevent the interactive image from moving out of the projection range.
[0229] It may also include: preset game characters for interactive game themes, supporting multiple replaceable types, including at least one of mice, toy cars, yarn balls, birds, and butterflies.
[0230] It may also include: while performing the projection operation, controlling the in-vehicle display screen to display the perceived images outside the vehicle and the interactive status of the projection, so that users inside the vehicle can view them.
[0231] It may also include: interacting with the projection systems of other vehicles through a communication module to achieve interactive linkage of projection content across multiple vehicles.
[0232] In this embodiment, the method further includes a preset safety threshold, which is a dynamic threshold that is adaptively adjusted according to the current ambient light intensity. When the ambient light intensity is higher than the preset threshold, the minimum safety threshold for projected brightness is increased to ensure the visibility of the projected content.
[0233] Furthermore, it also includes filtering invalid gesture inputs. When the duration of a user's gesture is detected to be less than the preset minimum valid time, it is determined to be invalid input and the movement of the interactive image is not triggered.
[0234] Furthermore, it also includes: when conducting multi-vehicle linkage interaction, permission authentication is required. Data interaction is only allowed after the identity of the paired vehicle is verified and the current user's authorization is obtained.
[0235] Furthermore, the wildlife deterrence function also includes: selecting corresponding warning images based on the types of wildlife detected, with different warning content corresponding to different types of wildlife, thereby improving the deterrence effect.
[0236] Furthermore, it also includes sending a prompt message to the user when the flatness, color, or lighting conditions of the projection target area are detected to be outside the adjustment range of the projection parameters, guiding the user to change the projection area.
[0237] Furthermore, it also includes: verifying the permissions of the projected content recommended by the AI model, and only recommending content to users after the permissions have been verified.
[0238] Furthermore, it also includes: when a user defines a gesture, it automatically detects whether the defined gesture conflicts with the system's preset gestures; if a conflict exists, it sends a prompt message to the user.
[0239] Furthermore, it also includes sending boundary prompts to the user when the interactive image moves to the edge of the projection area, including vibration prompts or sound effects, to inform the user that the projection boundary has been reached.
[0240] Furthermore, before switching the projection mode, the position and flatness of the wall are detected by a passive input module (sensing device), and the mode switch is only performed when a wall that meets the requirements is detected.
[0241] Furthermore, it also includes: external speakers, which are directional speakers that direct the sound effects towards the projection area when playing sound effects, thus avoiding noise interference to unrelated areas.
[0242] Furthermore, when displaying the perceived images outside the vehicle, the facial information of people outside the vehicle is also blurred to protect their privacy.
[0243] Furthermore, it also includes: when the projected content is detected to be obscured, the duration of the obstruction is also detected, and the projection path is adjusted only when the duration of the obstruction exceeds the preset minimum adjustment time, so as to avoid frequent adjustments caused by temporary obstruction.
[0244] Specifically, this application can be understood as: a vehicle-mounted projection method, comprising: receiving an active input command from a user, or receiving a passive sensing signal from an environmental perception module (perception device); generating a corresponding projection theme command based on the input command / signal; performing permission verification on the projection theme command; calling the corresponding projection theme resource based on the verified command, wherein the preset projection themes include interactive games, vehicle rescue, safety tips, etc.; and controlling a DLP projection device (projection device) to perform projection operations.
[0245] It also includes: detecting the eye position of an organism outside the vehicle through an environmental perception module (sensing device); when the organism's eye is detected to be within the projection coverage area, performing at least one of the following operations: reducing the projection brightness to below a preset safety threshold; adjusting the emission angle of the DLP projection device (projection device) to move the projected content to another area.
[0246] Calling the corresponding projection theme resources also includes calling interactive game themes that link the inside and outside of the vehicle. Specifically, this includes: recognizing the gesture commands of users inside the vehicle through the in-vehicle occupant monitoring system (OMS camera); establishing a dynamic coordinate mapping between the in-vehicle gesture space and the ground projection area outside the vehicle; and controlling the DLP projection device (projection device) to project interactive images outside the vehicle according to the user's gesture commands, so as to guide pets or people outside the vehicle to interact.
[0247] Receiving user input commands also includes receiving user touch input on the in-vehicle central control screen, and controlling the interactive image projected outside the vehicle by the DLP projection device (projection device) to move synchronously based on the user's click or drag operation.
[0248] Calling the corresponding projection theme resources also includes calling multi-vehicle linkage themes, specifically including: using V2X, Bluetooth or Wi-Fi communication to interact with the projection systems of other vehicles to achieve linkage interaction of multi-vehicle projection content.
[0249] Calling the corresponding projection theme resources also includes calling the wildlife removal theme. Specifically, when the environmental perception module (sensing device) detects wild animals on the road, it automatically calls the corresponding projection resources and projects a preset warning image through the DLP projection device (projection device) to drive the wild animals away from the road area.
[0250] It also includes: detecting the occlusion status of the projected content; when the projected content is detected to be occluded, dynamically planning a new projection path and adjusting the projected content to an unoccluded continuous area to ensure the continuity of interaction.
[0251] It also includes: receiving gesture commands from users outside the vehicle, and controlling the interactive images projected outside the vehicle by the DLP projection device (projection device) to move accordingly based on the gestures of the users outside the vehicle.
[0252] It also includes generating game scores and reward feedback based on the location and movement of pets or people outside the vehicle, which are then displayed simultaneously on the in-vehicle display screen or outside the vehicle speakers.
[0253] It also includes: scanning the projection target area through an environmental perception module (sensing device), identifying the flatness, color and lighting conditions of the target area, and adjusting the projection parameters of the DLP projection device (projection device) according to the identification results to ensure the display effect of the projected content.
[0254] It also includes: using large AI models to autonomously make decisions and recommend corresponding projection content based on current environmental perception results and the user's historical operations.
[0255] It also includes: while controlling the DLP projection device (projection device) to perform projection operations, triggering the vehicle's external speakers to play sound effects corresponding to the projected content, enhancing the immersive interactive experience.
[0256] Receiving user input commands also includes receiving user-defined gesture commands. Users can define gestures that correspond to the direction of projection movement, and the system controls the movement of the interactive image based on the user-defined gestures.
[0257] It also includes: when adjusting the projection position cannot avoid the eyes of the organism, automatically switch the projection type from ground projection mode to wall projection mode to avoid the light source shining directly into the eyes of the organism.
[0258] It also includes: when the interactive image moves to the edge of the projection area, it stops moving towards the edge to prevent the interactive image from moving out of the projection range.
[0259] Interactive video game themes that support multiple replaceable types, including at least one of the following: mouse, toy car, ball of yarn, bird, and butterfly.
[0260] It also includes: while performing the projection operation, controlling the in-vehicle display screen to display the perceived images outside the vehicle and the interactive status of the projection, making it convenient for users inside the vehicle to view.
[0261] It is worth noting that although this system / device only discloses the above-mentioned modules / units, it does not mean that this system / device is limited to the above-mentioned basic functional modules. On the contrary, what this invention intends to express is that, based on the above-mentioned basic functional modules, those skilled in the art can add one or more functional modules in combination with the prior art to form an infinite number of embodiments or technical solutions. That is to say, this system is open rather than closed. It cannot be assumed that the scope of protection of the claims of this invention is limited to the above-disclosed basic functional modules just because this embodiment only discloses a few basic functional modules.
[0262] In one specific embodiment, a lightweight pet interaction scenario is created by "gesture control / screen control + ground DLP projection", which enables "users to make gestures or click the screen inside the car, and project a small mouse image outside the car to guide the pet to chase", providing users with emotional value in human-pet interaction.
[0263] like Figure 3 , 4 As shown, a dynamic coordinate mapping is established between the in-vehicle gesture space and the ground projection area. By having the user control the movement of the projected mouse inside the vehicle, interaction from other people and animals outside the vehicle can be attracted.
[0264] In this embodiment, the user controls the mouse projection using gestures: gesture A is defined as upward (towards the car), gesture B as downward (backward), gesture C as left, and gesture D as right. After the user clicks "Start Game," the vehicle's screen displays the OMS camera image and recognition range frame. The user makes gesture A within the recognition range, and the mouse generates a point within a 90° sector in the upper region, with itself as the origin, and moves towards that point. After the mouse reaches the target position, the user makes gesture D, and the mouse generates a point within a 90° sector in the right region, with itself as the origin, and moves towards that point. When the mouse moves to the right edge of the projection, the user continues to make gesture D, and the mouse stops moving.
[0265] In this embodiment, the user controls the mouse projection using the screen: After clicking "Start Game," the user controls the projection using the screen, which displays a mirrored image of the projection. The user can click on a location on the screen or click on the mouse and then continue touching and dragging the screen. The mouse moves to the clicked location or along the dragged path, and the DLP projection also moves accordingly. The user can end the game by clicking the "End Game" button.
[0266] In another specific embodiment, the disclosure is as follows Figure 5 The architecture of the vehicle-mounted projection solution is shown.
[0267] The vehicle-mounted projection solution architecture includes the following components:
[0268] Control unit: includes the vehicle's main unit, which is used to receive input content and run control logic.
[0269] Sensing devices: These include cameras, infrared sensors, and millimeter-wave radar, installed around the vehicle body to detect the characteristics, location, and movement trajectory of living beings (people, pets, wild animals) outside the vehicle.
[0270] Input devices: touch screen, camera, microphone, used to input user interaction commands to the vehicle system.
[0271] Actuation devices: Projection devices: DLPs installed at the front and sides of the vehicle exterior for projecting static and dynamic images out of the vehicle. Other actuation devices: including external speakers (capable of playing sound) and in-vehicle displays (used to display external images and interactive status).
[0272] Communication devices: Support V2X, Bluetooth and Wi-Fi to enable multi-vehicle linkage, mobile app control and cloud data synchronization.
[0273] The architecture of an in-vehicle projection solution includes the system component:
[0274] Perception Module: The external perception module scans the vehicle's surrounding environment to identify the following information: a. The number, type, location, and posture (including command gestures) of external creatures (people, pets, wild animals); b. The flatness, color, and lighting conditions of the projected target area (ground or water surface); c. Whether there are eyes of creatures in the projection light path.
[0275] Input module: Obtains user input commands through the in-vehicle central control screen or preset shortcut gestures.
[0276] Control Module: ① Establishes a dynamic coordinate mapping between in-vehicle gestures and the ground projection area; ② Dynamically plans a new projection path based on the input content, ensuring the projected content is always displayed on a continuous, unobstructed ground surface, guaranteeing uninterrupted interaction; ③ Executes response operations via the in-vehicle central control screen or quick gestures inside and outside the vehicle, based on the mode corresponding to the current scene; ④ Possesses AI large-scale model capabilities, recommending projection content after autonomous system decision-making.
[0277] Storage module: Stores the controls and functions executed to deal with different perception and input scenarios, such as game libraries, tool libraries, etc.
[0278] Execution Module: Primarily performs the projection function. If a biological eye is detected within the projection coverage area, it performs the following actions: ① Reduces the projection brightness to below a preset safety threshold; ② Moves the projected content to another area by adjusting the projection module's emission angle. If any sensory or input content is detected inside or outside the vehicle, the corresponding projection is executed. It also coordinates with the external speakers to play sound and the screen to display interactive status.
[0279] In another specific embodiment, examples that can be implemented under the vehicle projection solution architecture include:
[0280] Self-projection: Adjusts the projection range based on the content detected by the sensing device to avoid shining into the eyes of people or animals (not limited to ground projection; if ground projection cannot avoid the eyes, it can be switched to wall projection).
[0281] Interactive Game 1: Human-Car-Pet (Human). Through sensing and input devices, players can interact with each other between a human, a car, and a pet, or between a human, a car, and another human. ① Players can project images from inside the car or via screen commands to interact with a pet or person outside the car; ② Players can project images from outside the car to interact with another person outside the car. Both methods utilize sensing devices to obtain the player's location and status, providing scores and rewards.
[0282] Interactive Game 2: Car-Car. This game facilitates car-to-car interaction through sensing and input devices. When cars are close enough that their projections overlap, the game can sense the content of the other car's projection and, through user input, change the position of the projection, thus engaging in the game.
[0283] Input Module - Using in-vehicle and out-of-vehicle gesture control: Predefined or user-defined gestures: A for upward (towards the vehicle), B for downward (backwards), C for left, and D for right. After the user starts the game, they make gesture A within the recognition range. The projected object generates a point within a 90° sector in the upper area, with itself as the origin, and moves towards that point. After the projected object reaches the target position, the user makes gesture D. The projected object generates a point within a 90° sector in the right area, with itself as the origin, and moves towards that point. When the projected object moves to the right edge of the projection, the user continues to make gesture D, and the projected object stops moving.
[0284] Input Module - Screen Control: When a user clicks on a location on the screen or clicks on the projected image and then touches and drags the screen, the projected image moves to the clicked location or along the dragged path, and the DLP projector also moves accordingly.
[0285] Tool: Based on the perceived external environment and user input commands, it provides functions such as lighting and prompts. For example, if wild small animals are detected on the road, images of these animals can be projected to scare them away.
[0286] This embodiment is a projection product that connects the interior and exterior of a vehicle, including game and auxiliary tool functions (lighting, indication, etc.). Specifically, it eliminates the risk of direct sunlight on the eyes of living beings, improving safety; significantly enhances user interaction freedom, no longer limited by the driver's seat; establishes an emotional connection between humans and pets, enhancing companionship and a sense of accomplishment, providing emotional value; enriches interactive content, increasing function reusability and user stickiness; expands applications to multiple scenarios, maximizing the practical value of in-vehicle projection, and has the expansion capability for multi-vehicle collaboration.
[0287] Figure 6 This is a block diagram of an electronic device structure for an in-vehicle projection method provided in one or more embodiments of the present invention.
[0288] like Figure 6 As shown, this application provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus;
[0289] The memory stores a computer program that, when executed by a processor, causes the processor to perform the steps of a vehicle projection method.
[0290] This application also provides a computer-readable storage medium storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the vehicle projection method.
[0291] This application also provides a vehicle, including:
[0292] Electronic devices, steps for implementing vehicle-mounted projection methods;
[0293] The processor runs a program that executes the steps of the vehicle projection method based on data output from the electronic device when the program is running.
[0294] Storage medium for storing programs that, when run, execute steps of the vehicle projection method based on data output from an electronic device.
[0295] The communication bus mentioned in the above electronic devices can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used to represent it in the diagram, but this does not indicate that there is only one bus or one type of bus.
[0296] The electronic device comprises a hardware layer, an operating system layer running on top of the hardware layer, and an application layer running on the operating system. The hardware layer includes hardware such as a central processing unit (CPU), a memory management unit (MMU), and memory. The operating system can be any one or more computer operating systems that control the electronic device through processes, such as Linux, Unix, Android, iOS, or Windows. Furthermore, in this embodiment of the invention, the electronic device can be a smartphone, tablet computer, or other handheld device, or a desktop computer, portable computer, or other electronic device; there is no particular limitation in this embodiment.
[0297] In this embodiment of the invention, the executing entity for electronic device control can be an electronic device itself, or a functional module within an electronic device capable of calling and executing a program. The electronic device can obtain the firmware corresponding to the storage medium. This firmware is provided by the supplier, and different storage media may have the same or different firmware; no limitation is made here. After obtaining the firmware corresponding to the storage medium, the electronic device can write this firmware into the storage medium; specifically, it burns the firmware corresponding to the storage medium into the storage medium. The process of burning the firmware into the storage medium can be implemented using existing technology, and will not be elaborated upon in this embodiment of the invention.
[0298] Electronic devices can also obtain reset commands corresponding to the storage media. The reset commands corresponding to the storage media are provided by the supplier. The reset commands corresponding to different storage media can be the same or different, and no restrictions are imposed here.
[0299] At this time, the storage medium of the electronic device is a storage medium on which the corresponding firmware has been written. The electronic device can respond to the reset command corresponding to the storage medium on which the corresponding firmware has been written, thereby resetting the storage medium on which the corresponding firmware has been written according to the reset command. The process of resetting the storage medium according to the reset command can be implemented by existing technology and will not be described in detail in this embodiment of the invention.
[0300] For ease of description, the above devices are described separately by function as various units and modules. Of course, in implementing this application, the functions of each unit and module can be implemented in one or more software and / or hardware.
[0301] It will be understood by those skilled in the art that, unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. It should also be understood that terms such as those defined in general dictionaries should be understood to have the meaning consistent with their meaning in the context of the prior art, and should not be interpreted in an idealized or overly formal sense unless specifically defined.
[0302] For the sake of simplicity, the method embodiments are described as a series of actions. However, those skilled in the art should understand that the embodiments of the present invention are not limited to the described order of actions, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions involved are not necessarily essential to the embodiments of the present invention.
[0303] As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of this application.
[0304] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.
Claims
1. A vehicle-mounted projection system, characterized in that, The vehicle-mounted projection system includes: Interaction module and control module; The interaction module includes an input module and an output module; the control module includes an instruction generation module and an instruction execution module. The input module includes a passive input module and an active input module; The passive input module is used to sense the internal and external environment of the vehicle and identify preset targets and their signal states. An active input module is used to capture input commands that are identified as having the necessary permissions. The output module is used to output data status and works with the input module to form external data interaction. The instruction generation module connects to the input module and obtains data from the input module. The instruction generation module is used to generate execution instructions based on the data obtained from the input module; The instruction execution module connects to the instruction generation module and is used to acquire and execute the execution instruction. The output module connects to the instruction execution module, instruction generation module, and / or input module, expressing the entire or partial process status from instruction generation to execution, and enabling data interaction with the input module to form external data. The active input module includes a permission authentication module; The permission authentication module is used to authenticate the permissions of input commands; It also includes an instruction generation module that identifies preset targets and preset target signal states, and interprets and generates execution instructions; The instruction generation module connects to the data connection permission authentication module to authenticate whether the execution instruction generated in association with the preset target and the preset target signal status has the permission to be executed. If so, send it to the instruction execution module and the output module; If not, then send to the output module; The output module outputs the data status after adding annotations based on whether the execution instructions generated by identifying and associating with the preset target and the preset target status have the permission to be executed.
2. The vehicle-mounted projection system according to claim 1, characterized in that, The control module also includes a communication module: The communication module is used to acquire data locally and / or from the cloud. The communication module connects the data input module, output module, and instruction generation module. The instruction generation module generates execution instructions based on the data from the communication module. After the execution instruction is authenticated by the permission authentication module under the input module, it is sent to the instruction execution module and / or the output module; The output module adds annotations to the data status based on the results of permission authentication.
3. The vehicle-mounted projection system according to claim 1, characterized in that, The instruction execution module includes a projection theme module; The projection theme module is used to set the software, hardware and data resources associated with the vehicle projection to be called based on the preset functional theme, so as to ensure the execution of the execution instructions. The projection theme module connects to the active input module and / or the instruction generation module; Among them, according to the instruction of the active input module to activate the preset functional theme under the projection theme module, the preset software, hardware and data resources associated with the vehicle projection are called. The instruction generation module generates execution instructions, including the instruction judgment conditions for activating the preset functional theme under the corresponding projection theme module. If the condition for activating the preset function theme under the corresponding projection theme module is met, the command to activate the preset function theme under the projection theme module will call the preset software, hardware and data resources associated with the vehicle projection.
4. A vehicle-mounted projection method, characterized in that, The vehicle-mounted projection method includes: Based on the preset functional themes, the software, hardware, and data resources associated with the in-vehicle projection that need to be called in the package are set; Activate the preset functional themes under the corresponding projection theme module and set the command judgment conditions; The instruction judgment conditions include, corresponding to a preset functional theme, setting judgment condition recognition features based on preset target recognition features and preset target signal state recognition features, and activating the preset functional theme judgment condition recognition features; Set judgment thresholds based on the corresponding judgment conditions and features; Based on the judgment threshold, scan the preset target recognition feature value and the preset target signal state recognition feature value; If both the preset target identification feature value and the preset target signal state identification feature value meet the judgment criteria of the identification feature judgment threshold, then the preset functional theme under the output projection theme module can be activated conclusion data. Based on the conclusion data that preset functional themes can be activated under the projection theme module, the associated software, hardware, and data resources of the vehicle projection are called up.
5. The vehicle-mounted projection method according to claim 1, characterized in that, The judgment condition recognition features for activating the preset functional theme based on preset target recognition features and preset target signal state recognition features also include: Based on the human-computer interaction terminal, the system captures input commands and identifies them as having permissions, using these as judgment condition recognition features for preset target recognition features. The system then directs the input commands to specific preset functional topics, using these as judgment condition recognition features for preset target signal state recognition features. It also includes, based on the perception of the vehicle's internal and external environment, identifying the judgment condition recognition feature of the preset target recognition feature, starting to scan the preset function theme in the preset function theme library, comparing the preset target recognition feature value and the preset target signal state recognition feature value of the preset target to see if they both meet the judgment criteria of the judgment condition recognition feature under the recognition feature judgment threshold. If the conditions are met, the software, hardware, and data resources associated with the vehicle projection under the selected preset function theme will be invoked. Among them, the selected preset function themes have a priority order, specifically: the vehicle safety function theme takes precedence over the vehicle rescue function theme, and the vehicle rescue function theme takes precedence over the interactive game function theme, and the current preset function theme is selected.
6. The vehicle-mounted projection method according to claim 1, characterized in that, The preset functional themes include: interactive game functional themes; Based on the interactive game theme, the software, hardware, and data resources associated with the in-vehicle projection system are utilized, including: The vehicle-mounted DLP projector and / or vehicle-mounted touchscreen serve as the interface output, while the vehicle-mounted camera and / or vehicle-mounted touchscreen serve as the command input. The vehicle infotainment system is used for command generation and execution. Among them, pixel coordinate instructions are generated based on the gestures of the person recognized by the vehicle camera and / or the touch commands of the vehicle's touch screen; Based on pixel coordinate instructions, the vehicle system drives the in-vehicle DLP projector and / or the in-vehicle touchscreen to output the interface. The interface output includes changing the position of the game character on the in-vehicle DLP projector and / or the in-vehicle touch screen according to preset pixel coordinate instructions.
7. The vehicle-mounted projection method according to claim 1, characterized in that, The preset functional themes include: vehicle rescue functional themes; Based on the functional theme of vehicle rescue, the software, hardware, and data resources associated with the in-vehicle projection are invoked, including: The vehicle-mounted DLP projector and / or vehicle-mounted touchscreen serve as the interface output, while the vehicle-mounted camera and / or vehicle-mounted touchscreen serve as the command input. The vehicle infotainment system is used for command generation and execution. The vehicle infotainment system obtains map navigation data based on local and / or cloud data. Map navigation data includes the vehicle's coordinates relative to the target area being searched, and the projectable orientation data of the onboard DLP; The vehicle system drives the vehicle-mounted DLP projector and / or the vehicle-mounted touchscreen as the interface output based on the vehicle's relative coordinates to the target area being searched and the projectable orientation data of the vehicle-mounted DLP. Among them, the vehicle-mounted DLP projection illuminates the map navigation data corresponding to the searched area, and simultaneously displays the map navigation data corresponding to the searched area illuminated by the vehicle-mounted DLP projection on the vehicle's touch screen. Among them, pixel coordinate instructions are generated based on the gestures of the person recognized by the vehicle camera and / or the touch commands of the vehicle's touch screen; Based on pixel coordinate instructions, the vehicle system drives the in-vehicle DLP projector and / or the in-vehicle touchscreen to output the interface. The interface output includes using the map navigation data corresponding to the searched area illuminated by the vehicle-mounted DLP projection as a background, and driving a bright cursor to change position on the vehicle-mounted DLP projection and / or the vehicle touch screen following pixel coordinate instructions. Calling the software, hardware, and data resources associated with the in-vehicle projection also includes calling the directional speakers and directional microphones; The synchronously highlighted cursor follows pixel coordinate instructions to change position on the in-vehicle DLP projector and / or in-vehicle touch screen, driving the directional speaker and directional microphone to control the pointing.
8. An electronic device, characterized in that, include: The processor, communication interface, memory, and communication bus are connected, with the processor, communication interface, and memory communicating with each other via the communication bus. The memory stores a computer program that, when executed by a processor, causes the processor to perform the steps of the vehicle projection method as described in any one of claims 4 to 7.
9. A computer-readable storage medium, characterized in that, include: The device stores a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the vehicle projection method as described in any one of claims 4 to 7.
10. A vehicle, characterized in that, include: An electronic device for implementing the steps of the vehicle projection method as described in any one of claims 4 to 7; A processor that runs a program that, when the program is running, performs the steps of the vehicle projection method as described in any one of claims 4 to 7 from data output by the electronic device. A storage medium for storing a program that, when running, performs the steps of the vehicle projection method as described in any one of claims 4 to 7 on data output from an electronic device.