Projection method, device, terminal equipment, storage medium and vehicle

By obtaining user description information to be generated and controlling vehicle headlight projection, the problem of traditional vehicle headlights lacking intelligent functions is solved, and the entertainment and practicality of human-computer interaction is improved.

CN115709678BActive Publication Date: 2025-08-08PATEO CONNECT (WUHAN) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110971732.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-08-23
Publication Date
2025-08-08
Estimated Expiration
2041-08-23

AI Technical Summary

Technical Problem

Traditional vehicle headlights lack intelligent functions and cannot achieve entertainment and practicality in human-computer interaction.

Method used

By obtaining the user's description information of the projected object, generating data to be projected, and controlling the vehicle lights to be projected, intelligent human-computer interaction is achieved.

Benefits of technology

It increases the human-computer interactive entertainment and practicality of vehicle headlights, and improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115709678B_ABST
    Figure CN115709678B_ABST
Patent Text Reader

Abstract

The present invention provides a projection method, apparatus, terminal device, storage medium, and vehicle. The method includes: when a vehicle's projection system is turned on, an information input component can collect a user's description of a projection object; at this time, a vehicle controller can obtain the description of the projection object and process the description of the projection object to obtain data to be projected corresponding to the description of the projection object; finally, the vehicle controller controls the vehicle's headlights to project the data to be projected. Through the above method, information can be obtained from the user, and the data to be projected corresponding to the user's description of the projection object can be projected through the vehicle's headlights, thereby increasing the entertainment and practicality of the vehicle's headlights and human-computer interaction.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to a projection method, device, terminal equipment, storage medium and vehicle. Background Art

[0002] Traditional vehicle lights only have lighting functions and lack intelligent functions.

[0003] In related technologies, vehicles can only obtain surrounding environment information and perform corresponding projection to prompt pedestrians or users, but lack some entertainment and practical functions regarding headlights and human-computer interaction. Summary of the Invention

[0004] The purpose of the embodiments of the present invention is to provide a projection method, apparatus, computing device, storage medium, and vehicle. This method obtains a user's description of the projection object and further obtains the data to be projected, thereby controlling the vehicle's headlights to project the data to be projected. This method can project the information the user desires, thereby increasing the practicality or entertainment of human-computer interaction through intelligent headlights. The specific technical solution is as follows:

[0005] In a first aspect of an embodiment of the present invention, a projection method is first provided, the method comprising:

[0006] While the projection system of the vehicle is in an on state, obtaining description information of the projection object by the user collected by the information input component of the vehicle;

[0007] Obtaining data to be projected according to the description information of the projection object;

[0008] Controlling the headlights of the vehicle to project the data to be projected.

[0009] In a second aspect of the embodiments of the present invention, a projection device is further provided, comprising:

[0010] A first acquisition module is configured to acquire, while the projection system of the vehicle is in an on state, description information of the projection object by the user collected by the information input component of the vehicle;

[0011] An acquisition module, configured to obtain data to be projected according to the description information of the projection object;

[0012] The first projection module is used to control the headlights of the vehicle to project the data to be projected.

[0013] In a third aspect of an embodiment of the present invention, a terminal device is further provided, comprising a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0014] Memory for storing computer programs;

[0015] The processor is configured to implement any of the above-mentioned projection methods when executing the program stored in the memory.

[0016] In another aspect of the embodiments of the present invention, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, any of the above-mentioned projection methods is implemented.

[0017] In another aspect of the implementation of the present invention, a vehicle is provided, comprising: a vehicle body and a vehicle controller arranged on the vehicle body, wherein the vehicle controller is used to execute any of the above-mentioned projection methods.

[0018] The projection method provided by an embodiment of the present invention first obtains user description information of the projection object collected by the vehicle's information input component while the vehicle's projection system is in an on-state, then obtains the data to be projected based on the description information of the projection object, and finally controls the vehicle's headlights to project the data to be projected. This method has the following technical effects:

[0019] When the vehicle's projection system is turned on, the information input component can collect the user's descriptive information of the projection object. At this time, the vehicle controller can obtain the descriptive information of the projection object and process the descriptive information of the projection object to obtain the data to be projected corresponding to the descriptive information of the projection object. Finally, the vehicle controller controls the vehicle's headlights to project the data to be projected. Through the above method, information can be obtained from the user, and the data to be projected corresponding to the user's descriptive information of the projection object can be projected through the headlights, thereby increasing the entertainment and practical functions of the vehicle's headlights and human-computer interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for describing the embodiments or the prior art.

[0021] Figure 1 This is a system block diagram of an application scenario of a projection method shown in an embodiment of the present application;

[0022] Figure 2 This is a flowchart of a projection method according to an embodiment of the present application;

[0023] Figure 3 This is a schematic diagram of a projection result when no result corresponding to the description speech is retrieved, as shown in an embodiment of the present application;

[0024] Figure 4This is a schematic diagram of a feedback projection result shown in an embodiment of the present application;

[0025] Figure 5 This is a schematic diagram of a projection result when no result corresponding to a gesture is retrieved, shown in an embodiment of the present application;

[0026] Figure 6 This is a structural block diagram of a projection device shown in one embodiment of the present application;

[0027] Figure 7 This is a structural diagram of a terminal device shown in an embodiment of the present application. DETAILED DESCRIPTION

[0028] The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention.

[0029] In related technologies, vehicles can only obtain surrounding environment information and perform corresponding projection to prompt pedestrians or users, but lack some entertainment and practical functions regarding headlights and human-computer interaction.

[0030] In order to solve the problem in the related art that vehicles lack some entertainment and practical functions regarding headlights and human-computer interaction, the present application provides a technical concept: by obtaining the user's description information of the projection object, further obtaining the data to be projected, thereby controlling the vehicle's headlights to project the data to be projected, so as to project the information the user wants to project, and increase the practicality or entertainment of human-computer interaction through intelligent headlights.

[0031] The projection method of the present application will be described in detail below.

[0032] Figure 1 This is a system block diagram of an application scenario of a projection method shown in an embodiment of the present application. Figure 1 As shown, it includes a vehicle controller, an information input component, an information output component and a projection system, wherein the projection method is applied to the vehicle controller, the information input component, the information output component and the projection system are respectively communicated with the vehicle controller, and the projection system includes the vehicle's headlights.

[0033] Before obtaining the user's description of the projection object collected by the vehicle's information input component, it is necessary to first turn on the vehicle's projection system. The specific method for turning on the vehicle's projection system is as follows:

[0034] Acquiring user wake-up information of the projection system collected by the information input component of the vehicle;

[0035] According to the wake-up information, the projection system of the vehicle is controlled to enter a start state.

[0036] In this embodiment, the wake-up information is used to wake up the vehicle's projection system. The vehicle's information input component can collect the user's wake-up information and then control the vehicle's projection system to be turned on based on the wake-up information. Specifically, the wake-up information can be gesture wake-up information or voice wake-up information. The information input component can be a built-in camera or a microphone in the vehicle. The built-in camera is used to collect the user's gesture wake-up information, and the microphone is used to collect the user's voice wake-up information.

[0037] For example, the user can make the corresponding gesture to wake up the projection system within the information collection range of the built-in camera: a victory gesture. The built-in camera will transmit the collected gesture wake-up information to the vehicle controller, and the vehicle controller will control the projection system to turn on according to the gesture wake-up information. Alternatively, the user can say the voice "turn on projection" to wake up the projection system in the vehicle. After the microphone collects the voice wake-up information, it will transmit the voice wake-up information to the vehicle controller, and the vehicle controller will control the projection system to turn on according to the voice wake-up information.

[0038] Through the above method, the projection system can be turned on through gestures or voice.

[0039] Figure 2 This is a flowchart of a projection method according to an embodiment of the present application. Figure 2 As shown, the projection method includes:

[0040] Step S201: while the projection system of the vehicle is in an on-state, obtaining description information of the projection object by the user collected by the information input component of the vehicle.

[0041] In this embodiment, after the vehicle's projection system is turned on, the user's projection information can be obtained for corresponding projection. Specifically, the user's description information of the projection object can be collected through the information input component, wherein the projection object can be used to prompt surrounding vehicles or pedestrians, and can also be used for user entertainment interaction. For example, the projection object can be a turn sign for prompting surrounding vehicles or pedestrians, or it can be an animated character or animated video, etc., for user entertainment interaction.

[0042] Step S202: obtaining data to be projected according to the description information of the projection object.

[0043] In this embodiment, the data to be projected may be retrieved from the database according to the description information of the projection object.

[0044] In a feasible implementation, the description information includes at least: a user's voice description of the projection object; and obtaining the data to be projected according to the description information of the projection object includes:

[0045] Recognizing the description voice of the projection object to obtain a description text of the projection object;

[0046] Searching a database according to keywords corresponding to the description text to obtain a first search result, wherein the database stores multiple groups of keywords and their corresponding data to be projected;

[0047] When the first search result is not empty, obtaining at least one piece of data to be projected from the first search result;

[0048] When the first search result is empty, the preset data to be projected is obtained.

[0049] In this embodiment, the description information may be the user's descriptive voice of the projection object. The descriptive voice is collected by the microphone in the information input component and transmitted to the vehicle controller. The vehicle controller obtains the descriptive voice of the projection object, performs voice recognition on the descriptive voice, and obtains a description text of the projection object. Then, based on the description text, the corresponding data to be projected is retrieved. Specifically, based on the keywords corresponding to the description text, the database is searched, wherein the database may be a local database pre-established by the vehicle or a third-party database. The database pre-stores multiple groups of keywords and the data to be projected corresponding to each group of keywords. The first search result can be retrieved from the database using the keywords corresponding to the description text, wherein the first search result may be empty or not empty. If the data to be projected corresponding to the keywords corresponding to the description text can be retrieved from the database, the first search result is not empty. If the data to be projected corresponding to the keywords corresponding to the description text cannot be retrieved from the database, the first search result is empty.

[0050] When the first search result is not empty, that is, the first search result contains at least one piece of data to be projected, at least one piece of data to be projected can be directly obtained from the first search result for projection. Specifically, one piece of data to be projected can be obtained so that the vehicle controller controls the headlights to project the one piece of data to be projected. Alternatively, a preset number of data to be projected can be obtained from the first search result, and the vehicle controller controls the headlights to project a preset number of multiple pieces of data to be projected in turn.

[0051] When the first search result is empty, that is, there is no data to be projected in the first search result, the preset data to be projected is directly obtained. The preset data to be projected can be stored in a database. The preset data to be projected can be a preset picture or preset text.

[0052] Figure 3This is a schematic diagram of a projection result when no result corresponding to the description of the voice is retrieved, as shown in an embodiment of the present application. For example, the user can directly say the name of the object to be projected in the vehicle, such as "chicken leg". When the microphone collects the voice information of "chicken leg", it transmits it to the vehicle controller. The vehicle controller recognizes the voice information and obtains the corresponding text information "chicken leg". The vehicle controller searches the local database or calls a third-party database based on the keyword "chicken leg" to obtain the first search result. If multiple data are retrieved, 3 of them are randomly selected as the data to be projected, and then the vehicle lights are controlled to project the 3 data in turn. If no data is retrieved, the preset text "What you said is so profound, it is beyond my understanding" is obtained, and then the vehicle lights are controlled to project the preset text, such as Figure 3 shown.

[0053] Through the above method, when the user's description information is a descriptive voice, the corresponding text information can be identified and generated according to the user's descriptive voice, and the data to be projected can be retrieved from the database according to the corresponding keywords of the text information to realize the voice projection function of the vehicle.

[0054] In a feasible implementation, when the first search result is empty, feedback data matching the keywords corresponding to the description text is obtained from the material library;

[0055] Updating the feedback data and its corresponding keywords into the database;

[0056] When it is detected again that the projection system of the vehicle enters the on state, controlling the headlights of the vehicle to project the feedback data and the first prompt text associated with the description text; or

[0057] When it is detected again that the projection system of the vehicle enters the on state, the vehicle lights are controlled to project the feedback data, and the first prompt text associated with the description text is displayed through the information output component of the vehicle.

[0058] In this embodiment, when the first search result is empty, the feedback mode can be turned on to feed back the database. Specifically, when the first search result is empty, feedback data that matches the keywords corresponding to the description text is obtained from the material library, where the material library is one or more other third-party information libraries different from the currently searched database, and then the obtained feedback data is updated to the database.

[0059] For example, during the feedback process, the vehicle controller searches for corresponding images in various material libraries based on the text information corresponding to the unrecognizable voice, and then stores the text information and images in combination. The system administrator manually reviews the above information regularly and updates the status of the combination after the review. When the status of the combination is updated to "feedback successful", the combination is updated to the database so that the text information can be used when it is projected again.

[0060] Figure 4 This is a schematic diagram of a feedback projection result shown in an embodiment of the present application. When the projection system of the vehicle is detected to be turned on again, the vehicle's headlights can be controlled to project the feedback data and the first prompt text associated with the description text. The first prompt text associated with the description text is a prompt text generated based on the description text. For example, if the description text is "chicken leg", the first prompt text can be "The content you wanted to project last time was 'chicken leg'. I found the answer. Please enjoy it." Figure 4 shown.

[0061] Or, when the vehicle's projection system is detected to be on again, the vehicle's lights are controlled to project the feedback data, and the first prompt text associated with the description text is displayed through the vehicle's information output component. The information output component can be a display panel or a microphone. The first prompt text associated with the description text is displayed through the vehicle's information output component. Specifically, the first prompt text can be output through the display panel, or the voice information corresponding to the first prompt text can be output through the microphone.

[0062] Through this method, if the first search result is empty, feedback data matching the keywords corresponding to the description text can be obtained from the material library, and the database can be updated so that the next time the same description text is encountered, the data to be projected can be retrieved. In addition, when the vehicle is next turned on, the data to be projected corresponding to the last time the user attempted to project but failed can be displayed to the user in a timely manner.

[0063] In a feasible implementation manner, the description information further includes: a gesture made by the user with respect to the projection object; and obtaining the data to be projected according to the description information of the projection object includes:

[0064] Recognizing the gesture and generating a description picture of the projection object;

[0065] Searching the image library according to the described image to obtain a second search result;

[0066] If the second search result is not empty, obtaining at least one image to be projected from the second search result;

[0067] When the second search result is empty, a preset picture to be projected is obtained.

[0068] In this embodiment, the descriptive information may be a gesture made by the user toward the projection object. The gesture is captured by a camera in the information input component and transmitted to the vehicle controller. The camera captures the gesture using the principle of 3D structured light imaging, and the gesture is recognizable within a specified area. The vehicle controller obtains the gesture of the projection object and recognizes the gesture to obtain a corresponding descriptive image. Then, based on the descriptive image, the corresponding data to be projected is retrieved. Specifically, based on the descriptive image, a similarity comparison is performed with images in the database, and images with a similarity greater than a preset value are determined as second search results. The database contains multiple images, and the second search result may or may not be empty. If an image with a similarity greater than the preset value to the image can be retrieved from the database, the second search result is not empty. If an image with a similarity greater than the preset value to the image cannot be retrieved from the database, the second search result is empty.

[0069] When the second search result is not empty, that is, the second search result contains at least one picture, at least one picture can be directly obtained from the second search result for projection. Specifically, one picture can be obtained so that the vehicle controller controls the headlights to project the obtained picture. Alternatively, a preset number of pictures can be obtained from the second search result, and the vehicle controller controls the headlights to project a preset number of pictures in turn.

[0070] When the second search result is empty, that is, there is no picture in the second search result, the preset picture to be projected is directly obtained. The preset picture to be projected can be stored in the database. Specifically, one or more pictures can be regularly obtained as the preset pictures to be projected.

[0071] Figure 5 This is a schematic diagram of a projection result when no result corresponding to a gesture is retrieved, as shown in an embodiment of the present application. For example, after the gesture is recognized, it is saved in the form of a description picture. The vehicle controller can perform a similarity comparison based on the local database or call a third-party picture library, and select the picture to be projected according to the algorithm. Specifically, a picture with a similarity greater than a preset value or a picture with the highest similarity can be selected. When there are multiple pictures with a similarity greater than a preset value or a picture with the highest similarity, one or more pictures are randomly selected; when no picture is matched, one or more specific pictures (for example: aliens) are obtained as data to be projected, and text information can also be obtained at the same time: "Oops, it cannot be recognized", so that the data to be projected (alien) and text information can be output through the car lights, such as Figure 5 The method for obtaining and using the above-mentioned specific images is as follows: the vehicle controller periodically (which can be set to 1 month) retrieves 10 alien images from a third-party image library and stores them. During the current time period, the specific projection image is randomly obtained from these 10 images.

[0072] Through the above method, when the user's description information is a gesture, a description picture can be identified and generated according to the user's gesture, and the data to be projected can be retrieved from the database according to the description picture to realize the gesture projection function of the vehicle.

[0073] In a feasible implementation, when the second search result is empty, a feedback picture having a similarity with the description picture greater than a preset similarity is obtained from the material library;

[0074] Updating the feedback picture to the picture library;

[0075] When it is detected again that the projection system of the vehicle is in the on state, controlling the headlights of the vehicle to project the feedback picture and the second prompt text associated with the description picture; or

[0076] When it is detected again that the projection system of the vehicle has entered the on state, the vehicle lights are controlled to project the feedback picture, and the second prompt text associated with the description picture is displayed through the information output component of the vehicle.

[0077] In this embodiment, when the second search result is empty, the feedback mode can be turned on to feed back the database. Specifically, when the second search result is empty, feedback data corresponding to the description picture is obtained from the material library, where the material library is one or more other third-party information libraries different from the currently searched database, and then the obtained feedback data is updated to the database.

[0078] When the vehicle's projection system is detected to be turned on again, the vehicle's headlights can be controlled to project the feedback picture and the second prompt text associated with the description picture, wherein the second prompt text associated with the description picture is a prompt text generated based on the description picture. For example, if the description picture is a "heart" picture, the second prompt text can be "The content you wanted to project last time was 'heart'. I found the answer, please enjoy it."

[0079] Or, when the vehicle's projection system is detected to be on again, the vehicle's lights are controlled to project the feedback picture, and the second prompt text associated with the description picture is displayed through the vehicle's information output component. The information output component can be a display panel or a microphone. The second prompt text associated with the description picture is displayed through the vehicle's information output component. Specifically, the second prompt text can be output through the display panel, or the voice information corresponding to the second prompt text can be output through the microphone.

[0080] Through the above method, if the second search result is empty, the feedback data corresponding to the description image can be obtained from the material library and the database can be updated so that the next time the same description image is encountered, the data to be projected can be retrieved. In addition, when the vehicle is next turned on, the data to be projected corresponding to the last time the user attempted to project but failed can be displayed to the user in a timely manner.

[0081] Step S203: controlling the vehicle lights to project the data to be projected.

[0082] In this embodiment, after obtaining the data to be projected, the vehicle controller can control the vehicle's lights to project the data to be projected. The lights here can specifically be the vehicle's headlights. Specifically, when the description information is a description of voice or gesture, any one of the two headlights of the vehicle can be controlled to project the data to be projected.

[0083] When the descriptive information is a description of voice and gestures, one of the headlights can be controlled to project the data to be projected corresponding to the description of voice and gestures, that is, the left headlight or the right headlight can be controlled to project the data to be projected corresponding to the description of voice and gestures. Specifically, the left headlight can be controlled to first project the data to be projected corresponding to the description of voice, and then the left headlight can be controlled to project the data to be projected corresponding to the gestures. Alternatively, the left headlight can be controlled to first project the data to be projected corresponding to the gestures, and then the left headlight can be controlled to project the data to be projected corresponding to the description of voice.

[0084] When the descriptive information is a description of voice and gestures, the left headlight and the right headlight can be used respectively to project the data to be projected corresponding to the description of voice and gestures, that is, the left headlight can be controlled to project the data to be projected corresponding to the description of voice, and the right headlight can be controlled to project the data to be projected corresponding to the gesture; or, the right headlight can be controlled to project the data to be projected corresponding to the description of voice, and the left headlight can be controlled to project the data to be projected corresponding to the gesture.

[0085] The specific method for controlling the vehicle's headlights to project the data to be projected is: the vehicle controller transmits the data to be projected to the pixel matrix driver module of the projection system, and the pixel matrix driver module drives the LED pixel matrix of the headlights according to the instructions of the vehicle controller to realize the display of graphics or animations.

[0086] The projection method provided by an embodiment of the present invention is that when the projection system of a vehicle is in an on-state, the information input component can collect the user's description information of the projection object. At this time, the vehicle controller can obtain the description information of the projection object and process the description information of the projection object to obtain the data to be projected corresponding to the description information of the projection object. Finally, the vehicle controller controls the vehicle's headlights to project the data to be projected. Through the above method, information can be obtained from the user, and the data to be projected corresponding to the user's description information of the projection object can be projected through the headlights, thereby increasing the entertainment and practical functions of the vehicle's headlights and human-computer interaction.

[0087] In a feasible implementation manner, before step S203, the method further includes:

[0088] Obtaining the collection time of the description information;

[0089] The projection background color is determined according to the acquisition time of the description information.

[0090] The step S203 specifically includes:

[0091] The headlights of the vehicle are controlled to perform projection according to the projection background color and the data to be projected.

[0092] In this embodiment, the projection background color is determined by obtaining the acquisition time of the description information, so that different projection background colors can be determined according to different acquisition times, so as to improve the projection effect.

[0093] Specifically, the projection background color can be divided into day mode and night mode. 06:00-18:00 is defined as day mode, and the rest of the time is defined as night mode. In day mode, the projection background color can be fluorescent purple, and in night mode, the projection background color can be fluorescent green. Specifically, when controlling the vehicle lights to project data based on the projection background color and the data to be projected, the data to be projected is placed on the projection background color.

[0094] In a feasible embodiment, the method further includes:

[0095] When detecting that the projection system of the vehicle enters an on state, starting timing;

[0096] If the description information is not obtained within the first preset time period, generating prompt information and displaying the prompt information through the information output component of the vehicle;

[0097] If no description information is obtained within a second preset time period, controlling the projection system of the vehicle to enter a shutdown state;

[0098] If the description information is obtained within the second preset time period, the timing is restarted.

[0099] In this embodiment, when the vehicle's projection system is detected as being in the on state, a timer begins. If no description information is obtained within a first preset time period, the projection system is determined to be in a silent state. At this point, a prompt message is generated and displayed via the vehicle's information output component to alert the user. Specifically, the first preset time period may range from 10 to 15 minutes, and the prompt message may read, "Master, I haven't detected your instructions for a long time. Do you want to turn off the projection function?" If no description information is obtained within a second preset time period, the vehicle's projection system is controlled to be turned off. The second preset time period may range from 12 to 17 minutes. Displaying the prompt message via the vehicle's information output component may specifically include outputting the prompt message via text or voice output via the vehicle's information output component. If a voice message or gesture message indicating the projection system is turned off is obtained within the second preset time period, the projection system is also controlled to be turned off. If a description message is obtained within the second preset time period, the timer restarts. Alternatively, if a voice message or gesture message indicating the projection system is resumed is obtained within the second preset time period, the timer restarts. By using the above method, the projection system can be automatically shut down to avoid excessive consumption of the projection system.

[0100] It should be noted that for the sake of simplicity, the method embodiments are described as a series of actions. However, those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0101] Based on the same inventive concept, an embodiment of the present invention provides a projection device. Figure 6 , Figure 6 This is a structural block diagram of a projection device shown in one embodiment of the present application. Figure 6 As shown, the device includes:

[0102] A first acquisition module 601 is configured to acquire, while the projection system of the vehicle is in an on state, description information of the projection object by the user collected by the information input component of the vehicle;

[0103] An acquisition module 602 is configured to obtain data to be projected based on the description information of the projection object;

[0104] The first projection module 603 is configured to control the vehicle's lights to project the data to be projected.

[0105] Optionally, the description information includes at least: a user's voice description of the projection object; and the obtaining module includes:

[0106] A first recognition submodule is configured to recognize a description voice of the projection object to obtain a description text of the projection object;

[0107] A second search submodule is configured to search a database based on keywords corresponding to the description text to obtain a first search result, wherein the database stores multiple groups of keywords and their corresponding data to be projected;

[0108] A first acquisition submodule, configured to acquire at least one piece of to-be-projected data from the first search result if the first search result is not empty;

[0109] The second acquisition submodule is configured to acquire preset data to be projected when the first search result is empty.

[0110] Optionally, the device further comprises:

[0111] A second acquisition module is used to acquire feedback data matching the keywords corresponding to the description text from a material library when the first search result is empty;

[0112] A first updating module, configured to update the feedback data and its corresponding keywords into the database;

[0113] A second projection module is configured to control the vehicle's headlights to project the feedback data and the first prompt text associated with the description text when it is detected that the projection system of the vehicle has entered the on state again; or

[0114] The third projection module is used to control the vehicle's lights to project the feedback data when it is detected again that the vehicle's projection system has entered the on state, and to display the first prompt text associated with the description text through the vehicle's information output component.

[0115] Optionally, the description information further includes: a gesture made by the user with respect to the projection object; and the obtaining module includes:

[0116] A second recognition submodule is used to recognize the gesture and generate a description picture of the projection object;

[0117] A second search submodule is used to search the image library according to the described image to obtain a second search result;

[0118] A third acquisition submodule is configured to acquire at least one image to be projected from the second search result if the second search result is not empty;

[0119] The fourth acquisition submodule is used to acquire a preset image to be projected when the second search result is empty.

[0120] Optionally, the device further comprises:

[0121] A third acquisition module is configured to acquire, when the second search result is empty, a feedback picture having a similarity with the description picture greater than a preset similarity from a material library;

[0122] A second updating module is used to update the feedback picture to the picture library;

[0123] a third projection module, configured to control the vehicle's headlights to project the feedback image and the second prompt text associated with the description image when detecting that the projection system of the vehicle has entered the on state again; or

[0124] The fourth projection module is used to control the vehicle's lights to project the feedback picture when it is detected that the vehicle's projection system has entered the on state again, and to display the second prompt text associated with the description picture through the vehicle's information output component.

[0125] Optionally, before the first projection module, the device further includes:

[0126] A fourth acquisition module is used to obtain the collection time of the description information;

[0127] A determination module, configured to determine a projection background color according to a collection time of the description information;

[0128] The first projection module includes:

[0129] The first projection submodule is used to control the headlights of the vehicle to perform projection according to the projection background color and the data to be projected.

[0130] Optionally, before the first acquisition module, the device further includes:

[0131] A fifth acquisition module is used to acquire the user's wake-up information of the projection system collected by the information input component of the vehicle;

[0132] A control module is used to control the projection system of the vehicle to enter an on state according to the wake-up information.

[0133] Optionally, the device further comprises:

[0134] a timing module, configured to start timing when detecting that the projection system of the vehicle has entered an on state;

[0135] a prompt module, configured to generate prompt information if the description information is not obtained within a first preset time period, and display the prompt information through the information output component of the vehicle;

[0136] a shut-down module, configured to control the projection system of the vehicle to enter a shut-down state if no description information is obtained within a second preset time period;

[0137] The retiming module is configured to restart the timing if the description information is obtained within the second preset time period.

[0138] An embodiment of the present invention further provides a vehicle, comprising: a vehicle body and a vehicle controller disposed on the vehicle body, wherein the vehicle controller is configured to execute the projection method described in any one of the above embodiments.

[0139] The embodiment of the present invention further provides a terminal device, such as Figure 7 shown. Figure 7 This is a schematic diagram of the structure of a terminal device shown in an embodiment of the present application. Figure 7 The terminal device includes a processor 71, a communication interface 72, a memory 73 and a communication bus 74, wherein the processor 71, the communication interface 72, and the memory 73 communicate with each other via the communication bus 74;

[0140] Memory 73, for storing computer programs;

[0141] The processor 71 is configured to execute the program stored in the memory 73 to implement the following steps:

[0142] While the projection system of the vehicle is in an on state, obtaining description information of the projection object by the user collected by the information input component of the vehicle;

[0143] Obtaining data to be projected according to the description information of the projection object;

[0144] Controlling the headlights of the vehicle to project the data to be projected.

[0145] Alternatively, the processor 71 implements the steps in the above-mentioned other method embodiments when executing the program stored in the memory 73.

[0146] The communication bus mentioned in the terminal can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. This communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is used in the figure, but this does not mean that there is only one bus or only one type of bus.

[0147] The communication interface is used for communication between the above terminal and other devices.

[0148] The memory may include random access memory (RAM) or non-volatile memory, such as at least one disk storage. Alternatively, the memory may be at least one storage device located away from the processor.

[0149] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

[0150] In another embodiment of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the projection method described in any one of the above embodiments.

[0151] In another embodiment of the present invention, a computer program product including instructions is provided. When the computer program product is run on a computer, the computer is enabled to execute the projection method described in any one of the above embodiments.

[0152] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0153] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0154] Each embodiment in this specification is described in a related manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences between the other embodiments. In particular, the system embodiment is generally similar to the method embodiment, so the description is relatively simple. For related parts, refer to the description of the method embodiment.

[0155] The above description is only a preferred embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention are included in the scope of protection of the present invention.

Claims

1. A projection method, characterized in that: The method comprises: While the projection system of the vehicle is in an on state, obtaining description information of the projection object by the user collected by the information input component of the vehicle; Obtaining data to be projected according to the description information of the projection object; controlling the headlights of the vehicle to project the data to be projected; The description information further includes: a gesture made by the user with respect to the projection object; and obtaining the data to be projected according to the description information of the projection object includes: Recognizing the gesture and generating a description picture of the projection object; Searching the image library according to the described image to obtain a second search result; If the second search result is not empty, obtaining at least one image to be projected from the second search result; If the second search result is empty, obtaining a preset image to be projected; The method further comprises: When the second search result is empty, obtaining a feedback picture from the material library whose similarity to the description picture is greater than a preset similarity; Updating the feedback picture to the picture library; When it is detected again that the projection system of the vehicle is in the on state, controlling the headlights of the vehicle to project the feedback picture and the second prompt text associated with the description picture; or When it is detected again that the projection system of the vehicle has entered the on state, the vehicle lights are controlled to project the feedback picture, and the second prompt text associated with the description picture is displayed through the information output component of the vehicle.

2. The method according to claim 1, characterized in that The description information at least includes: a user's voice description of the projection object; obtaining the data to be projected according to the description information of the projection object includes: Recognizing the description voice of the projection object to obtain a description text of the projection object; Searching a database according to keywords corresponding to the description text to obtain a first search result, wherein the database stores multiple groups of keywords and their corresponding data to be projected; When the first search result is not empty, obtaining at least one piece of data to be projected from the first search result; When the first search result is empty, the preset data to be projected is obtained.

3. The method according to claim 2, characterized in that The method further comprises: When the first search result is empty, obtaining feedback data matching the keywords corresponding to the description text from the material library; Updating the feedback data and its corresponding keywords into the database; When it is detected again that the projection system of the vehicle enters the on state, controlling the headlights of the vehicle to project the feedback data and the first prompt text associated with the description text; or When it is detected again that the projection system of the vehicle enters the on state, the vehicle lights are controlled to project the feedback data, and the first prompt text associated with the description text is displayed through the information output component of the vehicle.

4. The method according to any one of claims 1 to 3, characterized in that Before the step of controlling the vehicle lights to project the data to be projected, the method further includes: Obtaining the collection time of the description information; Determining the projection background color according to the acquisition time of the description information; Controlling the headlights of the vehicle to project the data to be projected includes: The headlights of the vehicle are controlled to perform projection according to the projection background color and the data to be projected.

5. The method according to any one of claims 1 to 3, characterized in that Before the step of obtaining the user's description of the projection object collected by the vehicle's information input component, the method further includes: Acquiring user wake-up information of the projection system collected by the information input component of the vehicle; According to the wake-up information, the projection system of the vehicle is controlled to enter an on state.

6. The method according to claim 5, characterized in that The method further comprises: When detecting that the projection system of the vehicle enters an on state, starting timing; If the description information is not obtained within the first preset time period, generating prompt information and displaying the prompt information through the information output component of the vehicle; If no description information is obtained within a second preset time period, controlling the projection system of the vehicle to enter a shutdown state; If the description information is obtained within the second preset time period, the timing is restarted.

7. A projection device, characterized in that: The device comprises: An acquisition module, configured to acquire, while the projection system of the vehicle is in an on state, description information of the projection object by the user collected by the information input component of the vehicle; An acquisition module, configured to obtain data to be projected according to description information of the projection object; A projection module, configured to control the vehicle's lights to project the data to be projected; The description information further includes: a gesture made by the user on the projection object; and the obtaining module includes: A second recognition submodule is used to recognize the gesture and generate a description picture of the projection object; A second search submodule is used to search the image library according to the described image to obtain a second search result; A third acquisition submodule is configured to acquire at least one image to be projected from the second search result if the second search result is not empty; A fourth acquisition submodule, configured to acquire a preset image to be projected when the second search result is empty; Wherein, the device further comprises: A third acquisition module is configured to acquire, when the second search result is empty, a feedback picture having a similarity with the description picture greater than a preset similarity from a material library; A second updating module is used to update the feedback picture to the picture library; a third projection module, configured to control the vehicle's headlights to project the feedback image and the second prompt text associated with the description image when detecting that the projection system of the vehicle has entered the on state again; or The fourth projection module is used to control the vehicle's lights to project the feedback picture when it is detected that the vehicle's projection system has entered the on state again, and to display the second prompt text associated with the description picture through the vehicle's information output component.

8. A terminal device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; Memory for storing computer programs; The processor is configured to implement the steps of the projection method according to any one of claims 1 to 6 when executing the program stored in the memory.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the projection method according to any one of claims 1 to 6 are implemented.

10. A vehicle, characterized in that: include: A vehicle body and a vehicle controller arranged on the vehicle body, wherein the vehicle controller is used to execute the projection method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Projector and projection method

    CN107479854A

  • Vehicle lamp control system and vehicle

    CN111757571A