An Out-of-Vehicle Scenery Special Effect Display Method and Device Based on Window Display

Abstract

The present application discloses an external scene special effect display method and device based on window display. The external scene special effect display method based on window display includes: obtaining external scene information; obtaining a preset special effect database; obtaining special effect information according to the external scene information and the preset special effect database; and transmitting the special effect information to a projection device, so as to be displayed on the window glass through the projection device. The external scene special effect display method provided by the present application can achieve a special effect blessing and produce an extraordinary and realistic visual effect when passengers observe the external scene through the window in the vehicle by obtaining the external scene information and finally combining the image special effects in real time through the in-vehicle computer algorithm, greatly improving the entertainment experience of the in-vehicle users.

Description

Technical Field

[0001] The present application relates to the technical field of vehicles, and in particular, to an external scene special effect display method based on window display, an external scene special effect display device based on window display, and a vehicle. Background Art

[0002] Existing window display technologies and solutions can be used for unmanned vehicles to remind pedestrians or other vehicles, driver greeting words, vehicle status display, etc. However, the observation subjects of most display contents are external personnel of the vehicle. Based on window display, there is currently no systematic solution for adding special effects to external scenes.

[0003] Therefore, it is desirable to have a technical solution to solve or at least mitigate the above deficiencies of the prior art. Summary of the Invention

[0004] The purpose of the present invention is to provide an external scene special effect display method based on window display to at least solve one of the above technical problems.

[0005] The present invention provides the following solutions:

[0006] According to one aspect of the present invention, there is provided an external scene special effect display method based on window display, and the external scene special effect display method based on window display includes:

[0007] Obtain external scene information;

[0008] Obtain a preset special effect database;

[0009] Obtain special effect information according to the external scene information and the preset special effect database;

[0010] Transmit the special effect information to a projection device, so as to be displayed on the window glass through the projection device.

[0011] Optionally, the obtaining of the external scene information includes:

[0012] Obtain image information of the outside of the vehicle captured by a camera device;

[0013] Obtain a trained image classifier group;

[0014] Extract image feature information of the image information in front of the vehicle;

[0015] Input the image feature information into the image classifier group, so as to obtain a classification label output by the classifier group, and the classification label includes one or more of a tree label, a building label, a pedestrian label, and a vehicle label.

[0016] Optionally, the obtaining of the external scene information further includes:

[0017] Obtain the distance information of each object obtained by the acoustic imaging system.

[0018] Optionally, the obtaining of the information of the scenery outside the window further includes:

[0019] Obtain weather information.

[0020] Optionally, the preset special effect database includes a special effect object information database, and the special effect object information database includes preset special effect object components and preset special effect object labels. One preset special effect object label corresponds to a group of preset special effect object components;

[0021] The obtaining of the special effect information according to the information of the scenery outside the window and the preset special effect database includes:

[0022] Obtain the preset special effect object components corresponding to the preset special effect object labels that are the same as the classification labels output by the classifier group;

[0023] Obtain the special effect object information according to the preset special effect object components as the special effect information.

[0024] Optionally, the preset special effect database further includes a special effect scene database, and the special effect scene database further includes at least one special effect scene and preset weather information. One preset weather information corresponds to one special effect scene;

[0025] The obtaining of the special effect information according to the information of the scenery outside the window and the preset special effect database further includes:

[0026] Obtain the special effect scene corresponding to the preset weather information that is the same as the weather information. Among them, the obtained special effect object information and the special effect scene constitute the special effect information.

[0027] Optionally, each of the special effect object components includes at least two pieces of special effect object information of the same type but different models and preset weather information. One preset weather information corresponds to one special effect object information;

[0028] The obtaining of the special effect object information according to the preset special effect object components as the special effect information includes:

[0029] Obtain the special effect object information corresponding to the preset weather information that is the same as the weather information as the special effect information.

[0030] This application also provides an in-vehicle exterior scenery special effect display device based on window display. The in-vehicle exterior scenery special effect display device based on window display includes:

[0031] An outside scenery information acquisition module, which is used to acquire the information of the scenery outside the window;

[0032] A preset special effect database acquisition module, wherein the preset special effect database acquisition module is used to acquire a preset special effect database;

[0033] A special effect information acquisition module, the special effect information acquisition module is used to acquire special effect information according to the scene information outside the window and a preset special effect database;

[0034] The sending module is used to transmit the special effect information to the projection device so as to display it on the vehicle window glass through the projection device.

[0035] The present application also provides a vehicle, the vehicle comprising:

[0036] A vehicle body, wherein the vehicle body is provided with one or more of a front windshield, a side windshield, a rear windshield and a sunroof;

[0037] A projection device, the number of the projection device is at least one, and one projection device is used for projecting on one of the front windshield, the side windshield, the rear windshield and the sunroof;

[0038] A vehicle window display-based vehicle exterior scene special effect display device, wherein the vehicle window display-based vehicle exterior scene special effect display device is connected to a projection device and is used to transmit special effect information to the projection device so as to be displayed on the vehicle window glass through the projection device.

[0039] The present application also provides a method for displaying special effects of exterior scenery on a vehicle window display based on a cloud, and the method for displaying special effects of exterior scenery on a vehicle window display based on a cloud comprises:

[0040] The vehicle obtains the scene information outside the window and transmits it to the cloud;

[0041] Obtain preset special effects database from the cloud;

[0042] The cloud generates special effect information according to the preset special effect database and the scene information outside the window and transmits the special effect information to the vehicle end;

[0043] The vehicle end performs projection display according to the special effect information, thereby displaying the special effect information on the vehicle window glass.

[0044] The method for displaying special effects of outdoor scenes based on window display provided in the present application obtains information of outdoor scenes and finally combines image special effects in real time through an on-board computer algorithm. This allows passengers in the car to observe the outdoor scenes through the windows with special effects, thereby producing extraordinary and realistic visual effects and greatly improving the entertainment experience of users in the car. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1It is a flowchart of an external scenery special effect display method based on window display provided by one or more embodiments of the present invention.

[0046] Figure 2 It is a block diagram of an electronic device of a method for generating natural language based on in-vehicle user information provided by one or more embodiments of the present invention.

[0047] Figure 3 It is a schematic flowchart of an external scenery special effect display method based on cloud-based window display in the second embodiment of the present application. Detailed implementation manners

[0048] Next, the technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings. Apparently, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0049] Figure 1 It is a flowchart of an external scenery special effect display method based on window display provided by one or more embodiments of the present invention.

[0050] As Figure 1 shown, the external scenery special effect display method based on window display includes:

[0051] Step 1: Obtain external scenery information;

[0052] Step 2: Obtain a preset special effect database;

[0053] Step 3: Obtain special effect information according to the external scenery information and the preset special effect database;

[0054] Step 4: Transmit the special effect information to a projection device, so as to be displayed on the window glass through the projection device.

[0055] The external scenery special effect display method provided by the present application can achieve a supernormal and realistic visual effect with special effect blessing when passengers observe the external scenery through the window in the vehicle by obtaining the external scenery information and finally combining the image special effects in real time through the in-vehicle computer algorithm, greatly improving the entertainment experience of in-vehicle users.

[0056] In this embodiment, obtaining the external scenery information includes:

[0057] Obtain the image information of the outside of the vehicle captured by the camera device;

[0058] Obtain a trained image classifier group;

[0059] Extract the image feature information of the image information in front of the vehicle;

[0060] Input the image feature information into the image classifier group, so as to obtain the classification labels output by the classifier group, and the classification labels include one or more of a tree label, a building label, a pedestrian label, and a vehicle label.

[0061] It can be understood that the classification labels can also include other labels, such as a road label, an animal label, etc.

[0062] In this embodiment, obtaining the information of the scenery outside the window further includes: obtaining the distance information of each object obtained by the acoustic imaging system.

[0063] In this embodiment, the acoustic imaging system includes a radar and an imaging device. The radar belongs to an acoustic instrument, and the imaging device expands the information scanned by the radar into position distance information and object shape information. In this way, with the object shape information, it is possible to determine what kind of object it is, and then correspond it to the object in the captured image.

[0064] Through the position distance information of each object, a special effect with depth information can be presented on the window glass.

[0065] In this embodiment, by comparing the object shape information scanned by the radar with the image information, the object shape information can be corresponded to each single object in the image information. For example, through the image information, it can be obtained that there is a tree in the upper left corner of the image, and through the object information scanned by the radar, it can be obtained that there is a tree in the upper left corner of the direction towards which the vehicle's imaging device is facing. At this time, the two correspond to each other to form a one-to-one correspondence.

[0066] Through the above-mentioned image information and the acoustic imaging system, the information of the objects in a certain direction of the vehicle (the specific direction is determined according to the specific orientations of the imaging device and the acoustic imaging system) can be obtained. For example, what objects (such as trees, houses, people, etc.) are there in the picture captured by the imaging device. Through the acoustic imaging system, the distance of these objects can be obtained. With this information, these information can be directly subjected to special effect conversion according to the preset special effect database to obtain the special effect information. It can be understood that when these information are subjected to special effect conversion and displayed on the window glass, it is not required to be exactly the same as the actual positions of these objects, or they can be randomly displayed on the window glass and have nothing to do with the actual positions.

[0067] In this embodiment, the obtaining the information of the scenery outside the window further includes: obtaining weather information. In this embodiment, the weather information may include: rainy weather, snowy weather, sunny weather, etc.

[0068] In this embodiment, various weather judgments in the weather information can be obtained through a meteorological forecast system. For example, the temperature, humidity, rain and snow conditions in a certain place today are obtained through the weather forecast, and the current weather information is judged based on the above temperature, humidity, rain and snow conditions. It can be understood that the above information can also be obtained through various devices brought by the vehicle, for example, the outside temperature is obtained through a temperature sensor, the outside humidity is obtained through a humidity sensor, and the camera device is used to judge whether there is rain, snow, fog, etc. outside the vehicle by image recognition.

[0069] In this embodiment, the preset special effect database includes a special effect object information database, and the special effect object information database includes preset special effect object components and preset special effect object tags, and one preset special effect object tag corresponds to a group of preset special effect object components;

[0070] Acquiring special effects information based on the scene information outside the window and the preset special effects database includes:

[0071] Obtaining a preset special effect object component corresponding to a preset special effect object label that is the same as the classification label output by the classifier group;

[0072] The special effect object information is obtained as the special effect information according to the preset special effect object component.

[0073] In this embodiment, the preset special effect database includes preset special effect object components, for example, a plurality of tree models form a group of preset special effect object components, and a plurality of human models form a group of preset special effect object components. Preset special effect tags generally include human tags, plant tags, and the like.

[0074] For example, when the acquired classification label includes a person label, a preset special effect object component (ie, a person model) corresponding to a label whose preset special effect label is the same as the classification label is acquired.

[0075] In this embodiment, each special effect object component includes at least two special effect object information of the same type and different models and preset weather information, and one preset weather information corresponds to one special effect object information;

[0076] Acquiring special effect object information as special effect information according to the preset special effect object component includes:

[0077] The special effect object information corresponding to the preset weather information which is the same as the weather information is obtained as the special effect information.

[0078] Taking the special effect object information corresponding to a person as an example, there may be multiple human models. For example, there is a cartoon character A (a character in "The Lord of the Rings"), a cartoon character B (belonging to a relatively cute model), and there are also other models, such as cartoon characters C, D, etc. These can be corresponded to weather information. For example, in foggy weather or bad weather, models such as cartoon characters C and D are selected to create a scary atmosphere, or the cartoon character B (belonging to a relatively cute model) is selected to relieve the depressing atmosphere.

[0079] It can be understood that when a certain weather information corresponds to multiple models, one can be randomly selected from them, or each model can be placed in the human-computer interaction interface for the user to select independently.

[0080] In this embodiment, the present application further includes:

[0081] Obtain the passenger information inside the vehicle.

[0082] In this embodiment, the face image information of each passenger inside the vehicle is obtained through the in-vehicle camera device.

[0083] Obtain a trained age classifier.

[0084] Extract the image features of the face image information of each passenger;

[0085] Input each image feature into the trained age classifier respectively to obtain age labels, and the age labels can be divided into minor labels and non-minor labels;

[0086] When the age label includes a minor label, obtain a prohibited playback database, and the prohibited playback database includes at least one prohibited playback special effect object;

[0087] When obtaining special effect object information as special effect information according to the preset special effect object component, exclude the special effect object information that is the same as the prohibited playback special effect object in this group of preset special effect object components as special effect information.

[0088] For example, in foggy weather or bad weather, a horror-type model is selected to create a scary atmosphere, etc. However, the above horror type may belong to a prohibited playback special effect object. At this time, it is excluded and other special effect objects that do not belong to the prohibited playback special effect object are selected.

[0089] In this embodiment, the preset special effect database further includes a special effect scene database, and the special effect scene database further includes at least one special effect scene and preset weather information, and one preset weather information corresponds to one special effect scene;

[0090] The obtaining of special effect information according to the outdoor scene information and the preset special effect database further includes:

[0091] Obtain a special effect scene corresponding to preset weather information that is the same as the said weather information, wherein the obtained special effect object information and the special effect scene constitute the special effect information.

[0092] In this embodiment, the special effect information not only includes special effect object information, but also includes a special effect scene. For example, if it is actually raining outside the vehicle, a special effect scene corresponding to a rainy day is generated. Such a special effect scene can be a rainy scene plus halo rendering, or a rainbow or other styles can be added.

[0093] In this embodiment, the present application further includes: scanning through an in-vehicle sensor to obtain the position of the passenger's eyes, so as to determine the distance between the passenger's eyes and the window.

[0094] When the distance between the passenger's eyes and the window is relatively close, the obtained special effect information can be displayed in a reduced size.

[0095] When the distance between the passenger's eyes and the window is normal, the obtained special effect information can be displayed normally.

[0096] When the distance between the passenger's eyes and the window is relatively far, it can be displayed in an enlarged size.

[0097] The present application also provides an in-vehicle exterior scene special effect display device based on window display. The in-vehicle exterior scene special effect display device based on window display includes an exterior scene information acquisition module, a preset special effect database acquisition module, a special effect information acquisition module, and a sending module. The exterior scene information acquisition module is used to acquire exterior scene information; the preset special effect database acquisition module is used to acquire a preset special effect database; the special effect information acquisition module is used to acquire special effect information according to the exterior scene information and the preset special effect database; the sending module is used to transmit the special effect information to a projection device, so as to be displayed on the window glass through the projection device.

[0098] The present application also provides a vehicle, which includes a vehicle body, a projection device, and an in-vehicle exterior scene special effect display device based on window display. Among them, one or more of a front windshield, side windshields, a rear windshield, and a sunroof are provided on the vehicle body;

[0099] The number of projection devices is at least one, and one projection device is used to project onto one of the front windshield, side windshields, the rear windshield, and the sunroof;

[0100] The in-vehicle exterior scene special effect display device based on window display is connected to the projection device, and is used to transmit the special effect information to the projection device, so as to be displayed on the window glass through the projection device.

[0101] In this embodiment, the method of the present application can be used on any piece of glass of a vehicle, such as the front windshield, side windshield, rear windshield, etc. For example, a passenger sitting in the back seat can implement the method of the present application through the side windshields on both sides.

[0102] See Figure 3 , the present application also provides an out-of-vehicle scene special effect display method for window display based on the cloud, and the out-of-vehicle scene special effect display method for window display based on the cloud includes:

[0103] The vehicle end obtains out-of-vehicle scene information and transmits the out-of-vehicle scene information to the cloud;

[0104] The cloud obtains a preset special effect database;

[0105] The cloud generates special effect information according to the preset special effect database and the out-of-vehicle scene information and transmits the special effect information to the vehicle end;

[0106] The vehicle end performs projection display according to the special effect information, so as to display the special effect information on the window glass.

[0107] Specifically, see Figure 3 , the vehicle end obtains out-of-vehicle scene information and transmits the out-of-vehicle scene information to the cloud. Specifically, the out-of-vehicle scene information is collected by an out-of-vehicle camera device. For example, the out-of-vehicle scene is collected by the out-of-vehicle camera devices located around the vehicle body, and the out-of-vehicle scene within a certain range is collected through the combination of multi-directional camera devices, and the collected out-of-vehicle scene is transmitted to the vehicle end;

[0108] In this embodiment, the vehicle end can also scan the out-of-vehicle scene through a radar to determine information such as the position and size of the out-of-vehicle scene.

[0109] In this embodiment, the position of the passenger's eyeball is scanned and obtained through an in-vehicle sensor (to determine the size and distance of the scene content displayed on the window).

[0110] In this embodiment, the eyeball positions of each passenger need to be preset. For example, the user pre-enters the shape and characteristic information of the eyeball through a camera or a device similar to an eye tracker. After the method of the present application is used, the sensor can obtain the eyeball position information by capturing the passenger's eyeball.

[0111] See Figure 3 , in this embodiment, the above-mentioned information collected (the collected out-of-vehicle scene, information such as the position and size of the out-of-vehicle scene, and the passenger's eyeball position) is transmitted to the cloud.

[0112] The cloud obtains special effect information from the preset special effect database through an algorithm and transmits the special effect information to the vehicle end.

[0113] First, the cloud collects the external scene information through the external vehicle camera for deconstruction processing, that is, the scene is split into individual independent elements. Each pedestrian, each building, each vehicle, and each tree is an influencing unit, and the influencing units are matched one by one with the special effect contents in the preset special effect database.

[0114] The cloud assigns classification labels to each image unit. For example, it assigns a pedestrian label to the pedestrians in the image, a building label to the building, etc.

[0115] Based on the obtained classification labels, the cloud obtains the corresponding special effect information from the preset special effect database. For example, it obtains the pedestrian special effect for the pedestrian label. It can be understood that environmental special effects such as color, halo, pattern, texture, number, dynamic effect, etc. can also be obtained here.

[0116] The independent element corresponding to each classification label is associated with the special effect information obtained for that classification label, thus forming a triple (special effect information, independent element with position data in the image, and classification label).

[0117] Obtain the eye position information of the passengers transmitted by the in-vehicle passenger eye position sensor. The position information can be divided into: far, medium, and near. According to the position information, scale or magnify the special effect information prepared to be displayed on the window. For example, when the passenger's eye position information is near, all the special effect information to be displayed remains unchanged. When the passenger's eye position information is medium, all the special effect information to be displayed is magnified by 1.2 times. When the passenger's eye position information is far, it is magnified to 1.5 times.

[0118] In this embodiment, an overall special effect scene can also be set. That is, in addition to the above-mentioned preset special effect objects, the overall picture can also be filtered, and the scene can be rendered into a cyberpunk picture, etc.

[0119] Finally, the vehicle terminal performs projection display according to the special effect information, thus displaying the special effect information on the window glass.

[0120] In Figure 3 the embodiment shown, the vehicle terminal performs projection display according to the special effect information, thus displaying the special effect information on the window glass, including:

[0121] The vehicle terminal obtains the external environment information of the vehicle, such as real-time temperature, humidity, light intensity, etc. data around the window glass. The window adjusts the display effect according to the temperature, humidity, and light intensity (for example, adjusts the brightness, performs the window defogging function), etc.

[0122] The user selects some or all of the obtained special effect information for display. For example, the cloud may transmit multiple special weather special effects to the vehicle terminal, and the vehicle terminal displays them through the human-computer interaction interface, allowing the user to select which special effect to use specifically.

[0123] For example, Scenario 1: When parking, the vehicle is located on a city street and the external environment outside the street is noisy. At this time, the passenger sitting on the right side of the rear row closes all the windows and selects to load the window display special effect, choosing the cyberpunk style. The camera outside the vehicle captures the scenery in the surrounding environment, the radar scans the position of the scenery, and the in-vehicle sensor scans the position of the passenger's eyes. The information processing module obtains the special effect algorithm and special effect materials from the cloud, and displays the image of the external scenery with cyberpunk special effects on the window glass. At this time, when the passenger looks at the outside world through the window, they see a cyberpunk world.

[0124] Figure 2 It is a block diagram of the structure of an electronic device provided by one or more embodiments of the present invention.

[0125] As Figure 2 shown, the present application also discloses an electronic device, including: a processor, a communication interface, a memory, and a communication bus. Among them, the processor, the communication interface, and the memory complete mutual communication through the communication bus; a computer program is stored in the memory. When the computer program is executed by the processor, the processor executes the steps of the method for displaying the special effects of the external scenery based on the window display.

[0126] The present application also provides a computer-readable storage medium, which stores a computer program executable by an electronic device. When the computer program runs on the electronic device, the electronic device executes the steps of the method for displaying the special effects of the external scenery based on the window display.

[0127] The communication bus mentioned in the above-mentioned electronic device may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into an address bus, a data bus, a control bus, etc. For the sake of simplicity, only a thick line is used to represent it in the figure, but it does not mean that there is only one bus or one type of bus.

[0128] The electronic device includes a hardware layer, an operating system layer running on top of the hardware layer, and an application layer running on the operating system. The hardware layer includes hardware such as a central processing unit (CPU, Central Processing Unit), a memory management unit (MMU, Memory Management Unit), and memory. The operating system can be any one or more computer operating systems that control the electronic device through processes. For example, Linux operating system, Unix operating system, Android operating system, iOS operating system, or Windows operating system, etc. And in the embodiments of the present invention, the electronic device can be a handheld device such as a smart phone or a tablet computer, or an electronic device such as a desktop computer or a portable computer. There is no special limitation in the embodiments of the present invention.

[0129] The execution subject of the electronic device control in the embodiments of the present invention can be the electronic device, or a functional module in the electronic device that can call and execute a program. The electronic device can obtain the firmware corresponding to the storage medium, and the firmware corresponding to the storage medium is provided by the supplier. The firmware corresponding to different storage media can be the same or different, and no limitation is made here. After the electronic device obtains the firmware corresponding to the storage medium, it can write the firmware corresponding to the storage medium into the storage medium. Specifically, it burns the firmware corresponding to the storage medium into the storage medium. The process of burning the firmware into the storage medium can be implemented by existing technologies and will not be elaborated in the embodiments of the present invention.

[0130] The electronic device can also obtain the reset command corresponding to the storage medium, and the reset command corresponding to the storage medium is provided by the supplier. The reset commands corresponding to different storage media can be the same or different, and no limitation is made here.

[0131] At this time, the storage medium of the electronic device is the storage medium written with the corresponding firmware. The electronic device can respond to the reset command corresponding to the storage medium in the storage medium written with the corresponding firmware, so that the electronic device resets the storage medium written with the corresponding firmware according to the reset command corresponding to the storage medium. The process of resetting the storage medium according to the reset command can be implemented by existing technologies and will not be elaborated in the embodiments of the present invention.

[0132] For the convenience of description, when describing the above device, various units and modules are described separately according to their functions. Of course, when implementing the present application, the functions of each unit and module can be implemented in the same or multiple software and / or hardware.

[0133] Those skilled in the art can understand that, unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by those of ordinary skill in the field to which the present invention belongs. It should also be understood that terms such as those defined in a general dictionary should be understood to have a meaning consistent with the context of the prior art, and will not be interpreted in an idealized or overly formal sense unless specifically defined otherwise.

[0134] For method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the embodiments of the present invention are not limited by the described action sequence, because according to the embodiments of the present invention, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily essential for the embodiments of the present invention.

[0135] From the description of the above embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present application.

[0136] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. An in-vehicle exterior scene special effect display method based on window display, characterized in that, the in-vehicle exterior scene special effect display method based on window display includes: Obtaining information of the exterior scene; Obtaining a preset special effect database; Obtaining special effect information according to the exterior scene information and the preset special effect database; Transmitting the special effect information to a projection device, so as to be displayed on the window glass through the projection device; The obtaining of the exterior scene information includes: Obtaining image information of the outside of the vehicle captured by a camera device; Obtaining a trained image classifier group; Extracting image feature information of the image information of the outside of the vehicle; Inputting the image feature information into the image classifier group, so as to obtain classification labels output by the classifier group, and the classification labels include one or more of a tree label, a building label, a pedestrian label, and a vehicle label; The obtaining of the exterior scene information further includes: Obtaining distance information of each object obtained by an acoustic imaging system; The obtaining of the exterior scene information further includes: Obtaining weather information; The preset special effect database includes a special effect object information database, and the special effect object information database includes preset special effect object components and preset special effect object labels, and one preset special effect object label corresponds to a group of preset special effect object components; The obtaining of the special effect information according to the exterior scene information and the preset special effect database includes: Obtaining the preset special effect object components corresponding to the preset special effect object labels that are the same as the classification labels output by the classifier group; Obtaining special effect object information as special effect information according to the preset special effect object components; The preset special effect database further includes a special effect scene database, and the special effect scene database further includes at least one special effect scene and preset weather information, and one preset weather information corresponds to one special effect scene; The obtaining of the special effect information according to the exterior scene information and the preset special effect database further includes: Obtaining the special effect scene corresponding to the preset weather information that is the same as the weather information, wherein the obtained special effect object information and the special effect scene form the special effect information; Each of the special effect object components includes at least two special effect object information of the same type but different models and preset weather information, and one preset weather information corresponds to one special effect object information; The obtaining of the special effect object information as special effect information according to the preset special effect object components includes: Obtaining the special effect object information corresponding to the preset weather information that is the same as the weather information as special effect information; Obtaining face image information of each passenger in the vehicle through an in-vehicle camera device; Obtaining a trained age classifier; Extracting image features of the face image information of each passenger; Inputting each image feature into the trained age classifier respectively, so as to obtain age labels, and the age labels include an adult label and a minor label; When the age label includes a minor label, obtaining a prohibited playback database, and the prohibited playback database includes at least one prohibited playback special effect object; When obtaining the special effect object information as special effect information according to the preset special effect object components, excluding the special effect object information that is the same as the prohibited playback special effect object in this group of preset special effect object components as special effect information.

2. An external scene special effect display device based on window display, characterized in that, the external scene special effect display device based on window display includes: an external scene information acquisition module, which is used to acquire external scene information; a preset special effect database acquisition module, which is used to acquire a preset special effect database; a special effect information acquisition module, which is used to acquire special effect information according to the external scene information and the preset special effect database; a sending module, which is used to transmit the special effect information to a projection device, so as to be displayed on the window glass through the projection device; The acquisition of the external scene information includes: acquiring image information of the outside of the vehicle captured by a camera device; acquiring a trained image classifier group; extracting image feature information of the image information of the outside of the vehicle; inputting the image feature information into the image classifier group, so as to obtain classification labels output by the classifier group, and the classification labels include one or more of a tree label, a building label, a pedestrian label, and a vehicle label; The acquisition of the external scene information further includes: acquiring distance information of each object acquired by an acoustic imaging system; The acquisition of the external scene information further includes: acquiring weather information; The preset special effect database includes a special effect object information database, and the special effect object information database includes preset special effect object components and preset special effect object labels, and one preset special effect object label corresponds to a group of preset special effect object components; The acquisition of the special effect information according to the external scene information and the preset special effect database includes: acquiring the preset special effect object components corresponding to the preset special effect object labels that are the same as the classification labels output by the classifier group; acquiring special effect object information as special effect information according to the preset special effect object components; The preset special effect database further includes a special effect scene database, and the special effect scene database further includes at least one special effect scene and preset weather information, and one preset weather information corresponds to one special effect scene; The acquisition of the special effect information according to the external scene information and the preset special effect database further includes: acquiring the special effect scene corresponding to the preset weather information that is the same as the weather information, wherein the acquired special effect object information and the special effect scene form the special effect information; Each of the special effect object components includes at least two types of special effect object information with the same type and different models and preset weather information, and one preset weather information corresponds to one special effect object information; The acquisition of the special effect object information as special effect information according to the preset special effect object components includes: acquiring the special effect object information corresponding to the preset weather information that is the same as the weather information as special effect information; acquiring face image information of each passenger in the vehicle through an in-vehicle camera device; acquiring a trained age classifier; extracting image features of the face image information of each passenger; inputting each image feature into the trained age classifier respectively, so as to obtain age labels, and the age labels include an adult label and a minor label; When the age label includes a minor label, obtain a prohibited playback database, and the prohibited playback database includes at least one prohibited playback special effect object; When obtaining special effect object information as special effect information according to the preset special effect object component, exclude the special effect object information that is the same as the prohibited playback special effect object in the group of preset special effect object components as special effect information.

Images