Target object display method, system and device and storage medium

Abstract

The invention relates to a target object display method, system and device and a storage medium, and the method comprises the steps: collecting an infrared radiation signal of a target object outside a vehicle through an optical module, enabling the infrared radiation signal not to be affected by weather and visibility, guaranteeing the availability of the infrared radiation signal, carrying out the signal amplification and modulation processing of the infrared radiation signal, and achieving the display of the target object. The method comprises the steps of obtaining a target infrared light signal, calculating and analyzing the target infrared light signal based on a photon neural network to obtain an infrared light processing signal, performing signal conversion processing on the infrared light processing signal to obtain an infrared image electric signal, and displaying an infrared image of a target object in a display unit in a vehicle based on the infrared image electric signal. According to the method, the light signal is directly processed, and the processed infrared light processing signal is converted into the infrared image electric signal, so that the target object can be accurately identified, the infrared image of the target object can be displayed on the display unit, and the safety in the driving process is improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle assistance technology, and in particular to a method, system, device and storage medium for displaying a target object. Background Art

[0002] With the development of economy and science and technology, cars have become consumer goods similar to mobile phones. They have entered thousands of households and brought great convenience to people's travel. However, with the increase in the number of vehicles, car driving safety has gradually become a big problem.

[0003] Under the influence of extreme weather, the external environment visibility is low, the driving conditions are extremely bad, the car driver's vision ahead is blurred, the judgment of the road conditions is greatly affected, and the probability of traffic accidents is significantly increased. How to accurately identify the target objects outside the car has become a problem that needs to be solved urgently in car driving. Summary of the invention

[0004] In order to solve the above technical problem or at least partially solve the above technical problem, the present application provides a method, system, device and storage medium for displaying a target object.

[0005] In a first aspect, the present application provides a method for displaying a target object, the method comprising:

[0006] Collect infrared radiation signals of target objects outside the vehicle through an optical module;

[0007] Amplifying and modulating the infrared radiation signal to obtain a target infrared light signal;

[0008] Performing calculation and analysis on the target infrared light signal based on a photonic neural network to obtain an infrared light processing signal;

[0009] Performing signal conversion processing on the infrared light processing signal to obtain an infrared image electrical signal;

[0010] Displaying the infrared image of the target object on a display unit in the vehicle based on the infrared image electrical signal;

[0011] Optionally, the performing computational analysis on the target infrared light signal based on a photon neural network to obtain an infrared light processing signal includes:

[0012] Obtaining a weight matrix and photon matrix multiplier parameters of the photonic neural network;

[0013] Performing convolution calculation on the target infrared light signal according to the weight matrix and the photon matrix multiplier parameter to obtain the infrared light processing signal;

[0014] Optionally, the performing signal amplification and signal modulation processing on the infrared radiation signal to obtain a target infrared light signal includes:

[0015] Amplifying the infrared radiation signal to obtain an infrared amplified signal;

[0016] Obtaining a preset signal format of the photonic neural network;

[0017] Performing signal modulation processing on the infrared amplified signal according to the preset signal format to obtain the target infrared light signal;

[0018] Optionally, performing signal conversion processing on the infrared light processing signal to obtain an infrared image electrical signal includes:

[0019] Converting the infrared light processing signal into the infrared image electrical signal through a photoelectric converter array;

[0020] Optionally, before performing signal amplification and signal modulation processing on the infrared radiation signal to obtain the target infrared light signal, the method further includes:

[0021] Get the current environment information outside the vehicle;

[0022] When the visibility represented by the current environmental information is lower than a preset threshold, performing the steps of amplifying and modulating the infrared radiation signal to obtain a target infrared light signal;

[0023] Optionally, the optical module includes a Fresnel lens and an optical waveguide; the Fresnel lens is used to receive infrared radiation signals from a target object outside the vehicle, and the optical waveguide is used to collect and transmit the infrared radiation signals;

[0024] Optionally, the optical module further comprises a filter, and the filter is arranged between the Fresnel lens and the optical waveguide;

[0025] The filter is used for filtering the infrared radiation signal received by the Fresnel lens and then transmitting the filtered signal to the optical waveguide.

[0026] In a second aspect, the present application provides a target object display system, the system comprising: an external infrared radiation signal acquisition unit, a signal preprocessing unit, a signal calculation unit, a signal conversion unit and a display unit;

[0027] The external infrared radiation signal acquisition unit is used to acquire infrared radiation signals of target objects outside the vehicle through an optical module;

[0028] The signal preprocessing unit is used to perform signal amplification and signal modulation processing on the infrared radiation signal to obtain a target infrared light signal;

[0029] The signal calculation unit is used to calculate and analyze the target infrared light signal based on a photonic neural network to obtain an infrared light processing signal;

[0030] The signal conversion unit is used to perform signal conversion processing on the infrared light processing signal to obtain an infrared image electrical signal;

[0031] The display unit is used to display the infrared image of the target object based on the infrared image electrical signal.

[0032] In a third aspect, the present application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0033] Memory, used to store computer programs;

[0034] The processor is used to implement the steps of the method for displaying the target object described in any embodiment of the first aspect when executing the program stored in the memory.

[0035] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the method for displaying a target object as described in any one of the embodiments of the first aspect are implemented.

[0036] Beneficial effects of this application:

[0037] The method provided in the embodiment of the present application uses an optical module to collect infrared radiation signals of target objects outside the vehicle. The infrared radiation signals are not affected by weather and visibility, and the availability of the infrared radiation signals can be guaranteed. The infrared radiation signals are amplified and modulated to obtain target infrared light signals. The target infrared light signals are calculated and analyzed based on a photon neural network to obtain infrared light processing signals. The infrared light processing signals are converted to infrared image electrical signals, and the infrared image of the target object is displayed on a display unit in the vehicle based on the infrared image electrical signals. Since the method directly processes the light signal, the infrared light processing signal after processing is converted into an infrared image electrical signal, which can accurately identify the target object and display the infrared image of the target object on the display unit, thereby improving the safety during driving. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0039] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0040] Figure 1 A system architecture diagram of a method for displaying a target object provided by an embodiment of the present application;

[0041] Figure 2 A schematic diagram of a flow chart of a method for displaying a target object provided by an embodiment of the present application;

[0042] Figure 3 A system architecture diagram of a method for displaying a target object provided by another embodiment of the present application;

[0043] Figure 4 A schematic flow chart of a method for displaying a target object provided in another embodiment of the present application;

[0044] Figure 5 A schematic diagram of the structure of an electronic device provided in accordance with an embodiment of the present application. DETAILED DESCRIPTION

[0045] The following will describe the implementation methods of the present application with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific implementation methods, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be understood that the preferred embodiments are only for illustrating the present application, not for limiting the scope of protection of the present application.

[0046] In order to facilitate understanding of this application, a brief introduction to the relevant technologies is first given. Under the influence of extreme weather, the external environment visibility is low, the driving conditions are extremely bad, the driver's vision ahead is blurred, the judgment of the road conditions is greatly affected, and the probability of traffic accidents is significantly increased.

[0047] Due to the temporal and spatial complexity of disasters such as rainstorms, sandstorms, and haze, the on-board camera may be wetted by rain or blocked by leaves, mud, sand, etc. In these cases, it is impossible to clearly identify the road conditions and cannot fully carry out the mission of assisting drivers in safe driving. Some technologies use thermal imagers to provide drivers with road conditions, but thermal imagers directly use infrared detectors to distinguish road conditions, which cannot accurately obtain the three-dimensional coordinates of certain obstacles in extreme weather, and the imaging is blurred, the image quality is not clear, and the calculation rate is low and the delay is high. In extreme weather, it cannot leave drivers with sufficient reaction time and good assisted driving functions. Some technologies also use multi-line laser radar systems to provide road condition information. The laser radar system uses beam light as a radar scanning signal, which has some advantages such as short optical path and small size. However, in extreme weather, the reflection efficiency will be affected. In addition, pedestrians and people riding electric vehicles are small in size, and the number of reflections is limited, which is difficult to be perceived by the laser radar, and cannot fully assist drivers in safe driving in extreme weather.

[0048] Based on the above shortcomings, the present application provides a method for displaying a target object to solve the problem of how to accurately identify the target object outside the vehicle.

[0049] An embodiment of the present application provides a method for displaying a target object. The method can be applied to Figure 1 The system architecture shown includes at least an external infrared radiation signal acquisition unit 101 , a signal preprocessing unit 102 , a signal calculation unit 103 , a signal conversion unit 104 and a display unit 105 .

[0050] The external infrared radiation signal acquisition unit is used to acquire infrared radiation signals of target objects outside the vehicle through an optical module.

[0051] The signal preprocessing unit is used to perform signal amplification and signal modulation processing on the infrared radiation signal to obtain a target infrared light signal.

[0052] The signal calculation unit is used to calculate and analyze the target infrared light signal based on a photonic neural network to obtain an infrared light processing signal.

[0053] The signal conversion unit is used to perform signal conversion processing on the infrared light processing signal to obtain an infrared image electrical signal.

[0054] The display unit is used to display the infrared image of the target object based on the infrared image electrical signal.

[0055] Next, based on the system architecture, the display method of the target object is described in detail, such as Figure 2 , methods include:

[0056] Step 201: Collect infrared radiation signals of target objects outside the vehicle through an optical module.

[0057] The target object can be a vehicle, pedestrian, obstacle, etc. outside the vehicle. The optical module can be set on the top of the vehicle (such as in front of the sunroof) or in front of the vehicle (such as in front of the rearview mirror), etc., without restriction. According to Planck's law, any object above absolute zero has infrared radiation. Depending on the temperature of the object, the energy and wavelength of its radiation are also different. From Boltzmann's law, it can be seen that the power of infrared radiation is proportional to the fourth power of its absolute temperature, that is, W = εσT 4 , ε is the blackbody radiation coefficient. If it is an absolute blackbody, ε=1; σ is the Stefan-Boltzmann constant, and T is the absolute temperature. Therefore, the electromagnetic waves radiated by vehicles or pedestrians on the road can be collected through the optical module as the infrared radiation signals of the vehicles or pedestrians.

[0058] In one embodiment, the optical module includes a Fresnel lens and an optical waveguide, the Fresnel lens is used to receive infrared radiation signals from a target object outside the vehicle, and the optical waveguide is used to collect and transmit the infrared radiation signals.

[0059] In this embodiment, a Fresnel lens can be used to receive infrared rays emitted by a substance and focus them on an optical waveguide. The surface of the Fresnel lens is engraved with multiple concentric circles from small to large and from shallow to deep from the inside to the outside, which looks like sawtooth from the cross section. Different Fresnel lenses have different numbers of rings. The more rings there are, the larger the sensing angle is and the longer the focal length is.

[0060] Specifically, the optical module also includes a filter, which is arranged between the Fresnel lens and the optical waveguide. The filter first filters the infrared radiation signal received by the Fresnel lens and filters out part of the interference signal. The optical waveguide collects the filtered infrared radiation signal.

[0061] Step 202, amplify and modulate the infrared radiation signal to obtain a target infrared light signal.

[0062] In one embodiment, an infrared radiation signal is amplified and modulated to obtain a target infrared light signal, including: amplifying the infrared radiation signal to obtain an infrared amplified signal, acquiring a preset signal format of a photonic neural network, and modulating the infrared amplified signal according to the preset signal format to obtain a target infrared light signal.

[0063] In this embodiment, the infrared radiation signal is first amplified. Specifically, an optical amplifier array can be used to amplify the received infrared radiation signal to obtain an infrared amplified signal. The infrared amplified signal is then modulated according to a preset signal format of the photonic neural network to obtain a target infrared light signal that can be recognized by the photonic neural network.

[0064] In one embodiment, before amplifying and modulating the infrared radiation signal to obtain the target infrared light signal, the method further includes: acquiring current environmental information outside the vehicle, and when the current environmental information indicates that visibility is lower than a preset threshold, amplifying and modulating the infrared radiation signal to obtain the target infrared light signal.

[0065] In this embodiment, the current environment information outside the vehicle can be first obtained, and when the current environment information indicates that the visibility is lower than the preset threshold, the infrared radiation signal of the target object collected by the optical module is preprocessed. The visibility lower than the preset threshold indicates that the vehicle is currently in an environment with bad road conditions such as thunderstorms, sandstorms, and haze. The on-board camera alone cannot accurately judge the current road conditions. In this case, the method provided by this application needs to be used to display the target object to improve safety during driving.

[0066] Step 203, performing calculation and analysis on the target infrared light signal based on the photonic neural network to obtain an infrared light processing signal.

[0067] In one embodiment, a target infrared light signal is computationally analyzed based on a photonic neural network to obtain an infrared light processing signal, including: obtaining a weight matrix and photon matrix multiplier parameters of the photonic neural network, performing convolution calculation on the target infrared light signal according to the weight matrix and the photon matrix multiplier parameters to obtain an infrared light processing signal.

[0068] In this embodiment, the weight matrix is ​​expressed as follows:

[0069] Y=WX

[0070] In the above expression, W is the weight matrix, X is the target infrared light signal, and Y is the infrared light processing signal. The weight matrix contains the bias matrix b, where the bias matrix b of each layer is directly added to the weight matrix W as a row (or column). The weight matrix can be combined with the parameters of the photon matrix multiplier for convolution calculation to achieve high-precision and fast processing of infrared light signals in the vehicle environment under extreme weather conditions. The photon matrix multiplier can be composed of a Mach-Zehnder interferometer (MZI) and a phase converter, and the parameters of the photon matrix multiplier can be controlled and adjusted through the FPGA unit.

[0071] Step 204: perform signal conversion processing on the infrared light processing signal to obtain an infrared image electrical signal.

[0072] The infrared light processing signal can be converted into an infrared image electrical signal through a photoelectric converter array. In this embodiment, the infrared light processing signal is converted into an electrical signal after processing, which can improve the clarity of the converted electrical signal when displayed, and avoid the problems of directly converting the collected infrared radiation signal into an electrical signal in the prior art, and then processing the electrical signal with slow processing speed and poor infrared image quality (poor contrast, blurred edge contours, poor non-uniformity, low signal-to-noise ratio).

[0073] Step 205 : displaying the infrared image of the target object on a display unit in the vehicle based on the infrared image electrical signal.

[0074] The display unit in the vehicle can be a display device such as the vehicle's central control screen. The method collects infrared radiation signals of target objects outside the vehicle through an optical module. The infrared radiation signals are not affected by weather and visibility, and the availability of infrared radiation signals can be guaranteed. The infrared radiation signals are amplified and modulated to obtain target infrared light signals. The target infrared light signals are calculated and analyzed based on a photon neural network to obtain infrared light processing signals. The infrared light processing signals are converted to infrared image electrical signals, and the infrared image of the target object is displayed on the display unit in the vehicle based on the infrared image electrical signals. Since the method directly processes the light signal, the processed infrared light processing signal is converted into an infrared image electrical signal, which can accurately identify the target object and display the infrared image of the target object on the display unit, thereby improving the safety during driving.

[0075] In a specific embodiment, the system architecture diagram of the target object display method can be as follows: Figure 3 ,include:

[0076] The vehicle exterior environment information acquisition unit 301 is used to acquire and collect infrared radiation signals of people or objects outside the vehicle under extreme weather conditions.

[0077] The signal preprocessing unit 302 is used to amplify and modulate the infrared signal outside the vehicle under extreme weather conditions.

[0078] The signal calculation unit 303 uses a photon matrix multiplier composed of a Mach-Zehnder interferometer (MZI) and a phase converter to calculate and analyze the pre-processed signal to extract the infrared image in a specific environment. The calculation is mainly achieved through the weight matrix of the neural network.

[0079] The FPGA unit 304 is used to control the Mach-Zehnder interferometer (MZI) and the phase converter to control the operation of the photonic neural network.

[0080] The signal conversion unit 305 is used to process the image after the calculation and convert the optical signal of the infrared image into an electrical signal.

[0081] The information feedback unit 306 outputs the result of the electrical signal to the central control screen based on the infrared image of the vehicle external environment signal conversion unit, so as to help the driver judge the road conditions outside the vehicle in extreme weather and solve the safety problem of vehicle driving in extreme weather.

[0082] Based on the system architecture, the display method of the target object, such as Figure 4 ,include:

[0083] Step 401, using an optical module located on the roof of the vehicle to obtain infrared radiation signals of people or objects outside the vehicle under extreme weather conditions.

[0084] According to Planck's law, any object above absolute zero has infrared radiation, and the energy and wavelength of the radiation produced vary depending on the temperature of the object. According to Boltzmann's law, the power of infrared radiation is proportional to the fourth power of its absolute temperature, that is, W = εσT 4 , ε is the blackbody radiation coefficient. If it is an absolute blackbody, ε=1; σ is the Stefan-Boltzmann constant, and T is the absolute temperature. According to the theory, the electromagnetic waves radiated by vehicles or pedestrians on the road can be collected as infrared radiation signals. The acquisition method is based on the optical module to obtain the infrared radiation signals of people or vehicles on the road in extreme weather. It mainly uses the Fresnel lens to receive the infrared rays emitted by the material and gathers them on the optical waveguide. The optical waveguide is used to collect the optical signal obtained by the Fresnel lens, and the output end of the optical waveguide is used as the output end of the optical module. The surface of the Fresnel lens is engraved with multiple concentric circles from small to large and from shallow to deep from the inside to the outside, which looks like sawtooth from the cross section. Different Fresnel lenses have different numbers of rings. The more rings there are, the larger the sensing angle and the longer the focal length.

[0085] Step S102, preprocessing the infrared radiation signal outside the vehicle under extreme weather conditions. The preprocessing includes signal amplification and signal modulation. Signal amplification is to amplify the received light signal outside the vehicle using an optical amplifier array, and signal modulation is to modulate the amplified light signal into a signal of a suitable frequency to obtain a light signal that can be recognized and calculated by the photonic neural network.

[0086] Step S103, based on the pre-processed infrared radiation signal outside the vehicle under extreme weather conditions, perform computational analysis on it to extract the infrared image of the environment outside the vehicle under extreme weather conditions. The computational analysis is mainly completed by a photonic neural network, which is mainly composed of a Mach-Zehnder interferometer (MZI) and a phase converter. The angle and phase of the Mach-Zehnder interferometer (MZI) and the phase converter are controlled by the FPGA unit to realize the computational analysis of the optical signal. The computational analysis is mainly realized by the weight matrix of the photonic neural network, and its weight matrix is ​​expressed as follows:

[0087] Y=WX

[0088] In the above expression, W is the weight matrix, X is the target infrared light signal, Y is the infrared light processing signal, and the weight matrix includes the bias matrix b, where the bias matrix b of each layer is directly added to the weight matrix W as a row (or column). The weight matrix can be combined with the photon matrix multiplier parameters for convolution calculation to achieve high-precision and rapid processing of infrared light signals in the vehicle environment under extreme weather conditions.

[0089] Step S104, for the infrared image of the vehicle exterior environment after calculation and processing, the optical signal of the infrared image is converted into an electrical signal through a photoelectric converter array, wherein the conversion of the photoelectric signal is achieved by the internal electrons of the material absorbing photons from a low energy level to a high energy level.

[0090] Step S105, for the infrared image converted by the photoelectric converter array, an electrical signal is input into the central control screen to display the result, so as to help the driver to drive the vehicle safely in extreme weather.

[0091] The method provided in the embodiment of the present application can analyze and calculate infrared light signals through photon neural networks, so as to process infrared signals outside the vehicle in extreme weather with high precision and high speed, and then convert the analyzed light signals into infrared image electrical signals. The infrared signals of vehicles or pedestrians outside the vehicle can be displayed on the central control screen inside the vehicle, and road conditions can be fed back in a timely manner with clear imaging. This can effectively solve the problem of safe driving of vehicles in extreme weather and provide safety protection for driving in extreme weather.

[0092] like Figure 5 As shown, an embodiment of the present application provides an electronic device, including a processor 111, a communication interface 112, a memory 113 and a communication bus 114, wherein the processor 111, the communication interface 112, and the memory 113 communicate with each other through the communication bus 114.

[0093] Memory 113, used for storing computer programs;

[0094] In one embodiment, the processor 111 is configured to implement the target object display method provided by any one of the aforementioned method embodiments when executing a program stored in the memory 113 .

[0095] The memory and processor in the above electronic device communicate through a communication bus and a communication interface. The communication bus can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The communication bus can be divided into an address bus, a data bus, a control bus, etc.

[0096] The memory may include a random access memory (RAM) or a non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0097] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0098] An embodiment of the present application also provides a computer-readable medium having a non-volatile program code executable by a processor.

[0099] Optionally, in an embodiment of the present application, a computer-readable medium is configured to store program code for a processor to execute the above method.

[0100] Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments, and this embodiment will not be described in detail here.

[0101] When the embodiments of the present application are specifically implemented, reference may be made to the above-mentioned embodiments, which have corresponding technical effects.

[0102] It is understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions of the present application, or a combination thereof.

[0103] For software implementation, the technology of this article can be implemented by a unit that performs the functions of this article. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.

[0104] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0105] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0106] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0107] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0108] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0109] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard drives, ROM, RAM, magnetic disks, or optical disks.

[0110] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0111] The above embodiments are only preferred embodiments for fully illustrating the present application, and the protection scope of the present application is not limited thereto. Any equivalent substitution or change made by a person skilled in the art based on the present application is within the protection scope of the present application.

Claims

1. A method for displaying a target object, characterized in that: The method comprises: Collect infrared radiation signals of target objects outside the vehicle through an optical module; Amplifying and modulating the infrared radiation signal to obtain a target infrared light signal; Performing calculation and analysis on the target infrared light signal based on a photonic neural network to obtain an infrared light processing signal; Performing signal conversion processing on the infrared light processing signal to obtain an infrared image electrical signal; The infrared image of the target object is displayed on a display unit in the vehicle based on the infrared image electrical signal.

2. The method according to claim 1, characterized in that The step of calculating and analyzing the target infrared light signal based on a photon neural network to obtain an infrared light processing signal includes: Obtaining a weight matrix and photon matrix multiplier parameters of the photonic neural network; The target infrared light signal is convolved according to the weight matrix and the photon matrix multiplier parameters to obtain the infrared light processing signal.

3. The method according to claim 1, characterized in that The amplifying and modulating the infrared radiation signal to obtain the target infrared light signal comprises: Amplifying the infrared radiation signal to obtain an infrared amplified signal; Obtaining a preset signal format of the photonic neural network; The infrared amplified signal is modulated according to the preset signal format to obtain the target infrared light signal.

4. The method according to claim 1, characterized in that: The step of performing signal conversion processing on the infrared light processing signal to obtain an infrared image electrical signal includes: The infrared light processing signal is converted into the infrared image electrical signal through a photoelectric converter array.

5. The method according to claim 1, characterized in that Before performing signal amplification and signal modulation processing on the infrared radiation signal to obtain the target infrared light signal, the method further includes: Get the current environment information outside the vehicle; When the visibility represented by the current environmental information is lower than a preset threshold, the step of amplifying and modulating the infrared radiation signal to obtain a target infrared light signal is performed.

6. The method according to claim 1, characterized in that The optical module includes a Fresnel lens and an optical waveguide; the Fresnel lens is used to receive infrared radiation signals from a target object outside the vehicle, and the optical waveguide is used to collect and transmit the infrared radiation signals.

7. The method according to claim 6, characterized in that The optical module further comprises a filter, wherein the filter is disposed between the Fresnel lens and the optical waveguide; The filter is used for filtering the infrared radiation signal received by the Fresnel lens and then transmitting the filtered signal to the optical waveguide.

8. A target object display system, characterized in that: The system comprises: an infrared radiation signal acquisition unit outside the vehicle, a signal preprocessing unit, a signal calculation unit, a signal conversion unit and a display unit; The external infrared radiation signal acquisition unit is used to acquire infrared radiation signals of target objects outside the vehicle through an optical module; The signal preprocessing unit is used to perform signal amplification and signal modulation processing on the infrared radiation signal to obtain a target infrared light signal; The signal calculation unit is used to calculate and analyze the target infrared light signal based on a photonic neural network to obtain an infrared light processing signal; The signal conversion unit is used to perform signal conversion processing on the infrared light processing signal to obtain an infrared image electrical signal; The display unit is used to display the infrared image of the target object based on the infrared image electrical signal.

9. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; Memory, used to store computer programs; A processor, for implementing any of the methods described in claims 1-7 when executing a program stored in a memory.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images