On-board interactive assisted driving method, on-board electronic device, and storage medium

Abstract

Provided in the embodiments of the present application are an on-board interactive assisted driving method, an on-board electronic device, and a storage medium. The on-board interactive assisted driving method comprises: acquiring dual-light image data collected by means of an on-board camera, wherein the dual-light image data comprises infrared image data and visible-light image data; determining a local display mode on a system unit end, and on the basis of the dual-light image data, displaying in a display interface of the system unit end a target-type von-board video corresponding to the local display mode; and after a communication connection with an intelligent terminal is established, determining a terminal display mode of the intelligent terminal, obtaining, on the basis of the dual-light image data, a target-type video source corresponding to the terminal display mode, and sending the target-type video source to the intelligent terminal for display.

Description

In-vehicle interactive assisted driving method, in-vehicle electronic equipment and storage medium

[0001] The present invention claims the priority of the Chinese patent application filed with the China Patent Office on September 28, 2023, with application number 202311277885.5 and application name “Vehicle-mounted interactive assisted driving method, vehicle-mounted electronic device and storage medium”; and the priority of the Chinese patent application filed with the China Patent Office on September 28, 2023, with application number 202322645328.6 and application name “Vehicle-mounted assisted driving device”, all of which are incorporated by reference into the present invention. Technical Field

[0002] The present application relates to the field of vehicle assisted driving technology, and in particular to a vehicle-mounted interactive assisted driving method, a vehicle-mounted electronic device, and a computer-readable storage medium. Background Art

[0003] In recent years, with the continuous development of society, traffic conditions have become increasingly complex. Based on driving safety considerations, assisted driving technology has received more and more attention and application.

[0004] At night, in backlight, in heavy fog, rain, or snow, drivers' vision is obstructed. They desire intuitive imagery to assist them in identifying and judging potential hazards ahead, thus minimizing the risk of danger. Infrared images are insensitive to light and can penetrate fog, making them excellent candidates for adverse weather conditions. However, infrared images have low resolution and lack rich texture and color information. Visible light images have high resolution and are rich in texture and color information, while wide-angle visible light allows for a wider field of view. Therefore, the simultaneous utilization of infrared and visible light images in in-vehicle driver assistance systems to improve driving safety is attracting increasing attention.

[0005] In addition, with the widespread use of mobile electronic devices such as mobile phones and tablets, they have brought a lot of convenience to users and are often used by drivers while driving. For example, drivers can use the navigation function in the mobile phone map and various music app functions while driving. However, although mobile motor devices are widely used in conjunction with in-vehicle products, the mobile electronic devices only provide independent additional functions, or simply synchronize with in-vehicle products to connect some mobile phone app functions (such as the aforementioned navigation function and music app function) to the in-vehicle system, and do not play a role in expanding and supporting the functions realized by the original in-vehicle products. In other words, the functions that can be realized by the in-vehicle products themselves are not improved by using them with mobile phones, and the mobile phone functions that drivers often use while driving are not improved by connecting them to in-vehicle products. Technical issues

[0006] In view of this, the present application provides an in-vehicle interactive assisted driving method, an in-vehicle electronic device and a computer-readable storage medium based on interactive auxiliary control to enable infrared and visible light images to be simultaneously utilized in in-vehicle assisted driving to improve driving safety performance. Technical Solutions

[0007] In a first aspect, an embodiment of the present application provides an in-vehicle interactive assisted driving method, which is applied to an in-vehicle electronic device, comprising:

[0008] Obtaining bi-optical image data collected by a vehicle-mounted camera; wherein the bi-optical image data includes infrared image data and visible light image data;

[0009] Determining a local display mode of a host terminal, and displaying a target type of vehicle-mounted video corresponding to the local display mode on a display interface of the host terminal based on the bi-optical image data;

[0010] After establishing a communication connection with the smart terminal, the terminal display mode of the smart terminal is determined, a target type video source corresponding to the terminal display mode is obtained based on the bi-optical image data, and the target type video source is sent to the smart terminal for display.

[0011] In some embodiments, obtaining bi-optical image data collected by a vehicle-mounted camera includes:

[0012] selecting, according to the size of the infrared image data, an idle image area of ​​the same size as the visible light image data as a target area, and superimposing the infrared image data onto the target area of ​​the visible light image data to form dual-light image data in a picture-in-picture mode;

[0013] The bi-optical image data is acquired from a vehicle-mounted camera.

[0014] In some embodiments, selecting an idle image area of ​​the same size as the target area in the visible light image data according to the size of the infrared image data includes:

[0015] According to the size of the infrared image data, the imaging area of ​​the sky part in the corresponding driving scene in the visible light image data is used as the idle image area, and an area with the same size as the infrared image data is selected as the target area, or multiple areas with the same size as the infrared image data after addition are selected as the target area.

[0016] In some embodiments, obtaining bi-optical image data collected by a vehicle-mounted camera further includes:

[0017] Processing the dual-light image data in the picture-in-picture mode to separate the data into two video signals, namely infrared and visible light, and compressing and encoding the video signals and storing them;

[0018] The sending the target type video source to the smart terminal for display includes:

[0019] If the terminal display mode is infrared mode, the infrared video signal is sent to the smart terminal for display via a wired communication method or a wireless communication method established between the terminal and the smart terminal;

[0020] If the terminal display mode is the visible light mode, the visible light video signal is sent to the smart terminal for display via a wired communication method or a wireless communication method established with the smart terminal.

[0021] In some embodiments, the in-vehicle interactive assisted driving method further includes:

[0022] After establishing a communication connection with the smart terminal, the host end is disguised as a master device and the smart terminal is disguised as a slave device using the fast charging protocol, and the smart terminal is charged according to the charging needs of the smart terminal.

[0023] In some embodiments, the in-vehicle interactive assisted driving method further includes:

[0024] When the GPS signal on the host side does not meet the requirements, determine whether a communication connection is currently established with the smart terminal;

[0025] If so, sending a GPS signal request to the smart terminal, receiving GPS data returned by the smart terminal, and executing a speed warning mechanism based on the GPS information;

[0026] If not, or the GPS signal of the smart terminal is invalid, the speed warning mechanism is turned off.

[0027] In some embodiments, determining the local display mode of the host includes:

[0028] Determining a local display mode based on a default setting of the host side; and / or determining the local display mode through adaptive adjustment based on real-time light intensity information and image information; and / or determining the local display mode based on a mode selection operation on the host side; wherein the local display mode is an infrared mode, a visible light mode, or an analog display mode;

[0029] Determining the terminal display mode of the smart terminal includes:

[0030] The terminal display mode is determined according to the default settings of the smart terminal; and / or, the terminal display mode is determined through adaptive adjustment according to real-time light intensity information and image information; and / or, the terminal display mode is determined according to the mode selection operation of the smart terminal; wherein, the terminal display mode is an infrared mode or a visible light mode.

[0031] In some embodiments, determining the local display mode of the host includes:

[0032] Keep the local display mode of the host side as analog display mode;

[0033] The determining of the terminal display mode of the smart terminal includes:

[0034] Acquire real-time light intensity information, and determine whether sufficient light conditions are met based on whether the light intensity information is greater than a threshold;

[0035] If the conditions are met, determining the size of the variance of the infrared image data and the variance of the Y component of the visible light image data;

[0036] If the variance of the infrared image data is less than the Y component variance of the visible light image data, determining that the terminal display mode of the smart terminal is the visible light mode;

[0037] If not, or if the variance of the infrared image data is not less than the Y component variance of the visible light image data, then the terminal display mode of the smart terminal is determined to be the infrared mode.

[0038] In some embodiments, the in-vehicle interactive assisted driving method further includes:

[0039] Performing image analysis based on the bi-optical image data and determining that a risk warning event exists, issuing an alarm prompt message; wherein the alarm prompt message includes: issuing an alarm prompt sound, displaying a corresponding simulated risk event image according to the risk warning event on a display interface of the host side; and / or,

[0040] After establishing a communication connection with the smart terminal, receiving an upgrade data packet sent by the smart terminal after the upgrade prompt, and completing the firmware upgrade based on the upgrade data packet; and / or,

[0041] Receive the shooting instruction sent by the smart terminal, shoot an image or record a video of a set length through the vehicle-mounted camera according to the shooting instruction, and send the image or video to the smart terminal for real-time display.

[0042] In a second aspect, an embodiment of the present application provides an in-vehicle electronic device, comprising a host, the host comprising a processor, a memory connected to the processor, and a computer program stored in the memory and executable by the processor; when the computer program is executed by the processor, the in-vehicle interactive assisted driving method as described in any embodiment of the present application is implemented.

[0043] In some embodiments, the host is installed in a vehicle, and the on-board electronic device also includes a vehicle-mounted camera communicatively connected to the host, and the on-board camera is installed outside the vehicle for collecting bi-optical image data in real time and sending it to the host; the housing of the host is provided with a mounting structure for installing the smart terminal, or the housing of the host is provided with a clamping structure for clamping and fixing the smart terminal.

[0044] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by the processor, the vehicle-mounted interactive assisted driving method as described in any embodiment of the present application is implemented.

[0045] In a fourth aspect, an embodiment of the present application provides an in-vehicle electronic device, comprising a host body and a mounting position provided on the host body for placing a smart terminal device;

[0046] The host body includes a controller connected to the vehicle camera, a display screen and a charging module. The display screen is provided on one side of the host body. The controller controls the display screen to display the vehicle image formed by the image data collected by the vehicle camera.

[0047] The host body is communicatively connected with the smart terminal device to perform data transmission with the smart terminal device, and the vehicle-mounted image is displayed through the smart terminal device. The controller controls the charging module to charge the smart terminal device according to the charging demand of the smart terminal device.

[0048] The vehicle-mounted camera is a vehicle-mounted dual-light camera equipped with a dual-light movement, and the controller is communicatively connected to the vehicle-mounted dual-light camera. The controller forms different types of vehicle-mounted images according to the visible light image data and infrared image data collected by the vehicle-mounted dual-light camera, and the types of the vehicle-mounted images include at least: infrared vehicle-mounted images and visible light vehicle-mounted images; the display screen on the host body displays the vehicle-mounted image in a first target type, and the smart terminal device displays the vehicle-mounted image in a second target type, and the first target type and the second target type are the same or different.

[0049] In some embodiments, a circuit board is installed in the host body, the controller and the charging module are both arranged on the circuit board, and the circuit board is connected to an on-board power module so as to be powered by the on-board power module;

[0050] The charging module is a wireless charging module, which includes a wireless transmitting module arranged on the circuit board for cooperating with the wireless receiving module in the smart terminal device. When the smart terminal device is placed in the installation position, the smart terminal device realizes wireless charging through the wireless transmitting module and the wireless receiving module; or, the charging module is a wired charging module, which includes a charging interface arranged on the shell of the host body for connecting to the smart terminal device, the charging interface is for the smart terminal device to be connected to it via a data cable, and the charging module realizes wired charging to the smart terminal device through the charging interface.

[0051] In some embodiments, a bracket for placing the smart terminal device is provided on the host body, and a magnetic component is provided on the bracket to provide a magnetic force to adsorb the smart terminal device and place it on the bracket.

[0052] In some embodiments, the charging module is a wireless charging module, which includes a transmitting coil arranged in the bracket, and is used to achieve radio connection with a receiving coil in the smart terminal device to achieve wireless charging of the smart terminal device.

[0053] In some embodiments, the bracket is rotatably connected to the host body via a rotating member, and a wire groove is provided in the rotating member for passing a wire connecting the transmitting coil and a controller provided on the host body through the wire groove.

[0054] In some embodiments, the bracket component rotates relative to the host body to form a bracket state and a storage state; when the bracket component rotates relative to the host body to form the bracket state, the bracket component and the host body together form the installation position for placing the smart terminal device; when the bracket component rotates relative to the host body to form the storage state, the bracket component is folded and stored on the host body.

[0055] In some embodiments, a voice module is further provided in the host body, and the voice module is connected to the controller for outputting an alarm signal.

[0056] In some embodiments, the host body is further provided with a GPS positioning module, and the GPS positioning module is used to obtain the real-time speed and / or position information of the vehicle and send it to the controller.

[0057] In some embodiments, the host body and the vehicle-mounted camera are connected to each other using a GMSL interface and a coaxial cable. Beneficial effects

[0058] The in-vehicle interactive assisted driving method provided by the above embodiment is that the host side establishes a communication connection with the smart terminal and interacts with data, so that the local display interface of the host side and the terminal display interface of the smart terminal can synchronously display the dual-light image data collected in the current vehicle driving scene in the same or different types. Therefore, thanks to the development and popularization of various portable smart terminals, the display of in-vehicle video is no longer limited to relying on the display function of the host side of the in-vehicle electronic equipment itself, but utilizes the interconnection between the host side and the smart terminal, and with the help of interactive auxiliary control between the host and the smart terminal, the smart terminal and the host side jointly provide a dual-screen display, which can display the video data source adapted to the scene in real time according to the scene conditions, thereby facilitating the driver's observation, thereby improving driving safety, and greatly improving the convenience and practicality of the host side.

[0059] In the above embodiments, the vehicle-mounted electronic equipment and computer-readable storage medium belong to the same concept as the corresponding vehicle-mounted interactive assisted driving method embodiments, and thus have the same technical effects as the corresponding vehicle-mounted interactive assisted driving method embodiments, and will not be repeated here.

[0060] Furthermore, in the in-vehicle electronic device, the host body can display the in-vehicle image formed by the image data collected by the in-vehicle camera on the local display screen while sending the in-vehicle image to the smart terminal in real time for display. The host body and the smart terminal can respectively display the in-vehicle image of the same or different target types. In this way, thanks to the development and popularization of various portable smart terminals, the display of in-vehicle video is no longer limited to relying on the display function of the host body of the in-vehicle electronic device itself. Instead, the host body and the smart terminal can use data exchanged between the host body and the smart terminal to provide dual-screen display, supporting the in-vehicle electronic device to display the video data source adapted to the scene in real time according to the scene conditions. For example, the dual-screen display of the host body and the smart terminal is supported to expand the use of infrared and visible light images for in-vehicle assisted driving, thereby facilitating the driver's observation, thereby improving driving safety, and greatly improving the convenience and practicality of the host side. In addition, a charging module is integrated in the host body. The charging module compensates the smart terminal for power according to the charging needs of the smart terminal during the process of data exchange between the smart terminal and the host body to expand the display of the in-vehicle image, thereby improving the battery life of the smart terminal and enhancing the practicality of the in-vehicle electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0062] FIG1 is a schematic diagram of an application scenario of an in-vehicle interactive assisted driving method according to an embodiment;

[0063] FIG2 is a flow chart of an in-vehicle interactive assisted driving method according to an embodiment;

[0064] FIG3 is a schematic diagram showing the principle of forming dual-light image data in a picture-in-picture mode using infrared and visible light images in an optional example;

[0065] FIG4 is a schematic diagram showing the principle of forming dual-light image data in a picture-in-picture mode using infrared and visible light images in another optional example;

[0066] FIG5 is a flowchart of an optional example in which a host obtains a GPS signal;

[0067] FIG6 is a schematic diagram of a local display mode in an optional example;

[0068] FIG7 is a schematic diagram of a terminal display mode in an optional example;

[0069] FIG8 is a flowchart of an optional example in which the host determines the local display mode and the terminal display mode through adaptive adjustment;

[0070] FIG9 is a system architecture diagram of an in-vehicle interactive assisted driving method in an optional example;

[0071] FIG10 is a flow chart of an in-vehicle interactive assisted driving method in an optional example;

[0072] FIG11 is a schematic structural diagram of an on-vehicle electronic device according to an embodiment;

[0073] FIG12 is a schematic diagram of the overall structure of a vehicle-mounted auxiliary driving device in one embodiment;

[0074] FIG13 is a schematic diagram of the functional modules of a vehicle-mounted driver assistance system according to an embodiment;

[0075] FIG14 is a schematic diagram of an exploded structure in which a transmitting coil is mounted on a bracket according to an embodiment;

[0076] FIG15 is a schematic diagram of the wireless charging principle of a vehicle-mounted driver assistance device according to an embodiment;

[0077] FIG16 is a schematic diagram of the overall structure of the vehicle-mounted auxiliary driving device in the stowed state according to one embodiment;

[0078] FIG17 is a side view of the intelligent terminal device placed on the vehicle-mounted assisted driving instrument;

[0079] FIG18 is a front view of the intelligent terminal device placed on the vehicle-mounted assisted driving instrument;

[0080] FIG19 is a schematic diagram of the exploded structure of the vehicle-mounted assisted driving device;

[0081] FIG20 is a schematic cross-sectional view of the structure of FIG16;

[0082] FIG21 is another cross-sectional structural schematic diagram of FIG16.

[0083] Description of Figure Numbers:

[0084] 1. Host body; 11. Controller; 111. Display screen; 112. Communication module; 113. Charging module; 1131. Transmitting coil; 114. Voice module; 115. GPS positioning module; 116. Decoder; 117. Processor; 118. Memory; 12. Upper housing; 121. Accommodating space; 122. Blocking surface; 123. Mounting surface; 13. Lower housing; 14. First PCB board; 141. First interface; 142. Second interface; 15. Second PCB board; 151. Data storage card slot; 16. First support plate; 17. Second support plate; 18. Fixed side panel; 19. Rubber pad; 2. Bracket; 21. Magnetic member; 22. Upper housing; 23. Lower housing; 3. Rotating member; 31. Rotating arm; 32. Center axis; 33. Fixed seat. Modes for Carrying Out the Invention

[0085] The technical solution of this application is further elaborated in detail below with reference to the accompanying drawings and specific embodiments.

[0086] In order to make the purpose, technical solutions and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limiting this application. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0087] In the following description, the expression "some embodiments" is involved, which describes a subset of all possible embodiments. It should be noted that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.

[0088] In the following description, the terms "first, second, and third" are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first, second, and third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0089] Please refer to FIG1 , which is a schematic diagram of an optional application scenario of the in-vehicle interactive assisted driving method provided in an embodiment of the present application. In the diagram, an in-vehicle electronic device 10 includes a host 12 disposed within the vehicle and an in-vehicle camera 11 mounted outside the vehicle. The host 12 is in communication with the in-vehicle camera 11. The in-vehicle camera 11 is configured to collect bi-optical image data corresponding to the driving scene in real time while the vehicle is in motion, and transmit the data to the host 12. The host 12 is provided with a display screen and is capable of establishing a communication connection with a smart terminal 30. When the driver uses the vehicle-mounted electronic device 10 for assisted driving, the smart terminal 30 used daily can be connected to the host 12 for communication. The host 12 receives and processes the dual-light image data from the vehicle-mounted camera 11, and divides it into two video signals, infrared and visible light. It also supports the driver user to display the infrared vehicle-mounted video or the visible light vehicle-mounted video respectively through the local display interface of the host 12 and the terminal display interface of the smart terminal 30 according to his own viewing needs for infrared vehicle-mounted video or visible light vehicle-mounted video, so that the driver can use the smart terminal 30 used daily to cooperate with the host 12 to display different types of vehicle-mounted videos, so that infrared and visible light images can be conveniently used in vehicle-mounted assisted driving at the same time when the user needs, thereby improving driving safety performance.

[0090] Please refer to FIG2 , which shows an in-vehicle interactive assisted driving method provided in one embodiment of the present application. The in-vehicle interactive assisted driving method can be applied to the host of the in-vehicle electronic device in the application scenario shown in FIG1 . The in-vehicle interactive assisted driving method includes the following steps:

[0091] S101, obtaining bi-optical image data collected by a vehicle-mounted camera; wherein the bi-optical image data includes infrared image data and visible light image data.

[0092] The onboard camera is mounted outside the vehicle and collects real-time image data of the driving scene while the vehicle is in motion and transmits it to the host computer. The onboard camera uses a dual-light camera, which combines a visible light camera with an infrared camera. This allows the camera to simultaneously collect visible light and infrared image data corresponding to the driving scene while the vehicle is in motion.

[0093] S103 , determining a local display mode of the host side, and displaying a target type of vehicle-mounted video corresponding to the local display mode in a display interface of the host side based on the bi-optical image data.

[0094] The host is provided with a display screen. The local display mode refers to the mode in which the host displays the in-vehicle video through its own display screen. The local display mode can be pre-set, and different local display modes correspond to different types of in-vehicle videos displayed in the display interface. The optional range of in-vehicle video types is determined by the in-vehicle video types that can be obtained by a single or combined image data based on light images of different wavelengths collected by the in-vehicle camera. Taking the dual-light image data including infrared image data and visible light image data as an example, the local display mode of the host includes a visible light display mode for displaying visible light in-vehicle video, an infrared mode for displaying infrared in-vehicle video, and a simulation display mode for displaying a virtual simulated in-vehicle video simulated by the Advanced Driver Assistance System (ADAS) based on the image data of the current driving scene. The target type in-vehicle video can refer to one of visible light in-vehicle video, infrared in-vehicle video, and virtual simulated in-vehicle video.

[0095] S105 , after establishing a communication connection with the smart terminal, determining a terminal display mode of the smart terminal, obtaining a target type video source corresponding to the terminal display mode based on the bi-optical image data, and sending the target type video source to the smart terminal for display.

[0096] Smart terminals generally refer to various portable smart devices that are easy for users to carry around, such as smartphones and tablets. Terminal display mode refers to the mode in which the display screen of the smart terminal displays the in-vehicle video. The terminal display mode can be pre-set. Different terminal display modes correspond to different types of in-vehicle videos displayed in the display interface of the smart terminal. Taking the dual-light image data including infrared image data and visible light image data as an example, the terminal display mode of the smart terminal includes a visible light display mode for displaying visible light in-vehicle video and an infrared mode for displaying infrared in-vehicle video. The target type video source refers to the infrared video signal or the visible light video signal, respectively. Before preparing to drive the vehicle, the user can connect the smart terminal he carries with the host to communicate. After obtaining the dual-light image data collected by the on-board camera, the host processes the dual-light image data, and displays the target type of on-board video corresponding to the local display mode in the local display interface. At the same time, the target type video source corresponding to the terminal display mode is sent to the smart terminal for display. In this way, the user can set the dual-screen display of the host and the smart terminal according to the viewing needs of the on-board video, so that when driving in various weather conditions such as night, backlight, heavy fog, rain and snow, etc., the user can obtain image data that can clearly display the current driving scene.

[0097] The in-vehicle interactive assisted driving method provided by the above embodiment is that the host side establishes a communication connection with the smart terminal and interacts with data, so that the local display interface of the host side and the terminal display interface of the smart terminal can synchronously display the dual-light image data collected in the current vehicle driving scene in the same or different types. Therefore, thanks to the development and popularization of various portable smart terminals, the display of in-vehicle video is no longer limited to relying on the display function of the host side of the in-vehicle electronic equipment itself, but utilizes the interconnection between the host side and the smart terminal, and with the help of interactive auxiliary control between the host and the smart terminal, the smart terminal and the host side jointly provide a dual-screen display, which can display the video data source adapted to the scene in real time according to the scene conditions, thereby facilitating the driver's observation, thereby improving driving safety, and greatly improving the convenience and practicality of the host side. Among them, the technical idea of ​​interactive auxiliary control between the host and the smart terminal breaks the conventional technical idea in the field of driving technology that mainly connects the smart terminal to utilize the independent additional functions provided by the smart terminal. The host can use the smart terminal as a component for its function expansion to optimize the assisted driving functions provided, and make full use of the intelligence and screen display of the smart terminal to form an overall vehicle-mounted system with expandable functions with the host. For example, when infrared and visible light images are required to be used in vehicle-mounted assisted driving at the same time, the smart terminal and the host can jointly form a dual-screen display overall vehicle-mounted system through interactive auxiliary control to display infrared vehicle-mounted video and visible light vehicle-mounted video respectively. In this way, the assisted driving function of the host can achieve more powerful auxiliary functions with the help of mobile phone access.

[0098] In some embodiments, step S101, obtaining bi-optical image data collected by a vehicle-mounted camera, includes:

[0099] selecting, according to the size of the infrared image data, an idle image area of ​​the same size as the visible light image data as a target area, and superimposing the infrared image data onto the target area of ​​the visible light image data to form dual-light image data in a picture-in-picture mode;

[0100] The bi-optical image data is acquired from a vehicle-mounted camera.

[0101] The infrared detector resolution corresponding to infrared image data is often lower than that of visible light image data. Furthermore, in the field of assisted driving, the upper portion of the image data of a driving scene often contains a sky image region with little effective information. This sky image region with little effective information in the visible light image data is considered an idle image region. Based on the size of the infrared image data, an idle image region of the same size is selected in the visible light image data as the target region. The infrared image data is then superimposed on the target region of the visible light image data, thus combining the infrared and visible light image data to form dual-light image data in a picture-in-picture mode.

[0102] In the above embodiment, by forming the infrared image data and visible light image data collected by the vehicle-mounted camera into dual-light image data in a picture-in-picture mode, the host side and the vehicle-mounted camera transmit the dual-light image data in the picture-in-picture mode, which is conducive to simplifying the hardware and cable layout of the host and improving transmission efficiency. For example, the host and the vehicle-mounted camera can be connected via a coaxial cable and the dual-light image data can be obtained by transmitting using the GMSL interface (Gigabit Multimedia Serial Links). In an optional example, the hardware architecture and cable connection method between the host and the vehicle-mounted camera can be the same as the conventional setting method of only setting a visible light camera to collect visible light image data in the currently known field of vehicle-mounted assisted driving. The installation position, installation method, and connection between the original vehicle-mounted camera and the vehicle-mounted assisted driving device can be retained. Only the vehicle-mounted camera and the host need to be upgraded and replaced accordingly, thereby facilitating users to upgrade on the original vehicle, which is conducive to the promotion and application of the vehicle-mounted interactive assisted driving method.

[0103] In some embodiments, selecting an idle image area of ​​the same size as the target area in the visible light image data according to the size of the infrared image data includes:

[0104] According to the size of the infrared image data, the imaging area of ​​the sky part in the corresponding driving scene in the visible light image data is used as the idle image area, and an area with the same size as the infrared image data is selected as the target area, or multiple areas with the same size as the infrared image data after addition are selected as the target area.

[0105] Infrared image data and visible light image data are combined to form dual-light image data in a picture-in-picture mode. Depending on the size of the infrared image data, the infrared image data can be overlaid entirely or in blocks onto the visible light image data. The sky imaging region in the visible light image data is typically a narrow, long rectangle. The infrared detector resolutions corresponding to the infrared image data are primarily available in two sizes: 256×192 and 640×512. The detector resolution for visible light image data is primarily 1920×1080. As shown in Figure 3, for a 256×192 infrared image, a 256×192 target region can be directly selected from the upper half of the visible light image data and the infrared image data can be directly overlaid onto the target region of the visible light image data. For a 640×512 infrared image, the infrared image is divided into rows and blocks, and multiple regions corresponding to the infrared image blocks are selected from the upper half of the visible light image data and overlaid onto the multiple regions corresponding to the visible light image data.

[0106] In some embodiments, step S101, obtaining bi-optical image data collected by a vehicle-mounted camera, further includes:

[0107] Processing the dual-light image data in the picture-in-picture mode to separate the data into two video signals, namely infrared and visible light, and compressing and encoding the video signals and storing them;

[0108] The sending the target type video source to the smart terminal for display includes:

[0109] If the terminal display mode is infrared mode, the infrared video signal is sent to the smart terminal for display via a wired communication method or a wireless communication method established between the terminal and the smart terminal;

[0110] If the terminal display mode is the visible light mode, the visible light video signal is sent to the smart terminal for display via a wired communication method or a wireless communication method established with the smart terminal.

[0111] The onboard camera captures infrared and visible light image data of the vehicle's driving scene in real time, generating a dual-light video stream for picture-in-picture mode and sending it to the host. The host processes the received video stream, separating the picture-in-picture mode into two video signals: infrared and visible light. The host compresses and encodes the video signal and stores it. Specifically, this may involve encoding the video signal using H.264 and automatically looping the video data onto a memory card, with the video segments lasting a preset duration, such as 5 minutes. The host then sends the target video source to the smart terminal based on the terminal's current display mode. For example, if the smart terminal's display mode is infrared, the host only sends the infrared video signal for display. If the smart terminal's display mode is visible light, the host only sends the visible light video signal for display. This improves data transmission efficiency between the host and the smart terminal and reduces the need for the smart terminal to process the image data received from the host.

[0112] In some embodiments, the in-vehicle interactive assisted driving method further includes:

[0113] After establishing a communication connection with the smart terminal, the host end is disguised as a master device and the smart terminal is disguised as a slave device using the fast charging protocol, and the smart terminal is charged according to the charging needs of the smart terminal.

[0114] Under different circumstances, users may need to drive the vehicle for a long cumulative time in a day, and the video display of the smart terminal is often power-consuming. Therefore, the battery life of the smart terminal will directly affect the usage time of the in-vehicle interactive assisted driving function. A communication connection is established between the smart terminal and the host. By default, the smart terminal is the master device and the host is the slave device. The data interaction between the master device and the slave device is that the smart terminal obtains video data from the host. In order to solve the battery life and charging problem of the smart terminal, the host is provided with a fast charging protocol chip, and the fast charging protocol is used to disguise the identities of the host and the smart terminal. For example, the fast charging protocol can modify the identity information of the identity identification ports at both ends of the charging data cable in the connection interface between the host and the smart terminal, disguise the host as the master device, and disguise the smart terminal as the slave device. In this way, while the host maintains data interaction with the smart terminal, the host starts the charging function of the smart terminal. Solving the battery life problem of the smart device will improve the practicality of the in-vehicle interactive assisted driving method.

[0115] In an optional example, a wired communication connection is established between the host and the smart terminal through the data cable of the type-C interface, and the smart terminal acts as the master device to communicate normally with the host for video data; the host modifies the master and slave device identities represented by the ID pins in the type-C interface through the fast charging protocol chip, inducing the host to be the master device and the smart terminal to be the slave device, and the host automatically charges the smart terminal through the type-C interface without affecting the data interaction communication.

[0116] In some embodiments, the in-vehicle interactive assisted driving method further includes:

[0117] When the GPS signal on the host side does not meet the requirements, determine whether a communication connection is currently established with the smart terminal;

[0118] If so, sending a GPS signal request to the smart terminal, receiving GPS data returned by the smart terminal, and executing a speed warning mechanism based on the GPS information;

[0119] If not, or the GPS signal of the smart terminal is invalid, the speed warning mechanism is turned off.

[0120] During driving, vehicles may encounter complex road sections such as tunnels and overpasses where GPS signals cannot be accurately obtained. Speed ​​warning mechanisms during driving require the activation of various alarms, such as FCW (Forward Collision Warning), LDW (Lane Departure Warning), PCW (Pedestrian Collision Warning), and Pre-Start Warning, based on speed conditions. In the absence of speed, false alarms can be easily triggered, potentially impacting driver safety. However, smart terminals are widely equipped with GPS modules, and the communication networks they use have multiple base stations, allowing them to consistently obtain valid GPS signals.

[0121] In one example, see FIG5 , which shows a process for a host terminal to obtain a GPS signal, using a mobile phone as an example, including:

[0122] S11, the host determines whether its own GPS signal is valid; if not, execute S12; if valid, execute S19.

[0123] S12, determine whether the host is connected to the mobile phone; if connected, execute S13; if not connected, execute S18.

[0124] S13, the host sends a request to obtain the mobile phone GPS signal through the UVC protocol; the UVC (USB Video Class) protocol refers to a protocol standard defined for USB-based video transmission.

[0125] S14, after receiving the GPS signal request, the mobile phone parses the GPS signal request and accesses the mobile phone GPS signal.

[0126] S15, determine whether the mobile phone GPS signal is valid, if valid, execute S16.

[0127] S16, transmit the GPS data back to the host side via UVC; wherein, the GPS data includes GPS latitude and longitude, speed, time, altitude and other information; if invalid, return the request failure information to the host side, and after receiving the request failure information, execute S18.

[0128] S17, the host receives the GPS data returned by the mobile phone, uses the GPS data to judge the speed, and uses the speed information to maintain the execution of the speed warning mechanism.

[0129] S18, exit the current process and turn off the speed warning mechanism.

[0130] S19, using its own GPS data to judge the speed, and using the speed information to maintain the execution of the speed warning mechanism.

[0131] In this embodiment, the host side will determine in real time whether a valid GPS signal is obtained. If the current GPS signal does not meet the requirements, it will determine whether a communication connection has been established with the smart terminal and request a GPS signal from the smart terminal. Based on whether the smart terminal can provide a valid GPS signal, it will determine whether to maintain the execution of the speed warning mechanism or turn off the speed warning mechanism. When the host's own GPS signal does not meet the requirements, obtaining a GPS signal from the smart terminal for speed warning is beneficial to reduce false alarms.

[0132] In some embodiments, determining the local display mode of the host includes:

[0133] Determining a local display mode based on a default setting of the host side; and / or determining the local display mode through adaptive adjustment based on real-time light intensity information and image information; and / or determining the local display mode based on a mode selection operation on the host side; wherein the local display mode is an infrared mode, a visible light mode, or an analog display mode;

[0134] Determining the terminal display mode of the smart terminal includes:

[0135] The terminal display mode is determined according to the default settings of the smart terminal; and / or, the terminal display mode is determined through adaptive adjustment according to real-time light intensity information and image information; and / or, the terminal display mode is determined according to the mode selection operation of the smart terminal; wherein, the terminal display mode is an infrared mode or a visible light mode.

[0136] The mode in which the host displays the in-vehicle video and the mode in which the smart terminal displays the in-vehicle video can be determined in different ways, that is, determining the local display mode of the host side and the terminal display mode of the smart terminal may include multiple situations: one is determined according to the default settings, the default settings are usually the infrared mode of the host side and the visible light mode of the smart terminal; the second is determined by adaptive adjustment, adaptive adjustment usually means that the host can intelligently determine the local display mode and the terminal display mode based on real-time light intensity information and image information; the third is determined according to the user's manual selection of the mode, such as the user can select the local display mode of the host side and the terminal display mode of the smart terminal respectively through the mode selection button provided in the display interface.

[0137] Please refer to Table 1 below, as well as Figures 6 and 7, for optional combinations of local display mode and terminal display mode:

[0138] Table 1

[0139] It should be noted that when determining the local display mode of the host side and the terminal display mode of the smart terminal, the above situations can all be included. The mode selection operation usually has the highest priority. When the user has not turned on adaptive adjustment, the host determines the current local display mode of the host side and the current terminal display mode of the smart terminal according to the default settings, and when receiving the user's mode selection operation, the user operation shall prevail; when the user turns on adaptive adjustment, the host determines the current local display mode of the host side and the current terminal display mode of the smart terminal according to the adaptive adjustment method, and when receiving the user's mode selection operation, the user operation shall prevail.

[0140] In some embodiments, determining the local display mode of the host includes:

[0141] Keep the local display mode of the host side as analog display mode;

[0142] The determining of the terminal display mode of the smart terminal includes:

[0143] Acquire real-time light intensity information, and determine whether sufficient light conditions are met based on whether the light intensity information is greater than a threshold;

[0144] If the conditions are met, determining the size of the variance of the infrared image data and the variance of the Y component of the visible light image data;

[0145] If the variance of the infrared image data is less than the Y component variance of the visible light image data, determining that the terminal display mode of the smart terminal is the visible light mode;

[0146] If not, or if the variance of the infrared image data is not less than the Y component variance of the visible light image data, then the terminal display mode of the smart terminal is determined to be the infrared mode.

[0147] This embodiment provides an optional example of automatic mode selection through adaptive adjustment to display corresponding display content on the display interface of the host end and the display interface of the smart terminal, respectively. Please refer to Table 2 below and Figure 8.

[0148] Table 2:

[0149] The process of determining the local display mode and the terminal display mode through adaptive adjustment includes:

[0150] S21, obtain light sensor data; set a threshold T based on the light sensor data, and judge whether the light is strong or weak based on the threshold. If it is greater than the threshold, it is considered that there is sufficient light, and if it is less than the threshold, it is considered that the light is dark.

[0151] S22, counting the variance var1 of the infrared image, and counting the variance var2 of the Y component of the visible light image; var1 and var2 are used as the image information amount for judgment.

[0152] S23, determine whether the light sensor data is greater than a threshold T; if not, execute S25; if so, execute S24.

[0153] S24, determining whether the infrared image variance var1 is greater than the visible light image Y component variance var2; if so, executing S25; if not, executing S26.

[0154] S25, the local display mode of the host side is the analog display mode, and the terminal display mode of the smart terminal is the infrared mode.

[0155] S26, the local display mode of the host side is the analog display mode, and the terminal display mode of the smart terminal is the visible light mode.

[0156] The host can be equipped with a light sensor to obtain real-time information about the current light intensity. This sensor, combined with a comparison of the image information contained in the infrared and visible light images collected in real-time, can be used to determine the video display mode for both the host and the smart terminal. Furthermore, when a user manually switches the video display mode of the host or smart terminal, the switch is executed based on the user's manual selection, with the selection taking precedence.

[0157] In some embodiments, the in-vehicle interactive assisted driving method further includes:

[0158] Performing image analysis based on the bi-optical image data and determining that a risk warning event exists, issuing an alarm prompt message; wherein the alarm prompt message includes: issuing an alarm prompt sound, displaying a corresponding simulated risk event image according to the risk warning event on a display interface of the host side; and / or,

[0159] After establishing a communication connection with the smart terminal, receiving an upgrade data packet sent by the smart terminal after the upgrade prompt, and completing the firmware upgrade based on the upgrade data packet; and / or,

[0160] Receive the shooting instruction sent by the smart terminal, shoot an image or record a video of a set length through the vehicle-mounted camera according to the shooting instruction, and send the image or video to the smart terminal for real-time display.

[0161] The host computer analyzes bi-optical image data captured in real time by the vehicle's onboard camera to identify risk warning events. It then generates a corresponding simulated risk event image based on the currently identified risk warning event and displays it on the host's display interface, thereby providing a better risk warning. The host computer can simulate the corresponding simulated risk event image based on the image data of the current driving scene and the type of risk warning event identified. For example, if the risk warning event is a possible front-end collision, the distance and speed between the current vehicle and the preceding vehicle can be determined based on image data analysis to predict a collision scenario. The ADAS simulates and generates an image of the collision scenario and displays it on the host's display interface to provide a risk warning. This helps the user understand the potential risk and take measures to mitigate it, such as slowing down or adjusting driving direction. Optionally, the smart terminal can automatically download an upgrade package via an application program (APP) upon detecting a software upgrade. When a software version upgrade is detected, the APP receives an upgrade notification, and the user can confirm the upgrade. Upon confirmation, the smart terminal downloads the upgrade package and sends it to the host computer. The host computer can store the upgrade package on a memory card, completing the software upgrade using the upgrade package stored on the memory card. Optionally, the host also supports users to receive various operating instructions by operating a smart terminal. For example, users can use the smart terminal to control the host to perform shooting instructions such as instant photography and recording of multispectral real-time video of a certain length. After receiving the user's instant shooting instruction, the host can interrupt the current regular acquisition and display of bi-optical image data, perform the corresponding photography or recording according to the shooting instruction, and then send the data to the smart terminal in real time for the user to review and view at any time. After completing the task of the shooting instruction started by the user, it can automatically return to the regular bi-optical image data acquisition and display process. Among them, the host also supports users to receive various operating instructions by operating a smart terminal, including receiving host configuration parameters obtained by the user configuring the host's operating parameters through the smart terminal.

[0162] In the above embodiments, by utilizing the interactive communication between the host and the smart device, the driving recording function can be conveniently realized through the host, the device parameter calibration and parameter setting functions of the host can be performed through the smart terminal, and the software upgrade function can be conveniently completed through the smart terminal, etc., which greatly improves the personalized experience and convenience of users.

[0163] In order to have a more holistic understanding of the in-vehicle interactive assisted driving method provided in the embodiment of the present application, please refer to Figures 9 and 10. Taking the smart terminal as a mobile phone and the in-vehicle camera as a dual-light camera as an example, the implementation end of the in-vehicle interactive assisted driving method includes a dual-light camera end, a host end and a mobile phone end. Among them, the dual-light camera end is connected to the host end through the GMSL port to communicate with the host end and send visible light and infrared image data to the host end. The host end includes an SD memory card, a light sensor, a GPS module, a fast charging protocol chip and a touch screen module. While the host end transmits the in-vehicle video data to the mobile phone end through the UVC protocol, it uses the fast charging protocol chip to realize automatic charging of the mobile phone. The in-vehicle interactive assisted driving method includes:

[0164] S31, obtains dual-light image data through the vehicle-mounted camera and transmits it to the host; wherein dual-light refers to infrared and visible light, and the vehicle-mounted camera and the host transmit the infrared and visible light image data to the host in picture-in-picture mode through the coaxial cable and GMSL interface.

[0165] In step S32, the host processes the video stream of the dual-light image data received from the vehicle-mounted camera, divides it into two video signals, infrared and visible light, and stores the video signals on the memory card. The host compresses and encodes the video signal using H.264 and automatically stores the video data on the SD card in a loop, with the video segmented into 5-minute segments.

[0166] S33, the host determines whether a mobile phone is connected. If a mobile phone is connected, the mobile phone is automatically charged.

[0167] S34, the host determines whether a valid GPS signal is obtained. If not, it sends a GPS request to the mobile phone. The mobile phone queries the GPS signal according to the GPS request and sends it to the host.

[0168] S35, the host determines the local display mode of the host side and the terminal display mode of the mobile phone side based on the light intensity information detected by the light sensor and the current infrared image and visible light image variance, and automatically displays the corresponding video source on the display interface of the host side and the display interface of the mobile phone side respectively.

[0169] S36, if the user manually switches the display mode through the mobile phone, the display mode is switched according to the display mode selected by the user, and the host sends the corresponding type of video signal to the mobile phone for display according to the user's selection.

[0170] S37, if the user manually switches the display mode of the host side, the display mode is switched according to the display mode selected by the user, and the host side displays the corresponding video source according to the user's selection.

[0171] S38, when the host detects a risk warning event, the alarm function includes issuing an alarm sound through the audio chip, and the alarm display includes generating a corresponding risk event simulation image through ADAS simulation and displaying it on the display interface of the host.

[0172] S39, after detecting the software upgrade prompt, the mobile phone downloads the upgrade data package and sends it to the host side, and upgrades the host software through the mobile phone.

[0173] S40, the mobile phone can conveniently obtain the image data sent by the host side for storage and processing.

[0174] In the above embodiment, interactive data communication between the host and the mobile phone supports UVC video transmission. This allows real-time transmission of perceived dual-light video data to the user's mobile phone for display on the phone's screen, and simultaneously on the host's own display screen, satisfying both the user's need for a small-screen interface and the need for large-screen video on the mobile phone. The host can intelligently determine environmental conditions (daytime, nighttime, and weather conditions with obstructed visibility) to automatically switch display modes, or the user can select the display mode. When the host itself lacks GPS signal, it acquires the mobile phone's GPS signal and transmits it to the host. The host's assisted driving function can use the phone's GPS signal to determine vehicle speed and activate warning functions such as FCW, PCW, LDWD, and preceding vehicle start. The host can charge the mobile phone without affecting data communication or auxiliary control interaction, providing timely battery replenishment for the user's mobile phone. For video stream transmission between the host and the vehicle's camera, infrared and visible light support customizable picture-in-picture mode for transmission from the vehicle camera to the host, simplifying host hardware and device cabling and improving transmission efficiency.

[0175] On the other hand, the present application provides a vehicle-mounted electronic device. Please refer to Figure 11, which is an optional hardware structure diagram of the vehicle-mounted electronic device provided in an embodiment of the present application. The vehicle-mounted electronic device includes a host, and the host includes a processor 117, a memory 118 connected to the processor 117, and a computer program stored in the memory 118 and executable by the processor; when the computer program is executed by the processor 117, the vehicle-mounted interactive assisted driving method provided in each embodiment of the present application is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0176] Wherein, the host is installed in the vehicle, and the on-board electronic device also includes an on-board camera communicatively connected to the host, and the on-board camera is installed outside the vehicle for collecting dual-light image data in real time and sending it to the host. Optionally, the housing of the host is provided with a mounting structure for mounting the smart terminal, or the housing of the host is provided with a clamping structure for clamping and fixing the smart terminal. The smart terminal can be stably mounted on the host through the mounting structure or the clamping structure on the host. When the smart terminal is mounted on the host, it can provide an angle that is convenient for the user to observe, and increase the stability of the mobile phone placement, which can enhance the user's driving experience of watching infrared on-board videos and visible light on-board videos on dual screens in the on-board interactive assisted driving function.

[0177] It should be noted that, referring to Figures 12 to 21 , an optional specific application example of the in-vehicle electronic device may be an in-vehicle assisted driving system. It is understood that in the embodiment using the in-vehicle assisted driving system as an application example, the execution functions of the processor 117 of the host in the in-vehicle electronic device may be correspondingly implemented by the controller 11 in the host body 1 of the in-vehicle assisted driving system. For example, the controller 11 in the host body 1 of the in-vehicle assisted driving system may execute a computer program to implement the in-vehicle interactive assisted driving method provided in each embodiment of the present application.

[0178] Please refer to Figures 12-13. An embodiment of the present application provides a vehicle-mounted assisted driving instrument, including a host body 1 and an installation position for placing a smart terminal device set on the host body 1; the host body 1 includes a controller 11 connected to a vehicle-mounted camera, a display screen 111 and a charging module 113. The display screen 111 is arranged on one side of the host body 1. The controller 11 controls the display screen 111 to display the vehicle-mounted image based on the vehicle-mounted image formed by the image data collected by the vehicle-mounted camera.

[0179] The host body 1 is connected to the smart terminal device for communication so as to transmit data between the host body 1 and the smart terminal device, and to display the vehicle-mounted image through the smart terminal device. The controller 11 controls the charging module 113 to charge the smart terminal device according to the charging requirements of the smart terminal device. Among them, a communication module 112 is provided in the host body 1, and the host body 1 and the smart terminal device are connected to each other through the communication module 112. The communication module 112 can be a wired communication module, or the communication module 112 can also be a wireless communication module. It should be noted that in the embodiment of the vehicle-mounted assisted driving instrument as an application example, the host body 1 and the body in each vehicle-mounted electronic device embodiment represent the same object, the smart terminal device and the smart terminal in each vehicle-mounted electronic device embodiment represent the same object, and the vehicle-mounted image and the vehicle-mounted video in each vehicle-mounted electronic device embodiment represent the same object.

[0180] In this embodiment, the host body 1 is communicatively connected to the smart terminal device. The host body 1 transmits data with the smart terminal device, so that the host body 1 can display the vehicle image formed by the image data collected by the vehicle camera on the local display screen 111, and at the same time, send the vehicle image to the smart terminal device in real time for display. In this way, thanks to the development and popularization of various portable smart terminal devices, the display of vehicle video is no longer limited to the display function of the host body 1 itself that relies on the vehicle-mounted assisted driving instrument. Instead, the host body 1 and the smart terminal device use data interaction to provide a dual-screen display, supporting the vehicle-mounted assisted driving instrument to display the video data source adapted to the scene in real time according to the scene conditions. For example, the dual-screen display of the host body 1 and the smart terminal device is supported to expand the use of infrared and visible light images in vehicle-mounted assisted driving, thereby facilitating the driver's observation, thereby improving driving safety, and greatly improving the convenience and practicality of the host side. In addition, a charging module 113 is integrated in the host body 1. The display of the smart terminal device is usually more power-consuming. Through the charging module 113, when the smart terminal device maintains data interaction with the host body 1 to expand the display of the vehicle-mounted image, the smart terminal device is compensated for its power according to the charging needs of the smart terminal device, thereby improving the battery life of the smart terminal device and enhancing the practicality of the vehicle-mounted assisted driving instrument.

[0181] In an optional embodiment, a circuit board is installed in the host body 1, and the controller 11 and the charging module 113 are both arranged on the circuit board. The circuit board is also provided with a power interface, a power module electrically connected to the power interface, and a voltage conversion circuit electrically connected to the power module. The power module supplies power to the circuit board through an external vehicle power module connected to the power interface. The voltage conversion circuit converts the voltage input by the vehicle power module to obtain the working voltage required for the operation of each circuit module on the circuit board.

[0182] The charging module 113 may be a wireless charging module, comprising a wireless transmitter module disposed on a circuit board for cooperating with a wireless receiver module within the smart terminal device. When the smart terminal device is placed in its mounting position, the smart terminal device is wirelessly charged via the wireless transmitter module and the wireless receiver module. When the smart terminal device no longer requires charging, a shutdown command can be entered via an app on the smart terminal device or via a corresponding button on the touchscreen display of the host body 1.

[0183] The charging module 113 can be a wired charging module. The wired charging module includes a charging interface provided on the housing of the host body 1 for connecting to a smart terminal device. The charging interface is connected to the smart terminal device via a data cable. The charging module 113 uses the charging interface to provide wired charging to the smart terminal device. The type of charging interface is not specifically limited and can be a USB interface, a Type-C interface, or a Lightning interface. The charging interface is electrically connected to the voltage conversion circuit on the circuit board. The voltage conversion circuit connects to the smart terminal device through the charging interface to enable wired charging of the smart terminal device.

[0184] In an optional embodiment, a bracket 2 for placing a smart terminal device is provided on the host body 1, and a magnetic member 21 is provided on the bracket 2. The magnetic member 21 provides a magnetic attraction force to attract the smart terminal device and place it on the bracket 2. When the charging module 113 is a wireless charging module, the wireless charging module includes a transmitting coil 1131 provided in the bracket 2. The bracket 2 includes an upper shell 22 and a lower shell 23 that matches the upper shell 22. Please refer to Figure 14. The magnetic member 21 can be provided on the inner surface of the upper shell 22 to improve the aesthetics and compactness of the entire device, or it can be provided on the outer surface of the upper shell 22 to improve the magnetic attraction between the smart terminal device and the bracket 2. The magnetic member 21 can be a magnet. For example, the magnetic member 21 includes four circular magnets distributed at the four corners of the bracket 2, and multiple magnets are provided at intervals on the inner surface of the upper shell 22. The upper shell 22 and the lower shell 23 can be connected by a snap connection or a threaded connection. In this embodiment, the upper shell 22 and lower shell 23 are made of ABS plastic and have a painted and brushed surface to enhance the aesthetics and wear resistance of the bracket 2. The provision of the magnetic element 21 in this embodiment not only improves the installation stability between the smart terminal device and the bracket 2, but also ensures that the smart terminal device is aligned with the transmitting coil 1131 disposed within the bracket 2, thereby ensuring the wireless charging module's charging efficiency for the smart terminal device.

[0185] Furthermore, the wireless charging module includes a transmitting circuit disposed on a circuit board and electrically connected to a voltage conversion circuit, a transmitting coil 1131 disposed within a bracket 2 and electrically connected to the transmitting circuit, and a frequency converter for converting direct current (DC) into alternating current (AC). The transmitting coil 1131 receives the AC power to generate a magnetic field, which is then received by a receiving coil in the smart terminal device. This magnetic field, after being acted upon by a rectifier circuit in the smart terminal device, forms DC power, thereby wirelessly charging the smart terminal device. Specifically, the wireless charging principle is illustrated in FIG15 . First, the on-board power module outputs a 12V voltage to the circuit board at the host body 1. The voltage conversion circuit on the circuit board converts the 12V voltage to 5V and transmits it to the transmitting circuit. The frequency converter in the transmitting circuit converts the 5V DC power into AC power. The transmitting coil 1131 receives the AC power to generate a magnetic field, which is then received by a receiving coil at the smart terminal device. This magnetic field, after being acted upon by a receiving circuit at the smart terminal device, forms DC power, thereby wirelessly charging the smart terminal device. In this embodiment, the transmitting circuit and transmitting coil 1131 are respectively disposed on a circuit board within the host body 1 and within the bracket 2. During wireless charging, the contact surface between the smart device terminal and the bracket 2 is much larger than the contact surface between the smart device terminal and the host body 1. During wireless charging, the circuit board generates heat. By arranging the smart terminal device to be supported and positioned by the bracket 2 and arranging the transmitting coil 1131 within the bracket 2 close to the surface in contact with the smart terminal device, it is possible to avoid the smart terminal device being in close contact with the circuit board when the transmitting coil 1131 is disposed on the circuit board and being excessively affected by the heat generated by the circuit board. In addition, a heat sink is disposed within the host body 1, and a plurality of heat dissipation holes are formed on the shell wall of the host body 1 for dissipating heat within the host body 1. This provides the driver assistance system with better heat dissipation.

[0186] In an optional embodiment, the bracket member 2 is rotatably connected to the host body 1 through the rotating member 3. A wire groove is opened in the rotating member 3 for passing the wires connecting the transmitting coil 1131 and the controller 11 provided on the host body 1. By opening the wire groove in the rotating member 3, the two pin wires of the transmitting coil 1131 are stored in the wire groove, thereby improving the compactness and aesthetics of the entire machine.

[0187] In an optional embodiment, the bracket member 2 rotates relative to the host body 1 to form a bracket state and a storage state; when the bracket member 2 rotates relative to the host body 1 to form the bracket state, the bracket member 2 and the host body 1 together form a mounting position for the smart terminal device; please refer to Figure 16, when the bracket member 2 rotates relative to the host body 1 to form the storage state, the bracket member 2 is folded and stored on the host body 1. The host body 1 of this embodiment integrates the bracket function of the mounting position for stably placing the smart terminal device, and also provides the storage function of the bracket member 2. Not only is the structure more compact, but it is also more conducive to the smart terminal device providing an installation state that is more conducive to user viewing in the bracket state provided by the bracket member 2, thereby improving the driving experience of watching in-vehicle videos on two screens. Please refer to Figures 17-18. Before preparing to drive the vehicle, the user can use the smart terminal he or she carries with him or her, such as a mobile phone, as an extended display device for the in-vehicle assisted driving instrument. The initial state of the bracket component 2 is usually the storage state. The user can manually operate the bracket component 2 to rotate so that the bracket component 2 forms a bracket state relative to the host body 1. When the user does not need to use the smart terminal device, the user can rotate the bracket component 2 so that the bracket component 2 switches back to the storage state relative to the host body 1.

[0188] In this embodiment, the assisted driving device is formed by integrating a bracket 2 and a charging module 113 with the main body 1. The bracket 2 rotates relative to the main body 1 to form a stand position and a storage position, thereby enabling the device to provide assisted driving, support, and charging functions. Installation requires only the entire device to be installed in the vehicle, making the installation process simple and easy. Furthermore, the communication connection between the main body 1 and the smart terminal device enables data transmission between the two devices, allowing the smart terminal to display in-vehicle images.

[0189] The host body 1, bracket 2, and rotating member 3 are integrated into a single unit, forming the main unit of the vehicle-mounted assisted driving system. The main unit can be a portable, integrated structure formed by the host body 1, bracket 2, and rotating member 3, and can be installed in the vehicle's cab via a detachable connection. This facilitates adding dual-screen assisted driving functionality to an existing vehicle by adding the host body. Alternatively, the main unit can be pre-integrated into the vehicle's cab during vehicle design. Onboard cameras are typically located outside the vehicle. The host body 1 and the onboard camera can establish a communication connection via wired or wireless communication. Exemplarily, the host body 1 and the onboard camera utilize a GMSL (Gigabit Multimedia Serial Links) interface and a coaxial cable. The onboard camera transmits captured image data to the host body 1 in real time as a video stream. The host body 1 is equipped with a decoder 116 that decodes the image data captured by the onboard camera. Alternatively, the host body 1 and the onboard camera utilize a FAKRA interface and a coaxial cable.

[0190] In an optional embodiment, a receiving space 121 is formed on the upper surface of the host body 1, and the rotating member 3 is disposed on one side of the receiving space 121. When the bracket member 2 rotates relative to the host body 1 to form a stand position, the bracket member 2 rotates from the receiving space 121 in a direction away from the upper surface of the host body 1, forming a space between the bracket member 2 and the upper surface of the host body 1 for placing a smart terminal device. When the smart terminal device is placed, one end of the bracket member abuts the inner side of the bracket member 2 and the other end abuts the upper surface of the host body 1. When the bracket member 2 rotates relative to the host body 1 to form a storage position, the bracket member 2 is stored in the receiving space 121. The receiving space 121 can be formed by a recess in the upper surface of the host body 1 or directly formed on the upper surface of the host body 1. In addition, a stopper can be provided at the front end of the receiving space 121, and / or an anti-slip pad or a retaining groove can be provided on the upper surface of the host body 1 to prevent the smart terminal device from slipping during use. When the bracket member 2 rotates relative to the host body 1 to form a storage position, the bracket member 2 is stored in the receiving space 121. In this embodiment, the upper surface of the host is recessed to form a receiving space 121, so that when the bracket 2 is in the bracket state, a recessed space for placing the smart terminal device is formed between the bracket and the upper surface of the host body 1, so that the smart terminal device is not easily dropped during driving of the car. When the bracket is in the storage state, the bracket 2 is stored in the receiving space 121 formed by the recessed upper surface of the host body 1, thereby improving the aesthetics of the entire device.

[0191] Rotating member 3 is connected to the outer surface of lower shell 23 of bracket 2. Lower shell 23 is recessed toward upper shell 22 at the position corresponding to rotating member 3 to form a storage space. When bracket 2 rotates relative to main body 1 to form a storage position, rotating member 3 is stored in this storage space. The provision of the storage space prevents interference between rotating member 3 and bracket 2 during rotation and reduces the overall size of bracket 2 in the stored state.

[0192] Please refer to Figure 19. In an optional embodiment, the host body 1 includes a lower housing 13 and an upper housing 12 that are relatively arranged. The lower housing 13 and the upper housing 12 are assembled to form the internal space of the host body 1. The top surface of the upper housing 12 is bent upward on the side close to the display screen to form a blocking surface 122, and the other side is bent downward to form a mounting surface 123 with multiple interfaces. The blocking surface 122 is used to limit and stop the smart terminal device placed in the mounting position. Optionally, the rotating member 3 is arranged on the edge of one side of the upper housing 12 close to the mounting surface 123, and the size and shape of the bracket member 2 are respectively adapted to the size and shape of the top surface of the upper housing 12. The material of the host body 1 is usually selected to be consistent with the material of the bracket member 2. In this embodiment, the material of the upper housing 12 and the lower housing 13 is also ABS plastic material, and the surface is spray-painted and brushed.

[0193] In an optional embodiment, the rotating member 3 includes a rotating shaft arm 31 fixedly connected to the bracket member 2, a central shaft 32 fixedly connected to the rotating shaft arm 31, and a fixing base 33 for setting the central shaft 32; the fixing base 33 is set on the side of the upper surface of the host body 1 away from the display screen 11, the central shaft 32 is movably connected to the fixing base 33, and can rotate relative to the fixing base 33, the fixing base 33 includes two parallel fixed frames, and the central shaft 32 is set between the two fixed frames. Specifically, a first through hole and a second through hole are respectively provided at both ends of the rotating shaft arm 31. The first through hole is used to pass the central shaft 32 to connect the rotating shaft arm 31 and the central shaft 32. The second through hole is used to pass a connecting member connected to the lower shell 23 of the bracket member 2. The connecting member can be a bolt, which is convenient to install and easy to replace. In this embodiment, the fixing seat 33 is arranged on the side of the upper surface of the host body 1 away from the display screen 11, so that when the bracket member 2 is rotated relative to the host body 1 to form a bracket state, the inner side of the bracket member 2 and the display screen 11 both face the user. In this way, when the smart terminal device is placed against the inner side of the bracket member 2, it can be ensured that the orientation of the smart terminal device and the display screen 11 is basically the same, both facing the user, which is convenient for the user to observe while driving.

[0194] Referring to Figures 20-21 , in an optional embodiment, the circuit board includes a first PCB board 14 and a second PCB board 15 disposed within the host body 1. The first PCB board 14 is provided with a first interface 141 for connecting to an external vehicle camera and a second interface 142 for communicating with a smart terminal device for data transmission or wired charging. The first interface 141 may be a FAKRA interface, and the second interface 142 may be a Type-C interface for data transmission. Specifically, the external vehicle camera communicates with the controller 11 via the FAKRA interface, and the smart terminal device communicates with the controller via the Type-C interface. Furthermore, a GPS positioning module 115 may be provided on the first PCB board 14. The second PCB board 15 is provided with a data storage card slot 151 and a third interface for data export and transmission. The third interface may be a Mini-USB interface. The data storage card slot 151 is used to insert a memory card for real-time recording, driving recorder functionality, or firmware upgrades. The data storage card slot 151 may be a TF card slot.

[0195] In an optional embodiment, a first support plate 16 and a second support plate 17 are spaced apart within the host body 1, and the first PCB board 14 and the second PCB board 15 are respectively disposed on the first support plate 16 and the second support plate 17; a fixed side plate 18 is disposed between the first support plate 16 and the second support plate 17, and the fixed side plate 18 is respectively fastened to the first support plate 16 and the second support plate 17. Specifically, the first PCB board 14 is disposed above the first support plate 16, the first support plate 16 is disposed above the second support plate 17, and the second PCB board 15 is disposed between the first support plate 16 and the second support plate 17. Furthermore, the fixed side plate 18 is a T-shaped structure, with the bottom of the fixed side plate 18 fastened to the second support plate 17 by a snap-fit ​​connection, the upper middle portion of the fixed side plate 18 fastened to the first support plate 16 by bolts, and the upper surface of the fixed side plate 18 abuts against the first PCB board 14. Optionally, the surfaces of the first support plate 16 and the second support plate 17 are mirror polished to reduce the roughness of the contact surface with the PCB board. After the mirror polishing treatment, an insulating paint coating treatment is performed to avoid the occurrence of short circuit of the PCB board.

[0196] In an optional embodiment, a rubber pad 19 is provided at the connection between the first interface 141 and the housing of the host body 1. The provision of the rubber pad 19 facilitates the connection between the first interface 141 and the vehicle-mounted camera and provides a cushioning and shock-absorbing effect. In a specific example, the rubber pad 19 is made of a rubber material with a hardness of 50.

[0197] In an optional embodiment, a voice module 114 is further provided in the host body 1, and the voice module 114 is connected to the controller 11 for outputting an alarm signal, wherein the voice module 114 outputs the alarm signal according to the information fed back by the controller 11, and the type of the voice module 114 can be a speaker or a honeycomb.

[0198] Furthermore, a GPS positioning module 115 is also provided in the host body 1 , and the GPS positioning module 115 is used to obtain the real-time speed / position information of the vehicle and send it to the controller 11 .

[0199] In an optional embodiment, the controller 11 is communicatively connected to a vehicle-mounted dual-light camera provided with a dual-light movement, and the controller 11 forms different types of vehicle-mounted images based on the visible light image data and infrared image data collected by the vehicle-mounted dual-light camera. The types of vehicle-mounted images include at least: infrared vehicle-mounted images and visible light vehicle-mounted images; the host body 1 displays the vehicle-mounted images as a first target type, and the smart terminal device displays the vehicle-mounted images as a second target type, and the first target type and the second target type are the same or different. It should be noted here that the first target type displayed by the host body 1 for the vehicle-mounted images and the second target type displayed by the smart terminal device for the vehicle-mounted images can be determined by the controller 11 executing the vehicle-mounted interactive assisted driving method provided in each embodiment of the present application, that is, the target type video source is the second target type.

[0200] The on-board dual-light camera can be an integrated unit formed by a visible light camera and an infrared camera. The on-board dual-light camera can simultaneously capture infrared and visible light signals within the vehicle's driving scene, and the dual-light core utilizes photoelectric conversion and imaging processing to generate visible light image data and infrared image data. The on-board driver assistance system establishes a communication connection between the host body 1 and the smart terminal device, utilizing data exchange between the host body 1 and the smart terminal to provide a dual-screen display. Thus, the infrared vehicle image and the visible light vehicle image, respectively generated by the visible light image data and infrared image data collected by the on-board dual-light camera, can be displayed on one of the display screens 111 of the host body 1 and the smart terminal, while the other simultaneously displays the visible light vehicle image. The first target type and the second target type can be default settings, such as the default setting that the host body 1 displays the infrared vehicle image as the first target type of the vehicle image, and the smart terminal displays the visible light vehicle image as the second target type of the vehicle image. It should be noted that the size of the display screen 111 of the host body 1 is often fixed. The vehicle-mounted assisted driving instrument provides dual-screen display by establishing a communication connection between the host body 1 and the smart terminal device. It can also be to expand the display demand of providing a larger size of vehicle-mounted image screen through the smart terminal device. The first target type of displaying the vehicle-mounted image on the display screen 111 of the host body 1 and the second target type of displaying the vehicle-mounted image on the smart terminal device can be manually selected by the user to synchronously display the same type of vehicle-mounted images.

[0201] It should be further explained that the upper surface of the host body 1 is mounted with a corrugated plate, and the smart terminal device is placed vertically within the concave corrugated grooves of the corrugated plate. When placing the smart terminal device, the smart terminal device can be placed in different corrugated grooves according to actual conditions to adjust the placement angle of the smart terminal device, making it easier for the driver to view the image information displayed by the smart terminal device. Optionally, the lower surface of the host body 1 is provided with a 3M adhesive layer for fixing the in-vehicle driver assistance device inside the vehicle.

[0202] In an optional embodiment, the host body 1 is further equipped with a light sensor. A window for light to pass through is provided on the housing of the host body 1 at a position corresponding to the light sensor. The light sensor senses a light intensity signal and transmits it to the controller 11. Based on the light intensity signal, the controller 11 controls the display screen 111 on the main body to switch between displaying the white light vehicle image and the infrared vehicle image. The host body 1 can obtain real-time light intensity information in the current environment through the light sensor, determine whether the current light is sufficient or dim, and adaptively control the type of vehicle image displayed in the host body 1 and the smart terminal based on this environmental information.

[0203] The present application also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the various processes of the above-mentioned in-vehicle interactive assisted driving method embodiment are implemented, and the same technical effects are achieved. To avoid repetition, the details are not described here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0204] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0205] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, computer, infrared imaging device, etc.) to execute the methods described in each embodiment of the present invention.

[0206] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A vehicle-mounted interactive assisted driving method, applied to a vehicle-mounted electronic device, characterized in that: include: Acquire dual-light image data collected by a vehicle-mounted camera; wherein the dual-light image data includes infrared image data and visible light image data; Determine a local display mode of the host end, and display a target type of vehicle-mounted video corresponding to the local display mode in a display interface of the host end based on the dual-light image data; After establishing a communication connection with the smart terminal, the terminal display mode of the smart terminal is determined, a target type video source corresponding to the terminal display mode is obtained based on the dual-light image data, and the target type video source is sent to the smart terminal for display.

2. The in-vehicle interactive assisted driving method according to claim 1, characterized in that: The step of obtaining bi-optical image data collected by the vehicle-mounted camera includes: According to the size of the infrared image data, selecting an idle image area of ​​the same size in the visible light image data as a target area, and superimposing the infrared image data onto the target area of ​​the visible light image data to form dual light image data in a picture-in-picture mode; The bi-optical image data is acquired from a vehicle-mounted camera.

3. The in-vehicle interactive assisted driving method according to claim 2, characterized in that: The step of selecting a free image area of ​​the same size as the target area in the visible light image data according to the size of the infrared image data includes: According to the size of the infrared image data, the imaging area of ​​the sky part in the driving scene in the visible light image data is used as the idle image area, and an area with the same size as the infrared image data is selected as the target area, or multiple areas with the same size as the infrared image data after addition are selected as the target area.

4. The in-vehicle interactive assisted driving method according to claim 2, characterized in that: The step of obtaining the bi-optical image data collected by the vehicle-mounted camera further includes: Processing the dual-light image data in the picture-in-picture mode to separate the two-channel video signals, infrared and visible, and compressing, encoding and storing the video signals; The sending the target type video source to the smart terminal for display includes: If the terminal display mode is the infrared mode, the infrared video signal is sent to the smart terminal for display through a wired communication method or a wireless communication method established between the smart terminal and the smart terminal; If the terminal display mode is the visible light mode, the visible light video signal is sent to the smart terminal for display via a wired communication method or a wireless communication method established with the smart terminal.

5. The in-vehicle interactive assisted driving method according to claim 1, characterized in that: Also includes: After establishing a communication connection with the smart terminal, the host end is disguised as a master device and the smart terminal is disguised as a slave device using the fast charging protocol, and the smart terminal is charged according to the charging needs of the smart terminal.

6. The in-vehicle interactive assisted driving method according to claim 1, characterized in that: Also includes: When the GPS signal of the host side does not meet the requirements, it is determined whether a communication connection is currently established with the intelligent terminal; If yes, send a GPS signal request to the smart terminal, receive GPS data returned by the smart terminal, and execute a speed warning mechanism according to the GPS information; If not, or the GPS signal of the smart terminal is invalid, the speed warning mechanism is turned off.

7. The in-vehicle interactive assisted driving method according to claim 1, characterized in that: Determining the local display mode of the host terminal includes: Determine the local display mode according to the default setting of the host side; and / or, determine the local display mode through adaptive adjustment according to the real-time light intensity information and image information; and / or, determine the local display mode according to the mode selection operation of the host side; wherein the local display mode is an infrared mode, a visible light mode or an analog display mode; The determining of the terminal display mode of the smart terminal includes: Determine the terminal display mode according to the default setting of the intelligent terminal; and / or determine the terminal display mode through adaptive adjustment according to the real-time light intensity information and image information; and / Or, the terminal display mode is determined according to a mode selection operation on the smart terminal; wherein the terminal display mode is an infrared mode or a visible light mode.

8. The in-vehicle interactive assisted driving method according to claim 1, characterized in that: Determining the local display mode of the host terminal includes: Keep the local display mode of the host side as analog display mode; The determining of the terminal display mode of the smart terminal includes: Acquire real-time light intensity information, and determine whether sufficient light conditions are met based on whether the light intensity information is greater than a threshold; If satisfied, determining the size of the variance of the infrared image data and the variance of the Y component of the visible light image data; If the variance of the infrared image data is less than the Y component variance of the visible light image data, determining that the terminal display mode of the smart terminal is the visible light mode; If it is not satisfied or if the variance of the infrared image data is not less than the Y component variance of the visible light image data, it is determined that the terminal display mode of the smart terminal is the infrared mode.

9. The in-vehicle interactive assisted driving method according to claim 1, characterized in that: Also includes: Performing image analysis based on the bi-optical image data and determining that there is a risk warning event, issuing a warning prompt information; wherein the warning prompt information includes: issuing a warning prompt sound, displaying a corresponding simulated risk event image according to the risk warning event in the display interface of the host side; and / or, After establishing a communication connection with the smart terminal, receiving an upgrade data packet sent by the smart terminal after an upgrade prompt, and completing the firmware upgrade based on the upgrade data packet; and / or, Receive the shooting instruction sent by the smart terminal, shoot an image or record a video of a set length through the vehicle-mounted camera according to the shooting instruction, and send the image or video to the smart terminal for real-time display.

10. An in-vehicle electronic device, characterized in that: The invention comprises a host (1), wherein the host (1) comprises a processor (117), a memory (118) connected to the processor (117), and a computer program stored in the memory (118) and executable by the processor (117); when the computer program is executed by the processor (117), the in-vehicle interactive assisted driving method as claimed in any one of claims 1 to 9 is implemented.

11. The vehicle-mounted electronic device according to claim 10, wherein: The host (1) is installed in a vehicle, and the vehicle-mounted electronic device also includes a vehicle-mounted camera that is communicatively connected to the host (1), and the vehicle-mounted camera is installed outside the vehicle and is used to collect dual-light image data in real time and send it to the host (1); the housing of the host (1) is provided with a mounting structure for mounting the smart terminal, or the housing of the host (1) is provided with a clamping structure for clamping and fixing the smart terminal.

12. The vehicle-mounted electronic device according to claim 10, wherein: The host (1) is provided with an installation position for placing the intelligent terminal; The host (1) further comprises an on-board camera, a display screen (111) and a charging module (113); the display screen (111) is arranged on one side of the host (1); the processor (117) controls the display screen (111) to display the on-board video according to the on-board video formed by the image data collected by the on-board camera; The host (1) is in communication connection with the smart terminal to perform data transmission with the smart terminal, and the vehicle-mounted video is displayed via the smart terminal, and the processor (117) controls the charging module (113) to charge the smart terminal according to the charging demand of the smart terminal.

13. The vehicle-mounted electronic device according to claim 12, characterized in that: The host (1) is provided with a circuit board, the processor (117) and the charging module (113) are both arranged on the circuit board, and the circuit board is connected to an on-board power supply module so that the circuit board is powered by the on-board power supply module; The charging module (113) is a wireless charging module, and the wireless charging module includes a wireless transmitting module arranged on the circuit board for cooperating with a wireless receiving module in the smart terminal. When the smart terminal is placed in the installation position, the smart terminal realizes wireless charging through the wireless transmitting module and the wireless receiving module; or, the charging module (113) is a wired charging module, and the wired charging module includes a wireless transmitting module arranged on the host (1) The housing is provided with a charging interface for connecting the smart terminal, the charging interface is used for the smart terminal to be connected thereto via a data cable, and the charging module (113) implements wired charging for the smart terminal via the charging interface.

14. The vehicle-mounted electronic device according to claim 12, characterized in that: The host (1) is provided with a bracket (2) for placing the smart terminal, and the bracket (2) is provided with a magnetic attraction component (21), and the magnetic attraction component (21) provides a magnetic attraction force for adsorbing the smart terminal and placing it on the bracket (2).

15. The vehicle-mounted electronic device according to claim 14, characterized in that: The charging module (113) is a wireless charging module, comprising a transmitting coil (1131) arranged in the bracket (2) and used to achieve a radio connection with a receiving coil in the smart terminal to achieve wireless charging of the smart terminal.

16. The vehicle-mounted electronic device according to claim 15, characterized in that: The support member (2) is rotatably connected to the host (1) via a rotating member (3); a wire groove is provided in the rotating member (3); and a wire connecting the transmitting coil (1131) and a processor (117) provided on the host (1) is passed through the wire groove.

17. The vehicle-mounted electronic device according to claim 14, characterized in that: The support member (2) rotates relative to the host (1) to form a support state and a storage state; When the support member (2) is rotated relative to the host (1) to form the support state, the support member (2) and the host (1) together form the installation position for placing the intelligent terminal; when the support member (2) is rotated relative to the host (1) to form the storage state, the support member (2) is folded and stored on the host (1).

18. The vehicle-mounted electronic device according to claim 12, characterized in that: The host (1) is also provided with a voice module (114), which is connected to the processor (117) and is used to output an alarm signal.

19. The vehicle-mounted electronic device according to claim 12, characterized in that: The host (1) is also provided with a GPS positioning module (115), and the GPS positioning module (115) is used to obtain the real-time speed and / or position information of the vehicle and send it to the processor (117).

20. The vehicle-mounted electronic device according to claim 12, characterized in that: The processor (117) is communicatively connected to a vehicle-mounted dual-light camera provided with a dual-light movement, and the processor (117) forms different types of vehicle-mounted videos according to visible light image data and infrared image data collected by the vehicle-mounted dual-light camera, wherein the types of the vehicle-mounted videos include at least infrared vehicle-mounted images and visible light vehicle-mounted images; The display screen (111) on the host (1) displays the in-vehicle video in a first target type, and the smart terminal displays the in-vehicle video in a second target type, wherein the first target type and the second target type are the same or different.

21. The vehicle-mounted electronic device according to claim 12, characterized in that: The host (1) and the vehicle-mounted camera are connected to each other by means of a GMSL interface and a coaxial cable.

22. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, the in-vehicle interactive assisted driving method according to any one of claims 1 to 9 is implemented.

23. A vehicle-mounted electronic device, characterized in that: It comprises a host body (1) and a mounting position arranged on the host body (1) for placing an intelligent terminal device; The host body (1) comprises a controller (11) connected to a vehicle-mounted camera, a display screen (111) and a charging module (113); the display screen (111) is arranged on one side of the host body (1); the controller (11) controls the display screen (111) to display the vehicle-mounted image based on the vehicle-mounted image formed by the image data collected by the vehicle-mounted camera; The host body (1) is connected to the smart terminal device for communication so as to perform data transmission with the smart terminal device, and the vehicle-mounted image is displayed through the smart terminal device, and the controller (11) controls the charging module (113) to charge the smart terminal device according to the charging demand of the smart terminal device; The vehicle-mounted camera is a vehicle-mounted dual-light camera provided with a dual-light movement, the controller (11) is in communication connection with the vehicle-mounted dual-light camera, and the controller (11) forms different types of vehicle-mounted images according to the visible light image data and infrared image data collected by the vehicle-mounted dual-light camera, and the types of the vehicle-mounted images include at least: infrared vehicle-mounted images, Visible light vehicle-mounted image; the display screen (111) on the host body (1) displays the vehicle-mounted image in a first target type, and the smart terminal device displays the vehicle-mounted image in a second target type, and the first target type and the second target type are the same or different.

24. The vehicle-mounted electronic device according to claim 23, characterized in that: A circuit board is installed in the host body (1), the controller (11) and the charging module (113) are both arranged on the circuit board, and the circuit board is connected to a vehicle-mounted power module so that power is supplied to the circuit board through the vehicle-mounted power module; The charging module (113) is a wireless charging module, comprising a wireless transmitting module arranged on the circuit board for cooperating with a wireless receiving module in the smart terminal device, and when the smart terminal device is placed in the installation position, the smart terminal device realizes wireless charging through the wireless transmitting module and the wireless receiving module; or, the charging module (113) is a wired charging module, comprising a charging interface arranged on the housing of the host body (1) for connecting to the smart terminal device, the charging interface being connected to the smart terminal device via a data cable, and the charging module (113) realizes wired charging for the smart terminal device via the charging interface.

25. The vehicle-mounted electronic device according to claim 23, characterized in that: The host body (1) is provided with a bracket (2) for placing the smart terminal device, and the bracket (2) is provided with a magnetic attraction component (21), and the magnetic attraction component (21) provides a magnetic attraction force for adsorbing the smart terminal device and placing it on the bracket (2).

26. The vehicle-mounted electronic device according to claim 25, characterized in that: The charging module (113) is a wireless charging module, comprising a transmitting coil (1131) arranged in the bracket (2) and used to achieve a radio connection with a receiving coil in the smart terminal device, so as to achieve wireless charging of the smart terminal device.

27. The vehicle-mounted electronic device according to claim 26, characterized in that: The support member (2) is rotatably connected to the host body (1) via a rotating member (3); a wire groove is provided in the rotating member (3); and a wire connecting the transmitting coil (1131) and a controller (11) provided on the host body (1) is passed through the wire groove.

28. The vehicle-mounted electronic device according to claim 26, characterized in that: The support member (2) rotates relative to the host body (1) to form a support state and a storage state; When the bracket component (2) is rotated relative to the host body (1) to form the bracket state, the bracket component (2) and the host body (1) together form the installation position for placing the intelligent terminal device; when the bracket component (2) is rotated relative to the host body (1) to form the storage state, the bracket component (2) is folded and stored on the host body (1).

29. The vehicle-mounted electronic device according to claim 23, characterized in that: A voice module (114) is also provided in the host body (1); the voice module (114) is connected to the controller (11) and is used to output an alarm signal.

30. The vehicle-mounted electronic device according to claim 23, characterized in that: The host body (1) is also provided with a GPS positioning module (115), and the GPS positioning module (115) is used to obtain the real-time speed and / or position information of the vehicle and send it to the controller (11).

31. The vehicle-mounted electronic device according to claim 23, characterized in that: The host body (1) and the vehicle-mounted camera are connected to each other by means of a GMSL interface and a coaxial cable.

Images