748 results about "Onboard camera" patented technology

The invention discloses a traffic operation and maintenance fault intelligent scheduling method and system based on an AI large model, and belongs to the technical field of traffic control. The method comprises the following steps: collecting a vehicle driving track GPS coordinate set, a traffic flow density matrix, a vehicle-mounted camera monitoring image frame sequence and a fault vehicle owner speed anomaly detection result in real time; constructing a traffic operation state analysis model, and outputting real-time traffic operation state characteristics; generating a traffic fault probability distribution curved surface in a future time window; generating a comprehensive fault positioning confidence coefficient matrix; and planning an optimal maintenance resource path according to the pheromone updating rule, and updating the optimal maintenance resource path to the visual scheduling platform in real time. According to the method, space-time diagram convolutional network dynamic modeling is constructed according to multi-source data, so that the limitation of a space blind area of a single data source is broken through, the fault positioning speed is improved, and the problems of incomplete coverage and low positioning speed in the prior art are solved.

The invention relates to the technical field of unmanned aerial vehicle navigation, and discloses an unmanned aerial vehicle navigation method and system based on computer vision, and the unmanned aerial vehicle navigation method based on computer vision comprises the following steps: collecting a current visual field image of an airborne camera of an unmanned aerial vehicle, and carrying out adaptive image enhancement; performing scene semantic understanding; semantic perception feature extraction is carried out; feature matching and outer point elimination are carried out; floor identification is carried out, and multi-sensor fusion positioning is carried out; plane segmentation, structural constraint extraction and map normalization are carried out; performing visual navigation evaluation, judging a navigation mode according to an evaluation result, and generating an exploration control instruction quantity based on the navigation mode; generating a cross-floor path sequence, optimizing a track in real time, and performing control fusion in combination with a navigation mode identifier and an exploration control vector; according to the method, the navigation problem of the unmanned aerial vehicle in complex scenes such as smoke interference, multi-story buildings and illumination dramatic change in a GPS denial environment is solved, and high-precision autonomous navigation is realized.

The invention provides a driving behavior intelligent identification method and system based on video analysis, and the method comprises the steps: obtaining a driver face video stream and a road environment video stream collected by a vehicle-mounted camera, and reading the driving information recorded by a whole vehicle communication network; recognizing an eyelid closing state, a sight line direction and a head posture in the driver face video stream based on a posture recognition model, and performing fatigue distraction analysis to obtain driver state information; performing motion trail analysis on the road environment video stream and the driving information, and performing driving risk assessment in combination with the driver state information to obtain driving assessment information; and performing early warning construction according to the driving evaluation information, generating early warning prompt information, and synchronously writing the early warning prompt information, the driving evaluation information and the driver state information into a safety data protection memory. The fatigue and distraction states of the driver can be recognized more accurately, and the accuracy of state judgment is improved.

A vehicular camera monitoring system includes an electronic control unit (ECU) at a vehicle and a support arm movably disposed at a side portion of the vehicle, with the support arm having a base end attached at the side portion of the vehicle and a distal end opposite the base end. A camera is disposed at the distal end of the support arm. The support arm is movable between a stowed position and an extended position. A cover element covers an aperture at the side portion at least when the support arm is in the extended position. The camera, when the support arm is in the extended position, captures image data and provides captured image data to the ECU, which processes the provided image data for (i) display of video images derived from provided image data and / or (ii) detection of an object in the field of view of the camera.

The invention discloses a multi-degraded image restoration method based on semantic guidance. According to the method, for degraded images captured by a vehicle-mounted camera under severe weather conditions, potential features of the images are extracted by adopting a trunk network based on Transform, multi-modal semantic information is extracted in combination with a CLIP visual language model, and semantic guidance is provided for different degradation types through a dynamic text prompt generation mechanism. A self-adaptive feature fusion module is designed, channel attention and space attention mechanisms are combined to realize effective integration of multi-modal features, and a degradation feature extraction and fusion module is introduced to enhance the generalization ability of the model. According to the semantic guidance multi-type image recovery network SGIRN provided by the invention, the global modeling capability of the Transform and the cross-modal representation capability of the CLIP visual language model are combined, so that high-quality recovery of various weather degradation types is realized.

Various systems and methods are presented regarding utilizing technology onboard a vehicle to mitigate the effects of communication signals being deleteriously affected / lost when operational surroundings cause occlusion / loss of receipt of positioning / location signals at the vehicle. The vehicle can be operating non-autonomously, partially autonomously, or autonomously. To supplement the lost / occluded signals position information of other systems proximate to the vehicle can be obtained / utilized. The other systems can include another vehicle, a mobile device, an internet, and suchlike. Also, onboard devices can be utilized to determine the location, such as an onboard camera system providing information regarding street signs, building facades, and suchlike.

The invention discloses a multi-source fusion real-time traffic perception and emergency early warning system and method based on vehicle and road cloud cooperation, and relates to the technical field of traffic management. The vehicle end system comprises an information acquisition and transmission module, a local decision module, a data receiving module, an emergency response module and a data feedback module, and the information acquisition and transmission module acquires vehicle peripheral information through a vehicle-mounted radar and a vehicle-mounted camera. According to the invention, a vehicle end collects local information such as obstacles around a vehicle and dynamic states of adjacent vehicles through a vehicle-mounted radar and a camera, a road end collects regional information such as road section traffic flow density, road damage and traffic facility states through a roadside camera and a sensor, and a cloud end integrates data at the two ends and carries out time-space synchronization through a multi-source fusion technology. The defect of a single vehicle end or road end sensing blind area is overcome, and complete sensing of the traffic state of the whole road network is achieved.

The invention relates to the field of automobile electronic testing technology and equipment, and discloses a vehicle-mounted camera imaging quality testing method and device suitable for a rain and fog scene, and the method comprises the steps: installing a to-be-tested camera module in a rain and fog environment cabin, setting the spectrum and illumination of a top natural illumination simulation system, and simulating the illumination at different time periods; selecting a test target plate in the darkroom; starting an automatic centering module to align the optical axis with the standard plate reference; rain and fog parameters are set through the environment control host, the rain and fog supply system is started to simulate different levels of rain and fog environments, and the raindrop particle size, concentration, dripping speed, fog visibility and fogdrop particle size are dynamically regulated and controlled; shooting a target plate graph card, extracting characteristic parameters by an image analysis module, performing quantitative analysis, and generating an evaluation report, so as to solve the technical problem of singleness of rain and fog scene environment simulation in the prior art.

The invention relates to an automobile windshield shelter removing method and system and an automobile, and belongs to the technical field of automobile active safety. The method comprises the steps that the surface of the windshield is monitored through a vehicle-mounted camera; when a shielding object is identified, calculating a view shielding coefficient based on the area, the position, the light transmittance and the type of the shielding object, and determining an initial influence level according to the view shielding coefficient; corresponding cleaning strategies are executed according to the influence levels, windscreen wiper cleaning is started at the low level, pneumatic suction generated by vehicle intersection is used for cleaning at the middle level, and negative-pressure airflow cleaning is induced through dynamic opening of a skylight at the high level; if the shielding is not removed, the influence level is increased step by step, and circulation execution is carried out until the shielding is removed or automatic parking is triggered. According to the method, grading, closed-loop and non-contact intelligent removal of different types of sheltering objects is achieved, and invalid or even harmful operation of a traditional windscreen wiper in a dry sheltering scene is effectively avoided.

The invention relates to the technical field of image processing, and provides an excavator operation safety monitoring method based on visual assistance and a laser radar, which comprises the following steps: acquiring continuous frames of monitoring images in the excavator operation process through a vehicle-mounted camera, and acquiring three-dimensional point cloud data at a plurality of moments through the laser radar; obtaining a target movement degree of each region, screening to obtain a plurality of moving targets and obtaining a movement sequence of the moving targets; obtaining the target influence degree of each moving target at each moment; the comprehensive influence degree of the moving target is obtained; screening an interference target based on the comprehensive influence degree, and obtaining an interference sequence of the interference target in combination with the moving sequence corresponding to each vehicle-mounted camera; and according to the interference target and the interference sequence thereof, collision early warning is carried out through an audible and visual alarm, and safety monitoring of excavator operation is achieved. The invention aims to solve the problem that the blind area and collision detection accuracy of a fusion result can be interfered by respective misrecognition problems of computer vision and laser radar.

The invention provides an aerial view feature generation method and device and electronic equipment. The method comprises the following steps: acquiring a plurality of acquisition images synchronously acquired by all vehicle-mounted cameras of a vehicle at the current moment; determining a bird's-eye view and an initial feature tensor thereof according to the plurality of collected images; generating a fusion feature tensor at the current moment according to the aerial view, the initial feature tensor and preset attention; and generating a target feature tensor of the aerial view at the current moment according to the historical feature tensor at the previous moment and the fused feature tensor. According to the generation mode, the fusion feature tensor is generated through the double attention of the spatial attention and the semantic attention, redundant calculation is remarkably reduced, overexposure or dark channel passing is inhibited through the spatial attention, high coupling with semantic categories is enhanced, and the accuracy of the fusion feature tensor is improved. Therefore, the robustness of generating the target feature tensor in extreme illumination scenes such as strong light, rain and fog is improved, noise interference is avoided, and the target feature tensor generation precision and generation efficiency of the aerial view are improved.

The present disclosure relates to a multi-mode vehicle window control method and device. The method combines voice recognition and computer vision technologies, detects a user's voice wake-up word using a vehicle-mounted microphone, turns on the vehicle-mounted camera to detect the user's face and head, analyzes the user's gaze, face pose, and head posture to estimate the user's attention region, and aligns the attention region with a vehicle body coordinate system. Intelligent control of a vehicle window is realized according to specific coordinates of an attention area on the vehicle window. Even if the user's face or eyes are not detected, the vehicle window may be operated accurately by determining the user's intention through the face or head pose.

A method and device for vehicle camera autocalibration during vehicle travel for driver assistance systems and automated driving. A vehicle camera images a region of vehicle surroundings through a window. The method includes: providing a vehicle camera projection model including multiple extrinsic parameters, at least one intrinsic vehicle camera parameter and at least one window parameter; capturing a sequence of camera images during vehicle cornering; determining a curve type during the cornering; estimating the parameters using pixels in the sequence of images of stationary objects in the vehicle surroundings, the current vehicle movement, and the determined curve type, by minimizing an error function indicating the deviation between pixels which correspond to stationary objects in the vehicle surroundings and which are established from the sequence of images and pixels of the stationary objects which are projected by the projection model; and outputting at least one of the estimated parameters.

To provide an image recognition device and image recognition method which confirm whether a vanishing point exists at a correct position and detect an installation abnormality of an on-vehicle camera even when a white line cannot be detected during vehicle travel.SOLUTION: An image recognition device 10 comprises: an image acquisition unit 11 that acquires an image of a scene ahead of a vehicle imaged by an on-vehicle camera 5; and a vanishing point calculation unit (second vanishing point calculation unit 14) that sets a predetermined region in the image as a detection frame and calculates a vanishing point on the basis of movements of feature points within the detection frame. The vanishing point calculation unit sets the size of the detection frame on the basis of at least a traveling speed of the vehicle and a time interval for capturing the image, and calculates the vanishing point on the basis of a position of a feature point detected within the detection frame in a first image captured at a first time and a position of the feature point detected within the detection frame in a second image captured at a second time after the time interval has elapsed from the first time.SELECTED DRAWING: Figure 1

This application relates to the technical field of Internet of Vehicles, and discloses a method and an apparatus for calibrating a roll angle of an on-board camera, a device, and a storage medium. The method for calibrating a roll angle of an on-board camera includes obtaining an image frame sequence collected by the on-board camera while a vehicle is in motion, the image frame sequence comprising n image frames of a road captured by the on-board camera at n timestamps; selecting a plurality of image groups from the image frame sequence; obtaining lane line images corresponding to the plurality of image groups at a target roll angle, to obtain a lane line image set corresponding to the target roll angle; and determining the roll angle of the on-board camera based on lane line image sets corresponding to different roll angles.

This application discloses a virtual reality display system, method, apparatus, device, and medium, relating to the field of virtual reality technology. The system includes a virtual reality device, an in-vehicle camera assembly, and an in-vehicle terminal. The in-vehicle camera assembly is configured to acquire road condition images and send them to the in-vehicle terminal. The in-vehicle terminal is configured to recognize the received road condition images and obtain recognition results; analyze the recognition results to obtain loading delay compensation data; and send the loading delay compensation data and recognition results to the virtual reality device. The virtual reality device is configured to receive the loading delay compensation data and recognition results; obtain loading displacement data based on the recognition results; and display a virtual reality screen based on the loading delay compensation data and loading displacement data. This system can eliminate the impact of vehicle vibrations on elements within the loading screen of the virtual reality device, reducing loading delays.

The invention relates to a vehicle lamp control method, electronic equipment and a vehicle, relates to the technical field of vehicles, and is used for improving the accuracy of vehicle lamp control while reducing the cost of a sensor. The method comprises the following steps: in response to starting of a vehicle lamp automatic switching function, obtaining illuminance detected by a vehicle-mounted camera; based on the illuminance, determining an illumination gradual change control instruction, an illumination sudden change control instruction and a forced turn-on control instruction; and based on the illumination gradual change control instruction, the illumination sudden change control instruction and the forced turn-on control instruction, controlling the on-off of the vehicle lamp, thereby improving the vehicle lamp control accuracy and ensuring the driving safety.

The invention provides a method and a device for detecting smudginess of a vehicle-mounted camera. The method comprises the following steps: acquiring continuous multi-frame to-be-processed images; converting each to-be-processed image to obtain a plurality of grayscale images, and cutting regions of interest in the grayscale images to obtain a plurality of target images; calculating the average information entropy of each target image; evaluating a gray level evaluation value corresponding to each target image; for each target image, calculating to obtain an adaptive gray threshold based on the corresponding average information entropy and the gray evaluation value, and calculating to obtain a contour average gray value; when the contour average gray value is smaller than the self-adaptive gray threshold value and smaller than an average gray evaluation value obtained based on the gray evaluation values, marking the target image as a dirty image; and when the number of the target images which are continuously marked as the dirty images exceeds a preset number threshold value, judging that the vehicle-mounted camera is in a dirty state. According to the scheme, the purpose that smudginess detection is non-inductive to the scene and is suitable for various scenes is achieved.

A communication apparatus, method and program that accommodate diverse usage are disclosed. In one example, a packet header is generated according to a CSI-2 standard. The packet header includes setting information of conditions set for data to be transmitted in a packet is placed. An extended header is also generated, into which the setting information is to be placed separately from the packet header. Then, into an unused region defined as a region that is not used in the existing CSI-2 standard with respect to a data type that is the setting information indicative of a type of the data to be transmitted in the packet, extension mode setting information indicative of whether or not an extension mode using the extended header is used is placed. The disclosed technology can be applied, for example, in a mobile device or in an in-vehicle camera.

The invention relates to the technical field of vehicle-mounted equipment testing devices, and discloses a vibration test evaluation method and device suitable for a long-focus wide-angle vehicle-mounted camera, a plurality of cameras to be tested are installed on a six-degree-of-freedom vibration table in a darkroom, and a position-adjustable test chart card and a light source system are arranged in front of the cameras; the driving module is adopted to lighten the camera, so that remote controllable shooting is realized; configuring a test environment, and adjusting parameters such as a graphic card position and illumination; driving a camera to shoot an image card under multiple working conditions, outputting an original image sequence, and driving a module to complete a traversal test; the driving module returns a shooting result to the image analysis module, and the image analysis module analyzes imaging quality in real time, evaluates indexes such as a modulation transfer function and motion blur, and generates a multi-dimensional optical performance report; generating a multi-degree optical dimension performance report of the camera; the technical problem that a real vehicle multi-degree-of-freedom direction vibration coupling scene cannot be simulated in the prior art is solved.

Certain examples relate to controlling a charging door of a vehicle based on an UWB. A system includes a charging door, a charging device, a vehicle-mounted UWB communication device, a vehicle-mounted camera device, a main control unit, and a charging door control device. The charging door may cover a charging port. The charging device includes a first UWB communication device. The first UWB communication device may transmit and receive a UWB communication signal. The vehicle-mounted UWB communication device may detect location information of the charging device based on the UWB communication signal. The vehicle-mounted camera device may capture image information near the charging door. The main control unit may generate a charging door control signal for opening or closing the charging door based on the location information and image information. The charging door control device may open or close the charging door based on the charging door control signal.

The invention relates to the technical field of vehicle-mounted equipment testing devices, and discloses a method and a device for testing the imaging quality of a vehicle-mounted camera in a salt-spray high-low temperature environment, and the method comprises the steps: installing a to-be-tested camera on an adjustable platform in a salt-spray environment cabin, maintaining an optimal angle, and forming a closed environment; adjustable sodium chloride salt mist is provided by the salt mist generation system, and environmental parameters are controlled by the temperature and humidity generation control system; the salt mist environment chamber is provided with high-low-temperature-resistant high-transmittance glass and a self-cleaning device, and the glass is cleaned before soaking is finished; the camera is lightened through the lightening driving system, and the camera is adjusted to be centered with the test graphic card; by adjusting working conditions such as temperature, humidity, light environment and attitude angle, the camera is driven to shoot an image card image and transmit the image card image to the image analysis module; the module analyzes the image in real time and quantifies the imaging quality of the camera; the technical problem that the composite environment working condition cannot be simulated in the prior art is solved.

The invention relates to the technical field of vehicle-mounted camera cleaning, in particular to a vehicle-mounted camera lifting type cleaning method and system based on image quality monitoring, and the method comprises the steps: receiving image data collected by a target vehicle-mounted camera, and carrying out the quantitative evaluation of the definition and transparency of an image through an image processing algorithm according to the image data; judging whether the lens is dirty or not according to the definition, the transparency and a preset threshold value; if the lens is dirty, generating a retraction instruction, and controlling a displacement driving mechanism to move the target vehicle-mounted camera from an external working position to an internal preset cleaning position; after the target vehicle-mounted camera is moved to a preset cleaning position, a preset cleaning program is started to clean a lens of the target vehicle-mounted camera; and after cleaning is completed, an extension instruction is generated, and the displacement driving mechanism is controlled to move the target vehicle-mounted camera back to the external working position from the preset cleaning position. According to the invention, efficient cleaning of the vehicle-mounted camera can be realized.

The disclosure provides a system and method for calibrating extrinsic parameters of a camera mounted on a vehicle. While the vehicle is parked, the camera captures an image of a plurality of feature points with known world coordinates on a ground plane. The system determines pixel coordinates of the plurality of feature points in an image plane and estimates a homography matrix between the ground plane and the image plane based on a subset of the plurality of feature points. The system generates an initial estimate of the extrinsic parameters based on the estimated homography matrix and applies an optimization technique to obtain calibrated extrinsic parameters based on the initial estimate, the world coordinates, and the pixel coordinates of the plurality of feature points. Applying the optimization technique can include minimizing inverse-projection errors of the plurality of feature points from the image plane to the ground plane.

The disclosure provides a system and method for calibrating extrinsic parameters of a camera mounted on a vehicle. While the vehicle is parked, the camera captures an image of a plurality of feature points with known world coordinates on a ground plane. The system determines pixel coordinates of the plurality of feature points in an image plane and estimates a homography matrix between the ground plane and the image plane based on a subset of the plurality of feature points. The system generates an initial estimate of the extrinsic parameters based on the estimated homography matrix and applies an optimization technique to obtain calibrated extrinsic parameters based on the initial estimate, the world coordinates, and the pixel coordinates of the plurality of feature points. Applying the optimization technique can include minimizing inverse-projection errors of the plurality of feature points from the image plane to the ground plane.

The invention relates to the technical field of digital image processing, in particular to a real-time image quality enhancement method for a vehicle-mounted camera EMC test, and the method comprises the steps: obtaining real-time image data and historical image data; and performing multi-branch collaborative decoupling processing on the real-time image data to generate a frequency domain purification graph, a core structure graph, a space domain purification graph and a time domain stability graph. And performing local statistical analysis on the real-time image data to generate an artifact intensity map and a perception saliency map. Under a multi-resolution Laplacian pyramid framework, fusing the frequency domain purification graph and the space domain purification graph; the weight of the fusion process is intelligently regulated and controlled spatially and hierarchically by an artifact intensity graph, a perception saliency graph and a time domain stabilization graph which are constructed based on a Gaussian pyramid, and finally a high-quality enhanced image is reconstructed and generated. According to the invention, through a multi-branch cooperative decoupling and intelligent fusion method, real-time enhancement of the vehicle-mounted camera image under EMC interference is realized.

A technique for a UAV includes acquiring a query aerial image with an onboard camera of the UAV and a reference aerial image, the query aerial image including multiple instances of an asset and the reference aerial image including annotated pixels indicating an expected location and an identification for the multiple instances of the asset. The technique further includes identifying a plurality of corresponding pixels between the query aerial image and the reference aerial image, determining a homography transformation describing a relationship between the query aerial image and the reference aerial image, annotating the query aerial image to identify a first instance of the asset included in the multiple instances of the asset within the query aerial image, and instructing the UAV to perform an action associated with the first instance of the asset.

The invention provides an automobile lamp self-adaptive adjusting method and system based on machine vision, and belongs to the technical field of automobile lighting and intelligent visual recognition. The method comprises the following steps: acquiring an environment image in front of a vehicle through a vehicle-mounted camera, and preprocessing the acquired environment image; performing target detection and semantic segmentation on the preprocessed image based on a deep learning model, and identifying targets and road structures at least including vehicles, pedestrians and lane lines; generating a corresponding illumination control strategy according to the identification result and the current state information of the vehicle; and according to the illumination control strategy, an LED matrix lamp group is controlled to carry out partition illumination adjustment, and self-adaptive control over the light beam shape, the brightness and the illumination range is achieved. According to the invention, accurate identification of multiple targets such as vehicles, pedestrians, road structures and the like can be realized, the light beam distribution is dynamically adjusted according to a real-time scene, and the safety and comfort of night driving are remarkably improved.

A vehicle-mounted camera shell serves as a core component of an automobile intelligent driving system and needs to meet the strict requirements of high-precision assembly, high heat dissipation performance, environmental corrosion resistance (such as salt mist), laser welding reliability and the like. The invention discloses a process for laser welding of a vehicle-mounted camera metal shell in the Chinese patent CN115958292A, the production process of the shell is completed through laser welding, along with the development of the technology, the cold extrusion technology becomes a better choice, according to the vehicle-mounted camera shell cold extrusion process for the new energy vehicle and the optimization method thereof, the production cost is reduced, and the production efficiency is improved. Through the combination of a gradient pressurizing cold extrusion process and customized mold design, the problem of internal defects caused by nonuniformity of metal flow is solved, meanwhile, the surface treatment procedure cohesion is optimized, and the thread structure requirement of a low-yield-strength material is met; the device has the advantages that the shell forming quality is improved, the planeness precision of the clamping face is improved, the surface treatment procedure cohesion is optimized, and the device is adaptive to a low-yield-strength material thread structure.