5582results about "Scene recognition" patented technology

An alert system for a vehicle includes a video display, an interior visual alert device disposed at an interior rearview mirror assembly, a driver side visual alert device disposed at a driver side exterior rearview mirror assembly and a passenger side visual alert device disposed at a passenger side exterior rearview mirror assembly. A control is operable to activate at least one of the alert devices in response to a detection of an object rearward of the vehicle. The alert devices are viewable by the driver of the vehicle when activated and are operable to guide or prompt the driver to check the images captured by a rearward facing camera and displayed in the vehicle cabin by the video display so that the driver can verify the nature and type of a potential hazard rearward of the vehicle.

A vision system for a vehicle includes an imaging device having an imaging sensor, a camera microcontroller, a display device having a display element, a display microcontroller, and at least one user input selectively actuatable by a user. The imaging device communicates an image signal to the display device via a communication link. The display microcontroller affects the image signal in response to the at least one user input. The camera microcontroller monitors the image signal on the communication link and adjusts a function of the imaging device in response to a detection of the affected image signal. The vision system may adjust a display or sensor of the system in conjunction with a distance detecting system.

Driver distraction is reduced by providing information only when necessary to assist the driver, and in a visually pleasing manner. Obstacles such as other vehicles, pedestrians, and road defects are detected based on analysis of image data from a forward-facing camera system. An internal camera images the driver to determine a line of sight. Navigational information, such as a line with an arrow, is displayed on a windshield so that it appears to overlay and follow the road along the line of sight. Brightness of the information may be adjusted to correct for lighting conditions, so that the overlay will appear brighter during daylight hours and dimmer during the night. A full augmented reality is modeled and navigational hints are provided accordingly, so that the navigational information indicates how to avoid obstacles by directing the driver around them. Obstacles also may be visually highlighted.

An apparatus, method for detecting critical areas and a pedestrian detection apparatus using the same are provided. An application of the pedestrian detection system is provided to help limit critical urban environment to particular areas. Contrary to traditional pedestrian detection systems that localize every pedestrians appearing in front of the subject vehicle, the apparatus first finds critical areas from urban environment and performs a focused search of pedestrians. The environment is reconstructed using a standard laser scanner but the subsequent checking for the presence of pedestrians is performed by incorporating a vision system. The apparatus identifies pedestrians within substantially limited image areas and results in boosts of timing performance, since no evaluation of critical degrees is necessary until an actual pedestrian is informed to the driver or onboard computer.

A method is provided using a system mounted in a vehicle. The system includes a rear-viewing camera and a processor attached to the rear-viewing camera. When the driver shifts the vehicle into reverse gear, and while the vehicle is still stationary, image frames from the immediate vicinity behind the vehicle are captured. The immediate vicinity behind the vehicle is in a field of view of the rear-viewing camera. The image frames are processed and thereby the object is detected which if present in the immediate vicinity behind the vehicle would obstruct the motion of the vehicle. The processing is preferably performed in parallel for a plurality of classes of obstructing objects using a single image frame of the image frames.

In accordance with various embodiments of the disclosed subject matter, a method and a system for vision-centric deep-learning-based road situation analysis are provided. The method can include: receiving real-time traffic environment visual input from a camera; determining, using a ROLO engine, at least one initial region of interest from the real-time traffic environment visual input by using a CNN training method; verifying the at least one initial region of interest to determine if a detected object in the at least one initial region of interest is a candidate object to be tracked; using LSTMs to track the detected object based on the real-time traffic environment visual input, and predicting a future status of the detected object by using the CNN training method; and determining if a warning signal is to be presented to a driver of a vehicle based on the predicted future status of the detected object.

A portable multispectral data acquisition system for use on a vehicle such as an aircraft comprises a plurality of gyroscope-stabilized remote sensing devices synchronized to simultaneously capture images of a common spatial area in both visible and invisible bands of the electromagnetic spectrum, a computer and digital recorder to record and correlate the captured images with temporospatial reference information, image processing software to stack or layer the images and to extract and compare the images in order to identify and filter hidden or subsurface anomalies that are invisible to the naked eye, and additional image processing software to orthorectify the images to a three-dimensional digital terrain map and to stitch adjacent images together into a mosaic. Methods for using the portable multispectral data acquisition system are also provided.

One embodiment provides a method of capturing the presence of a drone, including: collecting, using at least one sensor, data associated with an aerial object; analyzing, using a processor, the data to determine at least one characteristic of the aerial object; accessing, in a database, a library of stored characteristics of commercially available drones; determining, based on the analyzing, if the at least one characteristic of the aerial object matches a characteristic of a commercially available drone; and responsive to the determining, generating an indication of a positive match. Other aspects are described and claimed.

A method is provided for preventing a collision between a motor vehicle and a pedestrian. The method uses a camera and a processor mountable in the motor vehicle. A candidate image is detected. Based on a change of scale of the candidate image, it may be determined that the motor vehicle and the pedestrian are expected to collide, thereby producing a potential collision warning. Further information from the image frames may be used to validate the potential collision warning. The validation may include an analysis of the optical flow of the candidate image, that lane markings prediction of a straight road, a calculation of the lateral motion of the pedestrian, if the pedestrian is crossing a lane mark or curb and/or if the vehicle is changing lanes.

The present invention relates to various improvements relating to automatic vehicle equipment control systems.

The invention provides consumers, private enterprises, government agencies, contractors and third party vendors with tools and resources for gathering site specific information related to purchase and installation of energy systems. A system according to one embodiment of the invention remotely determines the measurements of a roof. An exemplary system comprises a computer including an input means, a display means and a working memory. An aerial image file database contains a plurality of aerial images of roofs of buildings in a selected region. A roof estimating software program receives location information of a building in the selected region and then presents the aerial image files showing roof sections of building located at the location information. Some embodiments of the system include a sizing tool for determining the size, geometry, and pitch of the roof sections of a building being displayed.

A method for computationally predicting future movement behaviors of at least one target object can have the steps of

• • producing sensor data by at least one sensor physically sensing the environment of a host vehicle, and
  • computing a plurality of movement behavior alternatives of a target object sensed by the sensor(s).

The context based prediction step uses a set of classifiers, each classifier estimating a probability that said sensed target object will execute a movement behavior at a time. The method can also include validating the movement behavior alternatives by a physical prediction comparing measured points with trajectories of situation models and determining at least one trajectory indicating at least one possible behavior of the traffic participant, estimating at least one future position of the traffic participant based on the at least one trajectory, and

• • outputting a signal representing the estimate future position.

A system mountable in a motor vehicle. The system includes a camera and a processor configured to receive image data from the camera. The camera includes a rolling shutter configured to capture the image data during a frame period and to scan and to read the image data into multiple image frames. A near infra-red illuminator may be configured to provide a near infra-red illumination cone in the field of view of the camera. The near infrared illumination oscillates with an illumination period. A synchronization mechanism may be configured to synchronize the illumination period to the frame period of the rolling shutter. The frame period may be selected so that the synchronization mechanism provides a spatial profile of the near infra-red illumination cone which may be substantially aligned vertically to a specific region, e.g. near the center of the image frame.

A computerized system for displaying, geolocating, and taking measurements from captured oblique images includes a data file accessible by the computer system. The data file includes a plurality of image files corresponding to a plurality of captured oblique images, and positional data corresponding to the images. Image display and analysis software is executed by the system for reading the data file and displaying at least a portion of the captured oblique images. The software retrieves the positional data for one or more user-selected points on the displayed image, and calculates a separation distance between any two or more selected points. The separation distance calculation is user-selectable to determine various parameters including linear distance between, area encompassed within, relative elevation of, and height difference between selected points.

Systems, methods and apparatus may be configured to implement automatic semantic classification of a detected object(s) disposed in a region of an environment external to an autonomous vehicle. The automatic semantic classification may include analyzing over a time period, patterns in a predicted behavior of the detected object(s) to infer a semantic classification of the detected object(s). Analysis may include processing of sensor data from the autonomous vehicle to generate heat maps indicative of a location of the detected object(s) in the region during the time period. Probabilistic statistical analysis may be applied to the sensor data to determine a confidence level in the inferred semantic classification. The inferred semantic classification may be applied to the detected object(s) when the confidence level exceeds a predetermined threshold value (e.g., greater than 50%).

An adaptive image acquisition system and method that generates virtual view of a surveillance scene to a user (operator), in which, the user operates the system. Through viewing the virtual view, the user controls sensors that create the virtual view. The sensors comprise at least one first sensor having a higher resolution than at least one second sensor. Images from the second sensor are processed to create an image mosaic that is overlaid with images from the higher resolution first sensor. In one embodiment of the invention, the first sensor is moved using Saccade motion. In another embodiment of the invention, a user's intent is used to control the Saccade motion.

In some implementations, a camera may be disposed on an autonomous aerial platform. A user may operate a smart wearable device adapted to configured, and/or operate video data acquisition by the camera. The camera may be configured to produce a time stamp, and/or a video snippet based on receipt of an indication of interest from the user. The aerial platform may comprise a controller configured to navigate a target trajectory space. In some implementation, a data acquisition system may enable the user to obtain video footage of the user performing an action from the platform circling around the user.

An augmented-reality helmet comprises a full-face motorcycle helmet with a look-down micro-display that projects a virtual image in-line with the helmet's chin bar. In order to accommodate the power requirements, the helmet includes a battery pack mounted at the base of the motorcyclist's skull. A wind turbine charges the batteries. Exhaust from the turbine is then deducted through the helmet to cool the battery pack and/or the motorcyclist's head. The turbine is controllable so that it can operate as a circulating fan to provide ventilation. A digital gyroscope provides a control input to a controller for operating a steerable headlight of the motorcycle to track the rider's head movements; and provides acceleration output to an algorithm that will contact emergency responders if the rider is non-responsive after a collision. A 170 degree rear-view camera is mounted within an aerodynamic fairing on the back of the helmet.

The invention discloses a remote sensing monitoring system for automotive exhaust emission of an urban road network. The system is mainly composed of a remote measurement device layer, a site selection and position arrangement layer, and a data processing layer. Through mobile, horizontal and vertical exhaust remote measurement devices, real-time data of the automotive exhaust emission in running is obtained; by adopting an advanced site selection and position arrangement method, the remote measurement devices are scientifically networked; and in combination with external data of weather, traffic, geographic information and the like, the real-time remote measurement data of the automotive exhaust emission is subjected to intelligent analysis and data mining by adopting big data processing and analysis technologies such as deep learning and the like, and key indexes and statistical data with optimal identification performance are obtained, so that effective support is provided for government departments to make related decisions.

A driver assistance systems mountable in a host vehicle while the host vehicle is moving forward with headlights on for detection of obstacles based on shadows. The driver assistance system includes a camera operatively connectible to a processor. A first image frame and a second image frame are captured of a road. A first dark image patch and a second dark image patch include intensity values less than a threshold value. The first and the second dark image patches are tracked from the first image frame to the second image frame as corresponding images of the same portion of the road. Respective thicknesses in vertical image coordinates are measured of the first and second dark image patches responsive to the tracking.

A method for automatically classifying images into events for composing and authoring of a multimedia image program on a recordable optical disc comprises the steps of: (a) receiving a plurality of images having either or both date and/or time of image capture; (b) determining one or more largest time differences of the plurality of images based on clustering of the images; (c) separating the plurality of images into events based on having one or more boundaries between events which one or more boundaries correspond to the one or more largest time differences; (d) specifying at least one multimedia feature that is related to each event; (e) encoding the images between event boundaries and the at least one multimedia feature associated therewith into an event bitstream; and (f) writing each event bitstream to the recordable optical disc, whereby each event is authored into a separate section of the recordable optical disc.

The invention discloses an unmanned aerial vehicle patrol detection image power small component identification method and system based on Faster R-CNN. The method comprises the following steps: carrying out pre-training on a ZFnet model, and extracting a feature graph of an unmanned aerial vehicle patrol detection image; training an RPN region proposed network model obtained through initialization to obtain a region extraction network, generating a candidate region frame on the feature graph of the image by utilizing the region extraction network, and carrying out feature extraction on the candidate region frame to extract position features and in-depth features of a target; carrying out training on a Faster R-CNN detection network obtained after initialization by utilizing the position features and in-depth features of the target and the feature graph to obtain a power small component detection model; and carrying out actual power small component identification detection by utilizing the power small component detection model. The beneficial effects are that Faster R-CNN is utilized to realize identification and positioning of a plurality of types of power small components, so that identification speed of about 80 ms per picture and 92.7% accuracy can be achieved.

Any presence of brake light emissions of another vehicle to the forward of a subject vehicle is sensed in a color camera and microprocessor system that detects (i) red light(s) illuminations in excess of other colors, that are any of (ii) appropriately sized, (iii) appropriately located, (iv) simultaneously occurring, (v) spaced apart in separation, (vi) substantially horizontal, and/or (vii) of approximately of equal intensity, as would be appropriate to a single brake light, or to a pair of brake lights, as the case may be. The brake lights of the subject vehicle are preferably applied either during (i) the persistence of any detection of the brake light(s) of any other vehicle(s) to the forward, or (ii) normal application of the subject vehicle's own brakes. The forward-sensed rearward-propagated brake light signal is preferably delayed in propagation, limiting any propagation of minor perturbations in traffic. Optional application of the vehicle's own brakes may be conditioned upon (i) proximity to and/or rate of closure with a forward emission source as is preferably determined by angles, and/or upon (ii) rate of closure, speed or deceleration G force of the subject vehicle. The brake light signal, whether simple or sophisticated in either its development and/or presentation, beneficially alerts drivers to the rear of impending or actual slowing, thus deterring rear end collisions and promoting fuel economy.

Vehicular situational awareness systems, method and arrangements are disclosed herein. In one embodiment digitized video can be acquired by a camera on a vehicle, and utilizing pixel differentiation at least one area of interest in the digitized video can be identified. The area of interest could be, for example, a group of pixels that represent another vehicle, a sign etc. Attribute information for the area of interest, such as size, movement etc of an object, can be acquired and then it can be determined if the attribute information is significant enough or important enough to set an alarm condition and notify the driver.

A user interface includes a display for displaying of a plurality of sensor data sets representative of signals associated with a plurality of sensors configured for sensing of a subsurface. At least some of the sensors are configured for subsurface sensing in a manner differing from other sensors of the plurality of sensors. Each of the sensor data sets comprises sensor data samples each associated with geographic position data. The sensor data sets are shown overlaid within a volume depicted on the display. The graphical representations of the sensor data sets are individually viewable within the volume and displayed in geographical alignment relative to one another within the volume in accordance with the geographic position data of the sensor data samples of each of the sensor data sets.

There is provided an exterior environment recognition device and an exterior environment recognition method. The exterior environment recognition device obtains a first image in a first exposure mode according to a level of light of an exterior environment, and obtains a second image in a second exposure mode of which exposure time is different from the first exposure mode and which allows determination as to whether a light emitting source is emitting light by itself or not. The exterior environment recognition device identifies, based on the first image, a vehicle area occupied by a vehicle preceding in a detection area, identifies a position of the light emitting source, based on luminance of the second image, and associates the position of the light emitting source and the vehicle area.

A method and system for processing image data to identify objects in an image. The method and system operate using various resolutions of the image to identify the objects. Information obtained while processing the image at one resolution is employed when processing the image at another resolution.

A method for efficiently and accurately inventorying image features such as timber, including steps of segmenting digital images into tree stands, segmenting tree stands into tree crowns, each tree crown having a tree crown area, classifying tree crowns based on species, and analyzing the tree crown classification to determine information about the individual tree crowns and aggregate tree stands. The tree crown area is used to determine physical information such as tree diameter breast height, tree stem volume and tree height. The tree crown area is also used to determine the value of timber in tree stands and parcels of land using tree stem volume and market price of timber per species.

Analysis of multi-spectral data for extraction of chlorophyll content. Multi-spectral data is obtained from an imaging device. The multi-spectral data contains spectral response data for chlorophyll and background data. The background data is removed from the multi-spectral data to isolate the spectral response due only to chlorophyll. This is then presented as a chlorophyll absorption feature which may be analyzed by measuring the width of the feature, the surface area of the feature, or measuring various angular changes of the feature. These measurements may than be used for a variety of purposes including plant health analysis.

A vehicle driving assist system is configured to convey a risk potential relating to a preceding obstacle to a driver using both visual information and haptic information. For example, the vehicle driving assist system executes accelerator pedal actuation reaction force control such that an actuation reaction force is generated in accordance with a risk potential that expresses a degree of convergence between the host vehicle and a preceding obstacle. In order to convey to the driver in a clear manner which preceding obstacle(s) is an obstacle targeted by the risk potential calculation and the reaction force control, the system displays a reference frame or marker at a position corresponding to the targeted obstacle (preceding vehicle). At least one of size, color, shape and brightness of the marker is set in accordance with the risk potential.