167 results about "Camera orientation" patented technology

Methods and processors for rendering a 3D object are disclosed. The method includes acquiring multi-camera image input including first image frames of the 3D object generated by a first camera and second image frames of the 3D object generated by a second camera, acquiring an initial 3D Gaussian Splatting (3DGS) model having a plurality of initial parameters including an initial frame-wise GS parameter and an initial camera-wise GS parameter, generating an adjusted 3DGS model by adjusting, based on the multi-camera image input, at least one of: the initial frame-wise GS parameter, the initial camera-wise GS parameter, generating, by the adjusted 3DGS model, a 3DGS output and rendering a 2D image of the 3D object using the 3DGS output.

Systems, methods, and apparatuses are described for causing a camera of a head-mounted computing device to capture a first video, the head-mounted computing device comprising a camera direction control element for controlling a capture direction of the camera, and a camera zoom control element for controlling zoom of the camera. One or more objects in the captured first video may be identified based on a detected gaze angle of a user wearing the head-mounted computing device. A target location in an environment may be determined, and based on such target location, the capture direction and zoom of the camera may be adjusted using the camera direction control element and the camera zoom control element, respectively. The camera may capture, based on the adjusted capture direction and the adjusted zoom of the camera, a second video using the camera of the head-mounted computing device.

The invention discloses a robot hand-eye calibration method, control equipment and a robot system, and relates to the technical field of robots. The robot hand-eye calibration method comprises the following steps: uniformly correcting a plurality of pixel coordinates obtained by dynamic shooting to a reference pixel coordinate system which is consistent with a camera coordinate system at a reference position in direction; and meanwhile, the world coordinates of the end effector corresponding to each sampling position are localized relative to the world coordinates of the end effector at the reference position, so that interference caused by global coordinate offset and camera orientation difference is eliminated, and the application range of the hand-eye calibration method is expanded. Besides, a singular value decomposition algorithm is adopted to solve a mapping relation between pixel coordinates and local world coordinates under a reference pixel coordinate system, so that a solved rotation matrix can meet orthogonality constraints, the hand-eye transformation process strictly conforms to a robot motion model with translation and rotation motion, and the calibration precision is improved. The calibration process can be automatically calculated and completed, and the calibration efficiency is high.

The invention discloses an omnidirectional fisheye image feature tracking and extracting method based on a non-parallel virtual binocular, and the method comprises the steps: constructing a four-eye fisheye camera system, obtaining the relative pose transformation based on a pre-calibration external parameter, predicting the pose based on a uniform speed model or IMU pre-integration, and constructing a re-projection error function through common-view feature points. According to the invention, by constructing four groups of virtual binocular combinations, on the premise of not increasing the number of physical cameras, eight-view-angle equivalent coverage is realized, so that a high-overlapping common-view area is formed between adjacent cameras; on the basis of a pre-calibrated external parameter and an MEI fisheye model, a spherical epipolar line is directly generated for a distorted image to carry out matching search, and meanwhile, a time sequence-space two-dimensional fault-tolerant mechanism is put forward for challenges of shielding and environmental interference: according to a dynamic direction switching design, when a tracking feature number is lower than a threshold value due to shielding in a camera direction, the tracking feature number is smaller than the threshold value; the camera direction is actively switched to serve as a main tracking source, new feature points are supplemented at the same time, and system collapse caused by local view failure is avoided.

A scene modeling system accesses a set of input two-dimensional (2D) images of a three-dimensional (3D) environment, wherein the input 2D images captured from a plurality of camera orientations. The environment includes first content. The scene modeling system applies a scene generation model to the set of input 2D images to generate a 3D remix scene. Applying the scene generation model includes configuring the scene generation model using at least a 2D discriminator and a 3D discriminator. Applying the scene generation model includes transmitting, for display via a user interface, the 3D remix scene. The 3D remix scene includes second content that is different from the first content.

The invention provides a grassland fire point detection and positioning method based on an unmanned aerial vehicle. The method comprises the following steps: Step 1, constructing a scene three-dimensional model by using a multi-overlapping-degree image; 2, detecting a suspicious target by using an optimized grassland fire point detection and positioning YOLOv8s model deployed on the unmanned aerial vehicle, calculating the orientation of a target point in an unmanned aerial vehicle coordinate system, automatically adjusting the flight direction of the unmanned aerial vehicle and the camera direction, and continuously approaching the suspicious target point; 3, the scene three-dimensional model established in the step 1 is used for accurately positioning the suspicious target, and the position # imgabs1 # of the target under the world coordinate system is obtained from the image plane coordinate # imgabs0 # of the target. Based on the optimized YOLOv8s model, steppe smoke and fire points are detected and tracked, and efficient detection and accurate positioning of the steppe fire points are achieved in combination with the live-action three-dimensional model. The optimized YOLOv8s shows higher recognition capability than other models, has 90.82% high-precision positioning when RTK is used, and can effectively recognize early fire points and feed back positioning information to a management department in time.

A computer-implemented method for determining a machine-learning function configured for taking an input 3D scene and for outputting one or more camera viewpoints each for generating a respective 2D rendering of the 3D scene. The method includes obtaining a library having 3D scenes. The method includes, based on the library, forming a first dataset for training a first neural network configured for outputting a camera position and forming a second dataset for training a second neural network configured for outputting a camera orientation. The method includes training the first neural network based on the first dataset and training the second neural network based on the second dataset. Each camera viewpoint outputted by the machine-learning function includes a camera position and a camera orientation. Such a method forms an improved solution for outputting one or more camera viewpoints of a 3D scene.

The invention provides a fog effect rendering method and device, electronic equipment and a computer readable storage medium, the method is applied to a game scene, and the game scene comprises a uniform medium and directional light; the method comprises the following steps: determining a plurality of target points from a light path between a to-be-rendered position in a uniform medium and a virtual camera; calculating a first distance from the position of the target point to the directional light; calculating a first attenuation value from the light intensity of the directional light to the target point according to the first distance and the fog concentration; calculating the incident light intensity of the target point according to the first attenuation value and the light intensity; according to the incident light intensity and the energy distribution of the target point in the direction pointing to the virtual camera, calculating the external scattering light intensity of the target point in the direction pointing to the virtual camera; and calculating an accumulated value of the external scattering light intensity of all the target points on the light path to obtain a fog effect rendering parameter, so that the game picture shot by the virtual camera presents a corresponding fog effect rendering effect. Through the method, the authenticity of the fog effect is improved.

A 3D building model generator has a server that constructs a 3D texture model for each floor in a building by extruding a 2D floor plan to 3D using user-inputted heights, and adding photos captured by a smartphone or mobile device as textures to image planes for surfaces in the 3D model. The server displays on the smartphone a floor-plan portion, or a virtual 3D display based on the camera orientation with a facing wall highlighted and confirmed by a smartphone user. The user moves mapping points overlaid upon the photo to wall corners to map the photo to the facing surface in the model. The user flags rooms and exits such as doors and elevators as walkable. The server stacks the 3D texture model for the floors and connects them into a walkable network of the rooms and exits that are flagged as walkable. Hashing removes duplicate floorplans.

To allow users to easily understand the direction of the imaging device that is taking their picture. [Solution] The imaging system of the present invention is an imaging system having an imaging device and a wearable device, characterized in that it has a determination means for determining the camera direction which is the direction from the wearable device toward the imaging device, and a notification means for notifying the user wearing the wearable device of the camera direction by vibration of the wearable device when the wearable device is within the imaging range of the imaging device.

The invention provides a three-dimensional effect rendering method and device and electronic equipment, and the method comprises the steps: carrying out the zooming processing of a target surface patch according to the model size of a target three-dimensional model and the camera orientation of a virtual camera, obtaining a zoomed target surface patch of which the size is matched with the model size, and keeping the zoomed target surface patch facing the virtual camera; stretching the scaled target surface patch according to the model shape of the target three-dimensional model to obtain a stretched target surface patch of which the shape is matched with the model shape; and moving the stretched target patch to the position of the target three-dimensional model in the virtual scene, deleting the target three-dimensional model in the virtual scene and rendering the stretched target patch to obtain a rendered target patch so as to simulate the three-dimensional effect of the target three-dimensional model through the rendered target patch. According to the method, the target surface patch is stretched in the camera space according to the visual angle, so that the surface patch fitting three-dimensional effect is realized, and a better three-dimensional effect is realized with extremely low rendering performance consumption.

The present disclosure particularly relates to a computer-implemented method for determining a machine learning function configured for taking an input 3D scene and for outputting one or more camera viewpoints, each camera viewpoint for generating a respective 2D rendering of the 3D scene. The method includes obtaining a library comprising a 3D scene. The method includes forming a first data set for training a first neural network configured to output a camera position based on the library, and forming a second data set for training a second neural network configured to output a camera orientation. The method includes training the first neural network based on the first data set and training the second neural network based on the second data set. Each camera viewpoint output by the machine learning function includes a camera position and a camera orientation. Such a method forms an improved solution for outputting one or more camera viewpoints of a 3D scene.

The camera surveillance system includes a first mirror-replacement camera extending outwardly from the vehicle. The first mirror-replacement camera defines a rear-facing field of view including at least one image feature during at least a first set of operating conditions. The at least one image feature has a fixed position within the field of view during at least the first set of operating conditions. The camera surveillance system controller is configured to automatically calibrate an orientation of the first mirror-replacement camera relative to the vehicle while the vehicle is operating under the first set of operating conditions by comparing a predicted position of the at least one image feature to an actual position of the at least one image feature and identifying a displacement of the camera orientation based on the difference.

Embodiments here observe the driver and determine an orientation of an articulating camera based on driver gaze tracking and external object detection. A fixed camera collects image data of the vehicle's surroundings, and an articulating camera collects image data of the driver. The gaze direction is used to identify what objects in the vehicle's surroundings the driver is looking at. Based on the position of the object, an orientation of the articulating camera may be determined.

This technology provides a way to effectively inform the subject of the direction of the imaging device. [Solution] The imaging system of the present invention is an imaging system having an imaging device and a wearable device, characterized by comprising: a first determination means for determining a camera direction which is the direction from the wearable device toward the imaging device; an acquisition means for acquiring information relating to the type of subject on which the wearable device is attached; a second determination means for determining a method for notifying the camera direction based on the information acquired by the acquisition means; and a notification means for notifying the subject of the camera direction determined by the first determination means from the wearable device using the notification method determined by the second determination means.

The invention relates to a method and device for detecting personnel in a vehicle cabin, electronic equipment, a medium and a vehicle, and particularly relates to the technical field of intelligent vehicle control. Comprising the steps that a plurality of image sets are acquired, and different image sets correspond to different camera azimuth information and / or camera type information; calculating a timestamp difference value between a target frame and an adjacent frame in the plurality of image sets; wherein the target frame and the adjacent frame are adjacent in time sequence and belong to different image sets; under the condition that the timestamp difference values are all within a preset threshold range, acquiring adjacent images of a preset frame number from the plurality of image sets; and inputting the preset frame number of adjacent images into the preset visual algorithm model to obtain the position of the personnel in the cabin output by the preset visual algorithm model, thereby improving the detection accuracy of the personnel in the vehicle cabin.

A method for inspecting an extreme ultraviolet (EUV) light source includes: removing a collector mirror of the EUV light source from a collector chamber; installing an inspection apparatus within the collector chamber, the apparatus including a selectively extendable and retractable member and a camera at one end of the member; operating a first actuator to extend the member along a path through the interior chamber of the EUV light source, thereby moving the camera to a given position within the interior chamber of the EUV light source; operating a second actuator to pan the camera about an axis of rotation, thereby establishing a given camera orientation within the interior of the EUV light source; and, capturing an image of the interior chamber of the EUV light source with the camera while the camera is at the given position and orientation established by the operation of the first and second actuators.

Systems, devices, media, and methods are described for capturing a series of video clips, together with position, orientation, and motion data collected from an inertial measurement unit during filming. The methods in some examples include calculating camera orientations based on the data collected, computing a stabilized output path based on the camera orientations, and then combining the video segments in accordance with said stabilized output path to produce a video composition that is stable, short, and easy to share. The video clips are filmed in accordance with a set of conditions called a capture profile. In some implementations, the capture profile conditions are reactive, adjusting in real time, during filming, in response to sensor data gathered in real time from a sensor array.

The embodiment of the application discloses a kind of based on indoor wireless signal control method, system first according to the installation position of wireless signal transmitter, transmission power, frequency parameter etc., signal coverage is calculated.According to signal coverage, shadow effect area is filtered out, and these areas are defined as target weak signal area needing optimization.System adjusts camera orientation, obtains the image of covering the weak signal area and its surrounding environment, generates target image data.System combines the coordinate position of wireless signal transmitter with the position of target weak signal area, analyzes and extracts the obstacle feature causing signal attenuation from target image.The system calculates the optimal reflection path of signal through reflection that can efficiently reach the target weak signal area according to the obstacle feature and camera position.System adjusts the transmission angle of wireless signal transmitter according to the optimal reflection path calculated, so that its signal propagates along the best path, thereby improving the communication quality of the area.

Techniques are described to estimate orientation of one or more cameras located on a vehicle. The orientation estimation technique can include obtaining an image from a camera located on a vehicle while the vehicle is being driven on a road, determining, from a terrain map, a location of a landmark located at a distance from a location of the vehicle on the road, determining, in the image, pixel locations of the landmark, selecting one pixel location from the determined pixel locations; and calculating values that describe an orientation of the camera using at least an intrinsic matrix and a previously known extrinsic matrix of the camera, where the intrinsic matrix is characterized based on at least the one pixel location and the location of the landmark. 2020257038 20 Oct 2020 the landmark. FI G . 1 10 6a 10 2 10 4 10 8 10 6c 10 6b 1 / 5 20 20 25 70 38 2 0 O ct 2 02 02020257038 20 Oct 2020 106c 106b 108 106a 104 FIG. 1

A wind turbine rotor blade imaging arrangement is provided, including a multi-axis gimbal mounted to the exterior of the wind turbine and configured to adjust its orientation in response to one or more received settings; a camera mounted on the multi-axis gimbal and arranged to capture images of a rotor blade; an image analysis unit configured to analyze the captured images; and a camera orientation controller configured to compute updated gimbal settings on the basis of the image analysis output.

To reduce labor required for three-dimensional photo measurement of agricultural products.SOLUTION: An agricultural mulch film 100 covering a ground surface planted with plants comprises a sheet-shaped member and a plurality of identification markers 101-116 for image recognition used for three-dimensional photo measurement arranged on the surface of the sheet-like member. The agricultural mulch film 100 is arranged in a state of covering a ridge 200 in a field. Some of the identification markers 101-116 are positioned on the upper part of the ridge 200 and others are positioned on the slope of the ridge 200.SELECTED DRAWING: Figure 1

The utility model discloses a camera multi-angle mounting rack which comprises a mounting base, a rotating disc is arranged in the mounting base, the upper end of the rotating disc is fixedly connected with a vertical rod, the vertical rod is slidably connected with a mounting rod through a lifting rail, and the lower end of the mounting rod is fixedly connected with a sliding rail through a first bolt. A communication module and a remote control module are arranged at the upper end of the mounting seat; the mounting block is slidably connected with the sliding rail, the lower end of the mounting block is fixedly connected with a steering gear, the steering gear is rotatably connected with a rotating frame, and the lower end of the rotating frame is fixedly connected with a camera. The mounting base, the rotating disc, the vertical rod, the lifting rail, the mounting rod, the bolt and the sliding rail are combined to form the direction changing mechanism, the rotating disc, the lifting rod and the sliding rail can change the camera shooting direction to adapt to different scenes, the structure is stable and flexible, and operation is easy; and an angle conversion mechanism is formed by combining the mounting block, the steering gear, the rotating frame and the camera, so that the shooting angle can be finely adjusted, and the shooting effect can be improved.

Methods and systems for camera direction control are provided. Example embodiments relate to taking images at certain predetermined angles so as to have consistent exposure between images. An example embodiment includes a method. The method includes determining, using a lidar device, light intensity information of a surrounding environment of the lidar device. The light intensity information includes a plurality of angles within an exposure threshold range. The method also includes determining a rotation time associated with each angle within the exposure threshold range. Further, the method includes determining a plurality of target image times based on the rotation time associated with each angle within the exposure threshold range. Moreover, the method includes capturing, by a camera system, a plurality of images at the plurality of target image times.

The invention relates to a tracking system (100) for illuminating a performer (12) at a tracked position (T) of a performance environment (10) with a light beam from a directable light beam generator, comprising: a camera input (120) for receiving a camera stream (125) from a camera arranged to observe the performance environment, where the camera stream represents a 2D view (127) of the performance environment presented by the camera; a display output (130) for outputting a display stream (125); and a controller (110) arranged to: acquire (210) a camera placement (30) of the camera relative to the performance environment; acquiring (215) a camera orientation ([theta]) of the camera relative to the performance environment; acquiring (255) an orientable beam generator placement (20, 20 ') of the orientable beam generator relative to the performance environment; acquiring (260) an orientable beam generator orientation ([theta]) of the orientable beam generator relative to the performance environment; receiving (230) a camera stream from a camera input; acquiring a tracked position; calculating (265) a 2D projection of the light beam at the tracked location based on the tracked location, the camera placement, the camera orientation, the orientable beam generator placement, and the orientable beam generator orientation; inserting (270) a beam indicator (190, 190 ', 191) for indicating the 2D projection of the beam in the camera stream to generate a display stream, and providing (250) the display stream to a display output.

According to the three-dimensional reconstruction method of the telecentric Sammer structured light based on the virtual plane, a traditional pinhole model is introduced for pre-calibration for the problem of uncertainty of external reference symbols in calibration of a telecentric camera, high-precision calibration is achieved, and the difference between an internal reference proportionality coefficient and a theoretical value is only one order of magnitude after a decimal point. Aiming at calibration of a Sammer projector, a Sammer pinhole imaging model is deduced, an equivalent internal and external parameter matrix is constructed by using a Zhang Zhengyou method to complete parameter initialization, coupling of a Sammer angle and a distortion parameter is reduced by using a multi-section optimization strategy, and a re-projection error is effectively reduced. In order to solve the problem that the Z direction of the telecentric camera is lack of translation parameters, a virtual plane concept is introduced, a space ray intersection mode is adopted to simplify the reconstruction complexity, and joint calibration and reconstruction of the system are achieved.

The application discloses a robot hand-eye calibration method, a control device and a robot system, and relates to the technical field of robots. The robot hand-eye calibration method unifies multiple pixel coordinates obtained through dynamic shooting to a reference pixel coordinate system consistent with the direction of the camera coordinate system at the reference position, simultaneously performs localization processing on the world coordinates of the end effector corresponding to each sampling position relative to the world coordinates of the end effector at the reference position, eliminates the interference caused by global coordinate offset and camera orientation difference, and expands the application range of the hand-eye calibration method. In addition, the singular value decomposition algorithm is used to solve the mapping relationship between the pixel coordinates in the reference pixel coordinate system and the local world coordinates, so that the rotation matrix obtained can satisfy the orthogonality constraint, the hand-eye transformation process strictly conforms to the robot motion model with translation and rotation motion, and the calibration accuracy is improved. The calibration process of the application can be automatically calculated, and the calibration efficiency is relatively high.

A camera integrates a magnet at one end of a cylindrical housing to magnetically attract and attach the camera to a front side of a peripheral display, such as to support a video conference through an information handling system interfaced with the display. Camera orientation at a display panel front face is detected, such as with an accelerometer or with analysis of a visual image captured by the camera module, so that the camera orientation is presented with an orientation indicator at the camera front face, such as an LED that illuminates with a predetermined color to indicate an upright vertical orientation. In one alternative embodiment, a gimble interfaced with the camera module and cylindrical housing actuates to adjust the camera module to the upright vertical orientation.