432 results about "Augmented reality systems" patented technology

An AI-powered augmented reality (AR) system for optimizing product placement and customer loyalty. The system includes: • a user interaction data collection unit configured to monitor consumer behavior in real time in any retail scenario (point-of-sale POS, online e-commerce and shopping areas within a public virtual technology space), with the unit analyzing consumer movement patterns, engagement metrics, eye-tracking and purchase intent; • an intelligent spatial mapping module to build a contextual understanding of high-traffic zones, underutilized areas and high-quality product placements using heatmap analysis, other spatial computer algorithms and the live movement of consumers; • A model-based product placement recommender based on machine learning, which uses one or more DL-based predictive models trained by importing current sales data, historical text interaction data, and consumer preference data to suggest optimal product placement so that customers see the advertisement and are likely to click through it to ensure a conversion. • a customer-centric, real-time AR visualization interface configured to allow customers to experience digitally enhanced product presentations directly via mobile AR applications, smart glasses, or in-store digital kiosks, enabling customers to preview product placements, rotate and resize objects, and visualize interactive advertising content before purchasing; • a customized advertising and sales promotion engine configured to generate augmented reality-based marketing content and provide users with tailored promotions and interactive ads based at least in part on an analysis of consumer sentiment by the system, as well as information on location data or consumer interaction history, wherein the customized advertising and sales promotion engine personalizes the configuration instructions for advertising and sales promotion to encourage consumer interaction and achieve higher sales revenues; • A secure, cloud-based data processing and analytics unit that uses an automated engagement model to link online and in-store sales information with established activity models for product placement decisions. The unit leverages AI-powered consumer insights to continuously recommend product placement changes based on a variety of programmatic retail trends; • a privacy-friendly AI module based on federated learning and on-device AI processing, providing consumer behavior analytics while complying with global data protection regulations and preventing the use of open data; • a processing framework characterized by a low-power mode suitable for AR rendering and AI calculations, and implemented via dynamic voltage scaling and energy management techniques for seamless and sustainable operation; The system according to claim 1, wherein the user interaction data capture unit further comprises an eye-tracking and sentiment analysis sub-module, wherein the sub-module detects facial expressions, emotional reactions, and attention levels of consumers in real time to determine the effectiveness of product placements and advertising strategies.

The present invention relates to an advanced augmented reality, AR, apparatus featuring a video see-through AR, VST-AR, device that captures images of a real-world environment and displays augmented versions on a screen. The system includes a corporal entity, such as an empty laboratory vessel, equipped with a unique identification marker. This marker provides real-time spatial data for generating visual augmentations representing virtual matter within the vessel. The apparatus integrates various sensors, including an inertial measurement unit, IMU, capacitive tactile sensors, and a thermal diode, to dynamically adjust visual augmentations based on user interactions. Additional sensory enhancements include an olfactory output fan, an eccentric rotating mass, ERM, motor, and auditory outputs. Wireless connectivity via IEEE 802.11 (Wi-Fi) and IEEE 802.15.1 (Bluetooth) ensures seamless communication between components. This AR system is particularly valuable for educational and laboratory settings, offering realistic, interactive simulations.

The invention relates to the technical field of augmented reality application, and discloses an augmented reality system and method for immersive experience. The method comprises the following steps: collecting dynamic spatial data of a physical environment in real time, and synchronously obtaining an interactive behavior data stream of a user terminal; performing environment semantic modeling on the dynamic spatial data to generate multi-level feature description of a physical environment, and determining a rendering priority sequence of virtual-real superposition content according to the multi-level feature description; extracting behavior pattern characteristics in historical interaction data of the user, performing immersion correlation analysis on the behavior pattern characteristics to obtain environment cognitive preference parameters of the current user, and generating a virtual-real interaction event sequence in combination with the environment cognitive preference parameters and the interaction behavior data flow; and dynamically compensating the virtual-real synchronization error in the immersive experience process according to the rendering priority sequence and the virtual-real interaction event sequence. According to the method, the accuracy and naturalness of virtual-real fusion can be improved, the personalized requirements of the user are met, and the overall immersive experience effect is enhanced.

An automation system controls an automated production process of an industrial plant. The system includes an augmented reality system, including augmented reality glasses and executable program logic coupled to the augmented reality glasses. The executable program logic is configured to receive an up-to-date spatial position of a user wearing the augmented reality glasses from a positioning system, determine coordinates of a bounding space proximate to the user wearing the AR-glasses, display one or more virtual objects to the wearer of the AR glasses via the AR glasses if and only if coordinates of the virtual objects are within the bounding space, and continuously update the coordinates of the three-dimensional bounding space and the virtual objects displayed therein as a function of the up-to-date spatial position of the user wearing the AR glasses.

An automation system controls an automated production process of an industrial plant. The industrial plant includes a plurality of equipment for performing the production process. The automation system includes an augmented reality system including augmented reality glasses, executable program logic and a database system including a task manager configured to store a list of processes associated with respective equipment, where each process includes one or more tasks to be performed with respect to the equipment. The executable program logic is configured to receive from the database system the list of processes for display to a user of the AR glasses, receive a selection of a displayed process assigned to the user, send the selected process to the database system, and receive from the database system additional data corresponding to the selected process.

A system can operate to receive an indication of a point in a space of an environment, wherein an augmented reality system is located in the space of the environment at a coordinate in a first coordinate system. The system can operate to query a digital twin for a coordinate of the point in a second coordinate system, the digital twin including a contextual description of the environment. The system can operate to translate the coordinate of the augmented reality system in the first coordinate system to a coordinate of the augmented reality system in the second coordinate system based on the coordinate of the point in the second coordinate system and the coordinate of the augmented reality system in the first coordinate system. The system can operate to generate data to cause the augmented reality system to display information based at least in part on the translation.

Augmented reality systems provide graphics over views from a mobile device for both in-venue and remote viewing of a sporting or other event. A server system can provide a transformation between the coordinate system of a mobile device (mobile phone, tablet computer, head mounted display) and a real world coordinate system. Requested graphics for the event are displayed over a view of an event. In a tabletop presentation, video of the event can be displayed with augmented reality graphics overlays at a remote location.

Disclosed herein is an augmented reality (AR) system that provides information about purchasing alternatives to a user who is about to purchase an item or product (e.g., a target product) in a physical retail location. In some variations, offers to purchase the product and / or an alternative product are provided by the merchant and / or competitors via the AR system. An offer negotiation server (ONS) aggregates offer data provided various external parties (EPs) and displays these offers to the user as the user is considering the purchase of a target product. In some variations, an AR system may be configured to facilitate the process of purchasing items at a retail location.

An augmented reality (AR) system for generating augmented reality reservation content using an AR computing device and an AR display device operated by a user is disclosed. The AR system is configured to receive, from the AR display device, image data, at least one user input, and geolocation data. The AR computing device is configured to process the image data using object recognition and the geolocation of the user to identify at least one object The AR computing device is further configured to communicate with an application programming interface (API) to obtain reservation data associated with the identified at least one object. The AR computing device is further configured to generate AR content associated with the received reservation data. The AR display device is configured to display the AR content on a display screen of the AR display device.

Devices, networks, systems, methods, and processes for an Augmented Reality (AR) based device management. An AR device may receive an image depicting one or more objects, from a camera. The AR device may determine position data, including a position and an orientation, of the AR device, and transmit the position data and the image to an application server. The application server may identify the one or more objects in the image and obtain status data associated with the one or more objects. The application server may generate overlay data based on the status data of the objects. The application server may transmit the overlay data to the AR device. An augmented image generated based on the overlay data may be displayed on the AR device to present the object status data. Such augmented images integrate information with real-world objects, providing instant access to object status data and enhancing user understanding.

Augmented reality systems provide graphics over views from a mobile device for both in-venue and remote viewing of a sporting or other event. A server system can provide a transformation between the coordinate system of a mobile device (smart phone, tablet computer, head mounted display) and a real world coordinate system. Requested graphics for the event are displayed over a view of an event.

An automation system controls an automated production process of an industrial plant including a plurality of equipment for performing the production process. The system includes an augmented reality system, including a database system configured to store data and spatial coordinates associated with respective equipment of the plurality of equipment, augmented reality glasses configured to display the data, and executable program logic coupled to the augmented reality glasses. The executable program logic receives an up-to-date spatial position of a user from a positioning system and the data of equipment that are located in a proximity of the up-to-date spatial position of the user from the database system and control the augmented reality glasses for display of at least some of the received data.

A display system includes a wearable display device for displaying augmented reality content. The display device comprises a display area comprising light redirecting features that are configured to direct light to a user. The display area is at least partially transparent and is configured to provide a view of an ambient environment through the display area. The display device is configured to determine that a reflection of the user is within the user's field of view through the display area. After making this determination, augmented reality content is displayed in the display area with the augmented reality content augmenting the user's view of the reflection. In some embodiments, the augmented reality content may overlie on the user's view of the reflection, thereby allowing all or portions of the reflection to appear to be modified to provide a realistic view of the user with various modifications made to their appearance.

This disclosure describes an interactive augmented reality system for improving surgeon's view and context awareness during laparoscopic and video assisted surgeries. Instead of purely relying on computer vision algorithms for image registration between pre-operation (or intra-operation) images / models and later intra-operation scope images, the system can implement an interactive mechanism where surgeons may provide supervised information in initial calibration phase of the augmented reality function, thus achieving high accuracy in image registration. Besides the initialization phase before operation starts, interaction between surgeon and the system can also happens during the surgery. Specifically, patient tissue might move or deform during surgery, caused by for example cutting. The augmented reality system can re-calibrate during surgery when image registration accuracy deteriorates, by seeking additional supervised labeling from surgeons. The augmented reality system can improve surgeon's view during surgery, by utilizing surgeon's guidance sporadically to achieve high image registration accuracy.

A head mounted display for use in a virtual reality, mixed reality or augmented reality system comprises a display device configured to display an image, a tracking system configured to determine a gaze direction of a user's eye and an optical system configured to project the image into the user's eye, the optical system comprising an adjustable optical device; and processing circuitry configured to control the adjustable optical device based on the gaze direction of the user's eye such that a position of the image projected into the user's eye is unchanged, when the gaze direction of the user's eye changes.

The present invention relates to an augmented reality system (AR system) for teaching a user of an application. The AR system comprises a detection unit that detects a real environment and provides it as environmental data, wherein at least one work unit is arranged in the environment; a communication unit that receives process data from the work unit; a control unit that processes the process data and environmental data, wherein a virtual image can be created based on the process data; and a display unit that displays the real environment and the virtual image in relation to one another to a user. The AR system further comprises an audio output unit that, on the basis of the process data, outputs audio signals for instructing a user, wherein the audio signals are preferably matched to the virtual image.

A virtual camera augmented reality (AR) system detects selection of a virtual camera added as an extension in an internet browser, generates a new canvas element for the virtual camera, and accesses video frames captured by a hardware camera coupled with a computing device. The virtual camera AR system detects selection of an AR option and applies the AR option to each video frame of at least a subset of the accessed video frames, at a predefined rate. The virtual camera AR system provides each video frame of at least the subset of video frames comprising the applied AR option to the new canvas element and causes display, of each video frame of at least the subset of video frames comprising the applied AR option in the new canvas element, on a user interface of the computing device.

An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.

An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.

An augmented reality (AR) system for an aircraft obtains an aircraft pose, determines a passenger pose relative to a window, and computes a field-of-view of the passenger. Operations select a set of passenger-relevant points of information (POIs) from a database that satisfy a relevance rule to the real-world objects viewable by the passenger through the window. For each of the passenger-relevant POIs in the set, operations determine an AR indicia to be displayed, and an AR indicia pose where the AR indicia is to be rendered on a display device. Operations generate a display command based on the AR indicia and the AR indicia pose for the passenger-relevant POIs in the set. Operations provide the display command to the display device to display renderings of the AR indicias with the AR indicia poses to augment the real-world objects viewed by the passenger through the window.

An augmented reality (AR) system includes a display, a camera; and a secure data vault system. The secure data vault system includes a sandbox system operatively coupled to the camera and configured to receive camera data from the camera, wherein in operations of the AR system, the camera only sends camera data to the sandbox system, and wherein the sandbox system comprises an execution environment configured to restrict execution of instructions to a predefined memory address range. The secure data vault system additionally includes a display and rending system operatively coupled to the sandbox system and configured to render an image based on the camera data processed via the instructions and to display the image via the display, wherein the display is configured to show both the image and a real-world environment surrounding the AR system.

A viewing optics assembly for augmented reality includes a projector configured to generate image light and an eyepiece optically coupled to the projector. The eyepiece includes at least one eyepiece layer comprising a waveguide having a surface, an incoupling grating coupled to the waveguide, and an outcoupling grating coupled to the waveguide. The outcoupling grating comprises a first array of first ridges protruding from the surface of the waveguide, each of the first ridges having a first height in a direction perpendicular to the surface and a first width in a direction parallel to the surface and a plurality of second ridges, each of the plurality of second ridges protruding from a respective first ridge of the first ridges and having a second height and a second width. At least one of the first width or the second width varies as a function of position across the surface.

An augmented reality system may include a waveguide having an edge surface extending between opposing light guide surfaces. The waveguide may direct light toward the edge surface. The waveguide may include a reduced reflectivity film, such as an absorber film or a photovoltaic film, disposed on the edge surface. To form a reduced reflectivity film, a curable material may be disposed on the dissolvable film. The curable material may be cured when disposed on the dissolvable film such that the cured material forms a reduced reflectivity structure on the dissolvable film. The dissolvable film may be dissolved such that the reduced reflectance structure remains intact as a reduced reflectance film, which may be adhered to the edge surface, for example, with a primer layer. The edge surface may include a nanostructure sized to be less than the half wavelength of the guided light, which nanostructure may reduce the reflectivity of the edge surface.

Systems and methods track a user's line-of-sight relative to objects through a transparent LCD display to provide information about the objects to be displayed on the display proximate the line-of-sight between the object being viewed and the user's head to create an augmented reality environment for the user. A method comprising: determining a position of an object; determining a position of a transparent display; determining a line-of-sight extending between a user's eye and the object through the transparent display; determining where the line-of-sight intersects the transparent display; and displaying object information corresponding to the object via the transparent display proximate where the line-of-sight intersects the transparent display.

A system and method for locating and guiding a peripheral nerve evaluation (PNE) lead. The system comprising an X-ray system to capture images of the patient. The images are processed by the system and are provided to a user to utilize an augmented reality (AR) system for inserting a needle for placing leads for the PNE procedure.

An augmented reality system and method for assisting surgical staff during an arthroplasty procedure includes a camera system configured to capture images of a surgical scene and a processor configured to determine from the images location and orientation information about one or more patient anatomical features and to maintain a three-dimensional model of these anatomical features within the surgical scene. The system models the field-of-view of augmented reality headsets worn by surgical staff, and maps this to the anatomical model, allowing the system to overlay relevant information to the user about particular anatomical features in the surgical plan.

Systems and methods are provided for verifying and tracking asset status using blockchain and augmented reality (AR). An example commerce system may comprise: (1) a signal-emitting tag attached to an asset; and (2) one or more processing resources configured to, in response to at least one of a device of a first user and a device of a second user processing a signal from the signal-emitting tag: (a) determine the processed signal is associated with an identifying blockchain hash code that uniquely identifies the asset within the commerce platform, (b) verify the first user is a valid possessor of the asset based on at least one of the identifying blockchain hash code and a transaction-recording blockchain that records transactions involving the asset on the commerce platform, and (c) permit the first user and the second user to execute a transaction involving the asset via the commerce platform.

A high-resolution image sensor suitable for use in an augmented reality (AR) system to provide low latency image analysis with low power consumption. The AR system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object, selectively output imaging information for that region, and synchronously output high-resolution image frames. The region may be updated dynamically as the image sensor and / or the object moves. The image sensor may output the high-resolution image frames less frequently than the region being updated when the image sensor and / or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an AR scene can be developed.

Systems and methods herein describe generating automatic reactions in an augmented reality messenger system. The claimed systems and methods generate a contextual trigger defining a set of conditions at a first computing device, detect at least one of the set of conditions has been satisfied, cause presentation of an augmented reality content item at a second computing device, generate a user reaction in response to the presentation of the augmented reality content item and transmit the user reaction to a first computing device.

Head-mounted augmented reality (AR) devices can track pose of a wearer's head to provide a three-dimensional virtual representation of objects in the wearer's environment. An electromagnetic (EM) tracking system can track head or body pose. A handheld user input device can include an EM emitter that generates an EM field, and the head-mounted AR device can include an EM sensor that senses the EM field. EM information from the sensor can be analyzed to determine location and / or orientation of the sensor and thereby the wearer's pose. The EM emitter and sensor may utilize time division multiplexing (TDM) or dynamic frequency tuning to operate at multiple frequencies. Voltage gain control may be implemented in the transmitter, rather than the sensor, allowing smaller and lighter weight sensor designs. The EM sensor can implement noise cancellation to reduce the level of EM interference generated by nearby audio speakers.