671 results about "Augmented reality systems" patented technology

An AI-powered augmented reality (AR) system for optimizing product placement and customer loyalty. The system includes: • a user interaction data collection unit configured to monitor consumer behavior in real time in any retail scenario (point-of-sale POS, online e-commerce and shopping areas within a public virtual technology space), with the unit analyzing consumer movement patterns, engagement metrics, eye-tracking and purchase intent; • an intelligent spatial mapping module to build a contextual understanding of high-traffic zones, underutilized areas and high-quality product placements using heatmap analysis, other spatial computer algorithms and the live movement of consumers; • A model-based product placement recommender based on machine learning, which uses one or more DL-based predictive models trained by importing current sales data, historical text interaction data, and consumer preference data to suggest optimal product placement so that customers see the advertisement and are likely to click through it to ensure a conversion. • a customer-centric, real-time AR visualization interface configured to allow customers to experience digitally enhanced product presentations directly via mobile AR applications, smart glasses, or in-store digital kiosks, enabling customers to preview product placements, rotate and resize objects, and visualize interactive advertising content before purchasing; • a customized advertising and sales promotion engine configured to generate augmented reality-based marketing content and provide users with tailored promotions and interactive ads based at least in part on an analysis of consumer sentiment by the system, as well as information on location data or consumer interaction history, wherein the customized advertising and sales promotion engine personalizes the configuration instructions for advertising and sales promotion to encourage consumer interaction and achieve higher sales revenues; • A secure, cloud-based data processing and analytics unit that uses an automated engagement model to link online and in-store sales information with established activity models for product placement decisions. The unit leverages AI-powered consumer insights to continuously recommend product placement changes based on a variety of programmatic retail trends; • a privacy-friendly AI module based on federated learning and on-device AI processing, providing consumer behavior analytics while complying with global data protection regulations and preventing the use of open data; • a processing framework characterized by a low-power mode suitable for AR rendering and AI calculations, and implemented via dynamic voltage scaling and energy management techniques for seamless and sustainable operation; The system according to claim 1, wherein the user interaction data capture unit further comprises an eye-tracking and sentiment analysis sub-module, wherein the sub-module detects facial expressions, emotional reactions, and attention levels of consumers in real time to determine the effectiveness of product placements and advertising strategies.

An augmented reality scene description format is provided comprising relationships between real and virtual objects and interactive triggering and processing of the augmented reality scene. An augmented reality system can read the scene description and run a corresponding augmented reality application. The scene description comprises a scene graph structuring descriptions of the real and virtual objects which may be linked to media content items. It also comprises anchors that describes triggers for performing actions on the media content items, on the scene description itself and / or on remote devices and services.

The present invention relates to an advanced augmented reality, AR, apparatus featuring a video see-through AR, VST-AR, device that captures images of a real-world environment and displays augmented versions on a screen. The system includes a corporal entity, such as an empty laboratory vessel, equipped with a unique identification marker. This marker provides real-time spatial data for generating visual augmentations representing virtual matter within the vessel. The apparatus integrates various sensors, including an inertial measurement unit, IMU, capacitive tactile sensors, and a thermal diode, to dynamically adjust visual augmentations based on user interactions. Additional sensory enhancements include an olfactory output fan, an eccentric rotating mass, ERM, motor, and auditory outputs. Wireless connectivity via IEEE 802.11 (Wi-Fi) and IEEE 802.15.1 (Bluetooth) ensures seamless communication between components. This AR system is particularly valuable for educational and laboratory settings, offering realistic, interactive simulations.

An augmented reality, AR, system (100) for use in a medical procedure is disclosed. The AR system (100) comprises an AR headset (2), and a processor (12). The AR headset (2) comprises a camera (6a, 6b), a near eye display (4a, 4b) and a depth sensor (10a, 10b). The processor (12) is configured to adjust the position of the image obtained by the camera (6a, 6b) on the display (4a, 4b) throughout the medical procedure based on changes in the distance measured by the depth sensor (10a, 10b).

The invention relates to the technical field of augmented reality application, and discloses an augmented reality system and method for immersive experience. The method comprises the following steps: collecting dynamic spatial data of a physical environment in real time, and synchronously obtaining an interactive behavior data stream of a user terminal; performing environment semantic modeling on the dynamic spatial data to generate multi-level feature description of a physical environment, and determining a rendering priority sequence of virtual-real superposition content according to the multi-level feature description; extracting behavior pattern characteristics in historical interaction data of the user, performing immersion correlation analysis on the behavior pattern characteristics to obtain environment cognitive preference parameters of the current user, and generating a virtual-real interaction event sequence in combination with the environment cognitive preference parameters and the interaction behavior data flow; and dynamically compensating the virtual-real synchronization error in the immersive experience process according to the rendering priority sequence and the virtual-real interaction event sequence. According to the method, the accuracy and naturalness of virtual-real fusion can be improved, the personalized requirements of the user are met, and the overall immersive experience effect is enhanced.

An automation system controls an automated production process of an industrial plant. The system includes an augmented reality system, including augmented reality glasses and executable program logic coupled to the augmented reality glasses. The executable program logic is configured to receive an up-to-date spatial position of a user wearing the augmented reality glasses from a positioning system, determine coordinates of a bounding space proximate to the user wearing the AR-glasses, display one or more virtual objects to the wearer of the AR glasses via the AR glasses if and only if coordinates of the virtual objects are within the bounding space, and continuously update the coordinates of the three-dimensional bounding space and the virtual objects displayed therein as a function of the up-to-date spatial position of the user wearing the AR glasses.

An automation system controls an automated production process of an industrial plant. The industrial plant includes a plurality of equipment for performing the production process. The automation system includes an augmented reality system including augmented reality glasses, executable program logic and a database system including a task manager configured to store a list of processes associated with respective equipment, where each process includes one or more tasks to be performed with respect to the equipment. The executable program logic is configured to receive from the database system the list of processes for display to a user of the AR glasses, receive a selection of a displayed process assigned to the user, send the selected process to the database system, and receive from the database system additional data corresponding to the selected process.

A system can operate to receive an indication of a point in a space of an environment, wherein an augmented reality system is located in the space of the environment at a coordinate in a first coordinate system. The system can operate to query a digital twin for a coordinate of the point in a second coordinate system, the digital twin including a contextual description of the environment. The system can operate to translate the coordinate of the augmented reality system in the first coordinate system to a coordinate of the augmented reality system in the second coordinate system based on the coordinate of the point in the second coordinate system and the coordinate of the augmented reality system in the first coordinate system. The system can operate to generate data to cause the augmented reality system to display information based at least in part on the translation.

An augmented reality (AR) system is provided. The AR system generates a text scene object including a virtual text object based on the text, and detects a text selection gesture made by a user of the AR system. The AR system generates a selection line based on a landmark of a user's hand. The AR system detects a confirmation gesture made by the user and sets a text selection start point at an intersection of a selection line and a starting virtual text object of the one or more virtual text objects. The AR system detects a subsequent confirmation gesture made by the user, sets a text selection end point, and selects a selected text from the text based on the text selection start point and the text selection end point.

Augmented reality systems provide graphics over views from a mobile device for both in-venue and remote viewing of a sporting or other event. A server system can provide a transformation between the coordinate system of a mobile device (mobile phone, tablet computer, head mounted display) and a real world coordinate system. Requested graphics for the event are displayed over a view of an event. In a tabletop presentation, video of the event can be displayed with augmented reality graphics overlays at a remote location.

A gesture-based text input user interface for an augmented reality (AR) system is provided. The AR system detects a start text input gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides the virtual keyboard user interface to the user. The AR system detects a retention of an input text gesture made by a user. When the user maintains an input text gesture, the AR system collects continuous motion gesture data for continuous motion as the user performs continuous motion across virtual keys of the virtual keyboard. The AR system detects a release of the input text gesture by the user and generates input text data based on the continuous motion gesture data.

Disclosed herein is an augmented reality (AR) system that provides information about purchasing alternatives to a user who is about to purchase an item or product (e.g., a target product) in a physical retail location. In some variations, offers to purchase the product and / or an alternative product are provided by the merchant and / or competitors via the AR system. An offer negotiation server (ONS) aggregates offer data provided various external parties (EPs) and displays these offers to the user as the user is considering the purchase of a target product. In some variations, an AR system may be configured to facilitate the process of purchasing items at a retail location.

An augmented reality (AR) system for generating augmented reality reservation content using an AR computing device and an AR display device operated by a user is disclosed. The AR system is configured to receive, from the AR display device, image data, at least one user input, and geolocation data. The AR computing device is configured to process the image data using object recognition and the geolocation of the user to identify at least one object The AR computing device is further configured to communicate with an application programming interface (API) to obtain reservation data associated with the identified at least one object. The AR computing device is further configured to generate AR content associated with the received reservation data. The AR display device is configured to display the AR content on a display screen of the AR display device.

A high-resolution image sensor suitable for use in an augmented reality (AR) system to provide low latency image analysis with low power consumption. The AR system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object, selectively output imaging information for that region, and synchronously output high-resolution image frames. The region may be updated dynamically as the image sensor and / or the object moves. The image sensor may output the high-resolution image frames less frequently than the region being updated when the image sensor and / or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an AR scene can be developed.

A system for facilitating cardiopulmonary resuscitation (CPR) by a CPR performer on a patient includes first, second, and third sensors configured to be positioned at least partially between a hand of the CPR performer and a chest of the patient. The first sensor is configured to measure a depth of compressions provided by the CPR performer on the patient. The second sensor is configured to measure a rate of the compressions. The third sensor is configured to measure a recoil of the compressions. The system also includes a computing system configured to receive data from the first, second, and third sensors. The computing system is also configured to compare the received data to stored data in a library that corresponds to the received data. The computing system is also configured to generate one or more outputs in response to the comparison.

An amusement ride system includes a ride vehicle configured to carry a passenger, one or more sensors configured to detect a face and a body of the passenger while the passenger is in the ride vehicle, and a display assembly configured to be viewable by the passenger while the passenger is in the ride vehicle. The amusement ride system also includes a controller configured to generate an animation based on signals received from the one or more sensors and to instruct display of the animation on the display assembly. The signals are indicative of movement of the face and the body of the passenger, and the animation mimics the movement of the face and the body of the passenger.

Devices, networks, systems, methods, and processes for an Augmented Reality (AR) based device management. An AR device may receive an image depicting one or more objects, from a camera. The AR device may determine position data, including a position and an orientation, of the AR device, and transmit the position data and the image to an application server. The application server may identify the one or more objects in the image and obtain status data associated with the one or more objects. The application server may generate overlay data based on the status data of the objects. The application server may transmit the overlay data to the AR device. An augmented image generated based on the overlay data may be displayed on the AR device to present the object status data. Such augmented images integrate information with real-world objects, providing instant access to object status data and enhancing user understanding.

The described technology regards an augmented reality system and method for estimating a position of a location of interest relative to the position and orientation of a display, including receiving and selectively filtering a plurality of measurement vectors from a rate-gyroscope. Systems of the described technology include including a plurality of sensors, a processing module or other computation means, and a database. Methods of the described technology use data from the sensor package useful to accurately render graphical user interface information on a display.

Augmented reality systems provide graphics over views from a mobile device for both in-venue and remote viewing of a sporting or other event. A server system can provide a transformation between the coordinate system of a mobile device (smart phone, tablet computer, head mounted display) and a real world coordinate system. Requested graphics for the event are displayed over a view of an event.

An automation system controls an automated production process of an industrial plant including a plurality of equipment for performing the production process. The system includes an augmented reality system, including a database system configured to store data and spatial coordinates associated with respective equipment of the plurality of equipment, augmented reality glasses configured to display the data, and executable program logic coupled to the augmented reality glasses. The executable program logic receives an up-to-date spatial position of a user from a positioning system and the data of equipment that are located in a proximity of the up-to-date spatial position of the user from the database system and control the augmented reality glasses for display of at least some of the received data.

A display system includes a wearable display device for displaying augmented reality content. The display device comprises a display area comprising light redirecting features that are configured to direct light to a user. The display area is at least partially transparent and is configured to provide a view of an ambient environment through the display area. The display device is configured to determine that a reflection of the user is within the user's field of view through the display area. After making this determination, augmented reality content is displayed in the display area with the augmented reality content augmenting the user's view of the reflection. In some embodiments, the augmented reality content may overlie on the user's view of the reflection, thereby allowing all or portions of the reflection to appear to be modified to provide a realistic view of the user with various modifications made to their appearance.

This disclosure describes an interactive augmented reality system for improving surgeon's view and context awareness during laparoscopic and video assisted surgeries. Instead of purely relying on computer vision algorithms for image registration between pre-operation (or intra-operation) images / models and later intra-operation scope images, the system can implement an interactive mechanism where surgeons may provide supervised information in initial calibration phase of the augmented reality function, thus achieving high accuracy in image registration. Besides the initialization phase before operation starts, interaction between surgeon and the system can also happens during the surgery. Specifically, patient tissue might move or deform during surgery, caused by for example cutting. The augmented reality system can re-calibrate during surgery when image registration accuracy deteriorates, by seeking additional supervised labeling from surgeons. The augmented reality system can improve surgeon's view during surgery, by utilizing surgeon's guidance sporadically to achieve high image registration accuracy.

A head mounted display for use in a virtual reality, mixed reality or augmented reality system comprises a display device configured to display an image, a tracking system configured to determine a gaze direction of a user's eye and an optical system configured to project the image into the user's eye, the optical system comprising an adjustable optical device; and processing circuitry configured to control the adjustable optical device based on the gaze direction of the user's eye such that a position of the image projected into the user's eye is unchanged, when the gaze direction of the user's eye changes.

The present invention relates to an augmented reality system (AR system) for teaching a user of an application. The AR system comprises a detection unit that detects a real environment and provides it as environmental data, wherein at least one work unit is arranged in the environment; a communication unit that receives process data from the work unit; a control unit that processes the process data and environmental data, wherein a virtual image can be created based on the process data; and a display unit that displays the real environment and the virtual image in relation to one another to a user. The AR system further comprises an audio output unit that, on the basis of the process data, outputs audio signals for instructing a user, wherein the audio signals are preferably matched to the virtual image.

A virtual camera augmented reality (AR) system detects selection of a virtual camera added as an extension in an internet browser, generates a new canvas element for the virtual camera, and accesses video frames captured by a hardware camera coupled with a computing device. The virtual camera AR system detects selection of an AR option and applies the AR option to each video frame of at least a subset of the accessed video frames, at a predefined rate. The virtual camera AR system provides each video frame of at least the subset of video frames comprising the applied AR option to the new canvas element and causes display, of each video frame of at least the subset of video frames comprising the applied AR option in the new canvas element, on a user interface of the computing device.

An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.

An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.

An augmented reality (AR) system for an aircraft obtains an aircraft pose, determines a passenger pose relative to a window, and computes a field-of-view of the passenger. Operations select a set of passenger-relevant points of information (POIs) from a database that satisfy a relevance rule to the real-world objects viewable by the passenger through the window. For each of the passenger-relevant POIs in the set, operations determine an AR indicia to be displayed, and an AR indicia pose where the AR indicia is to be rendered on a display device. Operations generate a display command based on the AR indicia and the AR indicia pose for the passenger-relevant POIs in the set. Operations provide the display command to the display device to display renderings of the AR indicias with the AR indicia poses to augment the real-world objects viewed by the passenger through the window.

The invention relates to the augmented reality (AR) interface control systems and methods. The technical effect consists in expanding the augmented reality system functionality through the possibility to control the AR interface by means of bioelectric signals detected using the contact lenses, and enhancing the compactness of the wearable part of the control system. The control system comprises a contact lens, a projecting module for projecting the augmented reality interface into the user's eye, a sensor configured to detect the user's bioelectric signals, a processing module, and a control module configured to modify the augmented reality interface in accordance with the control signals. Said sensor comprises at least two primary electrodes integrated into said contact lens. The processing module is configured to generate control signals based on said sensor's data reflecting changes over time in the voltage difference between its electrodes.

An augmented reality (AR) system includes a display, a camera; and a secure data vault system. The secure data vault system includes a sandbox system operatively coupled to the camera and configured to receive camera data from the camera, wherein in operations of the AR system, the camera only sends camera data to the sandbox system, and wherein the sandbox system comprises an execution environment configured to restrict execution of instructions to a predefined memory address range. The secure data vault system additionally includes a display and rending system operatively coupled to the sandbox system and configured to render an image based on the camera data processed via the instructions and to display the image via the display, wherein the display is configured to show both the image and a real-world environment surrounding the AR system.