689results about "Recording and playback systems" patented technology

Systems and methods for activity-based device recommendations are disclosed. For example, historical usage data associated with a device may indicate that the device is likely to be associated with a given state at a given time. When the device is not in the anticipated state, a recommendation to transition the device state, for example, may be sent. Additionally, a determination of the activity state associated with the device, such as an active state, an asleep state, and / or an away state may be utilized to determine the recommendation to surface, to determine whether to send a recommendation, and when and / or how to send the recommendation.

Systems, methods, and computer program code for controlling a robot that is interacting with an environment to perform a particular task The technique involves generating a 2D trajectory image representing a 2D trajectory sketch. The 2D trajectory sketch indicates a desired trajectory for a part of the robot, e.g. an end effector, when performing the task. A neural network system uses the 2D trajectory image as deliberately underspecified guidance for how to perform the task. Techniques for training the neural network system are also described.

A method of programming an industrial robot (100), with a robot manipulator (110) and robot controller (120), comprises: recording movements of the robot manipulator during a demonstration-based robot programming session, for thereby obtaining a robot trajectory; acquiring a video of the robot programming session; and generating, on the basis of the robot trajectory and the video, a robot program (C) executable by the robot controller, wherein the robot program includes at least one motion command which is expressed in a first reference frame (0 1). The method further comprises capturing operator input data indicating a first object (151) in an image in the video. The generated robot program includes a command to identify a position of an object resembling the first object in a work area (150) of a robot which executes the robot program; and the first reference frame is defined with respect to the identified position of the object resembling the first object.

Provided in the present application are a robot control method and apparatus, and an electronic device, a storage medium and a program product. The method comprises: acquiring state data for indicating the current motion state of a robot, and acquiring environment data for indicating the environment where the robot is currently located; on the basis of the state data, predicting an initial action parameter for controlling the robot to imitate an object action of a target object; on the basis of the environment data, predicting an environment influence parameter for representing the influence of the environment on the robot imitating the object action; fusing the initial action parameter with the environment influence parameter to obtain a fused action parameter of the robot; and generating a control instruction on the basis of the fused action parameter, wherein the control instruction is used for controlling the robot to execute a target action indicated by the fused action parameter.

Provided is a technique that allows even a person without knowledge on robots to intuitively and efficiently teach a work motion a robot by a work demonstration while maintaining a normal human motion as much as possible, and that can reduce the man-hours for pre-adjustment of teaching, facilitate the introduction, etc. A robot teaching method is a method for performing teaching for generating a motion of a robotic hand mechanism corresponding to a work motion including an operation on an operation object by a hand of a teacher based on measurement of a work motion, and includes, as steps performed by a computer system: a step of acquiring a first measured pose obtained by measuring a pose of the operation object and a second measured pose obtained by measuring a pose of the hand of the teacher during the work motion; a step of detecting the operation on the operation object by the teacher; and a step of generating a teaching pose for generating the robotic motion data based on the first measured pose, the second measured pose, and the detected operation.

A computer-implemented method is for generating reference data for use in a manufacturing and / or assembly process. The method may include, as a method step, obtaining a digital model of a workpiece. Herein, the digital model may be, in particular, a 3D model. The digital model may also be, in particular, a CAD model. The workpiece may be, in particular, an assembled workpiece. In another step, the method may include obtaining video data of the manufacturing and / or assembly process of the workpiece. Furthermore, the method may include generating a digital flowchart of the manufacturing and / or assembly process based at least in part on the digital model and the video data.

This patent defines a method for making robot programming more intuitive for tasks such as welding. The method further is an enhancement of manual guiding methods of robot positioning and can improve situations in which finer resolution or control of the robot end-effector is required. A motion sensor is mounted in series with the n−1 joint and in parallel with the nth joint, where n is the number of degrees of freedom or number of joints of the serial manipulator. The motion sensor is further mounted directly in-line with the nth joint and becomes part the opposing portion of the nth joint. The motion sensor further is uniquely adapted to apply to non-spherical wrist robots. The motion sensor senses input movements by a robot operator and controls the output tool motion in a controlled manner with resolution defined by user input at the motion sensor.

Provided are a robot control method and apparatus, an electronic device, a storage medium, and a program product. The method includes: acquiring state data configured for indicating a current motion state of a robot, and acquiring environmental data configured for indicating an environment where the robot is currently located; predicting, based on the state data, an initial action parameter configured for controlling the robot to imitate an object action of a target object; predicting, based on the environmental data, an environmental impact parameter configured for representing impact generated by the environment on imitation of the object action by the robot; fusing the initial action parameter and the environmental impact parameter to obtain a fused action parameter of the robot; and generating a control instruction based on the fused action parameter, the control instruction being configured for controlling the robot to perform a target action indicated by the fused action parameter.

A teaching device for performing program creation using an icon representing a function constituting a control program for an industrial machine is provided, the teaching device including: a state information acquisition unit that acquires state information indicating whether or not the icon constituting the control program can execute an anticipated action, or has performed execution thereof or not; and an information display creating unit that creates a display relating to the icon, so that whether or not the icon making can execute the anticipated action or has performed execution thereof or not can be visually recognized on the program creating screen, on the basis of the state information.

A teaching system includes a teaching point generator that generates a teaching point of a robot; an operator that is operated by a user; an image generator that generates a VR image in which a virtual robot corresponding to the robot is placed in a VR space; and a display that displays the VR image. The image generator generates the VR image in which the virtual robot moves in accordance with operation to the operator. The teaching point generator generates a teaching point corresponding to a position of the virtual robot in the VR space generated by the image generator.

A method of programming an industrial robot, comprising: recording movements of a robot manipulator during a demonstration-based programming session, to obtain a robot trajectory (301); using a natural-language model (171), parsing speech data describing the programming session into at least one robot parameter (305) value and annotating the robot trajectory with the robot parameter value; and, on the basis of the annotated robot trajectory (306), generating a robot program (307). The method further comprises: capturing a video (302) of the programming session; using a vision-enabled language model, VLM (172), generating descriptions (303) of movements of the robot manipulator which are visible in the video; and generating said speech data (304) on the basis of the descriptions of the robot manipulator movements.

A robot control device configured such that a storage unit stores a parameter defining a predetermined area near a singular point of a robot. In the robot control device, a processor receives a first teaching point and a second teaching point for robot operation and a type of interpolation between the teaching points, and automatically uses multi-axis interpolation operation different from linear interpolation for at least a part of interpolation operation between the first teaching point and the second teaching point when the type of interpolation is the linear interpolation and also when there is a teaching in which a predetermined position of a distal end of the second arm passes through the predetermined area during movement of the robot under the linear interpolation from the first teaching point to the second teaching point and therefore the teaching is subject to a change.

Embodiments of the present disclosure are directed to methods, computer program products, and computer systems of a robotic apparatus with robotic instructions replicating a food preparation recipe. In one embodiment, a robotic control platform, comprises one or more sensors; a mechanical robotic structure including one or more end effectors, and one or more robotic arms; an electronic library database of minimanipulations; a robotic planning module configured for real-time planning and adjustment based at least in part on the sensor data received from the one or more sensors in an electronic multi-stage process file, the electronic multi-stage process recipe file including a sequence of minimanipulations and associated timing data; a robotic interpreter module configured for reading the minimanipulation steps from the minimanipulation library and converting to a machine code; and a robotic execution module configured for executing the minimanipulation steps by the robotic platform to accomplish a functional result.

Provided is a programming device capable of reducing the load of an operator that creates a control program including a command corresponding to a function of an imaging device. Provided is a programming device for programming industrial machinery, the programming device including: a command generation unit that acquires information regarding an imaging device connected to a control device of the industrial machinery and that, on the basis of the acquired information, generates an icon or command statement expressing a command using an image acquired by the imaging device; and a command display unit that displays the generated icon or command statement on a display screen.

A robot teaching system includes: a photographing unit that photographs an image including a welding target and a marker installed on an industrial robot; a camera coordinate system setting unit that sets a camera coordinate system on a basis of the marker included in the image; an operation path setting unit that sets an operation path of the industrial robot on a basis of a welding position of the welding target included in the image in the camera coordinate system; and a program generation unit that generates a working program, while converting the set operation path from the camera coordinate system into a robot coordinate system set in a robot control apparatus on a basis of a position of the marker installed on the industrial robot. The robot teaching system generates a working program allowing appropriate welding at a welding position.

The present invention relates to an apparatus for programming robots based on a novel passive pointing device including fiducial markers which enables interaction with one or more cameras through a computer implemented method. By taking advantage of a camera integral to the robot. the computer implemented method and the pointing device enable a tracking mechanism that during robot programming makes possible to change the position of the robot in real time in order to maintain substantially constant the relative pose between the on-board camera and the pointing device. In this way, the human operator can advantageously set the poses of the robot tool by means of demonstration i.e., by placing the pointer in the desired position and orientation during execution of the computer implemented method. With respect to known systems, larger working-space and higher precision, adjustable according to needs, are thus achieved. The apparatus may include a passive pointer and a camera mounted on the robot's wrist.

In a method for executing a chemical workflow, the workflow is processed step-by-step manually and / or in an automated manner. While it is being processed, the workflow is recorded by means of a recording device and the recording so created is by means of a computer evaluated and converted into instructions which comprise detailed working instructions for a laboratory worker or for at least one automated laboratory device, on the basis of which working instructions the recorded workflow can be repeated manually and / or in an automated manner or, based thereon, a modified workflow can be created.

A system includes a robotic arm, a rotisserie control linkage, and a computer system. The robotic arm includes a touch probe and laser head. The rotisserie control linkage is configured to couple to a transport cart. The computer system is communicatively coupled to the robotic arm and the rotisserie control linkage and is configured to control the system to probe, using the touch probe of the robotic arm, a transparent outer layer of an aircraft canopy located on the transport cart in order to determine surface measurements of the aircraft canopy. The computer system also controls the system to ablate, using a plurality of predetermined parameters and the laser head of the robotic arm, an interface layer located between the transparent outer layer and the aircraft canopy, wherein movements of the robotic arm during the ablation are based on the surface measurements.

An offline teaching device includes a first determination unit configured to determine whether data related to production of a workpiece to be produced by welding is changed, a second determination unit configured to determine, in a case where the first determination unit determines that the data is changed, a target whose relative position between the workpiece and a welding robot that executes the welding is changed based on the changed data, and a teaching program creation unit configured to create and output a second teaching program obtained by correcting a first teaching program for executing the welding, based on a displacement amount between a position of the target after the change of the relative position and a position of the target before the change of the relative position.

The present disclosure addresses the problem of keeping a maximum trajectory error and a takt time within allowable ranges desired by a user. This trajectory determination system (1) comprises an acquisition unit (131) and a determination unit (134). The acquisition unit (131) acquires control information pertaining to a control target (30). The determination unit (134) determines a target trajectory for the control target (30) on the basis of trajectory characteristics of the control target (30), the trajectory characteristics being obtained on the basis of the control information and indicating the relationship between the maximum trajectory error that is allowed as an error in the trajectory of the control target (30) and the takt time for the control target (30).

A robot automation system facilitates automated robotic manufacturing processes by employing a teaching subsystem including a tracking assembly that tracks movement of the mapping tool in a teaching workspace. A computing device in communication with the tracking assembly and the mapping tool receives tracking data from the tracking assembly and the mapping tool indicating movement of the mapping tool along a working path. Based on the tracking data, the computing device automatically generates robot instructions. A robot controller receives the robot instructions from the computing device and executes the robot instructions whereby the robot controller controls a robot and an end effector to conduct the automated robotic manufacturing process.

A teaching system includes: a teaching point generator that generates a teaching point of a robot including an end effector that performs a treatment on a workpiece in a non-contact manner; an operator that is operated by a user; an image generator that generates a VR image in which a virtual end effector corresponding to the end effector and a first virtual workpiece corresponding to the workpiece are placed in a space; and a display that displays the VR image. The image generator generates the VR image in which the virtual end effector moves in accordance with an operation to the operator and performs a treatment on the first virtual workpiece. The teaching point generator generates a teaching point based on a position of the virtual end effector generated by the image generator in the VR space.

An information processing device obtains information to control a robot to perform an operation of transferring an operation target object in a source area to a destination area. The information processing device includes a display and an inputter that receives a user input. When the display displays a first detection result of detecting at least one candidate target area including a candidate for the destination area and a second detection result of detecting at least one candidate object including a candidate for the operation target object in a work environment of the robot, the inputter receives a destination input specifying the destination area from the at least one candidate target area.

To provide an operation trajectory generation method capable of reducing the time required for optimization of an operation trajectory.SOLUTION: An operation trajectory generation method generates an operation trajectory T of a substrate transporting robot 100 including a horizontal articulated robot arm 30 attached with a hand 40 for holding a semiconductor substrate W. The operation trajectory generation method comprises: receiving an input of a layout of a disposition region 210 where the robot arm 30 and the semiconductor substrate W are disposed; and acquiring a candidate for the operation trajectory T with respect to the received layout of the disposition region 210 by using a trained model 4b trained by machine learning using the layouts of the disposition region 210 as training data as inputs and the operation trajectories as outputs.SELECTED DRAWING: Figure 6

A data logger comprising a sensor interface for connecting at least one sensor or actuator to the data logger; an accessible memory (SD card) for storing data received from said at least one sensor or actuator; and a controller for controlling operation of the data logger wherein said data logger comprises a plurality of modules, each module having a housing electrically and mechanically connectable to a housing of an adjacent module; and wherein at least one module comprises the sensor interface and acts as a logging and / or actuation module (LAM) including at least a portion of said accessible memory (SD card); and at least one module connected to said at least one LAM acts as a control and communications module (CCM) and comprises the controller that controls communications within and external to the data logger.

A computer-implemented method executed by data processing hardware of a robot causes the data processing hardware to perform operations. The robot includes an articulated arm having an end effector engaged with a constrained object. The operations include receiving a measured task parameter set for the end effector. The measured task parameter set includes position parameters defining a position of the end effector. The operations further include determining, using the measured task parameter set, at least one axis of freedom and at least one constrained axis for the end effector within a workspace. The operations also include assigning a first impedance value to the end effector along the at least one axis of freedom and assigning a second impedance value to the end effector along the at least one constrained axis. The operations include instructing the articulated arm to move the end effector along the at least one axis of freedom.

The invention relates to the technical field of computer graphic processing, and discloses a method for automatically drawing a DCS (Distributed Control System) picture into a real-time database picture, which comprises the following steps of: firstly, identifying a DCS source file format, directly analyzing a public text format or intercepting a bottom layer rendering instruction for a private binary format, and extracting standardized discrete data; constructing an intermediate vector model, and performing coordinate normalization and curve smoothing processing on the static primitives by using an affine transformation matrix; meanwhile, syntactic analysis is conducted on the control script to construct an abstract syntax tree, and dynamic logic is converted; then recombining a composite object based on spatial semantics, and repairing pipeline topology connection by utilizing automatic adsorption and an orthogonal routing algorithm; and finally, calling a target system interface to complete object instantiation and persistent storage. According to the invention, the automatic high-fidelity migration of the DCS picture to the real-time database is realized, the labor cost is reduced, and the consistency and accuracy of the monitoring picture are ensured.

The present disclosure is directed to methods, computer program products, and computer systems for instructing a robot to prepare a food dish by replacing the human chef's movements and actions. Monitoring a human chef is carried out in an instrumented application-specific setting, a standardized robotic kitchen in this instance, and involves using sensors and computers to watch, monitor, record and interpret the motions and actions of the human chef, in order to develop a robot-executable set of commands robust to variations and changes in the environment, capable of allowing a robotic or automated system in a robotic kitchen to prepare the same dish to the standards and quality as the dish prepared by the human chef.

The welding system includes a welding robot provided with a welding torch and a device for creating a control program for the welding robot, wherein the device for creating the control program for the welding robot performs the following operations: obtaining position information of a welding start point and a welding end point of a welding operation on a workpiece, and posture information, by which the posture information can be used to specify the posture of the welding torch at a welding teaching point on a welding line connecting the welding start point and the welding end point relative to the welding line; and creating a control program for the welding robot based on the position information and the posture information, for realizing a welding operation between the welding start point and the welding end point, and the welding robot performs the welding operation based on the control program of the welding robot.