G05B2219/41054

Intelligent control with hierarchical stacked neural networks
11514305 · 2022-11-29 ·

A neural network method, comprising: modeling an environment; implementing a policy based on the modeled environment, to perform an action by an agent within the environment, having at least one estimated dynamic parameter; receiving an observation and a temporally-associated cost or reward based on operation of the agent in the environment controlled according to the policy; and updating the policy, dependent on the received observation and the temporally-associated cost or reward, to improve the policy to optimize an expected future cumulative cost or reward. The policy may represent a set of parameters defining an artificial neural network having a plurality of hierarchical layers and having at least one layer which receives inputs representing aspects of the received observation indirectly from other neurons, and produce outputs to other neurons which indirectly implement the policy, the plurality of hierarchical layers being trained according to respectfully distinct training criteria.

Training spectrum generation for machine learning system for spectrographic monitoring

A method of generating training spectra for training of a neural network includes generating a plurality of theoretically generated initial spectra from an optical model, sending the plurality of theoretically generated initial spectra to a feedforward neural network to generate a plurality of modified theoretically generated spectra, sending an output of the feedforward neural network and empirically collected spectra to a discriminatory convolutional neural network, determining that the discriminatory convolutional neural network does not discriminate between the modified theoretically generated spectra and empirically collected spectra, and thereafter, generating a plurality of training spectra from the feedforward neural network.

Training spectrum generation for machine learning system for spectrographic monitoring

A method of generating training spectra for training of a neural network includes measuring a first plurality of training spectra from one or more sample substrates, measuring a characterizing value for each training spectra of the plurality of training spectra to generate a plurality of characterizing values with each training spectrum having an associated characterizing value, measuring a plurality of dummy spectra during processing of one or more dummy substrates, and generating a second plurality of training spectra by combining the first plurality of training spectra and the plurality of dummy spectra, there being a greater number of spectra in the second plurality of training spectra than in the first plurality of training spectra. Each training spectrum of the second plurality of training spectra having an associated characterizing value.

System and method for controller adaptation

A neural-Model Predictive Control (MPC) controller is described to control a dynamical system (i.e., “plant”). The MPC controller receives, in a base controller, a measurement of a current state of a plant and generates a control signal based on the measurement of the current state of the plant. A forward module receives the measurement of the current state of the plant and the control signal to generate a forward module prediction. A forward module corrector receives the measurement of the current state of the plant and the control signal from the base controller to generate an additive correction to the forward module prediction to generate a predicted plant state. Control sequences of length L of pairs of control signals and corresponding predicted plant states are generated until N.sub.s control sequences have been generated. A next plant control signal is generated based on the N.sub.s control sequences.

INPUT DEVICES HAVING A DEFORMABLE MEMBRANE AND METHODS OF USING THE SAME

Input devices having a deformable membrane and methods of their use are disclosed. In one embodiment, an input device includes a body, a deformable membrane coupled to the body such that the body and the deformable membrane define an enclosure filled with a medium, and an internal sensor disposed within the enclosure, the internal sensor having a field of view configured to be directed through the medium and toward a bottom surface of the deformable membrane. The input device further includes a controller configured to receive an output signal from the internal sensor corresponding to a deformation in the deformable membrane, determine a gesture based on the output signal from the internal, and provide a gesture signal corresponding to the gesture.

System and method for predicting robotic tasks with deep learning

A computing system is provided for training one or more machine learning models to perform at least a portion of a robotic task of a physical robotic system by monitoring a model-based control algorithm associated with the physical robotic system perform at least a portion of the robotic task. One or more robotic task predictions may be defined, via the one or more machine learning models, based upon, at least in part, the training of the one or more machine learning models. The one or more robotic task predictions may be provided to the model-based control algorithm associated with the physical robotic system. The robotic task may be performed, via the model-based control algorithm associated with the robotic system, on the physical robotic system based upon, at least in part, the one or more robotic task predictions defined by the one or more machine learning models.

Training Spectrum Generation for Machine Learning System for Spectrographic Monitoring

A method of generating training spectra for training of a neural network includes measuring a first plurality of training spectra from one or more sample substrates, measuring a characterizing value for each training spectra of the plurality of training spectra to generate a plurality of characterizing values with each training spectrum having an associated characterizing value, measuring a plurality of dummy spectra during processing of one or more dummy substrates, and generating a second plurality of training spectra by combining the first plurality of training spectra and the plurality of dummy spectra, there being a greater number of spectra in the second plurality of training spectra than in the first plurality of training spectra. Each training spectrum of the second plurality of training spectra having an associated characterizing value.

ACCELERATING ROBOTIC PLANNING FOR OPERATING ON DEFORMABLE OBJECTS
20210349444 · 2021-11-11 ·

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network including an encoder network and decoder network and configured to receive a network input that includes sensor data characterizing a deformable object and to process the network input to generate a network output that specifies a mesh of the deformable object. Once trained, the neural network can be deployed in a robotic system for use in allowing a motion planner to issue timely commands which adjust a currently planned motion according to the mesh in order to prevent any collision between the robot and the deformable object.

Tooth contact position adjustment amount estimation device, machine learning device, and robot system
11407104 · 2022-08-09 · ·

A tooth contact position adjustment amount estimation device that performs processing with respect to estimating a tooth contact position adjustment amount for dimensional data of parts constituting a power transmission mechanism according to the present invention, comprising: a machine learning device that performs processing with respect to estimating the tooth contact position adjustment amount for the dimensional data of parts constituting the power transmission mechanism, wherein the machine learning device observes part dimensional data, which is the dimensional data of parts constituting the power transmission mechanism, as a state variable indicating a current state of an environment, and performs processing with respect to estimating the tooth contact position adjustment amount for the dimensional data of parts constituting the power transmission mechanism in assembling the power transmission mechanism by performing processing with respect to machine learning based on the observed state variable.

Mitigating reality gap through simulating compliant control and/or compliant contact in robotic simulator
11458630 · 2022-10-04 · ·

Mitigating the reality gap through utilization of technique(s) that enable compliant robotic control and/or compliant robotic contact to be simulated effectively by a robotic simulator. The technique(s) can include, for example: (1) utilizing a compliant end effector model in simulated episodes of the robotic simulator; (2) using, during the simulated episodes, a soft constraint for a contact constraint of a simulated contact model of the robotic simulator; and/or (3) using proportional derivative (PD) control in generating joint control forces, for simulated joints of the simulated robot, during the simulated episodes. Implementations additionally or alternatively relate to determining parameter(s), for use in one or more of the techniques that enable effective simulation of compliant robotic control and/or compliant robotic contact.