Patent classifications
G05B13/0265
DRIVE ASSIST DEVICE
In a drive assist system, a map data acquiring section acquires at least one of a driver's operation ability and a load of a vehicle. An adjustment section determines an assist control amount as a control parameter of drive assist for the vehicle so that a degree of the driver's operation is increased according to reduction of the driver's operation ability or increasing of the load of the vehicle. An assist control amount calculation section transmits the assist control amount to a steering motor and a notification section so as to execute the drive assist for the vehicle.
ONLINE LEARNING AND VEHICLE CONTROL METHOD BASED ON REINFORCEMENT LEARNING WITHOUT ACTIVE EXPLORATION
A computer-implemented method of adaptively controlling an autonomous operation of a vehicle is provided. The method includes steps of (a) in a critic network in a computing system configured to autonomously control the vehicle, determining, using samples of passively collected data and a state cost, an estimated average cost, and an approximated cost-to-go function that produces a minimum value for a cost-to-go of the vehicle when applied by an actor network; and (b) in an actor network in the computing system and operatively coupled to the critic network, determining a control input to apply to the vehicle that produces the minimum value for the cost-to-go, wherein the actor network is configured to determine the control input by estimating a noise level using the average cost, a cost-to-go determined from the approximated cost-to-go function, a control dynamics for a current state of the vehicle, and the passively collected data.
Autonomous substrate processing system
A substrate processing system comprises one or more transfer chambers; a plurality of process chambers connected to the one or more transfer chambers; and a computing device connected to each of the plurality of process chambers. The computing device is to receive first measurements generated by sensors of a first process chamber during or after a process is performed within the first process chamber; determine that the first process chamber is due for maintenance based on processing the first measurements using a first trained machine learning model; after maintenance has been performed on the first process chamber, receive second measurements generated by the sensors during or after a seasoning process is performed within the first process chamber; and determine that the first process chamber is ready to be brought back into service based on processing the second measurements using a second trained machine learning model.
APPROXIMATE VALUE ITERATION WITH COMPLEX RETURNS BY BOUNDING
A control system and method for controlling a system, which employs a data set representing a plurality of states and associated trajectories of an environment of the system; and which iteratively determines an estimate of an optimal control policy for the system. The iterative process performs the substeps, until convergence, of estimating a long term value for operation at a respective state of the environment over a series of predicted future environmental states; using a complex return of the data set to determine a bound to improve the estimated long term value; and producing an updated estimate of an optimal control policy dependent on the improved estimate of the long term value. The control system may produce an output signal to control the system directly, or output the optimized control policy. The system preferably is a reinforcement learning system which continually improves.
Error correction for predictive schedules for a thermostat
A heating, ventilation, and air conditioning (HVAC) control device is configured to record a plurality of actual occupancy statuses, to determine a plurality of corresponding predicted occupancy statuses, and to compare the plurality of predicted occupancy statuses to the plurality of actual occupancy statuses. The device is further configured to identify conflicting occupancy statuses based on the comparison. A conflicting occupancy status indicates a difference between an actual occupancy status and a corresponding predicted occupancy status. The device is further configured to identify timestamps corresponding with the conflicting occupancy statuses, to identify historical occupancy statuses corresponding with the identified timestamps, and to update the conflicting occupancy statuses in the predicted occupancy schedule with the historical occupancy statuses.
METHOD FOR OPTIMIZING PRODUCTION IN AN INDUSTRIAL FACILITY
A computer-Implemented method, system, and computer program product for optimizing production of an industrial facility. The industrial facility is designed to produce a predefinable quantity of at least one product. A model trained by machine learning is provided at a first time and the trained model is executed at a second time following the first time to generate a rolling forecast for a predefinable time interval. The predefinable time interval begins after the second time and the rolling forecast forecasts for any time within the time interval a quantity of the at least one product to be produced at this time. The rolling forecast is further processed by means of a further model to calculate a reforecast on the basis of the rolling forecast.
COGNITIVE ENGINEERING GRAPH
A method for representing knowledge in a cognitive engineering system (CES) includes receiving information relating to an automation engineering project from an engineering tool, storing the received information in a cognitive engineering graph (CEG) storing a plurality of previously generated CEGs for previous automation engineering projects, and establishing a communication path between the CEG storing the received information and the plurality of previously generated CEGs. The method may further include applying machine learning to the stored CEG based on the received information and the stored plurality of previously generated CEGs. The machine learning may analyze the CEG to identify at least one pattern that is representative of a given object from the automation engineering project. The CES may automatically add an element to the CEG based on the received information and a query from a user. Further, the user may request a change made by the CES be reversed.
METHOD AND APPARATUS FOR OPTIMIZED PRODUCTION OF SHEET-METAL PARTS
A method for optimizing production of sheet-metal parts, the production comprising cutting out and singularizing the sheet-metal parts and bending the sheet-metal parts, wherein the method includes: (A) training a neural network, which is executed on a Monte Carlo tree search framework, by means of supervised learning and self-play with reinforcement learning; (B) recording constraints for the sheet-metal parts, the constraints comprising geometric data of the sheet-metal parts; (C) creating an optimized production schedule by way of the neural network; and (D) outputting the production schedule.
COMPUTER-IMPLEMENTED METHOD FOR CREATING CONTROL DATA SETS, CAD/CAM SYSTEM, AND MANUFACTURING PLANT
A method creates numerical control data sets for controlling machine tools. The control data sets are read from the machine tools. A first component data set representing a first component design model is received. A first numerical control data set is created for the first component data set using control program generation software, having an assessment routine using a trained machine learning algorithm with settable parameters. A first additional training data set is compiled from the component data set and the created numerical control data set. The first additional training data set is output to a training database. The machine learning algorithm is updated by setting usage-environment-specific values for the parameters determined by training the machine learning training algorithm using the training database.
Digital-Twin-Enabled Artificial Intelligence System for Distributed Additive Manufacturing
An information technology system for a distributed manufacturing network includes an additive manufacturing platform configured to manage workflows for a set of distributed manufacturing network entities associated with the distributed manufacturing network. The information technology system includes a set of digital twins generated by the additive manufacturing platform. The information technology system includes an artificial intelligence system configured to be executed by a data processing system in communication with the additive manufacturing platform. The artificial intelligence system is trained to generate process parameters for the workflows managed by the additive manufacturing platform using data collected from the set of distributed manufacturing network entities. The information technology system includes a control system configured to adjust the process parameters during an additive manufacturing process performed by at least one of the set of distributed manufacturing network entities.