Actor-Critic Reinforcement Learning and Application in Developing Computer-Vision-Based Interface Tr

来源 :工程(英文) | 被引量 : 0次 | 上传用户:Tiny_Drunk
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
This paper synchronizes control theory with computer vision by formalizing object tracking as a sequen-tial decision-making process.A reinforcement learning(RL)agent successfully tracks an interface between two liquids,which is often a critical variable to track in many chemical,petrochemical,metal-lurgical,and oil industries.This method utilizes less than 100 images for creating an environment,from which the agent generates its own data without the need for expert knowledge.Unlike supervised learn-ing(SL)methods that rely on a huge number of parameters,this approach requires far fewer parameters,which naturally reduces its maintenance cost.Besides its frugal nature,the agent is robust to environ-mental uncertainties such as occlusion,intensity changes,and excessive noise.From a closed-loop con-trol context,an interface location-based deviation is chosen as the optimization goal during training.The methodology showcases RL for real-time object-tracking applications in the oil sands industry.Along with a presentation of the interface tracking problem,this paper provides a detailed review of one of the most effective RL methodologies:actor-critic policy.
其他文献
针对新元煤矿9104工作面沿空巷道,综合理论分析、数值模拟的结果,优化了9104煤柱宽度的留设,综合确定了9140工作面区段煤柱合理宽度为9 m.研究结果表明:采用理论分析计算得到沿空巷道煤柱宽度应不小于9 m;采用数值模拟得到当煤柱宽度为6、9、25 m时,煤柱帮及实煤体帮的变形量均较小,但当煤柱宽度为25 m时处在应力升高区,巷道两帮所受垂直应力较大,且煤柱太宽造成了不必要的资源浪费.当煤柱为6 m时,实煤体帮变形较大,综合考虑下9 m煤柱为留设最佳宽度.
为防止31004辅助进风和回风巷掘进期间出现瓦斯突出现象,通过分析气相压裂增透机理,得出气相压裂消突圈的增透抽采原理,结合掘进工作面的具体条件,设计掘进工作面采用60 m单孔和双孔气相压裂方案,并分别对方案中的各项参数进行设计,在气相压裂方案实施后进行抽采效果及消突效果分析.结果表明:双孔气相压裂增透效果优于单孔,气相压裂抽采实施后,煤巷掘进期间无瓦斯突出现象出现.
煤矿瓦斯涌出预测对于矿井通风设计和瓦斯管理非常重要.结合程庄矿煤层瓦斯的实际情况,对程庄煤矿9号煤层和15号煤层开采过程中的相对瓦斯涌出量和绝对瓦斯涌出量进行了预测.此外,还针对瓦斯涌出制定了防治措施.
Highlighting the accelerating pace of development in the field of quantum computing,in December 2020 a Chinese team reported that its all-photonic system,called Jiuzhang,performed in 200 s what they estimated would take 2.5 billion years for a classical s
期刊
Process manufacturing is a pillar of modern economy;it is the domi-nant mode of production in many industries,including oil and gas,chemicals,nonferrous metals,iron,steel,and more.In order to address the problems of resource constraints,energy efficiency,
期刊
On 1 March 2021,new regulations reinforcing consumers\'right to repair entered into legal force across the European Union(EU)[1].The regulations stem from the EU\'s Ecodesign Directive of 2009,which among other objectives aims to compel manufacturers
期刊
Computers already gobble a large share of the world\'s electrical power,and their energy demand will likely soar with the deploy-ment of more and more power-hungry artificial intelligence(AI)systems[1].In a step that might reduce AI\'s electricity use
期刊
Chemical engineers rely on models for design,research,and daily decision-making,often with potentially large financial and safety implications.Previous efforts a few decades ago to combine artificial intelli-gence and chemical engineering for modeling wer
Due to growing concerns regarding climate change and environmental protection,smart power genera-tion has become essential for the economical and safe operation of both conventional thermal power plants and sustainable energy.Traditional first-principle m
The world\'s increasing population requires the process industry to produce food,fuels,chemicals,and consumer products in a more efficient and sustainable way.Functional process materials lie at the heart of this challenge.Traditionally,new advanced mat