A Geometric Understanding of Deep Learning

来源 :工程(英文) | 被引量 : 0次 | 上传用户:kyuiyigjghj
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
This work introduces an optimal transportation (OT) view of generative adversarial networks (GANs).Natural datasets have intrinsic patts,which can be summarized as the manifold distribution principle:the distribution of a class of data is close to a low-dimensional manifold.GANs mainly accomplish two tasks:manifold leing and probability distribution transformation.The latter can be carried out using the classical OT method.From the OT perspective,the generator computes the OT map,while the discriminator computes the Wasserstein distance between the generated data distribution and the real data distribution;both can be reduced to a convex geometric optimization process.Furthermore,OT theory discovers the intrinsic collaborative-instead of competitive-relation between the generator and the discriminator,and the fundamental reason for mode collapse.We also propose a novel generative model,which uses an autoencoder (AE) for manifold leing and OT map for probability distribution transformation.This AE-OT model improves the theoretical rigor and transparency,as well as the computational stability and efficiency;in particular,it eliminates the mode collapse.The experimental results validate our hypothesis,and demonstrate the advantages of our proposed model.
其他文献
随着现代科学技术的迅猛发展和全球经济一体化的加强,各个国家或地区都面临着前所未有的机遇和挑战。现代物流作为一种先进的组织方式和管理技术,被广泛地认为是企业在除了降
期刊
社区卫生人力资源是卫生服务系统的重要组成部分,也是城市卫生服务工作持续健康发展的基础与前提。目前,我国大量优质医疗资源向高等级医疗卫生机构集中,社区卫生人力资源配置存
要使文章写出特色,给人留下深刻的印象,除了写作内容和语言的积累外,我们还要重视写作技巧和方法的积累.只有当学生的作文被人认识、认可、认同时,他才会拥有成功的幸福感.所
期刊
大脑中二十二碳六烯酸(DHA,ω-3脂肪酸)的含量与中枢神经系统的正常发育和功能维持高度相关.甘油酯sn-2位上的DHA可以被肠黏膜更好地吸收,从而实现机体对DHA的高效利用.然而,
阪崎克罗诺杆菌(Cronobacter sakazakii)是一种食源性条件致病菌,可引起坏死性肠炎、脑膜炎和婴儿败血症等危及生命的侵袭性疾病.受该菌污染的婴幼儿配方奶粉(powdered infan
期刊
期刊
抗美援朝战争中,为解决入朝初期后勤工作混乱的情况、对抗敌飞机和炮火对志愿军后方的狂轰滥炸、消除匪特对志愿军后方袭扰破坏和弥补志愿军后勤保障力量的不足,志愿军通过建