Sharing Pre-trained BERT Decoder for a Hybrid Summarization

来源 :第十八届中国计算语言学大会暨中国中文信息学会2019学术年会 | 被引量 : 0次 | 上传用户:xtmpjordan
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
  Sentence selection and summary generation are two main steps to generate informative and readable summaries.However,most previous works treat them as two separated subtasks.In this paper,we propose a novel extractive-and-abstractive hybrid framework for single document summarization task by jointly learning to select sentence and rewrite summary.It first selects sentences by an extractive decoder and then generate summary according to each selected sentence by an abstractive decoder.Moreover,we apply the BERT pre-trained model as document encoder,sharing the context representations to both decoders.Experiments on the CNN/DailyMail dataset show that the proposed framework outperforms both state-of-the-art extractive and abstractive models.
其他文献
学位
学位
Knowledge graph embedding aims at learning low-dimensional representations for entities and relations in knowledge graph.Previous knowledge graph embedding methods use just one score to measure the pl
学位
学位
This paper explores entity embedding effectiveness in ad-hoc entity retrieval,which introduces distributed representation of entities into entity retrieval.The knowledge graph contains lots of knowled
In order to solve the problem of data sparseness caused by less training corpus in Tibetan-Chinese transliteration,this paper ana-lyzes the alignment granularity of Tibetan-Chinese names as the resear
It is widely accepted that part-of-speech(POS)tagging and dependency parsing are highly related.Most state-of-the-art dependency parsing methods still rely on the results of POS tagging,though the tag
Text correction after automatic speech recognition(ASR)is an im-portant method to improve the speech recognition system.We regard the speech error correction as a translation task—from the language of
Online news platforms have gained huge popularity for online news reading.The topic categories of news are very important for these platforms to target user interests and make personalized recommendat