首页 > 其他 > 详细

Text Style Transfer论文笔记

时间:2019-06-26 23:37:04      阅读:384      评论:0      收藏:0      [点我收藏+]

 

Text Style Transfer主要是指Non-Parallel Data条件下的,具体的paper list见: https://github.com/fuzhenxin/Style-Transfer-in-Text

 

Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfer (NAACL 2018)

Transforming a sentence to alter a specific attribute while preserving its attribute-independent content.

Training data includes only sentences labeled with their attribute, but not pairs of sentences that differ only in their attributes

Our strongest method extracts content words by deleting phrases associated with the sentence‘s original attribute value, retrieves new phrases associated with the target attribute, and use a neural model to fluently combine these into a final output.

Training:

For DELETEONLY:

Reconstruct the sentences in the training corpus given their content and original attribute value by maximizing:

技术分享图片

For DELETEANDRETRIEVE: apply some noise to a(x, vsrc) to produce a‘(x, vsrc)

技术分享图片

这篇文章采用Reconstruct的方法来训练模型生成风格化的描述。

 

 

Unsupervised Controllable Text Formalization (AAAI 2019)

The crux of the framework is a deep neural encoder-decoder that is reinforced with text-transformation knowledge through auxiliary modules (called scorers)

 

 

 

 

Style Transformer: Unpaired Text Style Transfer without Disentangled Latent Representation (ACL 2019)

技术分享图片

Transfomer Network

To enable style control in the standard Transformer framework, add an extra style embedding as input to the Transformer encoder

技术分享图片

z stands for the representation of the encoded inputs

Discriminator Network

Conditional Discriminator: a sentence x and a proposal style s are feed into discriminator and the discriminator is asked to answer whether the input sentence has the corresponding style.

Multi-class Discriminator: only one sentence is feed into the discriminator, and the discriminator aims to answer the style of this sentence.

Learning Algorithm

技术分享图片

Discriminator Learning:

conditional discriminator

技术分享图片

multi-class discriminator

技术分享图片

Transformer Network Learning:

Self Reconstruction

Cycle Reconstruction

Style Controlling

Text Style Transfer论文笔记

原文:https://www.cnblogs.com/czhwust/p/10969988.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!