Richly formatted documents,such as financial dis-closures,scientific articles,government regulations,widely ex-ist on Web.However,since most of these documents are only for public reading,the styling information inside them is usu-ally missing,making them improper or even burdensome to be displayed and edited in different formats and platforms.In this study we formulate the task of document styling restoration as an optimization problem,which aims to identify the styling set-tings on the document elements,e.g.,lines,table cells,text,so that rendering with the output styling settings results in a document,where each element inside it holds the (closely) ex-act position with the one in the original document.Considering that each styling setting is a decision,this problem can be trans-formed as a multi-step decision-making task over all the docu-ment elements,and then be solved by reinforcement learning.Specifically,Monte-Carlo Tree Search (MCTS) is leveraged to explore the different styling settings,and the policy function is learnt under the supervision of the delayed rewards.As a case study,we restore the styling information inside tables,where structural and functional data in the documents are usually pre-sented.Experiment shows that,our best reinforcement method successfully restores the stylings in 87.65％ of the tables,with 25.75％ absolute improvement over the greedy method.We also discuss the tradeoff between the inference time and restoration success rate,and argue that although the reinforcement meth-ods cannot be used in real-time scenarios,it is suitable for the offline tasks with high-quality requirement.Finally,this model has been applied in a PDF parser to support cross-format dis-play.