We do not control this file content, we just use managed Microsoft.Web.Deployment API to set this rule, and it populates this file with default content.
However I remember I needed to provide a workaround when this temporary did not work on Azure. Please check this post. I believe you can use this approach with having custom content of app_offline_tmp.htm. Or you can change it on the fly, if you need it.