Move dev documentation hosting to new sagemath netlify account

[tobiasdiez]

I'm currently hosting the dev-preview of the docs in my private netlify account. In general, this is not a problem. However, I now regularly get warnings that I've used above 50% of the free bandwidth. For example, at the 22nd Dec I've used 59GB of the free 100GB.

To not run in problems that my other projects are not accessible anymore (they currently use less then 1GB of monthly traffic), I would ask if someone could create a new netlify account in the name of sage and host the docs there.

Moreover, I would suggest someone should investigate why the docs are taking so much traffic. It looks like MathJax is the main issue, loading quite a few files (some of them even multiple times in one request?) and not caching them between requests. Is there a reason not to use MathJax's CDN (for the online build)?

CC: @dimpase @mkoeppe @haraldschilly @williamstein

Component: documentation

Issue created by migration from https://trac.sagemath.org/ticket/34874

[dimpase]

comment:1

Do you host MathJax ? Naturally this is not a good idea for a server, that's what CDNs are for.

[tobiasdiez]

comment:3

Replying to Dima Pasechnik:

Do you host MathJax ? Naturally this is not a good idea for a server, that's what CDNs are for.

I "host" the complete documentation, which includes MathJax as a static asset. This is the same as for the production documentation, where the mathjax js file is at https://doc.sagemath.org/html/en/reference/_static/mathjax/tex-chtml.js and the fonts at https://doc.sagemath.org/html/en/reference/_static/mathjax/output/chtml/fonts/woff-v2/MathJax_Main-Bold.woff.

Another, but similar, "issue" is that the jupyter manager is downloaded from https://unpkg.com/@jupyter-widgets/html-manager@0.20.2/dist/embed-amd.js instead of from a "proper" cdn such as https://cdn.jsdelivr.net/npm/@jupyter-widgets/html-manager@0.20.2/dist/embed-amd.js

Yet another standard optimization would be to bundle the css and js files, but I'm not sure how easy this would be with sphinx.

[dimpase]

comment:4

Would 1TB per month suffice, no?
That's what one gets for $19 per month.
We certainly have funds to pay for this, while we work on the necessary optimisations.

Tobias, practically speaking, the easiest would be for you to buy a $19 p.m. subscription, and we'd reimburse you on your paypal account, or on your bank account.

[tobiasdiez]

comment:5

That would be fine with me as well. It's also not very urgent, as currently the traffic stays under the free limit of 100GB. Just wanted to give you guys a timely heads up.

I/We may also be able to apply for their open-source plan which would give us the 1TB for free but for this we would need to add a "This site is powered by Netlify" to the website/docs. https://www.netlify.com/legal/open-source-policy/

[dimpase]

comment:6

I see no problem in having "This site is powered by Netlify" shown.
Do they want it on every page?

[tobiasdiez]

comment:7

Yes on all pages, or only on the main page.

I guess this would make the most sense if the production website is also hosted on netlify. Are there any plans in this direction?

[dimpase]

comment:8

Do they allow to use a custom domain name? Having that long netify url shown is a bit ugly.

I think the sage docs are hosted on github pages, thus free, anyway.

[mkoeppe]

Netlify deployment is broken
https://github.com/sagemath/sage/actions/runs/7317658445/job/19933410074#step:6:12
Error: Site not found. Please rerun "netlify link"

[mkoeppe]

@tobiasdiez Still broken. Could you fix this please or advise what the project should do regarding the netlify deployment

[kwankyu]

I don't know if my account has free bandwidth as wide as his account (100 GB?). Where can I check this?

I checked it. It is the same 100GB for a free acoount. I have used 3MB of 100GB :-)

[kwankyu]

(somehow I lost my comment)

I don't know what caused to stop doc preview publishing to netlify. It may be the overuse of the bandwidth of Tobias' netlify account.

I have a netlify account (not paying). I made it to test PRs related with doc preview. I don't know if my account has free bandwidth as wide as his account (100 GB?). Where can I check this?

I don't use the account for any other purpose, and have no plan to do so. Hence if the problem is the bandwidth, and if my account has the same free bandwidth as his account, then I am willing to offer my free bandwidth.

I also own "sagemath" site name (instead of "sagemath-tobias"). It is very easy to replace netlify site id and credential, as far as I know. Let me know.