So I still don't know what the problem is. But as I was already running various reverse proxies, I put together one for Ajenti as well using the socket and Let's Encrypt certificate. (The config in the knowledge base was a big help.)

The problem is avoided but not really solved. Should you guys need more information to prevent this from hapening in future version, let me know.