Asciidoctor uses LaTeX or Asciimath. LaTeX is slow and unwieldy, but powerful and not buggy.
There are some newer engines, like Typster, but there are always some newer engines. We'll see. Alexandria is meant to run on a server, so package size isn't the paramount concern.