Pomegrante, the library currently used for HMMs is currently rewritten using a torch backend.
This is expected to solve many of the outstanding issues of pomegrante.
Once the new version matures, we should check, if it is possible to migrate to it.
https://github.com/jmschrei/torchegranate