LASER installation fails

[miau1]

Running pip install opusfilter[laser] fails due to version incompatibility issues:

Collecting opusfilter[laser]
  Using cached opusfilter-3.3.0-py3-none-any.whl.metadata (5.2 kB)
Collecting setuptools (from opusfilter[laser])
  Using cached setuptools-80.9.0-py3-none-any.whl.metadata (6.6 kB)
Collecting opustools>=1.6.2 (from opusfilter[laser])
  Using cached opustools-1.8.1-py3-none-any.whl.metadata (24 kB)
Collecting beautifulsoup4>=4.8.0 (from opusfilter[laser])
  Using cached beautifulsoup4-4.13.5-py3-none-any.whl.metadata (3.8 kB)
Collecting graphviz (from opusfilter[laser])
  Using cached graphviz-0.21-py3-none-any.whl.metadata (12 kB)
Collecting py3langid>=0.2.2 (from opusfilter[laser])
  Using cached py3langid-0.3.0-py3-none-any.whl.metadata (13 kB)
Collecting matplotlib (from opusfilter[laser])
  Using cached matplotlib-3.10.6-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (11 kB)
Collecting morfessor (from opusfilter[laser])
  Using cached Morfessor-2.0.6-py3-none-any.whl.metadata (628 bytes)
Collecting pandas>=1.0.0 (from opusfilter[laser])
  Using cached pandas-2.3.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (91 kB)
Collecting xxhash>=3.2.0 (from opusfilter[laser])
  Using cached xxhash-3.5.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (12 kB)
Collecting sentence-splitter (from opusfilter[laser])
  Using cached sentence_splitter-1.4-py2.py3-none-any.whl.metadata (2.8 kB)
Collecting rapidfuzz (from opusfilter[laser])
  Using cached rapidfuzz-3.14.1-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (12 kB)
Collecting ruamel.yaml>=0.15.0 (from opusfilter[laser])
  Using cached ruamel.yaml-0.18.15-py3-none-any.whl.metadata (25 kB)
Collecting regex (from opusfilter[laser])
  Using cached regex-2025.9.18-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (40 kB)
Collecting requests (from opusfilter[laser])
  Using cached requests-2.32.5-py3-none-any.whl.metadata (4.9 kB)
Collecting scikit-learn (from opusfilter[laser])
  Using cached scikit_learn-1.7.2-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (11 kB)
Collecting subword-nmt (from opusfilter[laser])
  Using cached subword_nmt-0.3.8-py3-none-any.whl.metadata (9.2 kB)
Collecting tqdm (from opusfilter[laser])
  Using cached tqdm-4.67.1-py3-none-any.whl.metadata (57 kB)
Collecting iso639-lang (from opusfilter[laser])
  Using cached iso639_lang-2.6.3-py3-none-any.whl.metadata (8.4 kB)
Collecting lingua-language-detector>=2.1.1 (from opusfilter[laser])
  Using cached lingua_language_detector-2.1.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (32 kB)
Collecting opus-fast-mosestokenizer>=0.0.8.7 (from opusfilter[laser])
  Using cached opus_fast_mosestokenizer-0.0.8.8-1-cp312-cp312-manylinux1_x86_64.whl.metadata (3.7 kB)
Collecting laserembeddings (from opusfilter[laser])
  Using cached laserembeddings-1.1.2-py3-none-any.whl.metadata (5.1 kB)
Collecting soupsieve>1.2 (from beautifulsoup4>=4.8.0->opusfilter[laser])
  Using cached soupsieve-2.8-py3-none-any.whl.metadata (4.6 kB)
Collecting typing-extensions>=4.0.0 (from beautifulsoup4>=4.8.0->opusfilter[laser])
  Using cached typing_extensions-4.15.0-py3-none-any.whl.metadata (3.3 kB)
Collecting numpy>=1.26.0 (from pandas>=1.0.0->opusfilter[laser])
  Using cached numpy-2.3.3-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (62 kB)
Collecting python-dateutil>=2.8.2 (from pandas>=1.0.0->opusfilter[laser])
  Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB)
Collecting pytz>=2020.1 (from pandas>=1.0.0->opusfilter[laser])
  Using cached pytz-2025.2-py2.py3-none-any.whl.metadata (22 kB)
Collecting tzdata>=2022.7 (from pandas>=1.0.0->opusfilter[laser])
  Using cached tzdata-2025.2-py2.py3-none-any.whl.metadata (1.4 kB)
Collecting ruamel.yaml.clib>=0.2.7 (from ruamel.yaml>=0.15.0->opusfilter[laser])
  Using cached ruamel.yaml.clib-0.2.12-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.7 kB)
INFO: pip is looking at multiple versions of laserembeddings to determine which version is compatible with other requirements. This could take a while.
Collecting laserembeddings (from opusfilter[laser])
  Using cached laserembeddings-1.1.1-py3-none-any.whl.metadata (5.1 kB)
  Using cached laserembeddings-1.1.0-py3-none-any.whl.metadata (5.1 kB)
  Using cached laserembeddings-1.0.1-py3-none-any.whl.metadata (4.2 kB)
  Using cached laserembeddings-1.0.0-py3-none-any.whl.metadata (4.0 kB)
  Using cached laserembeddings-0.1.3-py3-none-any.whl.metadata (7.6 kB)
  Using cached laserembeddings-0.1.2-py3-none-any.whl.metadata (7.7 kB)
  Using cached laserembeddings-0.1.1-py3-none-any.whl.metadata (6.8 kB)
INFO: pip is still looking at multiple versions of laserembeddings to determine which version is compatible with other requirements. This could take a while.
  Using cached laserembeddings-0.1.0-py3-none-any.whl.metadata (702 bytes)
Collecting py3langid>=0.2.2 (from opusfilter[laser])
  Using cached py3langid-0.2.2-py3-none-any.whl.metadata (12 kB)
Collecting numpy>=1.26.0 (from pandas>=1.0.0->opusfilter[laser])
  Using cached numpy-1.26.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (61 kB)
Collecting sacremoses==0.0.35 (from laserembeddings->opusfilter[laser])
  Using cached sacremoses-0.0.35.tar.gz (859 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
Collecting sacremoses<0.1.0,>=0.0.33 (from laserembeddings->opusfilter[laser])
  Using cached sacremoses-0.0.53.tar.gz (880 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting sacremoses<0.0.22,>=0.0.21 (from laserembeddings->opusfilter[laser])
  Using cached sacremoses-0.0.21.tar.gz (117 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting opusfilter[laser]
  Using cached opusfilter-3.2.0-py3-none-any.whl.metadata (5.1 kB)
  Using cached opusfilter-3.1.0-py3-none-any.whl.metadata (4.7 kB)
Collecting fasttext (from opusfilter[laser])
  Using cached fasttext-0.9.3-cp312-cp312-linux_x86_64.whl
Collecting langid (from opusfilter[laser])
  Using cached langid-1.1.6.tar.gz (1.9 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting pycld2 (from opusfilter[laser])
  Using cached pycld2-0.42-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.5 kB)
Collecting opusfilter[laser]
  Using cached opusfilter-3.0.0-py3-none-any.whl.metadata (4.7 kB)
  Using cached opusfilter-2.6.0-py3-none-any.whl.metadata (4.6 kB)
Collecting setuptools<=58.0.0 (from opusfilter[laser])
  Using cached setuptools-58.0.0-py3-none-any.whl.metadata (4.9 kB)
INFO: pip is looking at multiple versions of opusfilter[laser] to determine which version is compatible with other requirements. This could take a while.
Collecting opusfilter[laser]
  Using cached opusfilter-2.5.1-py3-none-any.whl.metadata (4.2 kB)
  Using cached opusfilter-2.5.0-py3-none-any.whl.metadata (4.2 kB)
  Using cached opusfilter-2.4.0-py3-none-any.whl.metadata (72 kB)
  Using cached opusfilter-2.3.1-py3-none-any.whl.metadata (61 kB)
WARNING: opusfilter 2.3.1 does not provide the extra 'laser'
  Using cached opusfilter-2.3.0-py3-none-any.whl.metadata (61 kB)
WARNING: opusfilter 2.3.0 does not provide the extra 'laser'
  Using cached opusfilter-2.2.0-py3-none-any.whl.metadata (55 kB)
WARNING: opusfilter 2.2.0 does not provide the extra 'laser'
  Using cached opusfilter-2.1.2-py3-none-any.whl.metadata (54 kB)
WARNING: opusfilter 2.1.2 does not provide the extra 'laser'
INFO: pip is still looking at multiple versions of opusfilter[laser] to determine which version is compatible with other requirements. This could take a while.
  Using cached opusfilter-2.1.1-py3-none-any.whl.metadata (54 kB)
WARNING: opusfilter 2.1.1 does not provide the extra 'laser'
  Using cached opusfilter-2.1.0-py3-none-any.whl.metadata (55 kB)
WARNING: opusfilter 2.1.0 does not provide the extra 'laser'
  Using cached opusfilter-2.0.0-py3-none-any.whl.metadata (50 kB)
WARNING: opusfilter 2.0.0 does not provide the extra 'laser'
  Using cached opusfilter-1.0.1-py3-none-any.whl.metadata (36 kB)
WARNING: opusfilter 1.0.1 does not provide the extra 'laser'
Collecting mosestokenizer (from opusfilter[laser])
  Using cached mosestokenizer-1.2.1.tar.gz (37 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting pyhash (from opusfilter[laser])
  Using cached pyhash-0.9.3.tar.gz (602 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... error
  error: subprocess-exited-with-error
  
  × Preparing metadata (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [3 lines of output]
      /local_scratch/miaulamo/pip-build-env-7dz3za54/overlay/lib/python3.12/site-packages/setuptools/_distutils/dist.py:289: UserWarning: Unknown distribution option: 'tests_require'
        warnings.warn(msg)
      error in pyhash setup command: use_2to3 is invalid.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.

[notice] A new release of pip is available: 25.0.1 -> 25.2
[notice] To update, run: pip install --upgrade pip
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

[svirpioj]

Seems that laserembeddings require torch version below 2, while torch 1.x versions do not work on Python 3.12+. There is a pull request to allow torch 2 for the laserembeddings package, but by the look of it, the repository is no longer maintained.

Fixing the pyproject.toml as indicated in the pull request, and installing the package manually, I was able to use it with Python 3.13. I'll add a note on this to installation.md.