Coiled runs if distributed is not included in environment

[jacobtomlinson]

I made a software environment that doesn't include dask or distributed. When using coiled run I get an error about distributed being missing. I was surprised that dask was required as a dependency for coiled run and that I'm not warned about this when creating the environment.

import coiled
coiled.create_software_environment(
    name="pandas-only",
    conda={
        "channels": ["conda-forge"],
        "dependencies": ["python=3.12", "pandas"],
    },
)

$ coiled run --software pandas-only -- python -c "import pandas; print(pandas.__version__)"
...
There was an unexpected error:
Cluster status is error (reason: Scheduler Stopped -> Docker reported `ModuleNotFoundError: No module named 'distributed'`.
Software environments for Dask clusters must include `dask` and `distributed`.
Please see https://docs.coiled.io/user_guide/software/docker.html for more about using Coiled with a Docker image.) (cluster_id:
678783)

[dchudz]

Yes, coiled run requires dask & distributed. I know that's pretty unintuitive/surprising. Sorry.

You may enjoy our newer API (more experimental, in active development) that doesn't require dask & distributed: coiled batch run.

https://docs.coiled.io/blog/slurm-job-arrays.html

We built this with job arrays in mind, but it's also fine for executing a single script.