Skip to content Skip to sidebar Skip to footer

Dask With HTCondor Scheduler

Background I have an image analysis pipeline with parallelised steps. The pipeline is in python and the parallelisation is controlled by dask.distributed. The minimum processing se

Solution 1:

HTCondor JobQueue support has been merged (https://github.com/dask/dask-jobqueue/pull/245) and should now be available in Dask JobQueue (HTCondorCluster(cores=1, memory='100MB', disk='100MB') )


Post a Comment for "Dask With HTCondor Scheduler"