Skip to content Skip to sidebar Skip to footer
Home / Condor / Dask / Parallel Processing / Python

Dask With HTCondor Scheduler

Post a Comment
Background I have an image analysis pipeline with parallelised steps. The pipeline is in python and the parallelisation is controlled by dask.distributed. The minimum processing se

Solution 1:

HTCondor JobQueue support has been merged (https://github.com/dask/dask-jobqueue/pull/245) and should now be available in Dask JobQueue (HTCondorCluster(cores=1, memory='100MB', disk='100MB') )


You may like these posts

Post a Comment for "Dask With HTCondor Scheduler"