Hello! I'm extremely new to SLURM and bioinformatics so apologies for this rather dumb question and if I use any terminology wrong (feel free to correct me)!
Basically I ran a SLURM operation, however it surpassed the allocated 24 hours on the HPC server I'm using and ran out of time...
Here are some of the allocated inputs I used:
--ntasks=1
--ntasks-per-node=1
--cpus-per-task=28
--mem=110
OMP_NUM_THREADS=28
My question is... what do I need to change from these inputs to get the analysis complete before 24 hours?
I'm not really sure about the terminology and what constitutes as "tasks" or what a "node" is etc...
Thank you so much
Thank you so much for your answer, my cluster does unfortunately have a max time allocation of 24 hours..
Basically I'm running OrthoFinder on the protein fasta files of 5 species... I was wondering if changing the ntasks/ntasks per node/cpus per task parameters would make me able to complete the job faster?
How are you running
orthofinder
? Are you using the-t
and-a
options to use multiple threads?From a SLURM shell script.
It doesn't have the -t and -a parameters but it has
I'm not really sure what to change or how many tasks or tasks per node to give it since this is all really new to me including the terminology
I am asking about
orthofinder
command line options. Do you have above options in that command line? Seeparallelizing orthofinder
section in the manual. e.g. if you are asking for 28 cpu's in your SLURM script (--cpus-per-task=28
) there needs to be a corresponding-t 28
in your orthofinder command line to take advantage of those (just an example).OHHH! I'm so sorry I didn't see the parallelising section in the manual, so in my run script I have:
but it should actually be
srun --export=ALL orthofinder -f species/ -t 28
?No worries. Yes something along that lines. Take a look at the manual and decide on what optimal options you need to use. You may also want to see if you want to run the blast/DIAMOND analyses separately (if that 24h limit is hard cap).
Thank you so much for all your help, I really appreciate it! :)
If you are using a script like one above you could also do something like this
Save contents in a file e.g.
my_script
. And then justsbatch my_script
to submit the job.