How to know a program I use is parallelizable?
1
0
Entering edit mode
9.5 years ago
mparadis92 ▴ 40

I'm an intern in a bioinformatic lab for the summer and I just got permission to use a super-computer to do protein disorder jobs. I know how to use this program on my local computer with linux and it's pretty simple. I downloaded it, make install, run the script with the right PATHs to the files I want to use et voilĂ .

My question is quite simple but since I'm new to all of this, I don't really know where to look : How can I know if I can use this program in parallel? I ask this because apparently I need to know that before I can submit a job. On the supercomputer there are nods with 8 cores. According to my colleagues, knowing if my job is parallelizable is very important since it will determine whether I use one core or all 8, which will affect time and resources.

I hope this makes sense and I'm sorry if it's a dumb question but I'm kind of lost here... Thanks for the help! :)

(the program I use is DISOPRED3, available for free)

supercomputers linux disopred parallel computing • 2.3k views
ADD COMMENT
1
Entering edit mode

The software man page generally has information on how to best parallelize runs. Quite a few use OpenMPI and such, so you could read through their documentation. If the developers have a github repo, you can read through the README there and look at issues. You could also email them.

ADD REPLY
0
Entering edit mode

Sadly there is not a lot of documentation. I searched a lot and couldn't find a definitive answer. I thought maybe there were ways to test this or something. Thanks for the answer!

ADD REPLY
1
Entering edit mode
ADD REPLY
2
Entering edit mode
9.5 years ago

If you inspect the run_disopred.pl file at line 20 you can find:

## IMPORTANT: Changing these flags will alter the behaviour of blastpgp
## You may want to use -a n to speed-up the search using n processors, if available
my $PSIBLAST_PAR = "-a 1 -b 0 -j 3 -h 0.001";

So, at least this part of the computation can be performed using more than one processor by properly setting parameter a.

ADD COMMENT
0
Entering edit mode

Wow I think that's what I need! I looked through all the files but I guess I didn't see this part.... thanks a lot! :)

ADD REPLY

Login before adding your answer.

Traffic: 1887 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6