Forum:What runs slow?/Improving Performance on Big Data

Question

[dirigible2012]

I am doing an MPhil exploring ways to improve data processing in bioinformatics, especially with regard to the pharmaceutical industry. I am looking for example programs to analyse.

Currently I am mostly looking for programs which run too slowly for their intended use. I realise slow is relative! - this may mean "takes 30 seconds to complete when you want to interact with the data in real time", "can't run comfortably overnight" or "have to send job to the HPC cluster when we would prefer to complete it on lab computers".

This can also includes instances when your job completes in a reasonable time, but you have to limit the amount of data analysed to get a reasonable speed. (e.g. the program is fine on small datasets but falls over when presented with Big Data)

Thanks for any suggestions,

Stephanie

[Pierre Lindenbaum]

moved to forum.