Entering edit mode
8.1 years ago
huwenhuo
▴
40
I am running GSEA in HPC. After run with qsub script.sh
It gives me this memory error as shown in the title. Here are the most likely relevant parameters when I run it:
#$ -l h_vmem=125G,virtual_free=2G
#$ -pe smp 3
java -jar gsea2-2.2.0.jar xtools.gsea.GseaPreranked -nperm 1000000 other_parameters_not_shown
the parameters works as this:
#$ -l h_vmem=5,virtual_free=2G
#$ -pe smp 5
java -jar gsea2-2.2.0.jar xtools.gsea.GseaPreranked -nperm 1000 other_parameters_not_shown
But I really want to get the nice p values to plot a figure. Is this normal that memory error rise from the top setting?
You are trying to assign 125x3 = 375G RAM for this job in the top example. Is your account allowed to use that much memory (likely not)?
Number you assign to
h_vmem
will be used for each core you specify insmp "n"
. Does GSEA have any recommendation about how much memory you should use?Yes, you are right. That is also I am so supprised I got this error.
below is the whole script
/home/huw/program/jdk7/bin/java -Xmx10g -cp /home/huw/program/gsea2-2.2.0.jar xtools.gsea.GseaPreranked -gmx /home/huw/program/c1.all.v5.0.symbols.gmt -rnk nhd.symbol.rnk -rpt_label gsea.nhd.symbol.rnk.c1.all.v5.0.symbols.gmt -out gsea -collapse false -mode Max_probe -norm meandiv -nperm 100000 -scoring_scheme classic -include_only_symbols true -make_sets true -plot_top_x 20 -rnd_seed timestamp -set_max 2500 -set_min 10 -zip_report false -gui false
here is what I got at one moment by
qstat -j jobid
Based on this FAQ page, GSEA should not need a lot of memory so I would start with 8G or so to check. Here is some additional help for the command line.