Hi, I used fastuniq, a duplicates removal tool for paired short DNA sequences. It used a lot of memory and I just wonder whether there is another tool which could remove duplication from paired-end with less memory?
You could try the tally tool with reaper. I've only ever use it in single-end mode, but it claims to do paired end as well. As a bonus, it records how many copies of each sequence their were in the read name.
Duplicate read removal software tools | NGS - OMICtools
and I suggest MarkDuplicates from picard tools
Since the omics tool does not have dedupe.sh from BBMap: dedupe.sh output from BBTools