But as for the answer, yes indeed they do matter but maybe not in the way you expect. Their choice will affect the way the scores are computed and the actual magnitude of them. But in general I would not worry too much about them.
In my opinion these scores and the underlying mathematics are more of an illusion when it comes to biological interpretation - they should be used to weed out obviously redundant hits but beyond that don't have that much use.
Thanks a lot. That's really helpful.