Would it make sense to remove the probes which have a low p value and bad annotation quality before doing the normalisation (quantile or neqc) across arrays?
Would it make sense to remove the probes which have a low p value and bad annotation quality before doing the normalisation (quantile or neqc) across arrays?
Normalization is done to make the data similar across arrays. Given that all arrays will have unexpressed genes, I doubt that doing so will significantly "improve" results, but I don't have any evidence to support my claim. Filtering is usually applied after normalization (can't think of any large-scale counter-examples) and is probably best based on variance rather than expression levels.
No, there is no purpose in doing so, and it might make it more difficult for the background correction and normalization algorithms to estimate the background intensity levels. As Sean says, it is much better to whatever filtering you want to do after background correction and normalization steps are completed.
Use of this site constitutes acceptance of our User Agreement and Privacy Policy.