It is just curious question, there is a lot of free software and scripts that serves I think all Bioinformatics research fields. Is there any field that matlab excel than these tools "actually I have never used matlab"?
Is it worth to learn it? "also there is an alternative for it Octave"
So generally it is more related to pure math work not bioinformatics work "more numerical stuff "
Math or engineering I'd say. At least those are the contexts that would led themselves more toward it. An exception to this might be microarray/etc. signal deconvolution (e.g., you have an admixture and want to perform cell-type specific DE from it). While there are packages to do the deconvolution in R/Bioconductor, there are a LOT more in matlab and they use about every method one can think of, since the same math is used heavily in signal processing. You'll often find things like that implemented first in Matlab and then maybe someday (though probably never) in R.