The literature clearly shows that development of monitoring system for FSW is most important and only a few researchers have focussed on this field. To the best of authors’ knowledge, the vision based quality monitoring in FSW is rarely reported and requires detailed analysis. This research work is mainly focussed to develop a monitoring system which uses surface image for identification and classification of defective welds produced during FSW process.