This paper deals with the understandig of sheikh or murshid (guide) in sufism, focusing on Rumi's renowned book, Mathnawi. According to sufism, it is agreed upon that a person who undertakes sufi training should necessarily engage in guidance of a sheikh so much that with no guidance, any progress in such training would be inadvisable, yet impossible. In this regard, the definition of the concepts, sheikh and murshid and their qualities in Rumi's thought are examined. Additionally the views of earlier and later sufis are referred to in terms of the necessity of guidance by a sheikh in sufi training. Afterwards Rumi's view regarding the said issue is provided. Lastly an evaluation of the mentioned views is presented.