Mycobacteria a genus of Actinobacteria are widespread in nature ranging from soil-dwelling saprophytes to human and animal pathogens. The rate of growth has been a classifying factor for the Mycobacterium spp., dividing them into the rapid growers and the slow growers. Here we have performed a comparative genome study of mycobacterial species in order to get better understanding of their evolution, particularly to understand the distinction between the rapid and slow growers. Our study shows that the slow growers had generally gained and lost more genes compared to the rapid growers. The slow growers might haved eventually lost genes (LivFGMH operon, shaACDEFG genes and MspA porin) that could contribute to the slow growth rate of the slow growers. The genes gained and lost in mycobacteria had eventually helped these bacteria to adapt to different environments and have led to the evolution of the present day rapid and slow growers. Our results also show high number of Mycobacterium abscessus specific genes (811 genes) and some of them are associated with the known bacterial quorum sensing genes that might be important for Mycobacterium abscessus to adapt and survive in variety of unfavorable environments. Mycobacterium abscessus also does not contains genes involved in the bacterial defense system and together with the quorum sensing genes may have contributed to the high gene gain rate of Mycobacterium abscessus.