Automatic speech recognition (ASR) in Sanskrit is interesting, owing to thevarious linguistic peculiarities present in the language. The Sanskrit languageis lexically productive, undergoes euphonic assimilation of phones at the wordboundaries and exhibits variations in spelling conventions and inpronunciations. In this work, we propose the first large scale study ofautomatic speech recognition (ASR) in Sanskrit, with an emphasis on the impactof unit selection in Sanskrit ASR. In this work, we release a 78 hour ASRdataset for Sanskrit, which faithfully captures several of the linguisticcharacteristics expressed by the language. We investigate the role of differentacoustic model and language model units in ASR systems for Sanskrit. We alsopropose a new modelling unit, inspired by the syllable level unit selection,that captures character sequences from one vowel in the word to the next vowel.We also highlight the importance of choosing graphemic representations forSanskrit and show the impact of this choice on word error rates (WER). Finally,we extend these insights from Sanskrit ASR for building ASR systems in twoother Indic languages, Gujarati and Telugu. For both these languages, ourexperimental results show that the use of phonetic based graphemicrepresentations in ASR results in performance improvements as compared to ASRsystems that use native scripts.