The rising interest in understanding the functions, regulation, and maintenance of the epitranscriptome calls for robust and accurate analytical methods for the identification and quantification of post-transcriptionally modified nucleosides in RNA. Monomethylations of cytidine and adenosine are common post-transcriptional modifications in RNA. Herein, we developed an LC–MS/MS/MS coupled with the stable isotope-dilution method for the sensitive and accurate quantifications of 5-methylcytidine (m5C), 2′-O-methylcytidine (Cm), N6-methyladenosine (m6A), and 2′-O-methyladenosine (Am) in RNA isolated from mammalian cells and tissues. Our results showed that the distributions of m5C, Cm and Am are tissue-specific. In addition, the 2′-O-methylated ribonucleosides (Cm and Am) are present at higher levels than the corresponding methylated nucleobase products (m5C and m6A) in total RNA isolated from mouse brain, pancreas, and spleen but not mouse heart. We also found that the levels of m5C, Cm, and Am are significantly lower (by 6.5–43-fold) in mRNA than in total RNA isolated from HEK293T cells, whereas the level of m6A was slightly higher (by 1.6-fold) in mRNA than in total RNA. The availability of this analytical method, in combination with genetic manipulation, may facilitate the future discovery of proteins involved in the maintenance and regulation of these RNA modifications.