As stated by Zvika, it seems that I have problem with https connections. So replacing https with http in epel.repo temporarily fixed the issue.