Costlier imports may pull down CAD: Finance Ministry