He also said that the government is aware of its responsibilities in working with the judiciary and other stakeholders to build a "strong and effective" justice delivery system.
"It is of critical importance that the bench and the bar work together in ensuring the rule of law in our country and in furthering our Constitutional objectives.
"Unless this happens, we cannot succeed substantially in providing speedy and affordable justice to millions of our countrymen, especially those who belong to the poor and weaker sections of our society," he said.
The Prime Minister was addressing the Golden Jubilee celebrations of the Bar Council of India here in the presence of Chief Justice of India Altamas Kabir and Law Minister Ashwani Kumar.
Singh said several challenges have to be overcome and many bottlenecks have to be removed before the objective is achieved.
"An obvious area of concern is the large number of cases pending in courts especially in trial courts. I would urge the whole of the legal fraternity to pool their knowledge, wisdom and experience to find ways and means to tackle this problem," he said.