Nayi Sadak at chandni chowk is popular for competitive exam books. It has a lot of shops which offers you a number of options. Also they have second hand books as well as new stock which are sold at reasonable rates, and you can even sell your old books which are in good condition to get some discount.