The Bibliothèque Mazarine is France's oldest public library, and certainly one of its most beautiful. Open to all as part of the Institut de France, it's a cultural and heritage gem well worth a visit.
If you're still a student, then you have the chance to visit the Bibliothèque de la Sorbonne, in the 5th arrondissement. A wonderful place to study in peace and quiet.