To uninstall a library, you must still have the source directory from which you installed the library. If you were superuser when you installed the library, you will have to be superuser to uninstall it.

To uninstall, first cd into the root directory of the source code (the same directory from which you invoked make install), and type the following at the command prompt
$ make uninstall

(The above instructions hold for the all-in-one installation as well as the individual library installations.)