PSP-Vault has put together a great guide on Firmware and Homebrew capabilities.

In addition to that, there is a large FAQ as well covering all sorts of topics ranging from changing firmware, homebrew installation, and more.

I recommend checking it out even if you are pretty familiar with the capabilities of the PSP.