Do you use the Firefox browser? It has a nice feature that allow you easy backup all of its data - your complete profile, including bookmarks, passwords, history, installed extensions or themes. All you need to do is copying its profile folders to another location. You can copy them to USB drive and back (e.g. if you reinstall you PC). There are different methods depending on your operating system.