Perhaps this is caused by the specific page that is loading, which could be either your home page or a page being restored as part of recovering from a previous crash.

What OS is this problem on -- Windows, Mac, Linux.

Try to start Firefox with the about:blank page by creating a copy of the current Firefox desktop shortcut. Add a space and -url "about:blank" to the target field in the Properties.