Apparently no response to my question, must be firefox bug.

For private window, the download icon is set to auto-hide. So, it appears at the time of active download and disappears after completion. To make it appear always in private window : Select customize from menu, then you will find download icon at the specified place. Click on it and un-tick the auto-hide option which pops up.