Click on bing search icon and select your favorite search engine.

No, that's not it. My regular search bar next to the address bar is still there and has the Bing option which is fine. I want to get rid of the extra box next to my tabs.

Can you attach a screenshot of it?

Search box I am referring to is circled at top.

Go to Customize ...

Drag that bing bar and drop inside the customize toolbar window.

There is no way to grab it. I can grab everything else but that. It moves only with the tabs.

https://support.mozilla.com/en-US/kb/How+to+customize+the+toolbar
http://kb.mozillazine.org/Toolbar_customization
If you can't hide that Bing Search box in the Customize Palette while in the Customize mode, try uninstalling the program or add-on that put it in Firefox.

A Bing search related addon could be in Firefox as something called default tab or Search bar, Search Toolbar, Search Helper, Default Manager or Bing.

Remove Search Helper and Bing Bar extensions
Uninstall Search Helper
Default Manager 2.2

Also, in past support threads, Bing has been installed through various non-Microsoft add-ons, including:

StartNow Toolbar (remove using Control Panel)
PDF Lite (remove under Extensions)
Vuze Toolbar (remove under Extensions)
BigSeekPro / Hypercam Toolbar (remove using Control Panel)

For me, it was the Default Tab Add On; I disabled it, restarted FF, and the Bing Search "tab" is gone  :)

Loren

Thank you all for your suggestions. I finally found the Default tab add on after looking at the-edmeister's links and lorenbc's post. Solved.