When you double click on an item in Eluma or choose the "open in browser" option with a right mouse click, Eluma launches the bookmark in whatever is set as the default browser in Windows. This would be the same as would happen if you double-clicked on an HTML file in Windows.
Windows only allows you to have one default browser, so you will have to set your Windows default browser to be Firefox and then Eluma will open things using Firefox.