I don’t have the Emile Henry bread baker, but have an EH pizza stone and like it very much which is to say I think that brand is very nice.
Other options … I’m guessing the oblong clay baker is not in the running as while not an oval, it is somewhat a rounded rectangle. I have that baker from the Breadtopia store and really like it and the loaf size/shape. (if you go to @breadwriter on Instagram that is @Fermentada’s (Melissa from this site) feed and she just made a gorgeous loaf in the oblong baker)
Have you looked at Pullman pans? There are 2 sizes in the Breadtopia store and also on Amazon if you prefer shopping there. You will get a rectangle loaf and the slices will be perfect squares.
I have a Lodge cast iron breadpan and use a USA aluminum pan for a lid to get a loaf that still has a crisp artisan-like crust.
You can’t see the entire loaf, but here is a sample of slices from a rye (with currants) that I made with the above pans: