To the OP:
I’m surprised the 4.10’s don’t seem to work, but maybe the four banger(I’ve never driven one) needs a little more gear. Modern engines of all brands and sizes don’t mind being revved up like they used to be. Also, remember that your four cylinder fires twice every revolution vs three times for a 4.0. That makes it sound differently, so go by feel, which I think you are. If the engine is in good shape, holding good oil pressure and being properly cared for, don’t be afraid to spin it up a little. I run 4.88’s with a 4.0, 35’s and 6 speed and they’re perfect. I would think that to let that engine rev a little, 4.56’s and maybe even 4.88’s would be fine.
Since it’s not an easily or inexpensively reversed change, it would be nice if you could find someone with one of these gear sets and drive it, but that would probably be hard to find.
We are all different about such things, but if it were me, I wouldn’t fear the gear.
Hope this helps.