[whypowt]

Also when I connect both of them the one wich was joy1 becomes joy2 and the new on becomes joy1 so I have to reconfigure some of the buttons.
Is there a way to fix these issues?

you can backup both joy configs by expotring the registry key after each setup:

"HKEY_CURRENT_USER\Software\epsxe\config"

then just click on the exported file for the one you want to use. some frontends will do this for you via a UI, but they can be buggy.

as for the rumble issue i never use it so can't you help there.