Opinion with some experience - Windows XP is still close enough to DOS to allow you to run some DOS software.
The connection to the printer is probably determined by your software (which may require a 36 pin parallel port or a serial port). Your current printer had USB in addition to parallel - so you know how that worked. Some USB ports can operate like a serial port and sometimes special cables or adapters are needed.
My guess is that you need a printer which supports PCL (but unsure if 4,5 or 6) and is able to use the USB like a serial port - but this is only a guess. You will have to ascertain in order to get the right printer.
HP 1150s can be bought on eBay for around $100.
I run a DOS program in DosBox on Windows 10 machine. I print to file and edit that with WordPad and I can print from there.
Let us know how it turns out.