Yes. If you set it up, maybe there was some mistake somewhere. Read the router manual about how to do a factory reset and start over.
Also, make sure you set up wireless encryption with a good password and change the router admin password. Maybe someone found your unencrypted(?) network and decided to play a prank on you..