Hope you're doing well!
In regards to your question I think it would be a good idea to try out another router to truly rule that out as a factor in this issue. If possible, it may be worth looking for a router aimed more at gaming.
I would also suggest checking the return policy for wherever you purchase a router from in the case it does not improve your connection.
I've personally used the Netgear Nighthawk series routers for gaming with good results. It would be wise for you to do some research on router options before purchasing one to make sure it will work with your network/use case.
Best of luck!