If all your neighbors are surfing wirelessly, it will affect your speed. You share the same space in the “air” and the solution is to change the channel in the router. With the Wifi Analyzer mobile app, you can check which channels your neighbors are using.
If you are not sure how to change the channel, you can read this PC for All article.