I have 2 10x10 tents. I have two 6inch exhaust fans only. They both pull the walls in on the tents when running. Like Dee said, the side vents are there for a reason. Use them and happy growing.
If they are pulling in the sides you should find a way to let more air in and not put that strain on you vent fans.