Was your bike crashed before? Sometimes the forks get slightly twisted, but loosening and retightening them causes them to relieve tension.
Try loosening the fork clamps above the wheel on both sides and wiggle the wheel and forks around with the front wheel off the ground. Then carefully line the forks level and snug the clamp bolts back up.