Then don't stay on a diet
Use the other definition of a diet. Don't look at a diet as a restricted regimen that you follow for a period of a time to reach a goal. Look at a diet as the foods that you regularly eat and look to control portions and realize that you've always been on a diet; it is a lifelong process and there will be ups and downs with weight but it's ok. If food control is too much of a problem, then you'll have to increase your activity to balance it out, but you can do it.