Frozen fruit might work well for you. For some fruits it's a decent price year-round (peaches are constantly about $2.20/lb)... some berries are almost never affordable fresh, but frozen they are about $3/lb.

If you can buy fresh seasonal fruit cheaply, you can wash and freeze most of it, just keeping a small amount in the fridge. Works especially well with cantalope, pineapple, and grapes- these are very easy to prep. After you eat the fridge's fruit, you can thaw frozen fruit in the fridge overnight, or you can eat it cold-- i microwave it straight from frozen sometimes too (peaches microwaved w/ cinnamon are great).

You could begin having fruit as dessert after dinner. I do this like all the time...