I wasn't at Bryce's Friday session, but looking back on Saturday's session fruit came out of the conversation fairly bruised. Just to clarify, that's because eating only real food and removing the GLD was taken as a given.
If you already had most grains out of your diet, then by all means jump right in to cutting back on some of the fruit to achieve your weight loss goals. If your typical day was oatmeal for breakfast, sandwich for lunch, and pasta for dinner, then clean that up first. Of course we'd suggest replacing those meals with one's composed primarily of meat and veggies, but adding in fruit to those meals is a far better option than just cutting back on the GLD.
If you're losing a will power battle with curing a sugar fix and choosing between an apple turnover and a banana. We'd be all for the banana! Heck, chop it up and poor a little coconut milk over it and you've got a decent desert.