No one likes to be told No, even when it comes from yourself. That defiant child in you says, "I can if I want!" Yet that defiance is getting in the way of your health, your body, and your peace of mind.
These are two very different things. Binging is a loss of food control and harmful to your physical body as well as emotional well being while late night eating may be exactly what your body needs for you goal. You don't have to go to bed starved.