I had to build this circuit – before I got no idea… Pressing the lower button will turn the light on, the upper button causes the light to go off. So it works similar as a Flipflop.
The battery: I can not see any strange connection so far – give me a hint!
Guenther