You need to trigger the bazooka cut scene.
Ride back to the switch house and toggle switch #3. Now take another round. This time you will be attacked by a bazooka as soon as you return to the place from where you intend to reach the green gem. The commies will fire a hole into the trails but you will survive. Now return there, clear the area and get the green gem.