Not long ago I read the topic regarding popup closing. It can be your case also.
Recommended solution was to move close to the button attribute
<button name="cancelConfirmBtn" title="Confirm cancellation" colspan="4" coloffset="4" onclick="action production-order-the-cancel,close"/>
and remove it from controller
Hope it helps!