The magnet was loose from the original magnet holder and instead of using CA-glue to put all my fingers together I designed new magnet holder. This version the magnet is pushed in place from back and it will snap in place and stay there forever. Maybe not forever but it wont fall off on its own.

There will also be small gap between the door and the magnet so the magnet will pull the door against the frame and make it more air tight. This might help to keep chamber warm when it is needed.

EDIT:
I just made input shaping and the door makes quite bad noise in some frequency. I think the magnet doesn't have enough force to keep the door fully closed during that vibration but so far I have not found any problems during normal operation.