Handle JVM exit gracefully in unit tests

System.exit / Rutime.halt can exit JVM and this can lead to failure of test runner that manages JVM for tests as well as providing output files for all tests. We should gracefully handle JVM exit by throwing our custom Exception rather than losing test runner outputs.