Test using AddToArchive:
ark -t <archive_name> <some_folder_with_many_files>
then stop the job using system tray. Try both with e.g. a tar.xz and a zip archive.
Test using GUI:
Create a new archive and add a large folder using Add Folder action. Then close Ark while AddJob is running. Again try both with e.g. a tar.xz and a zip archive.