The --cleanup flag is necessary to build multiple images in one
container. But that flag removes everything that's not in
the vanilla kaniko image.