Manual:$wgMaxShellFileSize

Details
Maximum file size created by shell processes under linux, in KB.

ImageMagick convert for example can be fairly hungry for scratch space.