[3.x] build script: optionalize 32 bit slices for iOS

By default, only 64bit slices will be compiled. For the CI and releases, we still build all the things.

This is a backport of !258 (merged)