do not build the allocation fail fuzzer when lto is enabled

Link time optimization and '--wrap' seems to not work together.
Fixes #219.
12 jobs for master in 5 minutes and 18 seconds (queued for 2 seconds)
Status Job ID Name Coverage
  Build
passed #242502
amd64 debian
build-debian

00:00:32

passed #242506
debian aarch64
build-debian-aarch64

00:01:27

passed #242507
debian aarch64
build-debian-aarch64-clang-5

00:01:08

passed #242503
amd64 debian
build-debian-static

00:00:35

passed #242509
debian aarch64
build-debian-werror

00:00:33

passed #242508
macos
build-macos

00:00:31

passed #242504
win32
build-win32

00:00:28

passed #242505
win64
build-win64

00:00:36

 
  Test
passed #242510
amd64 debian
test-debian

00:00:44

passed #242511
amd64 debian
test-debian-asan

00:02:10

passed #242512
amd64 debian
test-debian-msan

00:00:57

passed #242513
amd64 debian
test-debian-ubsan

00:01:19