access: cache: interrupt when the cache is destroyed

Cause the free_cb() to be called in an interrupted context, that will speed up resource cleaning (without teardown).