[FIXME] Exclude incompatible shared libs from platform wheels

[webknjaz]

          Self note: cibuildwheel doesn't clean the build dir in between building different wheels in the same container.

Seems to be something mentioned in pypa/cibuildwheel#1693.

Originally posted by @webknjaz in #562 (comment)