tests: take extra care for fsmonitor at enabling incompatible extension
This is worthwhile, because these tests don't focus mainly on using
incompatible extensions itself.
ERROR: FIXME: This is a known failure of filelog.size for data starting with \1\nOK.