Mercurial > hg
comparison contrib/fuzz/Makefile @ 40053:8c692a6b5ad1
fuzz: new fuzzer for cext/manifest.c
This is a bit messy, because lazymanifest is tightly coupled to the
cpython API for performance reasons. As a result, we have to build a
whole Python without pymalloc (so ASAN can help us out) and link
against that. Then we have to use an embedded Python interpreter. We
could manually drive the lazymanifest in C from that point, but
experimentally just using PyEval_EvalCode isn't really any slower so
we may as well do that and write the innermost guts of the fuzzer in
Python.
Leak detection is currently disabled for this fuzzer because there are
a few global-lifetime things in our extensions that we more or less
intentionally leak and I didn't want to take the detour to work around
that for now.
This should not be pushed to our repo until
https://github.com/google/oss-fuzz/pull/1853 is merged, as this
depends on having the Python tarball around.
Differential Revision: https://phab.mercurial-scm.org/D4879
| author | Augie Fackler <augie@google.com> |
|---|---|
| date | Thu, 06 Sep 2018 02:36:25 -0400 |
| parents | 46dcb9f14900 |
| children | a66594c5fad4 |
comparison
equal
deleted
inserted
replaced
| 40052:55db747a21ad | 40053:8c692a6b5ad1 |
|---|---|
| 68 xdiff_fuzzer: xdiff.cc fuzz-xdiffi.o fuzz-xprepare.o fuzz-xutils.o fuzzutil-oss-fuzz.o | 68 xdiff_fuzzer: xdiff.cc fuzz-xdiffi.o fuzz-xprepare.o fuzz-xutils.o fuzzutil-oss-fuzz.o |
| 69 $(CXX) $(CXXFLAGS) -std=c++17 -I../../mercurial xdiff.cc \ | 69 $(CXX) $(CXXFLAGS) -std=c++17 -I../../mercurial xdiff.cc \ |
| 70 fuzz-xdiffi.o fuzz-xprepare.o fuzz-xutils.o fuzzutil-oss-fuzz.o \ | 70 fuzz-xdiffi.o fuzz-xprepare.o fuzz-xutils.o fuzzutil-oss-fuzz.o \ |
| 71 -lFuzzingEngine -o $$OUT/xdiff_fuzzer | 71 -lFuzzingEngine -o $$OUT/xdiff_fuzzer |
| 72 | 72 |
| 73 # TODO use the $OUT env var instead of hardcoding /out | |
| 74 /out/sanpy/bin/python: | |
| 75 cd /Python-2.7.15/ && ./configure --without-pymalloc --prefix=$$OUT/sanpy CFLAGS='-O1 -fno-omit-frame-pointer -g -fwrapv -fstack-protector-strong' LDFLAGS=-lasan && ASAN_OPTIONS=detect_leaks=0 make && make install | |
| 76 | |
| 77 sanpy: /out/sanpy/bin/python | |
| 78 | |
| 79 manifest.o: sanpy ../../mercurial/cext/manifest.c | |
| 80 $(CC) $(CFLAGS) `$$OUT/sanpy/bin/python-config --cflags` \ | |
| 81 -I../../mercurial \ | |
| 82 -c -o manifest.o ../../mercurial/cext/manifest.c | |
| 83 | |
| 84 charencode.o: sanpy ../../mercurial/cext/charencode.c | |
| 85 $(CC) $(CFLAGS) `$$OUT/sanpy/bin/python-config --cflags` \ | |
| 86 -I../../mercurial \ | |
| 87 -c -o charencode.o ../../mercurial/cext/charencode.c | |
| 88 | |
| 89 parsers.o: sanpy ../../mercurial/cext/parsers.c | |
| 90 $(CC) $(CFLAGS) `$$OUT/sanpy/bin/python-config --cflags` \ | |
| 91 -I../../mercurial \ | |
| 92 -c -o parsers.o ../../mercurial/cext/parsers.c | |
| 93 | |
| 94 dirs.o: sanpy ../../mercurial/cext/dirs.c | |
| 95 $(CC) $(CFLAGS) `$$OUT/sanpy/bin/python-config --cflags` \ | |
| 96 -I../../mercurial \ | |
| 97 -c -o dirs.o ../../mercurial/cext/dirs.c | |
| 98 | |
| 99 pathencode.o: sanpy ../../mercurial/cext/pathencode.c | |
| 100 $(CC) $(CFLAGS) `$$OUT/sanpy/bin/python-config --cflags` \ | |
| 101 -I../../mercurial \ | |
| 102 -c -o pathencode.o ../../mercurial/cext/pathencode.c | |
| 103 | |
| 104 revlog.o: sanpy ../../mercurial/cext/revlog.c | |
| 105 $(CC) $(CFLAGS) `$$OUT/sanpy/bin/python-config --cflags` \ | |
| 106 -I../../mercurial \ | |
| 107 -c -o revlog.o ../../mercurial/cext/revlog.c | |
| 108 | |
| 109 manifest_fuzzer: sanpy manifest.cc manifest.o charencode.o parsers.o dirs.o pathencode.o revlog.o | |
| 110 $(CXX) $(CXXFLAGS) `$$OUT/sanpy/bin/python-config --cflags` \ | |
| 111 -Wno-register -Wno-macro-redefined \ | |
| 112 -I../../mercurial manifest.cc \ | |
| 113 manifest.o charencode.o parsers.o dirs.o pathencode.o revlog.o \ | |
| 114 -lFuzzingEngine `$$OUT/sanpy/bin/python-config --ldflags` \ | |
| 115 -o $$OUT/manifest_fuzzer | |
| 116 | |
| 117 manifest_corpus.zip: | |
| 118 python manifest_corpus.py $$OUT/manifest_fuzzer_seed_corpus.zip | |
| 119 | |
| 120 copy_options: | |
| 121 cp *.options $$OUT | |
| 122 | |
| 73 clean: | 123 clean: |
| 74 $(RM) *.o *_fuzzer \ | 124 $(RM) *.o *_fuzzer \ |
| 75 bdiff \ | 125 bdiff \ |
| 76 mpatch \ | 126 mpatch \ |
| 77 xdiff | 127 xdiff |
| 78 | 128 |
| 79 oss-fuzz: bdiff_fuzzer mpatch_fuzzer mpatch_corpus.zip xdiff_fuzzer | 129 oss-fuzz: bdiff_fuzzer mpatch_fuzzer mpatch_corpus.zip xdiff_fuzzer manifest_fuzzer manifest_corpus.zip copy_options |
| 80 | 130 |
| 81 .PHONY: all clean oss-fuzz | 131 .PHONY: all clean oss-fuzz sanpy copy_options |