tests/test-gendoc

hgfixes: add a fixer to convert plain strings to bytestrings

This patch implements a 2to3 fixer that converts all plain strings in a python
source file to byte strings syntax. Example:

foo = 'Normal string'

would become

foo = b'Normal string'

The motivation behind this fixer can be found in
http://selenic.com/pipermail/mercurial-devel/2010-June/022363.html or, in other
words: the current hg source assumes that _most_ strings are "meant" to be byte
sequences, so it makes sense to make the convertion implemented by this patch.

As mentioned above, not all mercurial modules want to use strings as bytes,
examples include i18n (which uses unicode), and demandimport (in py3k, module
names are normal strings, thus unicode, and there's no need for a convertion).
Therefore, these modules are blacklisted in the fixer. There are also a few
functions that can take only unicode arguments, thus the convertion shouldn't
be done for those.

#!/bin/sh

"$TESTDIR/hghave" docutils || exit 80

HGENCODING=UTF-8
export HGENCODING

for PO in C $TESTDIR/../i18n/*.po; do
    LOCALE=`basename $PO .po`
    echo
    echo "% extracting documentation from $LOCALE"
    echo ".. -*- coding: utf-8 -*-" > gendoc-$LOCALE.txt
    echo "" >> gendoc-$LOCALE.txt
    LC_ALL=$LOCALE python $TESTDIR/../doc/gendoc.py >> gendoc-$LOCALE.txt || exit

    # We call runrst without adding "--halt warning" to make it report
    # all errors instead of stopping on the first one.
    echo "checking for parse errors"
    python $TESTDIR/../doc/runrst html gendoc-$LOCALE.txt /dev/null
done