Mercurial Mercurial > hg-stable / annotate
summary | shortlog | changelog | graph | tags | bookmarks | branches | files | changeset | file | latest | revisions | annotate | diff | comparison | raw | help
Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
tests/list-tree.py
author Boris Feld <boris.feld@octobus.net>
Sun, 17 Dec 2017 04:31:27 +0100
changeset 35599 af25237be091
parent 35389 acff41957b34
child 43076 2372284d9457
permissions -rw-r--r--
perf: add threading capability to perfbdiff Since we are releasing the GIL during diffing, it is interesting to see how a thread pool would perform on diffing. We add a new `--threads` argument to commands. Synchronizing the thread pool is a bit complex because we want to be able to reuse it from one run to another. On my computer (i7 with 4 cores + hyperthreading), I get the following data for about 12000 revisions: threads wall comb wall gain comb overhead none 31.596715 31.59 0.00% 0.00% 1 31.621228 31.62 -0.08% 0.09% 2 16.406202 32.8 48.08% 3.83% 3 11.598334 34.76 63.29% 10.03% 4 9.205421 36.77 70.87% 16.40% 5 8.517604 42.51 73.04% 34.57% 6 7.94645 47.58 74.85% 50.62% 7 7.434972 51.92 76.47% 64.36% 8 7.070638 55.34 77.62% 75.18% Compared to the feature disabled (threads=0), the overhead is negligible with the threading code (threads=1), and the gain is already 48% with two threads.
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
35002
aa905f9cdcda tests: write and use a custom helper script to avoid find's -printf
Augie Fackler <augie@google.com>
parents:
diff changeset 
     1
 
from __future__ import (
aa905f9cdcda tests: write and use a custom helper script to avoid find's -printf
Augie Fackler <augie@google.com>
parents:
diff changeset 
     2
 
    absolute_import,
aa905f9cdcda tests: write and use a custom helper script to avoid find's -printf
Augie Fackler <augie@google.com>
parents:
diff changeset 
     3
 
    print_function,
aa905f9cdcda tests: write and use a custom helper script to avoid find's -printf
Augie Fackler <augie@google.com>
parents:
diff changeset 
     4
 
)
aa905f9cdcda tests: write and use a custom helper script to avoid find's -printf
Augie Fackler <augie@google.com>
parents:
diff changeset 
     5
 












aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




     6


import argparse













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




     7


import os













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




     8














aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




     9


ap = argparse.ArgumentParser()













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    10


ap.add_argument('path', nargs='+')













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    11


opts = ap.parse_args()













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    12














aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    13


def gather():













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    14


    for p in opts.path:













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    15


        if not os.path.exists(p):













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    16


            return













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    17


        if os.path.isdir(p):













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    18


            yield p + os.path.sep













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    19


            for dirpath, dirs, files in os.walk(p):













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    20


                for d in dirs:













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    21


                    yield os.path.join(dirpath, d) + os.path.sep













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    22


                for f in files:













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    23


                    yield os.path.join(dirpath, f)













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    24


        else:













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    25


            yield p













aa905f9cdcda
tests: write and use a custom helper script to avoid find's -printf



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    26









35389






acff41957b34
tests: stabilize the sorted output of list-tree.py on Windows



Matt Harbison <matt_harbison@yahoo.com>


parents: 
35002

diff
changeset




    27


print('\n'.join(sorted(gather(), key=lambda x: x.replace(os.path.sep, '/'))))















hg-stable