Toolserver:User:Valhallasw/enwikitslinks

This page was moved from the Toolserver wiki.
Toolserver has been replaced by Toolforge. As such, the instructions here may no longer work, but may still be of historical interest.
Please help by updating examples, links, template links, etc. If a page is still relevant, move it to a normal title and leave a redirect.

http:/	4879459
http:	4879459
http://org.toolserver.	4876159
http://org.toolserver./~geohack	1489204
http://org.toolserver./~geohack/geohack.php	1489196
http://org.toolserver./~enwp10	669649
http://org.toolserver./~enwp10/bin	669516
http://org.toolserver./~enwp10/bin/list2.fcgi	669150
http://org.toolserver./~magnus	483171
http://org.toolserver./~magnus/commonshelper.php	324327
http://org.toolserver./~dispenser	303958
http://org.toolserver./~dispenser/cgi-bin	302210
http://org.toolserver./~tparis	301116
http://org.toolserver./~tparis/pcount	288915
http://org.toolserver./~tparis/pcount/index.php	279798
http://org.toolserver./~svick	277944
http://org.toolserver./~svick/CleanupListing	277923
http://org.toolserver./~luxo	241917
http://org.toolserver./~luxo/contributions	241872
http://org.toolserver./~luxo/contributions/contributions.php	241838
http://org.toolserver./~verisimilus	166369
http://org.toolserver./~verisimilus/Bot	164004
http://org.toolserver./~dispenser/cgi-bin/dab_solver.py	148193
http://org.toolserver./~magnus/fist.php	147970
http://org.toolserver./~svick/CleanupListing/CleanupListingByCat.php	145449
http://org.toolserver./~dispenser/cgi-bin/webreflinks.py	139536
http://org.toolserver./~nakon	137300
http://org.toolserver./~nakon/autoblockfinder.php	137283
http://org.toolserver./~overlordq	130705
http://org.toolserver./~overlordq/cgi-bin	127840
http://org.toolserver./~overlordq/cgi-bin/whois.cgi	127828
http://org.toolserver./~verisimilus/Bot/DOI_bot	124035
http://org.toolserver./~verisimilus/Bot/DOI_bot/doibot.php	123933
http://org.toolserver./~revolus/afterUpload	110964
http://org.toolserver./~revolus/afterUpload/	110964
http://org.toolserver./~revolus	110964
http://org.toolserver./~rhaworth	101811
http://org.toolserver./~rhaworth/os	101801
http://org.toolserver./~rhaworth/os/coor_g.php	101786
http://org.toolserver./~svick/CleanupListing/CleanupListing.php	88752
http://org.toolserver./~vvv	78941
http://org.toolserver./~vvv/sulutil.php	78790
http://org.toolserver./~betacommand	59870
http://org.toolserver./~betacommand/cgi-bin	53776
http://org.toolserver./~betacommand/cgi-bin/afdparser	48626
http://org.toolserver./~svick/CleanupListing/Index.php	43710
http://org.toolserver./~para	42990
http://org.toolserver./~para/cgi-bin	42899
http://org.toolserver./~para/cgi-bin/kmlexport	42878
http://org.toolserver./~chm	36630
http://org.toolserver./~chm/whois.php	36492
http://org.toolserver./~quentinv57	31307
http://org.toolserver./~quentinv57/tools	31126
http://org.toolserver./~quentinv57/tools/sulinfo.php	31116
http://org.toolserver./~snottywong	30656
http://org.toolserver./~snottywong/cgi-bin	30249
http://org.toolserver./~snottywong/cgi-bin/votecounter.cgi	26987
http://org.toolserver./~verisimilus/Bot/taxobot	25313
http://org.toolserver./~eagle	22595
http://org.toolserver./~soxred93	17434
http://org.toolserver./~enwp10	17325
http://org.toolserver./~verisimilus/Bot/citation-bot	14629
http://org.toolserver./~verisimilus/Bot/citation-bot/doibot.php	14623
http://org.toolserver./~interiot	14549
http://org.toolserver./~interiot/cgi-bin	14548
http://org.toolserver./~shadow1	14108
http://org.toolserver./~shadow1/cgi-bin	14108
http://org.toolserver./~shadow1/cgi-bin/linksearcher.pl	14100
http://org.toolserver./~daniel	13954
http://org.toolserver./~daniel/WikiSense	13948
http://org.toolserver./~interiot/cgi-bin/Tool1	13827
http://org.toolserver./~interiot/cgi-bin/Tool1/wannabe_kate	13773
http://org.toolserver./~acc	13316
http://org.toolserver./~verisimilus/Bot/taxobot/update_child_list.php	13120
http://org.toolserver./~acc/	12879
http://org.toolserver./~verisimilus/Bot/taxobot/null_edit.php	12189
http://org.toolserver./~eagle/crosswiki.php	10525
http://org.toolserver./~tim1357	10301
http://org.toolserver./~tim1357/cgi-bin	10252
http://org.toolserver./~daniel/WikiSense/Contributors.php	9515

Generation

wget enwiki-20121201-externallinks.sql

import re,sys

for i,line in enumerate(open(sys.argv[1])):
    if i % 100 == 0:
        print >> sys.stderr, "line %i" % i
    entries = re.findall(r"'(http://org.toolserver.*?)'", line)
    if entries:
            print "\n".join(entries)

import sys, itertools, collections

counter = collections.defaultdict(lambda: 0)

scripts = ['http://org.toolserver./~tparis/pcount/',
           'http://org.toolserver./%7Edispenser/cgi-bin/dab_solver.py/']

for line in sys.stdin:
    fline = line.split('?')[0]
    fline = fline.replace('%7E', '~')
    pieces = []
    for sub in fline.split('/'):
        pieces.append(sub)
        counter["/".join(pieces)] += 1

data = sorted(counter.items(), key=lambda x:-x[1])

for key, value in data:
        print "<tr><td>", key.strip(), "</td><td>", value, "</tr>"
        if value < 10000:
                break