User:Leucosticte/Doing the Newgon stuff

Check out http://www.newgon.com/w/api.php?action=query&list=allpages&apnamespace=6&aplimit=500 and compare it to what's in the down folder. Anything new? If so, make a note of it for later.
~~Do LoggedOutAllPages.php to get the page titles~~Ain't nobody got time for that
~~Do LoggedOutExportAll.php to export the page titles~~That file doesn't exist either
Do this: http://en.boywiki.org/w/api.php?action=query&list=allpages&aplimit=500&apnamespace=0
And this: http://en.boywiki.org/w/api.php?action=query&list=allpages&aplimit=500&apnamespace=0&apfrom= (put the query-continue at the end)
And this: http://www.newgon.com/w/api.php?action=query&list=allpages&aplimit=500&apnamespace=0
And this: http://www.newgon.com/w/api.php?action=query&list=allpages&aplimit=500&apnamespace=0&apfrom= (put the query-continue at the end)
Copy and paste as you go into two tabs of Calc, boywiki and newgon.
B1: =SEARCH("title",A1,1)
C1: =SEARCH("/>",A1,B1)
D1: =MID(A1,B1+7,C1-B1-9)
Copy all the way down. Paste into: (but be sure to keep the XML files with the template pages separate from the other XML files, otherwise you'll be putting a bunch of crap {{x content}} in your templates. If you do accidentally put all that crap in there, the best thing to do is wreak a holocaust of the entire Template: namespace and then re-import. Do this before you import a bunch of other stuff on top of it that will get deleted if you pull a Special:DeleteBatch. Bear in mind, at last count Newgon had 44 templates and BoyWiki 203, for a total of 247.)
http://en.boywiki.org/wiki/Special:Export (don't check "Include only the current revision, not the full history"; don't check "Include templates".)
http://www.newgon.com/wiki/Special:Export
In Komodo Edit, Ctrl-Shift-H. Do check Multiline. Find what: </text> Replace with: {{boywiki content}}</text> (skip a couple lines before {{boywiki content}}</text>) Select appropriate directory
In Komodo Edit, Ctrl-Shift-H. Do check Multiline. Find what: </text> Replace with: {{newgon content}}</text> (skip a couple lines before {{newgon content}}</text>) Select appropriate directory
PS1="[\u@\h:\w ] $ "
mkdir ~/childwiki.net/boywiki
mkdir ~/childwiki.net/newgon
nathan@nathan-Inspiron-518:~/Downloads/boywikiXML$ scp * stauffenbergssh@nathania.org:~/childwiki.net/boywiki
nathan@nathan-Inspiron-518:~/Downloads/newgonXML$ scp * stauffenbergssh@nathania.org:~/childwiki.net/newgon
Narrow the window so there's only one column of files
[stauffenbergssh@ipe:~/childwiki.net/boywiki ] $ ls
Copy and paste result into your favorite editor
[stauffenbergssh@ipe:~/childwiki.net/w/maintenance ] $ pico childLoop.php

<?php
$cmd = array (
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111070838.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111070901.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111070920.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071115.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071144.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071159.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071219.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071234.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071249.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071303.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071321.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071338.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071353.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071407.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071422.xml',
        '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/boywiki/BoyWiki-20131111071436.xml'
);
foreach ( $cmd as $thisCmd ) {
        echo "$thisCmd\n";
        shell_exec ( $thisCmd );
}

Or better yet:

<?php
$files = array (
    'NewgonWiki-20131111072018.xml',
    'NewgonWiki-20131111072043.xml',
    'NewgonWiki-20131111072059.xml',
    'NewgonWiki-20131111072116.xml',
    'NewgonWiki-20131111072149.xml',
    'NewgonWiki-20131111072204.xml',
    'NewgonWiki-20131111072239.xml',
    'NewgonWiki-20131111072258.xml',
    'NewgonWiki-20131111072403.xml',
    'NewgonWiki-20131111072429.xml',
    'NewgonWiki-20131111072445.xml',
    'NewgonWiki-20131111072501.xml',
    'NewgonWiki-20131111072516.xml',
    'NewgonWiki-20131111072534.xml',
    'NewgonWiki-20131111072645.xml',
    'NewgonWiki-20131111072659.xml'
);
foreach ( $files as $file ) {
        $cmd = '/usr/local/php53/bin/php importDump.php < ~/childwiki.net/newgon/' . $file;
        echo "$cmd\n";
        shell_exec ( $cmd );
}

[stauffenbergssh@ipe:~/childwiki.net/w/maintenance ] $ php childLoop.php
Get a cup of coffee
Repeat for newgon
Find out the file extensions of the images. If you want to have fun, use getAllFileExtensions.php:

<?php
// Usage: php getAllFileExtensions.php path/to/files    
$number = 0;
$path = '.';
if ( isset ( $argv[1] ) ) {
        $path = $argv[1];
}
$extensions = array();
if ( $handle = opendir ( $path ) ) {
    while (false !== ( $entry = readdir ( $handle ) ) ) {
        if ( $entry != "." && $entry != ".." ) {
             $extensions[] = pathinfo ( $entry, PATHINFO_EXTENSION );
             $number++;
        }
    }
    closedir ( $handle );
}
echo "$number images\n";
$isFirst = true;
$extensions = array_unique ( $extensions );
foreach ( $extensions as $ext ) {
        if ( !$isFirst ) {
                echo ', ';
        }
        echo $ext;
        $isFirst = false;
}

However, I'll you right now that the extensions are png, jpg, mp3, mp4, gif, JPG, PNG, pdf, jpeg, txt.
importImages.php --extensions=png,jpg,mp3,mp4,gif,JPG,PNG,pdf,jpeg,txt ~/down/down (maybe you don't even need the extensions, as long as you get the right directory. On second thought, better use those extensions; who knows if you have them as allowable ones)
(Do Manual:importImages.php after importing the file description pages)