Hamstar » code http://www.hamstar.co.nz Another Metal Car Computer Geek blog Thu, 10 Jun 2010 20:05:53 +0000 http://wordpress.org/?v=2.8.5 en hourly 1 Hotfile link extractor http://www.hamstar.co.nz/2009/09/24/hotfile-link-extractor/ http://www.hamstar.co.nz/2009/09/24/hotfile-link-extractor/#comments Thu, 24 Sep 2009 10:53:43 +0000 hamstar http://www.hamstar.co.nz/?p=328 A mate of mine needed a link extractor for his hotfile.com account so that he could drop a bunch of download page links in and get the premium links to the actual file back, all in a single page, or file. From that page or file he can load them into his download program. These are all legit links btw, no illegal shit.

Anyways I made a bot that has a form to start with where you dump your download urls. Then it goes to the hotfile site, logs in with the given user credentials, runs through each link that the bot was given, and extracts the premium download URL to the file. Then it either prints the links to the page OR it saves the links into a files.txt in the web folder and forces a download in the browser.

The manual way to do that is go to every hotfile.com download link, click on the download file button to start the download, and repeat for every download url you have. This you can throw 50 hotfile.com download links in the form, hit go and it will give you all the premium download links at once. It probably breaks the hotfile terms and services so you could put your account in jeopardy (not my fault) but I don’t use the script, I just solved a problem.

Here’s the code for it if anyone wants to use it. Would be cool if you let me know if it was useful as well :)

Please note you will also need this (SimpleHTMLDOM) and this (Sean Hubers Curl Wrapper)

<?php



    /**************************************************************************
    *
    *   This program is free software: you can redistribute it and/or modify
    *   it under the terms of the GNU General Public License as published by
    *   the Free Software Foundation, either version 3 of the License, or
    *   (at your option) any later version.
    *
    *   This program is distributed in the hope that it will be useful,
    *   but WITHOUT ANY WARRANTY; without even the implied warranty of
    *   MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
    *   GNU General Public License for more details.
    *
    *   You should have received a copy of the GNU General Public License
    *   along with this program.  If not, see <http://www.gnu.org/licenses/>.
    *
    *   There is one condition on the use of this software and that is that
    *   you accept that you are not part of or party to any DCMA agents or
    *   companies, nor do you represent any anti-piracy groups or industry
    *   distributers.
    *
    ****************************************************************************

    hotfilebot.php VERSION 1.5

    This bot will take the URLs for a download link from hotfile.com and extract
    the URLs of the actual file in each URL.  This is so you can run it on a
    personal web server, and automatically extract every file URL from every
    download page without having to go through them 1 by 1.  You need to have
    a hotfile account for this to work and you need to fill out your details
    below.

    Please let me know if you find this bot useful :)

    Copyright (c) 2009 Robert McLeod <hamstar[[@]]telescum.co.nz>

    http://www.hamstar.co.nz/2009/09/24/hotfile-link-extractor/

    */

    // Disable errors
    ini_set('display_errors',0);

    // Define your own username and password for hotfile.com
    // And also the filename and extension you want to save the urls to
    define('HOTFILE_USER', 'your_username');
    define('HOTFILE_PASS', 'your_password');
    define('OUTPUT_FILE_NAME','files');
    define('OUTPUT_FILE_EXT','.txt');
    define('SLEEP_TIME',100); // Time to sleep between requests in milliseconds

    // Don't touch these
    define('TO_FILE',$_POST['tofile']);
    define('OUTPUT_FILE', OUTPUT_FILE_NAME . OUTPUT_FILE_EXT);

    // Error messages to use when iterating through the failuresArray
    $errors[1] = 'the file was removed from hotfile.';
    $errors[2] = 'the HTTP status code was not 200.';

    // Function to check if its a file output
    function tofile() {
        return TO_FILE; // Should return a true or false
    }

    // Force a download of the file
    if($_GET['getfile'] == true) {
       
        // Turn of output compression for IE
        if(ini_get('zlib.output_compression')) { ini_set('zlib.output_compression', 'Off'); }

        // Print the contents of the file to the browser
        header('Content-type: application/force-download');
        header('Content-Disposition: inline; filename="' . OUTPUT_FILE . '"');
        header('Content-Transfer-Encoding: Binary');
        header('Content-length: '.filesize(OUTPUT_FILE));
        header('Content-Type: application/octet-stream');
        header('Content-Disposition: attachment; filename="' . OUTPUT_FILE . '"');
        readfile(OUTPUT_FILE);
        exit;

    }

?>

<html>
    <head>
        <title>Hotfile FileURL Fetcher</title>
    </head>
    <body>

<?php

    // Check that there is a filelist incoming
    if($_POST['urls']) {

        // Include CURL and HTML
        include 'lib_curl.php';
        include 'lib_html.php';

        // Set username and pass
        $user = HOTFILE_USER;
        $pass = HOTFILE_PASS;

        // Set login and post data
        $loginUrl = 'http://hotfile.com/login.php';
        $postData = "user=$user&pass=$pass";
        $authString = '<b>' . HOTFILE_USER . '</b>  | <a href="/logout.php';

        // Start curl
        $c = new Curl;
        $c->user_agent = $_SERVER['HTTP_USER_AGENT'];

        // Check if already logged in
        $r = $c->get('http://hotfile.com');
        $html = $r->body;

        $count = 0;
        while(!strstr($html,$authString)) {

            // Try logging in with the user details
            usleep(SLEEP_TIME);
            $r = $c->post($loginUrl,$postData);
            $html = $r->body;

            // For some reason we couldn't log in (after 2 tries)
            if($count == 2) {
                die('Couldn\'t log in for some reason');
            }

            // Increment the counter
            ++$count;

        } # end login while loop

        // Split up the urls by newline character
        $urls = explode("\n",$_POST['urls']);

        // Print messages
        echo '<div style="font-family: arial; margin: 0px auto; text-align: center;">';
        echo '<p>OK, here are your '.count($urls).' file URLs</p>';

        // Run through each URL
        foreach($urls as $u) {

            // Trim whitespace characters so we don't
            // get a 400 bad request error
            $u = trim($u);

            // Unset HTML first
            unset($html,$c,$r,$h,$fn,$fileurl);

            // Get the html of the current URL
            $c = new Curl;
            $c->user_agent = $_SERVER['HTTP_USER_AGENT'];
            $r = $c->get($u);
            $h = $r->headers;

            // If the status code is 200 we are good to go
            if($h['Status-Code'] == 200) {

                // Parse the HTML into html
                $html = str_get_html($r->body);

                // Check that the file has not been removed
                if(!strstr($html,'This file is either removed due to copyright claim or is deleted by the uploader.')) {
                   
                    // Get the href (protip: its in h3)
                    $fileurl = $html->find('h3',0)->find('a',0)->href;

                    // Get the filename
                    $fn = substr($fileurl,strrpos($fileurl,'/')+1);

                    // Put the url and filename into the files array
                    $filesArray[] = array('fn' => $fn, 'url' => $fileurl);

                } else {

                    // Notify removal into failures array
                    $failuresArray[] = array('url' => $u, 'errno' => 1);

                } # end file removal check

            } else {

                // Notify status into failures array
                $failuresArray[] = array('url' => $u, 'errno' => 2);

            } # end status code check

            // Dont hammer
            usleep(SLEEP_TIME);

        } # end URL forloop

        // Wipe the contents of our file cos this is a fresh load
        if(tofile()) { file_put_contents(OUTPUT_FILE, ''); }

        // Run through the files array
        foreach($filesArray as $f) {

            if(tofile()) {
                // Add the current URL to the file
                file_put_contents(OUTPUT_FILE, $f['url']."\r\n", FILE_APPEND);
            } else {
                // Else print it to the screen
                echo "<p><a href='{$f['url']}'>{$f['fn']}</a></p>";
            }

        }

        // Print the file download link
        if(tofile()) {
            echo '<p>Here is your file of <a href="'. OUTPUT_FILE . '">files</a></p>';
            echo '<meta http-equiv="refresh" content="1; url=' . $_SERVER['SCRIPT_NAME'] . '?getfile=true"/>';
        }

        // Print the failures no matter what
        foreach($failuresArray as $f) {
            // Print the failure
            echo "<p><span style='color: red;'>Failure</span>: {$f['url']} because <span style='color: red;'>{$errors[$f['errno']]}</span></p>";
        }

        // Print the redo button
        echo '<p><button onclick="location.href=\''.$_SERVER['SCRIPT_NAME'].'\';">KK Gimme some more!</button></p>';
        echo '</div>';

    } else {   

        ?>

        <div style="font-family: arial; margin: 0px auto; text-align: center;">
            <form action="<?=$_SERVER['SCRIPT_NAME'];?>" method="post">
                <p>Give me some download URLs and I will munch them up and spit out file URLs</p>
                <p><textarea name="urls" style="width: 1000px; height: 400px;"></textarea></p>
                <p style="font-size: small;">* make sure you put a newline between each file</p>
                <p><input type="submit" value="Gimme file URLs in a webpage!"/> |
                <input type="submit" name="tofile" value="Gimme the file URLs in a file!"/></p>
            </form>
        </div>

        <?php  

    } # end post urls check

?>

    </body>
</html>

The next step is to try to get it to integrate with the download managers wget and axel. That could be tricky, basically a php backend/process monitor.

]]> http://www.hamstar.co.nz/2009/09/24/hotfile-link-extractor/feed/ 1 KML creator class http://www.hamstar.co.nz/2009/09/22/kml-creator-class/ http://www.hamstar.co.nz/2009/09/22/kml-creator-class/#comments Tue, 22 Sep 2009 10:05:49 +0000 hamstar http://www.hamstar.co.nz/?p=303 Update: This is now available on github!!! Much better! Check it.

For my latest project I needed a script to create a KML file from a set of data so it could be loaded into Google Earth. So here is the class if anyone else wants to do the same thing.

Here’s an example of how to use it:

<?php
// Include the class
include 'create.kml.php';

// Create a new KML object
$kml = new KML;

$styles = array(
  array('myStyle','iconId','http://example.com/icon.gif'),
  array('myStyle2','iconId2','http://example.com/icon2.gif')
);

foreach($styles as $style) {
  $s = new KMLStyle;
  $s->id = $style[0]; // Id of the style for use in placemarks
  $s->iconid = $style[1]; // Icon ID
  $s->iconhref = $style[2]; // Link to the icon

  // Add the style to the KML
  $kml->addItem($s);
}

// Get the data from the database
$q = mysql_query('SELECT id,name,desc,link,city,state,country,coords FROM table;');

while(list($id,$name,$desc,$folder,$coords,$style) = mysql_fetch_row($q)) {
  // Create a new place object
  $p = new KMLPlace;

  // Assign bits of the array
  $p->id = $id;
  $p->name = $name;
  $p->desc = $desc;
  $p->folder = $folder;
  $p->style = $style;
  $p->coords = $coords;

  // If you have HTML in both name and desc call this
  //$p->setCDATA();

  // If you have HTML in just desc then call this
  //$p->setCDATA('desc');

  // Add the item to the kml
  $kml->addItem($p);
}

// Create the KML
$kml->printHeader('xml'); // Allows the KML to be viewed in the browser
//$kml->printHeader(); // Forces the user to download the KML file

// Print the KML to the browser
echo $kml->create();

// Save the file as well if we want
$kml->save('output.kml');
?>

This is what the output would look like (I changed the extension to XML so you can view it in your browser).

Here’s a breakdown of each function:

KMLPlace::setCDATA()

This function encloses fields in a KMLPlace object (eg. $p) with <![CDATA[ and ]]> which allows Google Earth to process it as HTML. Its an XML standard thing. Called without an argument it will enclose ‘name’ and ‘desc’ in CDATA tags however you can put a comma separated string of all the fields you want enclosed as a function argument (eg. $p->setData(’name,style,desc’) or $p->setData(’desc’)).

KML::addItem($item)

This function adds an item to your KML object that you created (eg $kml). This must be an either a KMLPlace object (eg. $p) or a KMLStyle object (eg. $s). If the object given is not either of those it will return false.

KML::save(’output.kml’)

This function saves the KML data loaded into the KML object (eg. $kml) to the given filename. Without the filename it returns false.

KML::printHeader()

This function prints the content type header to the page so the browser knows what kind of content is coming after it. With no arguments it will output the content type for XML which is “application/vnd.google-earth.kml+xml”. However the browser usually thinks it can’t display this so automatically wants you to download it. If you give an argument that is boolean true to the function (eg. ‘xml’, 1 or true) it will send a much more browser friendly “text/xml” header and you will be able to view the KML in the browser.

KML::create()

This is the function that creates all the KML. It doesn’t need any arguments and will return to you a string. What you do with this string is up to you. I usually just echo it to the page. Be aware there are \t’s and \n’s in the output.

KML::clear()

This function will clear the KML data out of the KML object (eg. $kml) to save on memory. Only really need to do this if you are creating lots of KML files in the same script.

Yeah, thats the class, hope it helps some people. I bet there is already a class for this, but I couldn’t find one.

EDIT: Y’know what, here’s the whole class here:

<?php

    /**
    * Create a KML file
    *
    * Class for creating a KML file from a data source
    * and outputing it to either a file or string
    *  
    * PHP version 5
    *
    * @category     XML
    * @package      Create_KML
    * @author       Robert McLeod <hamstar[[@]]telescum.co.nz>
    * @copyright    2009 Robert McLeod
    * @license      http://www.gnu.org/copyleft/lesser.html  LGPL License 2.1
    * @version      SVN: 1.0
    *
    */
   
    /**
    * Class to define a style to be added to the KML class
    *
    */
    class KMLStyle
    {
        public $type = 'style';
        public $id, $iconid, $iconhref;
    }
   
    /**
    * Class to define a place to be added to the KML class
    *
    */
    class KMLPlace
    {
        public $type = 'place';
        public $folder = '**[root]**';
        public $id, $name, $desc, $style, $coords;
       
        /**
        * Sets the folder name or empty argument sets the folder to root
        *
        * @param string
        * @access public
        */
        public function setFolder($folder = '') {
            if ($folder == '') {
                $this->folder = '**[root]**';
            } else {
                $this->folder = $folder;
            }
        }
       
        /**
        * Sets a CDATA surround on the given comma separated fields
        * Called without params it will CDATA the name and desc fields
        *
        * @param string
        * @access public
        */
        public function setCDATA($fields = '') {
            if ($fields = '') {
                $this->desc = '<![CDATA['.$this->desc.']]>';
                $this->name = '<![CDATA['.$this->name.']]>';
            } else {
                if(strstr($fields,',')) {
                    $fields = explode(',',$fields);
                    foreach($fields as $f) {
                        $this->$f = '<![CDATA['.$this->$f.']]>';
                    }
                } else {
                    $this->$fields = '<![CDATA['.$this->$fields.']]>';
                }
            }
    }
   
    /**
    * Main class to add items to and create the KML
    *
    */
    class KML
    {
        /**
        * The array of styles
        *
        * @var array
        * @access protected
        */
        protected $styles = array();
       
        /**
        * The array of places in their folders
        *
        * @var array
        * @access protected
        */
        protected $folders = array();
       
        /**
        * Print the content header for a KML file or optionally an XML file
        * (so it can be viewed in a browser)
        *
        * @param bool
        * @access public
        */
        public function printHeader($xml = false)
        {
            if ($xml == false {
                header('Content-type: application/vnd.google-earth.kml+xml');
            } else {
                header('Content-type: text/xml');
            }
        }
       
        /**
        * Adds an item to the KML data
        *
        * @param object
        * @access public
        * @return bool
        */
        public function addItem($item)
        {
            if (!$item
                || gettype($item) != 'object'
                || $item->type != 'style'
                && $item->type != 'place'
            ) {
                return false;
            }
       
            // Switch which array to put the given item in
            switch ($item->type) {
                case 'place':
                    $this->folders[$item->folder][] = $item;
                    break;
                   
                case 'style':
                    $this->styles[] = $item;
                    break;
                   
                default:
                    return false;
                    break;
            }
            return true;
        }
   
        /**
        * Creates the file under the filename given with the KML code
        *
        * @param string     filename
        * @access public
        * @return bool
        */
        public function save($filename)
        {
            if (!$filename) {
                return false;
            }
           
            return file_put_contents($filename, $this->create());
        }
       
        /**
        * Creates the KML code from data given
        *
        * @access public
        * @return string
        */
        public function create()
        {
       
            // Set some tabs
            function pad($num, $str) {
                return str_pad($str,$num,"\t",STR_PAD_LEFT);
            }
       
            // Set the xml version and open the kml and document
            $kml[] = '<?xml version="1.0" encoding="UTF-8"?>';
            $kml[] = '<kml xmlns = "http://earth.google.com/kml/2.1">';
            $kml[] = pad(1, '<Document>');
           
            // Set all the styles for the document
            foreach ($this->styles as $s) {
                $kml[] = pad(2, '<Style id="'.$s->id.'">');
                $kml[] = pad(3, '<IconStyle id="'.$s->iconid.'">');
                $kml[] = pad(3, '<Icon>');
                $kml[] = pad(4, '<href>'.$s->iconhref.'</href>');
                $kml[] = pad(3, '</Icon>');
                $kml[] = pad(3, '</IconStyle>');
                $kml[] = pad(2, '</Style>');
            }
           
            // Set all the folders and places in each folder
            foreach ($this->folders as $f => $places) {
                if ($f != '**[root]**') {
                    // Set the folder and folder name
                    $kml[] = pad(2, '<Folder>');
                    $kml[] = pad(3, "<name>$f</name>");
                    $kml[] = pad(3, '<open>0</open>');
                   
                    // Set all the placemarks in this folder
                    foreach ($places as $p) {
                        $kml[] = pad(3, '<Placemark id="'.$p->id.'">');
                        $kml[] = pad(4, '<name>'.$p->name.'</name>');
                        $kml[] = pad(4, '<description>'.$p->desc.'</description>');
                        $kml[] = pad(4, '<styleUrl>'.$p->style.'</styleUrl>');
                        $kml[] = pad(4, '<Point>');
                        $kml[] = pad(5, '<coordinates>'.$p->coords.'</coordinates>');
                        $kml[] = pad(4, '</Point>');
                        $kml[] = pad(3, '</Placemark>');
                    }
                   
                    // Close the folder
                    $kml[] = pad(2, '</Folder>');
                }
            }
           
            // Set all the root placemarks so they are not in a folder
            foreach($this->folders['**[root]**'] as $p) {
                // Set all the placemarks in the root folder
                foreach ($places as $p) {
                    $kml[] = pad(2, '<Placemark id="'.$p->id.'">');
                    $kml[] = pad(3, '<name>'.$p->name.'</name>');
                    $kml[] = pad(3, '<description>'.$p->desc.'</description>');
                    $kml[] = pad(3, '<styleUrl>'.$p->style.'</styleUrl>');
                    $kml[] = pad(3, '<Point>');
                    $kml[] = pad(4, '<coordinates>'.$p->coords.'</coordinates>');
                    $kml[] = pad(3, '</Point>');
                    $kml[] = pad(2, '</Placemark>');
                }
            }
           
            // End the document and kml
            $kml[] = pad(1, '</Document>');
            $kml[] = '</kml>';
       
            // Return the string of KML data
            return join("\n", $kml);
        }
   
        /**
        * Clears all the data to free up memory
        *
        * @access public
        */
        public function clear()
        {
            $this->folders = null;
            $this->styles = null;
        }
    }
?>
]]> http://www.hamstar.co.nz/2009/09/22/kml-creator-class/feed/ 0 Box Office Data API http://www.hamstar.co.nz/2009/09/21/box-office-data-api/ http://www.hamstar.co.nz/2009/09/21/box-office-data-api/#comments Mon, 21 Sep 2009 11:49:00 +0000 hamstar http://www.hamstar.co.nz/2009/09/21/box-office-data-api/ Reading about the stink the MPAA and RIAA are kicking up about the whole P2P bittorrent thing got me thinking. I wonder if what they are saying is actually true. Are movie makers actually being ripped off by bittorrent?

I found this website called The Numbers which has a whole lot of box office data on it.

However no API. And I wanted an API that would tell me whether to feel guilty about downloading a particular movie.

So I made this: Box Office Data API

You just have to enter the movie name and year (in the url bar – no form yet) and it will tell you (if the data is available) the production costs, the gross revenue, and the net profit the movie makers made.

Here’s an example for the movie District 9 also if you look at Titanic they made over 1.5 billion bucks profit on that piece of shit movie!

The search code isn’t very smart though so it may return some dodgey results. Still beta but still useful.

]]> http://www.hamstar.co.nz/2009/09/21/box-office-data-api/feed/ 0 Software RAID type perl script http://www.hamstar.co.nz/2009/08/18/software-raid-type-perl-script/ http://www.hamstar.co.nz/2009/08/18/software-raid-type-perl-script/#comments Tue, 18 Aug 2009 05:33:59 +0000 hamstar http://www.hamstar.co.nz/?p=237 So I have had a problem whereby I have 1.2TB of hard drive space on my server split across 5 drives. I am constantly going to the movies folder in this drive, then the movies folder in that drive, trying to check that I didn’t accidentally leave any pornos lying around.

So I made a script to display multiple folders of the same name accross drives in their own folder under /home/shared.

So I made a folder called shared in my /home directory and in it created longhand names of categories like so:

[hamstar@dolmayan ~]# ls -l /home/shared
total 132
-rwxrwxrwx   1 root root     6 2009-06-21 05:25 1.2TB.in.total.txt
drwxr-xr-x   2 root root 49152 2009-06-21 05:21 Albumart
drwxr-xr-x   4 root root  4096 2009-06-21 05:21 Anime
drwxr-xr-x  26 root root  4096 2009-06-25 10:07 Applications
drwxr-xr-x  14 root root  4096 2009-06-21 05:21 Audiobooks
drwxr-xr-x  11 root root  4096 2009-06-21 05:20 Cartoons
drwxr-xr-x   5 root root  4096 2009-06-21 05:21 Comedy
drwxr-xr-x  18 root root  4096 2009-06-21 05:20 Documentaries
drwxr-xr-x  11 root root  4096 2009-06-21 05:21 Games
drwxr-xr-x   8 root root  4096 2009-06-21 05:20 Guides
drwxr-xr-x  91 root root 20480 2009-06-25 09:06 Movies
drwxr-xr-x  13 root root  4096 2009-06-21 05:21 Music
drwxr-xr-x 141 root root  4096 2009-06-25 14:05 Music (Unsorted)
drwxr-xr-x   2 root root  4096 2009-06-21 05:21 Music Videos
drwxr-xr-x  42 root root  4096 2009-06-21 05:20 Pictures
drwxr-xr-x   5 root root  4096 2009-06-21 05:20 Pr0n
drwxr-xr-x  28 root root  4096 2009-06-21 05:21 TV
drwxr-xr-x  15 root root  4096 2009-06-21 05:21 Videos

Then in each drive under the /mnt/ folder I created specifically named shorthand folders for my stuff like so:

[hamstar@dolmayan ~]# ls -l /mnt/sde1/
total 196
drwxrwxrwx   2 hamstar hamstar 53248 2009-06-01 14:06 albumart
drwxrwxrwx   9 hamstar hamstar  4096 2009-06-11 08:44 apps
drwxrwxrwx  12 hamstar hamstar  4096 2009-05-25 01:24 audiobooks
drwxrwxrwx   5 hamstar hamstar  4096 2009-05-22 13:29 comedy
drwxrwxrwx   5 hamstar hamstar  4096 2009-05-24 15:30 docos
drwxrwxrwx   6 hamstar hamstar  4096 2009-05-24 16:03 games
drwxrwxrwx   3 pcguest pcguest  4096 2009-05-24 15:53 guides
drwx------   2 root    root    16384 2009-05-19 07:59 lost+found
drwxrwxrwx  91 hamstar hamstar 20480 2009-06-25 08:46 movies
-rwxrwxrwx   1 hamstar hamstar  7411 2009-05-19 12:35 movies2.txt
drwxrwxrwx  13 hamstar hamstar  4096 2009-05-24 13:52 music
drwxrwxrwx 142 hamstar hamstar  4096 2009-06-01 14:29 music-unsorted
drwxrwxrwx   2 hamstar hamstar  4096 2009-05-25 15:48 music-videos
drwxrwxrwx   2 pcguest pcguest  4096 2009-06-25 14:27 Private Folder
drwxrwxrwx   3 pcguest pcguest  4096 2009-05-24 16:06 tv
drwxrwxrwx   9 hamstar hamstar  4096 2009-05-24 09:52 videos

And then I put this perl script in the /etc/cron.hourly folder and it updates the /home/shared folder with symbolic links to all the (specified) folders on all the drives.

#!/usr/bin/perl

use strict;
use warnings;

my $command;
my $base_dir = '/home/shared/';

my @search_dirs = (
        '/mnt/sda3',
        '/mnt/sdb1',
        '/mnt/sdc1',
        '/mnt/sdd1',
        '/mnt/sde1'
);

my %folders = (
        'Music' => 'music',
        'TV' => 'tv',
        'Applications' => 'apps',
        'Comedy' => 'comedy',
        'Documentaries' => 'docos',
        'Games' => 'games',
        'Movies' => 'movies',
        'Music\ Videos' => 'music-videos',
        'Music\ \(Unsorted\)' => 'music-unsorted',
        'Guides' => 'guides',
        'Audiobooks' => 'audiobooks',
        'Albumart' => 'albumart',
        'Videos' => 'videos',
        'Cartoons' => 'cartoons',
        'Pictures' => 'pics',
        'Anime' => 'anime',
        'Pr0n' => 'pr0n'
);

foreach my $dir (@search_dirs) {
        foreach my $share (keys %folders) {
                $command = "cp -Rs $dir/$folders{$share}/* $base_dir$share/ > /dev/null 2>&1";

                qx/$command/;
        }
}

chdir($base_dir);
$command = "cleanlinks > /dev/null 2>&1";
qx/$command/;

exit 0;

It even automatically creates folders under folders so the docos from docos/Bad Government on one drive are in the same folder as the docos from docos/Bad Government on another drive.

Then I can share the /home/shared folder without worry of my “Private Folder” or any folder not specified in the script being seen by people browsing the network or at lans or whatever.

Sure its a little quick and nasty, just throws any errors straight into the bit bucket, but its works pretty sweet.

All thanks to cp -Rs :)

P.S. All my shares data is paid for and legit.

]]> http://www.hamstar.co.nz/2009/08/18/software-raid-type-perl-script/feed/ 0 Batch converting Works (WPS) to Word (DOC) http://www.hamstar.co.nz/2008/09/20/batch-converting-works-wps-to-word-doc/ http://www.hamstar.co.nz/2008/09/20/batch-converting-works-wps-to-word-doc/#comments Fri, 19 Sep 2008 16:20:09 +0000 hamstar http://www.hamstar.co.nz/?p=87 My friends mum needed a bunch of works files to work on her PC, but I could so not be bothered searching around for a works install disc, plus the converter from the Microsoft site wasn’t working.

So I took the documents to work where I knew the converter was working but there was still like over 100 documents and I didn’t want to open and save each one.

Luckily I found this page (can’t believe I’m linking to an MS site) which had a macro to use to convert a whole bunch of WPS’s to DOC’s.

I’ll re-post it here incase that other page disappears (also I made an adjustment so it works):

[code lang="vb"]
Sub Batch_Save_WPS_as_DOC97()

    Dim bConv As Boolean
    Dim strFileName As String
    Dim strDocName As String
    Dim strPath As String
    Dim oDoc As Document
    Dim Response As Long
    Dim fDialog As FileDialog

    bConv = Options.ConfirmConversions
    Options.ConfirmConversions = False
    Set fDialog = Application.FileDialog(msoFileDialogFolderPicker)

    With fDialog
        .Title = "Select folder and click OK"
        .AllowMultiSelect = False
        .InitialView = msoFileDialogViewList

        If .Show <> -1 Then
            MsgBox "Cancelled By User", , "Save all as DOC"
            Exit Sub
        End If

        strPath = fDialog.SelectedItems.Item(1)
        If Right(strPath, 1) <> "\" Then strPath = strPath + "\"
    End With

    'If Documents.Count > 0 Then
    'Documents.Close SaveChanges:=wdPromptToSaveChanges
    'End If

    strFileName = Dir$(strPath & "*.wps")

    While Len(strFileName) <> 0
        Set oDoc = Documents.Open(strPath & strFileName)

        strDocName = ActiveDocument.FullName
        intPos = InStrRev(strDocName, ".")
        strDocName = Left(strDocName, intPos - 1)
        strDocName = strDocName & ".doc"
        oDoc.SaveAs FileName:=strDocName, _
        FileFormat:=wdFormatDocument97
        oDoc.Close SaveChanges:=wdDoNotSaveChanges
        strFileName = Dir$()
    Wend
    Options.ConfirmConversions = bConv

End Sub
[/code]

Don’t worry about the fact it says doc97 format it just means the format between 97 and 2003 (i.e. doc and not docx).

So you just:

  1. Open up a new word doc
  2. Press Alt+F11 to open the VB editor
  3. Insert a new module
  4. Copy and paste the above code
  5. Save the document
  6. Press Alt+F8 to open the macro window
  7. Select Batch_Save_WPS_as_DOC97 and hit Run
  8. Select the folder you want and hit OK
  9. Watch it do its thing

It won’t overwrite any of the original documents so you don’t need to stress (I made a backup anyway just in case).

Hope this helps anyone in need.

By the way thanks to codesnippet for the syntax highlighting :)

]]> http://www.hamstar.co.nz/2008/09/20/batch-converting-works-wps-to-word-doc/feed/ 0