SCIENTIFIC-LINUX-USERS Archives

June 2007

SCIENTIFIC-LINUX-USERS@LISTSERV.FNAL.GOV

Options: Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
From:
Mason Schmitt <[log in to unmask]>
Reply To:
Mason Schmitt <[log in to unmask]>
Date:
Fri, 29 Jun 2007 12:31:51 -0700
Content-Type:
text/plain
Parts/Attachments:
text/plain (90 lines)
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Today I found the sites directory contains many copies of itself each
within the other. Which has ballooned 4x/i386/sites to 22GB.

I logged into ftp.scientificlinux.org, took a look at that directory and
found that a symlink had been added recently and a README that states
the symlink is necessary to allow xen installations to work.

Because I don't keep a full mirror of the entire
ftp.scientificlinux.org, I have rsync setup with the -L switch so that
rather than copying symlinks I copy the referent.

Would it be best for me to setup rsync to mirror the entire site but
just have a more comprehensive exclude list?

In case you want to see what I'm doing, below my sig in my current
mirror script.

- --
Mason Schmitt
Manager, Internet Operations
Sun Country Cablevision
ph:(250) 832-9711
www.sunwave.net


- -----------------------------

#!/bin/bash

QUIET_OPTIONS="--delete-excluded -qrztLH"
DEBUG_OPTIONS="--progress --stats --delete-excluded -vrztLHn"
GENERIC_EXCLUDES="
                   --exclude=/ia64 \
                   --exclude=/SRPMS \
                   --exclude=/archives \
                   --exclude=/archive \
                   --exclude=/i386/apt \
                   --exclude=/i386/contrib/SRPMS \
                   --exclude=/i386/errata/debuginfo \
                   --exclude=/i386/errata/obsolete \
                   --exclude=/i386/sites/Fermi \
                   --exclude=/x86_64/apt \
                   --exclude=/x86_64/contrib/SRPMS \
                   --exclude=/x86_64/errata/debuginfo \
                   --exclude=/x86_64/errata/obsolete \
                   --exclude=/x86_64/sites/Fermi \
                   --exclude=/iso/i386/archives/ \
                   --exclude=/iso/x86_64/archives/ \
                   --exclude=/iso/ia64 \
"

GENERIC_INCLUDES=""
DEBUG='false'

if [ "$1" = '-d' ]; then
        OPTIONS=$DEBUG_OPTIONS
        echo "You are running in debug mode.  No files will be
downloaded, you will just see what would happen"
        DEBUG='true'
else
        OPTIONS=$QUIET_OPTIONS
fi

# Scientific Linux
rsync $OPTIONS $GENERIC_INCLUDES $GENERIC_EXCLUDES
rsync://rsync.scientificlinux.org/scientific/4x/ /opt/scientific_linux/4x/
rsync $OPTIONS $GENERIC_INCLUDES $GENERIC_EXCLUDES
rsync://rsync.scientificlinux.org/scientific/5x/ /opt/scientific_linux/5x/

if [ "$DEBUG" = 'false' ]; then
        # send a report of all files, in /opt/scientific_linux  that
have changed since the last rsync run
        find /opt/scientific_linux/4x/ -cmin -1380 | cut -c23- | \
             mail [log in to unmask] -s "Newly rsynced SL 4x files - `date`"

        find /opt/scientific_linux/5x/ -cmin -1380 | cut -c23- | \
             mail [log in to unmask] -s "Newly rsynced SL 5x files - `date`"
fi
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFGhV4nbip6upg8pq8RAo4vAKCKGM0dI9PGyQzw/huCitxAjT/wGACfX0cF
1OeWYOhNhad0kxBFKuoLnjU=
=T+Qb
-----END PGP SIGNATURE-----

ATOM RSS1 RSS2