SCIENTIFIC-LINUX-USERS Archives

June 2007

SCIENTIFIC-LINUX-USERS@LISTSERV.FNAL.GOV

Options: Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Subject:
From:
Troy Dawson <[log in to unmask]>
Reply To:
Troy Dawson <[log in to unmask]>
Date:
Fri, 29 Jun 2007 15:05:19 -0500
Content-Type:
text/plain
Parts/Attachments:
text/plain (114 lines)
Hi,
I hadn't thought about that situation.

I had been thinking that most people would exclude

/i386/sites/
/x86_64/sites/

if they weren't doing a full mirror.
If you still want the sites/example I think the best way would to exclude

/i386/sites/example/sites/
/x86_64/sites/example/sites/

Troy

Mason Schmitt wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> Today I found the sites directory contains many copies of itself each
> within the other. Which has ballooned 4x/i386/sites to 22GB.
> 
> I logged into ftp.scientificlinux.org, took a look at that directory and
> found that a symlink had been added recently and a README that states
> the symlink is necessary to allow xen installations to work.
> 
> Because I don't keep a full mirror of the entire
> ftp.scientificlinux.org, I have rsync setup with the -L switch so that
> rather than copying symlinks I copy the referent.
> 
> Would it be best for me to setup rsync to mirror the entire site but
> just have a more comprehensive exclude list?
> 
> In case you want to see what I'm doing, below my sig in my current
> mirror script.
> 
> - --
> Mason Schmitt
> Manager, Internet Operations
> Sun Country Cablevision
> ph:(250) 832-9711
> www.sunwave.net
> 
> 
> - -----------------------------
> 
> #!/bin/bash
> 
> QUIET_OPTIONS="--delete-excluded -qrztLH"
> DEBUG_OPTIONS="--progress --stats --delete-excluded -vrztLHn"
> GENERIC_EXCLUDES="
>                    --exclude=/ia64 \
>                    --exclude=/SRPMS \
>                    --exclude=/archives \
>                    --exclude=/archive \
>                    --exclude=/i386/apt \
>                    --exclude=/i386/contrib/SRPMS \
>                    --exclude=/i386/errata/debuginfo \
>                    --exclude=/i386/errata/obsolete \
>                    --exclude=/i386/sites/Fermi \
>                    --exclude=/x86_64/apt \
>                    --exclude=/x86_64/contrib/SRPMS \
>                    --exclude=/x86_64/errata/debuginfo \
>                    --exclude=/x86_64/errata/obsolete \
>                    --exclude=/x86_64/sites/Fermi \
>                    --exclude=/iso/i386/archives/ \
>                    --exclude=/iso/x86_64/archives/ \
>                    --exclude=/iso/ia64 \
> "
> 
> GENERIC_INCLUDES=""
> DEBUG='false'
> 
> if [ "$1" = '-d' ]; then
>         OPTIONS=$DEBUG_OPTIONS
>         echo "You are running in debug mode.  No files will be
> downloaded, you will just see what would happen"
>         DEBUG='true'
> else
>         OPTIONS=$QUIET_OPTIONS
> fi
> 
> # Scientific Linux
> rsync $OPTIONS $GENERIC_INCLUDES $GENERIC_EXCLUDES
> rsync://rsync.scientificlinux.org/scientific/4x/ /opt/scientific_linux/4x/
> rsync $OPTIONS $GENERIC_INCLUDES $GENERIC_EXCLUDES
> rsync://rsync.scientificlinux.org/scientific/5x/ /opt/scientific_linux/5x/
> 
> if [ "$DEBUG" = 'false' ]; then
>         # send a report of all files, in /opt/scientific_linux  that
> have changed since the last rsync run
>         find /opt/scientific_linux/4x/ -cmin -1380 | cut -c23- | \
>              mail [log in to unmask] -s "Newly rsynced SL 4x files - `date`"
> 
>         find /opt/scientific_linux/5x/ -cmin -1380 | cut -c23- | \
>              mail [log in to unmask] -s "Newly rsynced SL 5x files - `date`"
> fi
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.2.4 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
> 
> iD8DBQFGhV4nbip6upg8pq8RAo4vAKCKGM0dI9PGyQzw/huCitxAjT/wGACfX0cF
> 1OeWYOhNhad0kxBFKuoLnjU=
> =T+Qb
> -----END PGP SIGNATURE-----


-- 
__________________________________________________
Troy Dawson  [log in to unmask]  (630)840-6468
Fermilab  ComputingDivision/LCSI/CSI DSS Group
__________________________________________________

ATOM RSS1 RSS2