[Webteam] File cleanups, yes... again

[Ken Causey]

On Tue, 2007-12-18 at 00:45 +0100, karl wrote:
> Ken Causey wrote:
> > We are climbing up above 90% disk usage on box2 so time for another
> > audit.  Previously I managed to talk you into a more conservative backup
> > schedule.  Now I would like to ask you to cleanup what is being backed
> > up.  A little nosing around indicates that you are backing up a lot of
> > files that I suspect were just used in setting up the sites/testing and
> > or just junk at this point:
> >
> > # tar ztf backups/foundation/2007-12-17-0005.tgz 
> > SqF-Pier-1.5-maybe-bad.image
> > SqF-Pier-1.5-safe.image
> > SqF-Pier-1.5-safe.old.image
> > SqF-Pier-1.5.image
> > SqF-Pier-1.5.old.image
> > SqueakFoundation.image
> > SqF-Pier-1.5-maybe-bad.changes
> > SqF-Pier-1.5-safe.changes
> > SqF-Pier-1.5-safe.old.changes
> > SqF-Pier-1.5.changes
> > SqF-Pier-1.5.old.changes
> > SqueakFoundation.changes
> >   
> Squeak foundation images are not used at all. Brad Fuller put a lot of 
> effort into it but the foundation is a a few pages in the squeak.org 
> image. You can delete foundation directory and backups

I'd prefer if Brad could confirm he has no more interest in any of that
content and one of you take care of it.

> > # tar ztf backups/2007-12-17-0005.tgz
> > smallwikiSnapshot.1.image
> > smallwikiSnapshot.backup.image
> > smallwikiSnapshot.image
> > smallwikiSnapshot.1.changes
> > smallwikiSnapshot.backup.changes
> > smallwikiSnapshot.changes
> >
> > s# tar ztf backups/testing/2007-12-17-0005.tgz 
> > smallwikiSnapshot.backup.image
> > smallwikiSnapshot.image
> > wwwtest.squeak.org.backup.image
> > wwwtest.squeak.org.image
> > smallwikiSnapshot.backup.changes
> > smallwikiSnapshot.changes
> > wwwtest.squeak.org.backup.changes
> > wwwtest.squeak.org.changes
> >   
> I'm not at all sure how backup is run. I screwed up the squeak.org image 
> a few years back and found that the images backed up were useless 
> because they were copied from a unix process on a running image I think.
> We need backup of squeak.org image.

That's fine, but even the backup of the main site involves backing up 3
image and changes file sets.  I can maybe imagine 2 sets (current and
previous to last modification), but 3?

> The wwwtest.squeak.org image we hardly use anymore, but it is good for 
> testing major changes to style scripts etc. wwwtest.squeak.org does not 
> need backup now. I guess we can turn backup on when someone get the urge 
> to hack at stuff.

Either that or just scale back the extent to which wwwtest is backed up.
Again, I'm primarily concerned about the backing up of files which never
change.

> 
> > Are all of these files needed at all, much less needing to be backed up
> > over and over again?
> >   
> I guess not
> > The home directory for the website team totals 4.3GB.  Since there is an
> > rsync backup also on the server that is doubled, and then any images
> > that change are backed up in their entirety again.  So in effect the
> > website team ends up using perhaps as much as 10GB on the server.
> > Anything you can do to lower this I would greatly appreciate.
> I think you can delete all the files I mentioned.

I'd rather not delete anything myself.  However designed the backup
process of course would need to change that.

Thanks,

Ken

> 
> Karl
> 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
Url : http://lists.squeakfoundation.org/pipermail/webteam/attachments/20071217/f9866407/attachment.pgp