[Expo-tech] files to munge whilst converting VCS

Wookey wookey at wookware.org
Mon Apr 13 00:54:03 BST 2020


Here is the list of files I'm nobbling or modifying whilst converting the repo.

Now would be a good time to suggest any more that should be expunged or shrunk.

Candidates are things which are in the history but really shouldn't have
been. (e.g. large survey files (which should be in expofiles), video files,
massive dissertation pdf, manufacturer's spec pdfs)

I'm also resizing overly large images (few need to be bigger than
1024x768, and we have stuff up to 6000x4000) and PDFs which have much
higher than printer resolution (usually due to lots of included large
images).

All are resized 'in place' as if they were the original object so the
large object is removed from the repo, and it looks like the
sensible-size object was the original check-in (or at least they would
be if this bit was actually working the way it should: currently only
'remove' works, the shrinkage commands work fine on their own, but
fail inside git filter-branch for mysterious reasons - still fiddling
with this).

The net result of all this is the repo going from 1.3G to about
800MB. Most of that gain comes from hg->git which just seems to have
more efficient storage, but there is a decent chunk from resizing
files and removing unused objects that are not of historical interest.

I should insert a discussion here about exactly what our policy
is/should-be for storing pics/documents, but that's quite a
complicated matter so in the interst of sharing this list for
feedback/further suggestions, I'm going to skip that for now.

List of files:

Moved to expofiles:
years/2007/reports/dissertation.pdf
handbook/rope/notice_generale_cordes_courant_downloaded_22_07_16.pdf
years/2009/edvintshirtdesign.pdf
years/2018/noodlesandcustard.pdf
1623/258/surveys/plan2008hires.png
1623/258/surveys/plan2007BWhires.png

Removed:
(unused, corrupt, already present in other formats)
handbook/festering/movies/bottling.mov (corrupt all the way back to 2014)
noinfo/prospecting_guide_scripts/pguidemap.xcf
handbook/rope/notice_generale_cordes_courant_downloaded_22_07_16.pdf
1623/204/surveys/plan2005.pdf

smkridge/2011-01/i/ent1.jpg
smkridge/2011-01/i/ent4.jpg
smkridge/2011-01/i/ent2.jpg
smkridge/2011-01/i/ent3.jpg
smkridge/2012-dd-09/i/2012-dd-09.jpg
smkridge/2012-dd-02/i/2012-dd-02.jpg

smkridge/2012-dd-04/i/2012-dd-04.JPG
smkridge/2012-dd-06/i/BigD.jpg
smkridge/2012-dd-06/i/2012-dd-06.jpg
smkridge/2012-dd-07/i/2012-dd-07.JPG
smkridge/2012-dd-05/i/2012-dd-05.JPG
smkridge/2012-dd-08/i/2012-dd-08.JPG
smkridge/2012-OK-03/i/2012-OK-03-02.JPG
smkridge/2012-OK-03/i/2012-OK-03-01.JPG
smkridge/2012-OK-01/i/2012-OK-01-03.JPG
smkridge/2012-OK-02/i/2012-OK-02-01.JPG
smkridge/2012-OK-01/i/2012-OK-01-02.JPG
smkridge/2012-OK-02/i/2012-OK-02-02.JPG
smkridge/2012-OK-01/i/2012-OK-01-01.JPG
documents/tunnocksschirt/routetothebottom.png

Repacked PDFs:
years/2009/ExpoReportCUCC.pdf
years/2007/reports/die_hoehle_article.pdf
documents/tunnel-loefflerCP35-only.pdf
documents/tunnel-guide.pdf
handbook/survey/XI-2-11.pdf
documents/survex-guide.pdf
documents/Grike.pdf
'documents/Idiots guide to accessing expo git.pdf'

resized (to max 1024x768) images:
1623/2012-dd-10/2012-dd-10_entrance.jpg
years/2010/images/TraverseandDerigTunnocks_18_08_10c.jpg
years/2010/images/Tunnocks_13_08_10.jpg
years/2010/images/TunnocksUsualSuspects_10_08_2010a.jpg
years/2010/images/TraverseandDerigTunnocks_18_08_10b.jpg
years/2010/images/TraverseandDerigTunnocks_18_08_10a.jpg
years/2010/images/Tunnocks_Rigging_02_08_11.jpg
years/2010/images/TunnocksUsualSuspects_10_08_2010b.jpg
years/2017/p1040306_e.jpg
1623/225/225vw.jpg
1623/225/ent.jpg
1623/2004-17/2004-17downent.jpg
1623/2004-17/2004-17ent.jpg
1623/94/94_ent.jpg
1623/94/94_ent_close.jpg
1623/40/i/40f-2.jpg
1623/40/i/40f-4.jpg
1623/40/i/40f-1.jpg
1623/40/i/40sarea.jpg
1623/185/185-entclose.jpg
1623/185/185-ent.jpg
1623/229/229below.jpg
1623/229/229ent.jpg
1623/237/237Cphotolarge.jpg
1623/2004-18/2004-18far.jpg
1623/2004-18/2004-18close.jpg
1623/104/104.jpg
1623/2001-07/2001-07ent.jpg
1623/240/ent_south.jpg
1623/240/ent_east.jpg
1623/240/ent_tag.jpg
1623/240/ent_far.jpg
1623/2002-08/ent.jpg
1623/2002-OB-01/02-OB-01approach.jpg
1623/2002-OB-01/02-OB-01.jpg
1623/2004-16/2004-16.jpg
1623/2002-XX/ent.jpg
1623/205/ent.jpg
1623/205/entclose.jpg
1623/251/elev.jpg
1623/251/plan.jpg
1623/flood.jpg
1623/2002-AD-04/i/klippenhoele_1.jpg
1623/2002-AD-04/i/klippenhoele_3.jpg
1623/2002-AD-04/i/klippenhoele_2.jpg
1623/214/ent.jpg
1623/190/ent_1999.jpg
1623/1996-X01/1996-X01-ent.jpg
1623/209/209ent.jpg
1623/2012-dd-10/2012-dd-10_entrance.jpg
1623/1997-07/ent.jpg
1623/1997-07/ent05.jpg
1623/145/145c.jpg
1623/145/145b.jpg
1623/145/145a.jpg
1623/258/Bent.jpg
1623/258/Aent.jpg
1623/2001-08/cent.jpg
1623/2001-08/aent3.jpg
1623/2001-08/aent1.jpg
1623/2001-08/bent1.jpg
1623/2001-08/view.jpg
1623/2001-08/bent2.jpg
1623/2001-08/aent2.jpg
1623/163/163ent.jpg
1623/liagerview.jpg
1623/198/tagging_198.jpg
1623/2003-X14/ent.jpg
1623/81/ent.jpg
1623/208/208b.jpg
1623/208/208a.jpg
1623/hfg-ka88/hfgcloseup.jpg
1623/hfg-ka88/hfgapproach.jpg
1623/85/number.jpg
1623/85/ent.jpg
1623/101/downent.jpg
1623/liager.jpg
1623/2002-W-01/lowerent2.jpg
1623/2002-W-01/upperent.jpg
1623/2002-W-01/lowerent.jpg
1623/217/217ent.jpg
1623/207/207ent.jpg
1623/2006-09/downent.jpg
1623/2006-09/ent.jpg
1623/2003-X15/downent.jpg
1623/2003-X15/ent.jpg
images/nippath.jpg

resized to 640x480
 folk/i/robwatson.jpg
resized to 1500x1500
 smk000.jpg
 geology.jpg

Large .pngs converted to jpegs:
1623/204/surveys/plan2006.png
1623/204/surveys/plan2005.png
1623/204/surveys/plan2004.png
1623/76/76_A2_2005.png

Wookey
-- 
Principal hats:  Linaro, Debian, Wookware, ARM
http://wookware.org/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: not available
URL: <http://lists.wookware.org/pipermail/expo-tech/attachments/20200413/c8a604e9/attachment.sig>


More information about the Expo-tech mailing list