<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:v="urn:schemas-microsoft-com:vml" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<!-- Template generated by Exclaimer Mail Disclaimers on 04:55:43 Tuesday, 20 May 2014 -->
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css">P.ebea49ee-3201-4f89-8274-bd5b723048b2 {
MARGIN: 0cm 0cm 0pt
}
LI.ebea49ee-3201-4f89-8274-bd5b723048b2 {
MARGIN: 0cm 0cm 0pt
}
DIV.ebea49ee-3201-4f89-8274-bd5b723048b2 {
MARGIN: 0cm 0cm 0pt
}
TABLE.ebea49ee-3201-4f89-8274-bd5b723048b2Table {
MARGIN: 0cm 0cm 0pt
}
DIV.Section1 {
page: Section1
}
</style>
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<p class="ebea49ee-3201-4f89-8274-bd5b723048b2"></p>
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Ouch!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">One of our admins ran a script once that accidentally shutdown all of the systems it reached before he killed it. I forget the details but it was trying to
parse /etc/passwd on the remote hosts and when it hit the user named “shutdown” it actually ran the command “shutdown” for some reason. (Looking at his script after the fact it wasn’t clear to me why that happened but I also didn’t decide to test any variations
of it.) Our director kids him to this day about his script writing abilities. Luckily impromptu reboots while not good aren’t usually as disastrous as wiping all servers.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">A great reminder to everyone that backups ARE critical. Losing some files is not good but losing them all would be catastrophic. It flabbergasts me how
often I have had to argue with higher ups about backups (and restore testing). It is especially maddening to hear as I often have the “we’ll back it up once because it never changes” idea – Systems always change even if only a little. No one ever thinks
backups are important until they need a restore at which point it is too late to figure out what you SHOULD have been backing up or whether the backup WILL restore.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> ale-bounces@ale.org [mailto:ale-bounces@ale.org]
<b>On Behalf Of </b>Jim Kinney<br>
<b>Sent:</b> Tuesday, May 20, 2014 4:23 PM<br>
<b>To:</b> Atlanta Linux Enthusiasts<br>
<b>Subject:</b> Re: [ale] I didn't post this but I saw it happening<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Tue, May 20, 2014 at 4:11 PM, Beddingfield, Allen <<a href="mailto:allen@ua.edu" target="_blank">allen@ua.edu</a>> wrote:<o:p></o:p></p>
<p class="MsoNormal">We were all here bright and early on Sunday morning to do our yearly DR failover exercise (failing to our colo site in Atlanta), and some optimist brought up that "it could be worse, we could be at Emory and actually having a disaster right
now..." Yeah, that didn't make me feel any more awake at 7:00 on a Sunday morning..lol<br>
So, how is the recovery from that going over there?<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I am happily ignorant of the scope of the mess. All of my stuff runs Linux and Emory UTS is not allowed to even look in the direction of the cabinets!
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Payroll systems were wiped out as was everything in the library and most smaller departments that don't have dedicated support staff.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I saw the notice the following Monday and burst out laughing. I was in the building with payroll staff and was informed they got wiped out. My humour vanished rather quickly. At this point all servers are back
and all desktops are working but all files from the day of the wipe are likely gone as the re-image happened before/during backups.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">I'm glad I don't work with that bunch.<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal"><br>
Allen B.<br>
<br>
--<br>
Allen Beddingfield<br>
Systems Engineer<br>
The University of Alabama<br>
</p>
</blockquote>
</div>
</div>
</div>
</div>
<p></p>
<p class="ebea49ee-3201-4f89-8274-bd5b723048b2"> </p>
<p class="ebea49ee-3201-4f89-8274-bd5b723048b2"></p>
<div class="WordSection1">
<div>
<div>
<div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal">________________________________<br>
From: <a href="mailto:ale-bounces@ale.org">ale-bounces@ale.org</a> [<a href="mailto:ale-bounces@ale.org">ale-bounces@ale.org</a>] on behalf of Jim Kinney [<a href="mailto:jim.kinney@gmail.com">jim.kinney@gmail.com</a>]<br>
Sent: Tuesday, May 20, 2014 2:59 PM<br>
To: Atlanta Linux Enthusiasts - Yes! We run Linux!<br>
Subject: [ale] I didn't post this but I saw it happening<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
<a href="http://it.slashdot.org/story/14/05/17/051214/emory-university-sccm-server-accidentally-reformats-all-computers-campus-wide" target="_blank">http://it.slashdot.org/story/14/05/17/051214/emory-university-sccm-server-accidentally-reformats-all-computers-campus-wide</a><br>
<br>
Um. Yeah. Centralized control is great until it's not.<br>
<br>
--<br>
--<br>
James P. Kinney III<br>
<br>
Every time you stop a school, you will have to build a jail. What you gain at one end you lose at the other. It's like feeding a dog on his own tail. It won't fatten the dog.<br>
- Speech 11/23/1900 Mark Twain<br>
<br>
<a href="http://heretothereideas.blogspot.com/" target="_blank">http://heretothereideas.blogspot.com/</a><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
Ale mailing list<br>
<a href="mailto:Ale@ale.org">Ale@ale.org</a><br>
<a href="http://mail.ale.org/mailman/listinfo/ale" target="_blank">http://mail.ale.org/mailman/listinfo/ale</a><br>
See JOBS, ANNOUNCE and SCHOOLS lists at<br>
<a href="http://mail.ale.org/mailman/listinfo" target="_blank">http://mail.ale.org/mailman/listinfo</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<br>
-- <o:p></o:p></p>
<div>
<p class="MsoNormal">-- <br>
James P. Kinney III<br>
<i><br>
</i>Every time you stop a school, you will have to build a jail. What you gain at one end you lose at the other. It's like feeding a dog on his own tail. It won't fatten the dog.<br>
- Speech 11/23/1900 Mark Twain<br>
<i><br>
<a href="http://heretothereideas.blogspot.com/" target="_blank">http://heretothereideas.blogspot.com/</a></i><o:p></o:p></p>
</div>
</div>
</div>
</div>
<p></p>
<p class="ebea49ee-3201-4f89-8274-bd5b723048b2"><font face="Arial"><font color="fuchsia"><font style="FONT-FAMILY: Arial; FONT-SIZE: 10pt" size="2">Athena<font size="1">®</font>, Created for the Cause</font><font size="1">™
</font></font></font></p>
<p class="ebea49ee-3201-4f89-8274-bd5b723048b2"><font size="2" face="Arial">Making a Difference in the Fight Against Breast Cancer</font></p>
<p class="ebea49ee-3201-4f89-8274-bd5b723048b2"><font size="2" face="Arial">____________________________________________________</font></p>
<p class="ebea49ee-3201-4f89-8274-bd5b723048b2"><span style="FONT-FAMILY: Arial; FONT-SIZE: 10pt"><font color="#7d7d7d">CONFIDENTIALITY NOTICE: This e-mail may contain privileged or confidential information and is for the sole use of the intended recipient(s).
If you are not the intended recipient, any disclosure, copying, distribution, or use of the contents of this information is prohibited and may be unlawful. If you have received this electronic transmission in error, please reply immediately to the sender that
you have received the message in error, and delete it. Thank you.<br>
</font></span></p>
<p></p>
<p></p>
</body>
</html>