[ale] sometimes you just need to reboot NOW!

[Jim Kinney]

So you're working away and suddenly you get a console error message:
Kernel: BUG: <fill in your fav thing to break here>
and that console pukes and locks.
You're loged in remote over and ssh session and screen. You can't reattach
to that screen session and then, WHAM, another one pops in and informs you
also that cpu core #19 has timed out for the past 67 seconds.

and THAT console locks.

Suddenly you get that sinking feeling in the pit of your gut as you realize
you never did set the ipmi port IP address.

You can ssh in but you have only a few seconds to do something before every
new session you open locks up.

If you can reboot, you can set the IPMI IP address. But even a remote KVM
console hangs after you hit the 3-finger-salute and you know shutdown -r
now will never finish since you have 3 consoles that are hung with that one.

Now you're screwed.

But, ah HA! a solution:

If you could send an instant "reboot now and do no shutdown stuff" over an
new ssh connection, it might get through.

In that case, you want to know these commands:

Force Reboot :
*#echo 1 > /proc/sys/kernel/sysrq *
 *#echo b > /proc/sysrq-trigger*
  If you want to force shutdown machine try this.
*#echo 1 > /proc/sys/kernel/sysrq*
*#echo o > /proc/sysrq-trigger*

So you run ssh root at brokenbox.com 'echo 1 > /proc/sys/kernel/sysrq; echo b
> /proc/sysrq-trigger' and your remote KVM console flashes to green as the
video disconnects on the reboot. Resume breathing and reach for a tasty
beverage.

Now set that IPMI IP address...

-- 
-- 
James P. Kinney III

Every time you stop a school, you will have to build a jail. What you gain
at one end you lose at the other. It's like feeding a dog on his own tail.
It won't fatten the dog.
- Speech 11/23/1900 Mark Twain


*http://heretothereideas.blogspot.com/
<http://heretothereideas.blogspot.com/>*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.ale.org/pipermail/ale/attachments/20140729/2f864f78/attachment.html>