<html><head></head><body>BWAHAHAHAHA! Well said!<br><br><div class="gmail_quote">On June 3, 2021 6:10:08 AM EDT, Boris Borisov via Ale <ale@ale.org> wrote:<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div dir="auto">In Universe everything GO to RUST</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 2, 2021, 20:38 Jon "maddog" Hall via Ale <<a href="mailto:ale@ale.org">ale@ale.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><u></u>
<div>
<div style="font-size:12pt;font-family:helvetica,arial,sans-serif;color:#333333">
<span style="font-family:helvetica;font-size:12pt">Wow, I turn my back for a few minutes and the conversation goes from "vim is the greatest text editor" to "Rust, Go and the Universe"...<br><br></span>md
</div>
<blockquote type="cite">
<div>
On 06/01/2021 3:32 PM Jerald Sheets via Ale <<a href="mailto:ale@ale.org" target="_blank" rel="noreferrer">ale@ale.org</a>> wrote:
</div>
<div>
</div>
<div>
</div>
<br>
<div>
<br>
<blockquote type="cite">
<div>
On Jun 1, 2021, at 9:34 AM, Allen Beddingfield via Ale <
<a href="mailto:ale@ale.org" target="_blank" rel="noreferrer">ale@ale.org</a>> wrote:
</div>
<div>
<div>
So, how do you get from one type of operation to another? For example, I have 500-600 SLES servers. 99% of them were loaded by booting the ISO image, stepping through the installer, bootstrapping against config management, and pushing a base configuration to them.
<br>That is where the "cookie cutter" setup stops. Various firewall ports have been configured, directories have been made, "stuff" installed, disks added and mounted, virtual hosts configured, nfs shares configured, local users and groups added, etc . . .
<br>Some of these started on SLES 11, were upgraded to 12, then 15. Our idea of config management is pushing patches, deploying rpm-based applications, pushing config files, and remote execution operations.
<br>I don't see a path to get from what I have to what you have, without just blowing everything away and starting with a clean slate - which will never be an option.
<br>Allen B.
</div>
</div>
</blockquote>
</div>
<br>
<div>
</div>
<div>
</div>
<div>
This is worlds difficult without a whiteboard with which to kibbutz this around.
</div>
<div>
</div>
<div>
</div>
<div>
We tend to see systems as objects with many things needing configuration. The secret sauce is not in whether we automate, but in how we apply the configurations we need in that automation.
</div>
<div>
</div>
<div>
</div>
<div>
Let me do a hyper-simplistic example consisting of a web app server, a php server, and a bare apache server and I’ll have a “base” configuration consisting of NTP, DNS, and perhaps sudo.
</div>
<div>
</div>
<div>
My presupposed framework is Puppet, but this methodology works on pretty much any config platform.
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
First, let’s look at the app side. For simplicity, let’s say we use Apache everywhere. Secondarily, let’s say we use mod_proxy and let’s say we use Tomcat/Java.
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
Base_config
</div>
<div>
NTP settings
</div>
<div>
DNS Settings
</div>
<div>
sudoers settings
</div>
<div>
</div>
<div>
Webapp_server_config
</div>
<div>
apache settings
</div>
<div>
mod_proxy config
</div>
<div>
java_config
</div>
<div>
tomcat_config
</div>
<div>
php_config
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
In most older design patterns, we would create a scenario where we’d create a new configuration fro every type of machine we have. This becomes unruly quickly and the larger the fleet, the more unruly and unmanageable it becomes.
</div>
<div>
</div>
<div>
</div>
<div>
Now, in a Puppet paradigm, there is a datasource tool (Hiera) which provides not only data lookups, but hierarchical conditionals wherein you can choose complex context per machine, class of machines, or even large abstractions (like “east coast” or “Australia”)
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
So, for a fleet of web servers, I may have the following:
</div>
<div>
</div>
<div>
</div>
<div>
<strong>**BASE CONFIGS*</strong>
</div>
<div>
Apache_Config
</div>
<div>
- install and options
</div>
<div>
Apache_Settings
</div>
<div>
- configuration
</div>
<div>
Java_Config
</div>
<div>
- install and options
</div>
<div>
Java_settings
</div>
<div>
- configuration
</div>
<div>
PHP_Config
</div>
<div>
- install and options
</div>
<div>
PHP_Settings
</div>
<div>
- configuration
</div>
<div>
MySQL_Config
</div>
<div>
- install and options
</div>
<div>
MySQL_Settings
</div>
<div>
- configuration
</div>
<div>
Mod_proxy_config
</div>
<div>
- Instalation AND configuration
</div>
<div>
OS_Base_Config
</div>
<div>
- customizations looked up and specific to distro, etc.
</div>
<div>
</div>
<div>
<strong>**ABSTRACTIONS**</strong>
</div>
<div>
Apache_php_stack
</div>
<div>
- Apache_config
</div>
<div>
- Apache_Settings (Values for settings looked up from datastore)
</div>
<div>
- PHP_Config
</div>
<div>
- PHP_Settings (Values looked up from datastore)
</div>
<div>
- MySQL_Config
</div>
<div>
- MySQL_Settings (Values looked up)
</div>
<div>
</div>
<div>
HR PHP Server
</div>
<div>
OS_Base_config
</div>
<div>
Apache_PHP_Stack
</div>
<div>
HR codebase
</div>
<div>
HR configuration (SIDs, DB names, tables, authentication, etc. all looked up)
</div>
<div>
</div>
<div>
</div>
<div>
Static Webserver
</div>
<div>
OS_Base_config
</div>
<div>
Apache_Config
</div>
<div>
Apache_Settings (Looked up)
</div>
<div>
</div>
<div>
Java Web Server
</div>
<div>
OS_Base_Config
</div>
<div>
Apache_Config
</div>
<div>
Apache_Settings
</div>
<div>
Java_Config
</div>
<div>
Java_Settings
</div>
<div>
Mod_proxy config
</div>
<div>
</div>
<div>
</div>
<div>
As you can see, the more “building blocks” you create, the more things you can build. You can mix & match all the various configurations and installations to put together highly customized configurations depending on what you’ve chosen to identify a system to the “collective”.
</div>
<div>
</div>
<div>
For instance, if you have a hostname
<a href="http://wwwdevhr3129.foo.com" target="_blank" rel="noreferrer">wwwdevhr3129.foo.com</a>, that is one highly information packed name you can parse to tell the system just what it’s dealing with. So, to not go into stupid details, imagine just a dev/testprod scenario. If your data lookup engine has values for things differing between each environment and then can structurally decide whether to apply a value and which one to apply based on the context of the machine itself, you’ve started to institutionalize how you deal with servers with “special needs” and have now created a way to manage all this in ways that the team works all the while storing it in code, moving the config out of the realm of “cowboy sysadmins” and into the realm of managed configs (no matter how gnarly they may be.
</div>
<div>
</div>
<div>
</div>
<div>
As I said, this is a terrible way to explain it, and white boarding is much better. I have one puppet-centric video tha;t describes this design pattern in a Puppet context, but does a considerably better job than I because 1) I’m trying to type it all out and 2) I’m trying to remain config platform agnostic. The principle carries, and it’s an entertaining video. I’d recommend watching the entire thing to get the full gist:
</div>
<div>
</div>
<div>
<a href="https://www.youtube.com/watch?v=v9LB-NX4_KQ" target="_blank" rel="noreferrer">https://www.youtube.com/watch?v=v9LB-NX4_KQ</a>
</div>
<div>
</div>
<div>
I’ve done this for several companies as a Puppet consultant and as a Puppet partner as well as in my own DevOps consulting company. Last count, I think I’ve helped along or completed DevOps journeys for over 100 companies now. The stuff works. You just have to be able to get the concepts across better which I still feel as though I’m failing at through email.
</div>
<div>
</div>
<div>
Happy to meetup for pizza and beer and a whiteboard if anyone has interest, I just don’t know when everyone will feel comfy getting together in public again.
</div>
<div>
</div>
<div>
</div>
<div>
Let me know. Happy to help.
</div>
<div>
</div>
<div>
—jms
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
</div>
<div>
</div> _______________________________________________
<br>Ale mailing list
<br><a href="mailto:Ale@ale.org" target="_blank" rel="noreferrer">Ale@ale.org</a>
<br><a href="https://mail.ale.org/mailman/listinfo/ale" target="_blank" rel="noreferrer">https://mail.ale.org/mailman/listinfo/ale</a>
<br>See JOBS, ANNOUNCE and SCHOOLS lists at
<br><a href="http://mail.ale.org/mailman/listinfo" target="_blank" rel="noreferrer">http://mail.ale.org/mailman/listinfo</a>
</blockquote>
</div>
_______________________________________________<br>
Ale mailing list<br>
<a href="mailto:Ale@ale.org" target="_blank" rel="noreferrer">Ale@ale.org</a><br>
<a href="https://mail.ale.org/mailman/listinfo/ale" rel="noreferrer noreferrer" target="_blank">https://mail.ale.org/mailman/listinfo/ale</a><br>
See JOBS, ANNOUNCE and SCHOOLS lists at<br>
<a href="http://mail.ale.org/mailman/listinfo" rel="noreferrer noreferrer" target="_blank">http://mail.ale.org/mailman/listinfo</a><br>
</blockquote></div>
</blockquote></div><br>-- <br>Computers amplify human error<br>Super computers are really cool</body></html>