I’m in our daily standup and it’s turned into exchanging fucked up sysadmin redundancy tales.

One place I worked lost a machine room. They’d fired people so fast that nobody remembered where the boxes were any more.

I knew, but they didn’t ask me. Oh well!

The cycle of IT binge and purge is eternal. Post your tales here.

  • bitofhope@awful.systems
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 days ago

    There are tradeoffs to higher and higher grades of redundancy and the appropriate level depends on the situation. Across VMs you just need to know how to set up HA for the system. Across physical hosts requires procuring a second server and more precious Us on a rack. Across racks/aisles might sometimes require renting a whole second rack. Across fire door separated rooms requires a DC with such a feature. Across DCs might require more advanced networking, SDN fabrics, VPNs, BGP and the like. Across sites in different regions you might have latency issues, you might have to hire people in multiple locations or deal with multiple colo providers or ISPs, maybe even set up entire fiber lines. Across states or countries you might have to deal with regulatory compliance in multiple jurisdictions. Especially in 2001 none of this was as easy as selecting a different Availability Zone from a dropdown.

    Running a business always involves accepting some level of risk. It seem reasonable for some companies to decide that if someone does a 9/11 to them, they have bigger problems than IT redundancy.