Feb 22 2010

Xen, KVM, or what will be your next Open Source Virtualization Platform ?

Xen
27% (101 votes)
KVM
51% (195 votes)
VirtualBox
15% (57 votes)
Something else (add comment)
7% (26 votes)
Total votes: 379
Feb 16 2010

Packaging Drupal Modules or not ?

So John wrote down his experiences on deploying Drupal sites with Puppet .

It's not a secret that I've been thinking about similar stuff and how I could get to the best possible setup.

John starts of with using Puppet to download Drush... while I want to use rpm for that ...

I want my core infrastructure to be fully packaged... not downloaded and untarred. I want to be able to reproduce my platform in a couple of months , with the exact same versions I`m using now .. not with the version that happens to be on ftp.drupal.org at that point in time, or with ftp.drupal.org being down.

Now the next question off course is what's the core infrastructure.
Where does the infrastructure end and does the application start. There's little discussion about having a puppet created vhost , an apache conf.d file, a matching .htaccess file if wanted , and the appropriate settings.php for a multisite drupal config.

There's also little doubt to me on using drush to run the updates, manage the drupal site etc . Reading John's article made me think some further about what and when I want things packaged.

John's post lead to a discussion on #infra-talk on getting all drupal modules packaged for Centos with Karan and some others

In a development environment I probably want to have periodic drush updates getting the latest modules from the interwebs and potentially breaking my devs code. But making sure that when you put a site in production it will be on a fairly up to date platform, and not on the platform you started developing on 24 months ago.

In a production environment however you only want tested updates of your modules as indeed they will break code.

It's probably going to be a mix and match setup having a local rpm/deb repo with packaged modules that have been tested and validated in your setup and using drush to enable or configure them for that production setup.

But also having a CI environment wher Drush will get the new modules from the interwebs when needed. and package them for you.

To me that sounds beter than getting all the available Drupal modules and packaging them, even automated, and preparing a repository of those modules of which only a small percentage will actually be used by people.

But I need to think about it some more :)

Feb 16 2010

To not yum or to not apt-get, that's NOT the question.

Over at the OPenARK blog Shlomi Noach argues that using apt-get or yum to install your MySQL instance will one day most likeley break your MySQL setup. Depdendencies, distros not shipping the MySQL version you want to use and on some distro's indeed the mysql vs MySQL issue, agreed, it all makes things less trivial.

However why give up a clean packaged system if there are other ways out ?

First of all by claiming that such an installation can break a working production environment looks to me like admitting you don't have a split development, production environment and that rather than testing stuff upfront indeed you just hack a long in production.

So rather than using a tarball for the MySQL instance an --force to satisfy the missing dependencies (hence also cluttering your system) , a much cleaner and less error prone setup is to only deploy from your own , self controlled repository , in which you only allow tested packages, most probably not the distro based package , hence packages that won't break your setups ;) But still you will be using apt or yum and deploying rpm's and debs , perfectly satisfying dependency needs.

Apart from that .. watch out for Banquise .. :) Coming to your favourite distro soon..

Feb 12 2010

Irc vs Twitter err.. Identi.ca

Over 1.5 decade ago, a bunch of us were addicted to irc, I lived on channels such as #coders, #nlcoders, #demoscene, sneaked in on #vlaanderen to see when the Leuven locals were heading to the pub, then started joining multiple Linux and Open Source related channels around 94...

Then some weirdos had an alternative way of chatting ICQ, then the folks from Redmond reinvented the wheel... Luckily XMPP arrived and Jabber became the open alternative, but still all of this time irc stayed

Then twitter came and us Open Source peeps are obviously denting via identi.ca But while Twitter / Identica are nothing more than todays version of Instant Messaging only in broadcast rather than multicast mode irc still stays the best way to discuss.

And irc starts to become more and more active again There are lot of regular project channels and now there is #devopsdays , ##infra-talk and different other channels that are being much more frequented than before again ...

You might wanna join us again on irc.freenode.net that is :)

PS. And whatever they tell you .... Wave is not usable for online meetings ;)

And don't even get me started about Buzz

Feb 11 2010

Loadays CFP

I would like to point the crowd to the Call For Presentaions of Loadays. , the Linux Open Administration Days .


The Linux Open Administration days 2010 will be the first edition of a new conference focusing on Linux and Open Administration, we are trying to fill a gap for System Engineers and Administrators using Open Source technologies"

More details on the Linux Open Administration Days site

I'll probably be there .. given the fact that the event will be 5 minutes from where I live .

Feb 09 2010

Fosdem 2010

Fosdem 2010 was my 10th fosdem Edition (including the first OSDEM)
As every year Fosdem suffered even more from it's own success.

On Friday evening ther was the obligatory Beer event... however as people need to eat to .. the Devops crowd fled the scene

I had made reservations for a 20 something group and with the CentOS crowd joining us (as there was some overlap anyhow) we were 25 when we arrived in the restaurant .

Dinner and Discussions were great .. I learned about some new projects and we had some insightfull dicussions on how fat your thin foil should be ...

After dinner we went back to the Beer Event were lots of Free Beer was tasted ...

Saturday was the first full day of Fosdem, as usual Fosdem was the victim of it's own success , too much interresting stuff to see .. too little time.

Lots of Devrooms had the "FULL" sign put up more than you want as a visitor ...
I never even made it into the Drupal or NoSQL rooms :(

Sadly I had to correct Ploum's first law but for a lot of people .. Fosdem each time means the battle choosing which presentation you'll go to ... If you can even make it to the talk .. as usually the the hallway track is much more interresting :)

The MySQL devroom was on sunday but on saturday the crowd met in an Italian place nearby the Fosdem campus to get to know each other and chat a lot ..
The discussions ranged from French vs Canadaian and the future of Forks

During Saturday afternoon @patrickdebois suggested a Devops Meetup for Breakfast ... and some how that also happened ...

When I arrived at Fosdem on sunday morning they were still there :)

I spent the biggest part of Sunday in and around the MySQL devroom listening to a bunch of interresting talks

My own talk went fairly well given the time constraint .. sqeezing content for an hour in 20 minutes means you can't really go deep into the topics ...
My initial plan was to only focus on Pacemaker integration however the community had voted for the overview talk :)

After my own talk it was almost time to head to the Janson auditorium for the Footnote of Greg Kroah-Hartman, and as on any Fosdem .. there once again had to be Beer

Feb 01 2010

Upcoming Conference Talks

I know the biggest part of my fanclub already booked tickets for my upcoming presentations, but the other 2 might want to check their calendars to see if they aren't missing out on the good stuff :)

Next Sunday I`ll giving a shortish overview of MySQL HA alternatives in the MySQL and Friends devroom at Fosdem.

March will bring me to Manchester again for the UKUUG Spring conference where I`ll be giving a longer version of that presentation with a strong focus on integrating with PaceMaker, and automating the whole boostrap procedure of a HA setup.

Early may will bring me to Ede in the Netherlands where I`ll be telling the crowds at the NLUUG spring conference, about their new fancy jobtitles, as all the Systeembeheerders there will have to become Devministrators, or Devops if you prefer ...

Apart from my talks also watch out for LoadAys , PuppetCamp Europe, OpsCamp Europe and maybe a Real CloudCamp in Belgium :)

And I`m not the only Inuit on Tour,

Jan 28 2010

Implementing Raid Monitoring on a 3Ware 3w-9xxx based controller.

When you pull out a disk from your Raid setup it shows a warning in syslog

  1. Jan 27 10:18:22 EL860 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0019): Drive
  2. removed:port=1.
  3. Jan 27 10:18:22 EL860 kernel: 3w-9xxx: scsi0: AEN: ERROR (0x04:0x0002): Degraded
  4. unit:unit=0, port=1.

However if no one is looking at syslog that won't really be helpfull.

3Ware provides a tool from their site called tw_cli which can be used to manage
the raid setup from the command line.

  1. [EL860-root@EL860 admin]# tw_cli /c0 show
  2.  
  3. Unit UnitType Status %RCmpl %V/I/M Stripe Size(GB) Cache AVrfy
  4. ------------------------------------------------------------------------------
  5. u0 RAID-1 REBUILDING 41% - - 232.82 RiW ON
  6.  
  7. VPort Status Unit Size Type Phy Encl-Slot Model
  8. ------------------------------------------------------------------------------
  9. p0 OK u0 232.88 GB SATA 0 - ST3250310NS
  10. p1 DEGRADED u0 232.88 GB SATA 1 - ST3250310NS

I'd figure I'd either have to write wrapper script around that or find some other way of integrating it.
Asking the question on ##infra-talk on irc.freenode.net gave me the following link to a check script on github

koollman: sdog: something like http://github.com/stanaka/check_tw should work.

With that in your snmpd.conf you can get the info via snmp

  1. [root snmp]# snmpwalk localhost -v 2c -c public .1.3.6.1.4.1.2
  2. 021 | grep ext
  3. UCD-SNMP-MIB::extIndex.1 = INTEGER: 1
  4. UCD-SNMP-MIB::extNames.1 = STRING: TW_RAID
  5. UCD-SNMP-MIB::extCommand.1 = STRING: /usr/local/sbin/check_tw
  6. UCD-SNMP-MIB::extResult.1 = INTEGER: 2
  7. UCD-SNMP-MIB::extOutput.1 = STRING: CRITICAL: Unit: u0, Type: RAID-1, Status: RE
  8. BUILDING
  9. UCD-SNMP-MIB::extErrFix.1 = INTEGER: 0
  10. UCD-SNMP-MIB::extErrFixCmd.1 = STRING:
  11. UCD-SNMP-MIB::ssSysContext.0 = INTEGER: 2073
  12. UCD-SNMP-MIB::ssRawContexts.0 = Counter32: 11781783
  13. UCD-DLMOD-MIB::dlmodNextIndex.0 = INTEGER: 1

Jan 19 2010

F12 Dependency failure

Fresh laptop arrived, obviously the first thing to do is to install the latest fedora. then do a full yum update.

However that failed with the following failed dependency

  1. mesa-libGL-7.7-2.fc12.i686 from updates has depsolving problems
  2. --> Missing Dependency: libdrm >= 2.4.17-1 is needed by package mesa-libGL-7.7-2.fc12.i686 (updates)
  3. Error: Missing Dependency: libdrm >= 2.4.17-1 is needed by package mesa-libGL-7.7-2.fc12.i686 (updates)
  4. You could try using --skip-broken to work around the problem
  5. You could try running: package-cleanup --problems
  6. package-cleanup --dupes
  7. rpm -Va --nofiles --nodigest

Now I don't really use all the fancy compiz stuff so for now I can just solve it by running

  1. [root@stillmine ~]# yum remove mesa-libGL

Jan 15 2010

MySQL & Friends Meetup @ Fosdem

Fosdem is coming up again .. It's going to be the 10th edition already So it's going to be 2 days and nights of fun, tech and geek stuff

Lenz already posted the announcement , but allow me to recapitulate.

The MySQL & Friends meetup is on saturday evening , we'll meet around 1900 in front of the under the big tree in front of the AW building...

As with the Devops Meetup you can once again vote for your preferred food

The crowd voted and Favoured an Italian place , so I've made reservations for a 15+ persons group at Sogno d'Italia which is walking distance from the conference location, so there'wont be any hassle with cars and transport

The schedule for the Devroom is also already available

See u there :)