IV International Conference of Unix at Uninet
  • Presentation
  • Register
  • Program
  • Organizing Comittee
  • Listing of registered people
  • Translators team
Rik van Riel talk

rielI've now made this channel moderated, so there won't be huge
amounts of text in the middle of my talk
rielif you have questions, remarks or just want to chat, you can do so at
any time in the #qc channel
rielI'd like to welcome everybody to this year's Umeet
rielI think this is the 4th time I have participated in Umeet, and I like this
conference because the audience is from all over the world - and I can participate
without having to travel ;)
riellike the internet, anybody can participate (and do ask questions on
#qc)
rielthis year I'm giving the opening talk of Uninet
rielusually I talk about something I have been working on, but this year I
am going to give a different talk
rielnot because I haven't been working on cool stuff (I have), but because I
would like the audience to have something to do after Umeet is over
rielI am going to present to you some of the technologies I want to play
with during the christmas holidays
rielbecause, lets face it, engineers stay children for their whole life!
rielI like toys, and chances are that you do too
rielthe toys I present here are all free software projects in search of beta
testers and developers
rielI really want to play with:
riel- Xen
riel- Smart
riel- Stateless Linux
rielyou probably do not know what all of them are, so I will present them
one by one, explaining why I want to play with them and what you could use them
for
rielthe first technology I want to play with - and am already playing with
during work hours - is Xen
rielXen is a project that implements paravirtualisation for Linux and other
OSes
rielit is available under the GPL and has very good performance
rielI assume most of you are familiar with VMware, and some of you will
also know User Mode Linux
rielVMware emulates a whole PC in software, so you can run Linux or
Windows inside Linux or Windows
rielhowever, emulating hardware is not very efficient
rielthe advantage is that you can run multiple unmodified operating
systems on your computer
rielUser Mode Linux takes the opposite approach, it emulates a Linux
environment for applications, and runs on an unmodified Linux kernel
rielso you get emulation in the "guest", with no emulation needed in the
"host"
off)
riellike VMware, UML is not very efficient
rielXen is taking an interesting compromise between the two
approaches
rielXen has a lightweight hypervisor, that does not emulate hardware,
but it can only run modified operating system kernels
rielthis is called paravirtualisation
rielluckily the only thing that needs to be modified for Xen is the OS
kernel, so there is no compatibility problem for the rest of the OS
rielI have seen benchmarks showing that Linux running inside Xen
(xenolinux) has 95% of the performance of Linux running on bare hardware, for
some server benchmarks
rielUser Mode Linux and VMware only have half of that performance for
some benchmarks!
riel == a quick notice:  there is a spanish translation of this talk in #redes ==
rielnow, since you need a special kernel, not every OS can run inside Xen
rielbut I know that Xen 2.0 has ports available for Linux, NetBSD and Plan
9, with a FreeBSD port underway
rielthere is even a special version of Windows XP to run under Xen, but
unfortunately this software is not available ...
rielnow, what could you use Xen for ?
rielI want to use Xen to:
riel- try out multiple distributions or free OSes
riel- build & test programs on multiple distributions
riel- security separation, for various reasons
rielfor example, I could want to try out a root kit
rielor a suspected root kit, like posted in the fake security
announcement last month
rielI could run such software on a virtual machine with no network access
rieland later inspect the virtual machine to see what the suspicious
software did
rielspeaking of untrusted software - I could run Fedora Rawhide, or
Mandrake Cooker, or Conectiva Snapshot in a virtual machine - if something
breaks, the computer still works so I can file a bugzilla and fix things ;)
rielI am creating Fedora RPMs of Xen and Xen Linux kernels for exactly
this reason - I want people to be able to test rawhide, or build and test their own
software on Fedora Core 3, Fedora Core 2 and other distributions
rielnow, Xen is still in development and not well integrated with Linux
distributions
rielthis means you have to do a lot of things "by hand" to try it out
rieleven booting requires you to do a non-standard trick to your grub.conf
rieltitle Fedora Core (2.6.9-1.1021_FC4xen0)
riel        root (hd0,0)
riel        kernel /xen.gz dom0_mem=180000
riel        module /vmlinuz-2.6.9-1.1021_FC4xen0 ro root=LABEL=/ debug 3
riel        module /initrd-2.6.9-1.1021_FC4xen0.img
rielthis would be a good moment to explain a bit about Xen ;)
riela Xen system is controlled by the Xen hypervisor, which is the "main
kernel"
rielone of the Xen guest OSes, domain 0, has all the device drivers, eg the
ones that can read from and write to the hard disk
rielso the domain 0 kernel needs to be loaded at boot time, just like an
initrd is preloaded by the boot loader
rielXen and domain 0 together are a complete system
rielyou can log into that and do whatever you do on a full Linux system,
but you can also use the remaining memory in the system to load up additional
virtual machines
rielthose extra virtual machines do not have access to the hardware, so
they are called "unprivileged guests"
rielif an unprivileged guest needs something from disk, it will ask the Linux
kernel in domain 0 to get the data
rieldomain 0 provides device services to the unprivileged domains, this is
also called a "service VM"
rielnow, Xen has a number of additional things you can control
rielfor example, you can resize the memory each virtual host gets
rielor change the cpu priority
rielall thsi is done by the Xen daemon, or xend
rieland you can control this with the commandline tool "xm"
rielfor example, I could ask for a list of virtual machines:
riel# xm list
rielName              Id  Mem(MB)  CPU  State  Time(s)  Console
rielDomain-0           0      171    0  r----     97.9
rielTestDomain         2       31    0  -b---      5.6    9602
rielor I can resize the amount of memory one of the virtual machines has
riel# xm balloon 2 25
riel# xm list
rielName              Id  Mem(MB)  CPU  State  Time(s)  Console
rielDomain-0           0      171    0  r----     98.6
rielTestDomain         2       24    0  -b---      5.6    9602
peer)
rielXen also has good documentation available online, so this should be
the perfect christmas gift for a computer nerd who isn't afraid of trying out new
technology
rielyou can find more information on the Xen web site:
rielhttp://www.cl.cam.ac.uk/Research/SRG/netos/xen/
riel----------------------------------------
rielnow, time to talk a bit about the next technology I want to play with
rieloh wait, a remark on #qc ;)
rielalejandro riel: Xen seems like the sun e10k, with multiple domains
used. :)
rielalejandro, yes, this is one of the ways in which you could use Xen
rielI want to try things like putting untrusted services, like named and
httpd, in their own virtual machines
rielso if somebody breaks into named, they cannot do anything bad to the
rest of my system
rielok, now I will really move on to the next item ;)
rieltoday every distribution has a piece of software to automatically
upgrade software, or make it easier to install new software and all the libraries and
tools that software needs
rielthe most popular two examples are apt-get and yum
rielhowever, both of these have their problems
rieland nobody seems to be completely happy with either
rielluckily one of my friends at Conectiva, Gustavo Niemeyer, is
developing a new package manager to solve some of the issues with yum and
apt-get
rielhis project is called "smart", and the home page is at
http://smartpm.org/
rielI have not had time to play with it yet, but it has a number of features
that I like a lot
rielfor example, it can download packages from multiple mirror sites
simultaneously
rielit understands apt-deb, apt-rpm, yum, slackware, urpmi, red carpet and
other repositories
rielI will probably only use apt-rpm and yum repositories myself, but it is
very useful that I can use both
rielsmart also works with RPM, debian and Slackware packages - so you
can probably try it out on your distribution
rielanother big reason why I want to try smart, is that it is smarter in
calculating which packages need to be upgraded (or downgraded!) in order to be
able to install a certain package
rielI have often run into trouble when a Fedora repository has one version
of an RPM, and a 3rd party repository has another version of the same RPM
rielwhen I install that RPM, the newest gets installed
rielbut then I try to install a second RPM, that wanted the older version
instead
rielneither apt-get or yum are able to downgrade the package to the older
one
rielI hope smart will do this for me ;)
rielmmmm, some questions in #qc
rielI have not used smart though, so I cannot answer those questions
myself
rielluckily the author of smart, Gustavo Niemeyer, is in the channel
niemeyerHello everyone!
niemeyerThanks for these nice comments Rik!
rielniemeyer, I have used your software before - it has always worked for
me, so I trust smart will work too ;)
niemeyer<E0x> riel: what about source tarball ? can smart in a near
feature do the same that do distro like , gentoo , sourcemage or freebsd ,
optimization of the software using gcc flag ?
niemeyerE0x: In the current implementation, there's no support for
installing source tarballs nor src.rpm packages. On the other hand,
niemeyerSmart has a very nice abstraction of the package concept. A
good example of that, for instance, is that Arnaldo Carvalho de Melo (acme),
niemeyerwas able to build a backend for installing kernel modules
directly, since they already provide the dependency information which is needed.
niemeyerThis was an experiment, and is not yet available in the Smart
source.
#linux
niemeyerWith that in mind, building something like a src.rpm/source
tarball installer is just a matter of building a new backend which
niemeyerimplements the concept of "package" and "package manager"
for installing these on the system.
niemeyerI hope this answers your question.
off)
niemeyer<xtingray> how "smart" deal with libraries versions?
niemeyerxtingray: Smart works with package relations, and do its best to
keep the system in good shape respecting these relations.
niemeyerIf library packages have correct relations, Smart will do whatever
necessary to install these libraries once requested.
#linux
niemeyer<xtingray> niemeyer: even if one library is coming from a .deb
package and other from an .rpm?
niemeyerCurrently, no. Smart currently have these system in independent
graphs, on purpose.
niemeyerMixing them would be very easy (indeed, easier than not mixing),
niemeyerbut the real problem is about distribution policy, in that case.
USA) : "New technologies for the christmas holidays" || #qc -->questions&comentar
y; #redes --> traducen a español '
USA) : "New technologies for the christmas holidays" || #qc -->questions&comentar
y; #redes --> traducen a español '
niemeyer<offray> niemeyer: I think that Linux package installation is too
much oriented toward filesystem/administrator instead of oriented toward
applications-directories/end-user. What do you think about some alternative
aproaches that try to solve the problem of package managment using a distro
neutral packaging format and empower the user to install software (without
crashing all the system)
niemeyeroffray: That's one common misconception, in my opinion.
niemeyerThe real problem is not the packaging system. The real problem
is policy. We need standards, like LSB, which tell us how to build software
packages that are able to work in every distribution.
niemeyerConectiva, RedHat, Mandrake and others all use rpm as their
package management software. Even then, we're mostly unable to cross-install
softwares in these distributions, even when they use the same basic system.
niemeyerriel: I'm ashamed for talking so much in your presentation.
Please, help me. :)
rielI have found Conectiva and Red Hat to be mostly compatible at the
.src.rpm level though ;)
rielniemeyer, thank you for helping me out answering questions on Smart
rielI think I'll talk for a few minutes about the third technology I want to
play with this christmas
rielafter that we can do some more questions and answers
riel--------------------------------
rielok, the last technology I am going to talk about today is Stateless Linux
rielI will try to keep it short, since we're already an hour into the
presentation ;)
rielStateless Linux is a project with the goal of making it easier to deploy a
number of similar Linux configurations
rielfor example, a network of workstations
rielor a compute farm, with many compute nodes
rielor even virtual machines
rieleverybody is familiar with things like kickstart, where you can specify
a configuration file and the installer will install 30 identical systems for you
rielthat only solves a small part of the problem - the installation
rielafter the installation is complete, the sysadmin has 30 identical
systems to manage
rieland needs to do common sysadmin tasks 30 times
rielalso, there will inevitably be data on those 30 systems that need to be
backed up, data spread out all over the filesystem
rielStateless Linux aims to fix these problems
rielthe idea is that a system boots into an unconfigured Linux OS
rielwith no local data that needs to be remembered past a reboot
rielfor example, a workstation would have no configuration locally and all
of the user's data would be stored on an NFS home directory
rielso if a user's CPU fan gets stuck and the computer catches fire, all the
sysadmin has to do is give the user a new system
rielthere is no data on the old system that needs to be rescued
rielthe new system needs no configuration - the user switches it on, logs
in and goes to work
rielsimilar things could be done for a supercomputer cluster, where each
node of the cluster simply gets its configuration at boot time
rielsystems could boot from the network, or copy over a newer version of
the distribution for upgrades - you want to avoid things that can go wrong, like
upgrading individual packages
rielor at least, if upgrading individual packages goes wrong, you just want
to automatically boot into a newer version of the distribution on the next reboot
rielthe Stateless Linux project also has some script changes that make it
possible to run with the root filesystem readonly
rielI want to use this in my Xen experiments, so I can run multiple virtual
machines off the same disk image
rielStateless Linux is a Fedora project, mostly run by David Malcolm
reset by peer)
rielI am sure other people have other ideas on how to use it, your
participation in the project is welcome ;)
rielI guess my time is almost up, so I'll give you the URLs of the projects I
want to play with over christmas
rielif you think any of them are interested - you've got a christmas holiday
too and it is free software, so download your christmas presents now ;)
rielXen - virtualisation
rielhttp://www.cl.cam.ac.uk/Research/SRG/netos/xen/
rielSmart - package management
rielhttp://smartpm.org/
rielStateless Linux
rielhttp://fedora.redhat.com/projects/stateless/
smart
rielif you have any questions, about any of the subjects discussed,
please ask them in #qc
rielI will try to answer them here
riel<_libra_> Is it possible or Would it be possible to use virtual machines
in other host's inside a intranet?
riel_libra_, yes, you can use virtual machines in another physical system
rielin fact, Xen has the ability to move virtual hosts from one physical
system to another, without shutting down the virtual host
rielif the virtual host can access its disk from both physical systems, you
can do a "live migration"
rielthe Xen developers have moved a quake server (in a virtual machine)
from one physical machine to another
rielthe migration is live, except for the final push
rielif I remember correctly, the total downtime was something on the order
of 45 milliseconds
rielnone of the quake players even noticed that their server was moved to
another computer while they were playing
rielif anybody else has a question, please ask it in #qc
riel<LKM> riel: Xen is loaded as a new kernel in grub, but that
happens(passes) with the portability with lilo?
rielLKM, currently lilo is unable to boot Xen - if you really want lilo, you will
have to create a patch to lilo so it can boot Xen
#linux
rielok, I guess this is it
rielthanks to Gustavo Niemeyer for helping me out
rielhere are the URLs again:
rielXen - virtualisation
rielhttp://www.cl.cam.ac.uk/Research/SRG/netos/xen/
rielSmart - package management
rielhttp://smartpm.org/
rielStateless Linux
rielhttp://fedora.redhat.com/projects/stateless/
rieloh - and you can download your christmas presents before december
25th, don't feel bad
riel<moya> does xen need any special kernel support ?
rielmoya, yes, in order to run Xen you need a special kernel
rielthese special kernels are available for Linux, NetBSD and Plan 9
rielFreeBSD is underway
riel<niemeyer> riel: Have you seen any numbers regarding the overhead
of Xen, if compared to a "raw" system?
rielniemeyer, I have seen benchmarks where Xen has only a 3%
performance overhead
rielthe Xen website has some benchmark results
rielhttp://www.cl.cam.ac.uk/Research/SRG/netos/xen/performance.html
rielok, I guess these were all the questions
rielthank you for your time, and I hope you will enjoy this year's umeet
error: EOF from client)
rieldon't forget to be here again tomorrow, there are more presentations
coming up
rielhttp://umeet.uninet.edu/umeet2004/english/prog.html
rielthere is this year's Umeet program
moyariel: is this presentation the last one of today ?
rielmoya, yes, but tomorrow at the same time there will be another talk
rielin fact, tomorrow has 2 talks
rielDecember 10 Friday, 18 GMT. Horacio Peña, Felix Cuello, Cristian
Knoblauch. Universidad Palermo. Buenos Aires. Argentina. "Experiencias de la
competición ACM"
rielDecember 10 Friday, 21 GMT. Offray Luna. Pontificia Universidad
Javeriana. Colombia. "Deconstrutivist approach to building custom made distros"
the channel #redes
RaD|Tzclap clap clap clap clap clap
Ferreclapclapclapclapclapclapclap
toomany@riel like ever, is a pleasure... Thank you!!
xtingrayclap clap clap clap clap clap
smithclap clap
LKMea
marioclpa clap clap
hCirtsainclap clap clap clap clap
kroczCLAP CLAP CLAP CLAP
rexlee_clap clap clap CLAP
LKMclpa clap clap
krlosclap clap clap clap clap clap
mariosaludos a todos desde CHILE!!!
LKM:D
rielI hope you will have fun this christmas, playing with new free software
xtingrayyehaaaaaaaaaaa!!!
BatusaiXxD
CiberosaCLAP CLAP CLAP CLAP
bigjockergreetings
> clap clap clap clap clap clap clap clap clap clap
> clap clap clap clap clap clap clap clap clap clap
> clap clap clap clap clap clap clap clap clap clap
> clap clap clap clap clap clap clap clap clap clap
> clap clap clap clap clap clap clap clap clap clap
RaD|Tznos vemos ma?ana!
> thanks riel,
toomanypooo zi
FerreCiao Hasta mañana
mariosee you!!
toomanybyez
satugracias a los ponentes, thanks
mariolastima q no pude sacar fotos ; )    (jejej)
> in #redes are working fjjimenez, _libra_ and PCM
LKMjejeje
> riel, muchas gracias !
feistelcuanto duro mas o menos la conferencias?
krlosMuchas gracias, hasta mañana gente
kroczagradecimentos para a conferência
krlos1 hora diez minutos
toomanysaludos cordialesssssss a todosss y todasssss... aaaadios
marionos vemos mañana si Dios quiere. Adios!!!!
feistelgente, yo expongo la semana q viene podria chatear con algunos
de los organizadores, no es nada grave solo un detalle
Ernesto alguien me puede comentar qué le parece webmin?
Ernestoos parece seguro?
feistelErnesto: no para nada
Ernestoes que lo he descubierto esta mañana y me parece interesante
Luis0se va a publicar la confercia en algún sitio?
Ernestofeistel para = pasa?
feistelErnesto: no, para=para
panasync))
> jeje
> in the mailing list umeet2004 we write the program every day. For
subscribe please, go to registration pages linked to http://umeet.uninet.edu
feistelhola gente, yo soy de argentina, de donde son uds?
> aroun the world ! (I'm at Spain)
feistelhay argentinos por aqui?
ErnestoErnesto de Spain, Madrid
feistelse puede hablar de negocios, ahora q la conferencia a finalizado :-)
Luis0yo de Valencia (Spain)
error: EOF from client)
feistelsoy argentino y quiero hacer negocios en españa
> sobre qe cosa ?
feistelo solo intercambiar ideas y opiniones al respecto, alguien aqui
tiene una empresa de desarrollo, Linux o seguridad en españa ?
SchizOp0pifty, =)
fjjimenezcongratulations, riel
> tener empresa es mucho !
fjjimenezfeistel: de que tipo? nosotros trabajamos con servicios sociales
y accesibilidad, redes y telemedicina
rielXen - virtualisation
rielhttp://www.cl.cam.ac.uk/Research/SRG/netos/xen/
rielSmart - package management
rielhttp://smartpm.org/
rielStateless Linux
rielhttp://fedora.redhat.com/projects/stateless/
niemeyerriel: Thanks for the presentation!
> clap clap clap clap clap clap clap clap clap clap
niemeyerBye everyone!
> clap clap clap clap clap clap clap clap clap clap
> clap clap clap clap clap clap clap clap clap clap
> clap clap clap clap clap clap clap clap clap clap
> clap clap clap clap clap clap clap clap clap clap
End of #linux buffer Thu Dec 09 20:36:15 2004

Generated by irclog2html.pl by Jeff Waugh - find it at freshmeat.net!

The Organizing Comittee

Email UsMore information


© 2004 - www.uninet.edu - Contact Organizing Comittee - Valid XHTML - Valid CSS - Based on a Design by Raul Pérez Justicia