Ubuntu home server

One of the most common requests the Ubuntu community asks for is a home server or small business server.  This Beepstar post, The trouble with Ubuntu Server for beginners, encapsulates the argument nicely when the article says:

“95% of the would-be “nixers” are completely stunned, at that point when the Ubuntu Server installation states that it has finished and all that’s offered to the user is a black screen and a prompt line. Users … basically scrap the whole thing, install Windows and use … solutions which lack raw power but come with an comprehensive interface”

It’s certainly an interesting point, we can surmise that one of the things that heavily assisted the growth of Windows on the server was the Graphical User Interface (GUI) that came with NT 3.5 and NT 4. At the time the competitive product was Netware which was the dominant technology for providing servers in LAN’s, and networks were themselves reasonably new for small business networks. Windows rode the networking trend really well, and gave advanced technical users (rather than professional IT staff) the idea that they could run their own servers.

I’ll come back to the question of whether Ubuntu server should be trying to focus in this area for a moment, and just focus on technology problems we face in providing a home server. There’s two elements:

a. A set of common services
The use-cases are relatively straight-forward but the key is the integration.  So we’d want thinks like basic file and print, with network services.

b. A nice user experience
An easy to use interface that can guide the user through the initial installation, but also the reconfiguration and management of the services.

We’ve been working on common services in Ubuntu server and ensuring that they’re well integrated and easy to set-up as this makes every system administrators life easier.  So making LAMP easy to install, integrating the experience of attaching to a Windows Network and the recent e-mail stack work all make setting up common services easy and quick.

To provide a graphical user experience there are a range of options.  There’s some well-known free software options, the two most well-know are E-Box and Webmin.  There’s also commercial control panels such as Plesk which is used a lot by hosting providers.

It’s difficult to see a way to integrate one of these panels as the default way of adminstering  an Ubuntu server as the impact on professional users would be dramatic.  For various reasons these tools assume that you only manage the system through the GUI.  So there’s no way to integrate them that would maintain the freedom of professional system administrators to manage the system using the command line interface.

Meanwhile, professional system administrators face a different set of problems.  The shift of delivering everything through a web server and the introduction of virtualization and cloud computing is causing an explosion of server instances.  So for these use cases the focus is on a small, efficient server with centralised configuration management capability.

The compromise may well be a small, powerful server platform aimed for cloud computing.  Then a range of appliances (virtual or otherwise) built  to meet the specific needs of both professional and personal (ie home) users.  There’s been a few different community efforts along these lines and I hope we’ll see more.

A few members of the Ubuntu Server Team wrote about this a while ago, so check out the posts by Dustin, Soren and Thierry.

ubuntu, server, linux

Linux eclipses Windows

The Eclipse team released a survey that shows Linux is the most popular deployment platform, outstripping Microsoft Windows. Ubuntu is the second most popular Linux deployment platform, just behind Red Hat Enterprise Linux (RHEL). On the development side the Linux desktop shows strong growth, with 27% of developers using it.

The survey itself had over 1,300 participants from a range of different organisations, you can get the full results from their site. Eclipse is popular with Java developers or developers not strongly tied to Microsoft technologies, so the survey gives good insight into their behaviour.

From the survey Linux is used by 27% of developers as their desktop environment, up from 20% in 2007. This is very strong growth, and shows that Linux continues to expand its reach on the desktop. Ubuntu is the lead distribution with 14.5% of users, RHEL/Fedora is next on 4.7% and then SUSE/Novell on 3.2%. Windows is still the largest platform but has lost 10% market share; it was 74% in 2007 and has now dropped to 64% in the 2009 survey.

The survey also asked what platform was used for deployment. There’s a dramatic shift from previous surveys as Linux now represents the majority on 43% and Microsoft Windows 41%. The breakdown is also interesting. RHEL/Fedora is the lead distribution with 13.1%, Ubuntu comes second with 12.0% and SUSE/Novell is used by 5.3% for deployments.

The desktop Linux trend is really good news as it’s another strong data point showing that Linux is growing on the desktop. Developers are power users who tweak and play with their environment, so if they’re satisfied with Ubuntu then it bodes well for other broader users.

For Ubuntu the deployment platform data is also good news as it shows continuing growth for the server. By it’s nature the server isn’t as flashy as the desktop, it’s strengths and capabilities are more subtle. It’s great to see that developers are appreciating that the server edition is capable of delivering the full range of enterprise workloads, including Java application serving. A lot of work has been put into making LAMP and Tomcat easy to install and maintain, to my mind this survey demonstrates that the work is paying off – we’re helping users deploy Java more simply.

If you’re interested in more analysis of the survey then Ian Skerret’s blog post is a good place to start. And for some more commentary on the Ubuntu element see Nick Barcet’s post.

Ubuntu Server survey

Ubuntu is widely used as a server platform, across organisations of all sizes, particularly for web and application delivery.  Those are the results from a survey of 7000 Ubuntu users that we released a while ago, in conjunction with RedMonk.  The press coverage was good, and now it’s died down I thought I’d add a few other thoughts.

The first question has to be why we undertook a survey.  Understanding how platform’s used, what users value and what features they want is incredibly important.  We use that input to guide our development, inform our decisions and focus our attention.  Open source development provides significant detailed and direct feedback, but surveys offer some other insights.

First, they’re a route to reach people that don’t take part in the development process directly – which is the majority of users.  Second, the volume of input gives us a strong statistical basis for examining trends – 7000 users is a significant pool of input. Finally, it’s an objective confirmation to qualitative feedback that we receive through other mechanisms, this helps confirm assessments we’ve made or trends we’ve observed. If you took the survey thanks very much for your time and input!

What are the main take-aways from the survey? Well clearly our users depend on Ubuntu as a server platform, it’s used for serious production deployments.  It’s used across a wide range of organisation sizes and industries.  That’s important because it tells us that our efforts to develop the platform, and spread the message that Ubuntu has a strong server capability are meeting with success.  It’s also a data driven stake through the heart of the myth that Ubuntu server is only used by small business or hobbyists.

Second, that our users value the key qualities that we provide – the heritage from Debian, the regular releases, the focus on a tight and efficient platform for all the common workloads.  I was particularly struck by the range of workloads that Ubuntu is being used for.  We see Ubuntu being used for edge of network infrastucture (DNS/Web), but also internal application delivery (Java app serving/Databases) and it’s starting to make its way into line of business (CRM/ERP) delivery.  These aspects are important because they guide our focus for future development as we make our way towards the next LTS release in 2010.

Finally, the range of geographies and individual situations where the server is deployed is incredibly exciting.  Between the geographical data from Shipit and this survey we can conclude that Ubuntu is used globally. From a large media delivery platform in Europe, to a school in the Phillipines, each is spreading Ubuntu and benefiting from it in their own unique way.  In the long-run this reach broadens the tent of Ubuntu (and Linux) supporters and developers.  If the next 8 million users come from the developing world image what we can accomplish!

My thanks to Nick Barcet and the server community who put the survey together – it was a lot of work but has been really beneficial.  I hope we’ll continue to run surveys in the future so that we can build up a picture of how things change.  If you’d like to see the results with a deeper analysis then pop over to Gerry Carr’s blog post to download the whitepaper.

Comfortable wiki editing

Wikis are great for collaboration, and using your favourite editor makes life more comfortable.  These directions show you how to use Vim on Ubuntu to edit a MoinMoin wiki.

If you spend a lot of time editing a wiki you soon realise that working in a tiny browser text box isn’t that comfortable.  It would be much better if you could use your favourite editor.  That way if Firefox crashes you still have a local copy.  With local editing you can also keep working while the wiki previews your page.  And, re-united with your editor you get to use all those cool productivity-enhancing key combinations that you paid for with serious RSI!

The trick is to use the Firefox add-on It’s All Text! by docwhat. This add-on lets you specify a local editor to use when you edit a textarea.  When you edit a wiki page instead of typing in it you can run your mouse over the bottom of the text area and a small blue “edit” button appears.  If you click this the external editor you specified is launched.

I’m using gvim, so when I click the edit button a gvim window pops up with the mark-up and contents of the wiki page there read for me to edit.  If I save the file then the textarea flashes yellow in my browser as it updates from my gvim window.  When I’ve finished with my page I dismiss the gvim window, preview my page and save.

As Ubuntu uses MoinMoin I wanted to add highlighting so that when I’m editing a wiki page it looks neat and tidy.  Since It’s All Text! provides the buffer as a normal .txt file I needed to tell it how to highlight the MoinMoin file when it loads it.  Here are the steps:

1.  Get the MoinMoin syntax file
There’s a MoinMoin syntax file on Vim Scripts directory so download and save it into ~/.vim/syntax/moin.vim

Just for completeness I’m actually using Gustavo’s moin.vim which is in the latest version of his editmoin. I use a dark background and his highlights are a bit more straightforward.

After you’ve done this you can check it works by saving a MoinMoin wiki page to your system.  Then opening it in vim and running the following command which will show highlights:
:setf moin

2.  Tell vim about locally saved files
Add the following to your ~/.vim/filetype.vim

augroup filetypedetect
au BufNewFile,BufRead *.moin setf moin
au BufNewFile,BufRead *.wiki setf moin
augroup END

This comes from a Wikipedia page on Text editor support when editing Wikipedia.  I believe you only need this step if you’re going to be keeping local copies of your wiki pages as something .moin.  I do this a lot as I like local backups and want to see the highlights when I open them in vim.

At this point you can check it’s working by opening a locally saved MoinMoin page and the highlights should take effect automatically.

3.  Tell It’s All Text! how to launch gvim
Finally, you need to tell the It’s All Text! extension how to launch gvim with the MoinMoin syntax highlighting turned on.  First you need to add a small script somewhere in your path (for me in ~/bin/), it contains:

#!/bin/bash
set -eu
exec /usr/bin/gvim -c “setf moin” “$@”

Just edit the Preferences for It’s All Text! and test it out.  It should launch your gvim window and set the file to being moin so that your highlights are applied.

This is very applicable to other editors, such as Emacs, and perhaps even OpenOffice’ new wiki editor.

The only thing I can’t work out how to do is to apply different settings and highlights depending on which wiki I’m editing.  This is a feature editmoin has that’s pretty useful.

MoinMoin, ItsAllText!

Hot Hosted Apps

Consumers, technologists and start-ups have taken heavily to running hosted applications. Squash reminded us a while back that a lot of the basics still need to be covered. Still, it’s interesting to consider whether this is a trend that consumers, medium business and enterprises will take-up with a vengeance.

The rise of Gmail really kicked the trend off and the Google team have done a great job expanding the capabilities. The buzz around Web 2.0 doesn’t do any hard either to getting people excited and experimenting. However, it’s worth remembering that lots of “trends” seen by the digerati don’t take-off. For example, while I couldn’t live without RSS it’s not used by most users (according to Yahoo, only 4% of surveyed users are RSS users). While I assume that this figure has changed since that survey I don’t think it’s the majority!

The main hosted applications I use are:

Gmail
E-mail is intrinsic to how people use the Web, and Google changed the game with it. They’ve done everything possible to make it feel like you’re not locked in, while locking you in with all the features!

LinkedIn
I’m not a big social networking user, but I do use Linkedin to stay in touch with business contacts and look for job candidates.

Del.icio.us
The oldest of social networking sites. Perhaps not the prettiest but I have all my bookmarks there and there hasn’t been anything more compelling.

So far, every other application I use is on the desktop. File storage is the one that I’d really like to solve but there doesn’t seem to be a clear winner that is cross-platform. Which hot hosted applications do you find indispensable?

Developing great technology

Irving Wladawsky-Berger is an interesting technologist and strategist, whose blog is worth reading if you have spare cycles for good quality input. He’s known for having been deeply involved in many of IBM’s technical strategy decisions, for example he was a key actor in their Linux strategy. He officially retired this year and Eweek did a wide-ranging interview that finally made it to the top of my reading list. A key quote that struck me as true is when he’s asked where he got his vision from:

“The answer is easy: Find where the smart people are and hang out with them. I’m serious. The smart people have a lot of ideas …”

IBM has resources both money and brain-power that are far beyond those of most organisations. But it strikes me as true that if you find smart people with a range of views and get into an exchange of ideas then you’ve got a much better chance of doing something amazing. That’s definitely true of Open Source, but it applies generally. He continues,

“But the way I looked at it a new idea was whether it was something we should do, and then how we should do it in IBM. Because just because it’s something we should do, doesn’t mean we have to do it like everybody else is doing.”

This second point is really important to me, although it’s often difficult to practise. Sometimes, the accepted way of meeting a need is the right way to do it. Sometimes people want a better mousetrap, not an entirely new mouse removal system. Perhaps the problem is well understood, and there are no better approaches, or at least none worth the effort for the benefit.

But generally, if something is worth doing, it’s worth examining it from the underlying principles and wondering whether it can be done with a different approach. It’s really the only way to develop something really innovative and different.

The rub seems to be when do you do the former, and when the latter, perhaps there are ways to combine the two.

Ubucon New York 2007

I really enjoyed Ubucon NY which happened on the Friday after LinuxWorld New York. Ubucon’s are informal gatherings where Ubuntu users get together to learn and socialise. The New York one was set up as an unconference so the attendees decided what the activities and talks would be. They’re organised by active members of the user community. John Mark did a great job organising it, and kept the day clicking along. Leslie and the rest of the Google team deserve thanks for providing the facilities and their overall enthusiasm. I of course returned the favour by making sure that no food on the buffet went
to waste!

It was interesting to see the wide variety of people who are active and interested enough to come along to a community event. The range was amazing, from professional business users who wanted to learn more about Ubuntu, to some of the seasoned Free Software activists.

Fabian did a great talk about our commercial support services for Ubuntu and what it’s like to work at Canonical. I learnt a few things myself! I was supposed to do a talk on the Ubuntu roadmap but there wasn’t enough time at the end of the day. So as people were getting tired I did a quick Q&A session on Canonical and Ubuntu instead. It got picked up in eWeek which was very surprising as it really was short: I think I managed to answer most people’s questions with a reasonable level of clarity!

If you’d like to be notified about upcoming Ubucon’s then you can subscribe to the Wiki page. The plan is for the next one to be in Sevilla, Spain on Saturday May 5th and is being organised by Jono Bacon. We’re also having our first formal user and business conference called Ubuntu Live. It’s in Portland, USA and comes right in front of OSCON July 22nd to 24th – make it a date in your diary!

Webcasts from the Oxford Internet Institute

The Oxford Internet Institute has videos of guest speakers who address the research group. The files are very large (200MB+) but they’re in a format that you should be able to view in Linux, Windows or Mac OS X. The sites worth browsing around as there’s lots of interesting content. The one I’m linking is by David Isenberg from The Berkman Center for Internet and Society at Harvard Law School, his talk is wide-ranging and focuses on how he sees the Internet developing.

This is a total cheat of a post as I wrote it ages ago and forgot to publish it. As I’m back from the US today and barely functioning enough to read I thought wandering through my post queue would suit my available brain power!

Samsung launches Nokia 770 competitor

Samsung have launched their Q1 ultra-mobile PC which will compete against the Nokia 770 Internet tablet. This is one of the first of the Origami machines that Microsoft designed to make the PC more mobile. Like the Nokia 770 Internet tablet it's a small (pocket sized) handheld with a touch screen and no inbuilt keyboard.

The launch didn't go that well, according to the Korean Times (via Chris Head). The demo machine had problems during the press release:

"[T]he new PC proved to be too revolutionary, enough to baffle the three firms' executive officers who publicly tried to demonstrate how to use it."

Interestingly they quote Kim Hun-soo, Vice President of Samsungs PC division who says that the battery life will be short:

"Kim later admitted that Q1 has three hours of battery life and two hours when watching a DVD, which is comparably short to other laptops."

The unit will cost about 1.2 million won in Korea, which converts to 673 GBP. Aside from a quick chuckle at a failed demo it's great that machines based on the Origami concept are getting to market. Bob Young the co-founder of RedHat used to say that he didn't want all of a small pie, but a small piece of a big pie. More Origami PC's can only help to increase the popularity of the mobile Internet and hopefully will bring new users and applications to the party.

Has anyone played with a UMPC yet? And, what do you think the Nokia 770 developers can learn from the Origami?

Subscribe | | | | | Email this post

Managing your identity with ClaimID

In the Internet's environment of free expression passions often run hot. Flamewars and vitriolic rants enliven online conversations making them interesting and human. But, will those passionate words come back to haunt you? What picture do they paint to a prospective employer, and what inferences will be drawn about you in thirty years time? A digital world is transforming our identities, making them public.

Our online activities leave a trail of bread crumbs behind us that search engines gather together. Try searching yourself on Google or egoSurf, to see what trail you've already left behind. As more of our activities migrate online they become public, indexable and searchable. The read-write web envisioned by Web 2.0 is increasing this trend as it stores social relationships and interactions. Consider what Flickr, Delicious, Technorati and Friendster could reveal about you: this might include information on your holidays, hobbies and work.

Managing our identity is a complex issue because it involves issues of ownership, perception and change. A key problem is we all play a variety of parts (personas) in different social spheres. As Shakespeare said in As you Like it (Act ii. Sc. 7):

"All the world 's a stage, And all the men and women merely players. They have their exits and their entrances; And one man in his time plays many parts"

For example, character aspects we emphasise in work may be different to those we accentuate in our local community. The virtual world doesn't recognise social boundaries so merges our interactions into a single identity which may be misleading.

ClaimID is a service that helps you to categorise your personas and present a multi-faceted on-line identity. You gain control by sifting and sorting links about yourself into groups. These groups represent social spheres and together they represent how you wish to be perceived. When someone wants to find out about you, or you want provide information about yourself you can direct them to your ClaimID page.

To use the service you sign up for a home page where you collect and group links that describe and annotate your identity. So you might have a group called Personal where you collect links that describe you personally such as your blog, delicious and flickr. Another group would be Professional with links to organisations and places you've worked. ClaimID lets you specify who authored the link and whether it's about you or not. The completed page is a list of groups that defines your personas and aggregates them into a single meta-identity. This is my page for Steve George.

It's a nice service, cleanly presented and executed. It took me about two hours to decide what groups I wanted and to populate my page. It would have been nice if there were some templates to use, and perhaps a wizard to make searching for yourself easier. The most time consuming aspect was finding links and deciding what was appropriate. My name is very common and my online footprint anaemic so my links were sunk under a army of impostor Stephen George, Steve George and slgeorge pages.

ClaimID doesn't tackle information collecting about you on the Interent. And we often value what we find out about someone more than what they tell us about themselves. Nor does it authenticate us and attest to our identity. But it is an interesting first step to managing our identity.

Do you think that the Internet is changing identity? And, is ClaimID a useful way of managing your identity?

Subscribe | | | | | Email this post