Take the 2-minute tour ×
Ask Ubuntu is a question and answer site for Ubuntu users and developers. It's 100% free, no registration required.

I'd like to get involved with Ubuntu QA by creating automated tests. Is there an ongoing effort to create these tests? Where can I learn more?

share|improve this question
add comment

6 Answers

up vote 12 down vote accepted

The QA team does extensive automated testing - it's part of the requirements for hardware to get Ubuntu certified.

The project they use is Checkbox. Don't be fooled by the quite cut-down version shipped in the checkbox-gtk package - the full suite contains a huge range of tests.

The Ubuntu QA mailing list is where you want to go for checkbox questions, or to discuss merge requests. This link discusses about the complete set of tools used by the QA team for automation.

share|improve this answer
2  
Please add this link too: qa.ubuntu.com/automation –  saji89 Dec 28 '12 at 6:45
    
@saji89: you can go ahead and suggest an edit. –  Flimm Jan 4 '13 at 15:53
add comment

Usually automated testing is done on a per project basis and the quality of those tests are highly dependant on the project's organisation and quality control. Tests can be tied into the building of debs and such but as far as I know I've never heard of any external testing framework outside of any particular project.

share|improve this answer
add comment

A project does exist at https://wiki.ubuntu.com/Testing/Automation for this - I'm not sure how much it currently covers, but there is also automated upgrade testing done to test out upgrading various package combinations.

share|improve this answer
add comment

There is http://qa.ubuntu.com/ - which links to e.g. http://mago.ubuntu.com/

While I cannot point at something specific, this appears to be a good starting point.

share|improve this answer
add comment

You can get involved with testing by joining the QA team, their mailing list - ubuntu-quality, and their launchpad page.

The last link will take you to the autopilot launchpad site which is thier automatated testing package.

See my answer here for additional details on how Ubuntu automated testing works.

share|improve this answer
add comment

There are a couple ways to get involved in writing automated tests. The quality team is involved in writing autopkg and autopilot tests for ubuntu packages.

Autopkg

Autopkg tests are run at build time automatically by the buildbots for the package. The goal of these tests is to provide system and integration testing to guarantee basic functionality. You can see the live output of the current autopkg tests here. If your interested in writing these tests, see:

Autopilot

These tests are written in python using the autopilot framework. The goal of these tests is to provide higher level application and functional testing. The tests are written in python and can be user executed or scripted via a test runner such as UTAH or jenkins to run and publish results automatically. For more information on autopilot, check out the project on launchpad as well as the documentation for the project. If your interested in writing these tests, see:

Getting Help

For more information or to get help, email the ubuntu-quality list or visit #ubuntu-quality on freenode.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.