Comparison of continuous integration software

This is a compendium of continuous integration software which support a software engineering practice, continuous integration,[1] in which developer's changes are immediately tested and reported when they are added to the mainline code base. The comparison of various continuous integration tools is done on the basis of platform, license, builders and Integration IDEs.

These software aid in enabling continuous delivery and increase a developer's productivity by giving in-time feedback. This ultimately leads to an improved code quality thus improving the overall software quality.

Comparison

The following table compares the features of some of the most popular continuous integration software ; it is not comprehensive with regard to listing all of the popular CI Softwares. Comparison is done on the basis of Platform, Computing Platform, License, Builders and the Integration tools and IDEs supported

Name Platform License Builders: Windows Builders: Java Builders: other Notification Integration, IDEs Integration, other
AnthillPro Cross-platform Proprietary MSBuild, NAnt, Visual Studio Ant, Maven 1-2-3 Shell script, batch script, cross-platform command-line, Groovy, Make, RTC Jazz, TFS Build, Custom Script Interpreter Email, XMPP-Jabber, RSS, Systray Eclipse, Visual Studio Many
Apache Continuum JDK, web container Apache 2.0 Unknown Maven 1-2-3 Shell script[2] Mail, Jabber and Google Talk, MSN, IRC, report deployment with wagon Unknown Unknown
Apache Gump Python Apache 2.0 Unknown Ant, Maven 1 Unknown Email Unknown Unknown
AppVeyor Hosted Proprietary Visual Studio, MSBuild, Psake No Custom Script, PowerShell Email, HipChat, Slack, Catlight No GitHub, Bitbucket, Kiln, Windows Azure
Assertible Hosted Proprietary Unknown Unknown Unknown Email, Slack, Web, Webhooks No Many
Bamboo Web container Proprietary MSBuild,[3] NAnt,[4] Visual Studio[5] Ant,[6] Maven 1-2-3[7] Custom script, command-line tool, Bash, Xcode,[8] Phing,[9] Grunt XMPP, Google Talk, Email, RSS, Remote API, HipChat IntelliJ IDEA, Eclipse, Visual Studio FishEye, Jira, Clover, Bitbucket, GitHub
BuildBot Python GPL Command-line Command-line Command-line Email, Web, GUI, IRC Unknown Unknown
Buddy Cross-platform, Hosted Proprietary Yes Ant, Maven, Gradle, Android C, C++, Clojure, Dart, Elixir, Erlang, Go, Groovy, Haskell, Node.js, PHP, Python, Rake, Ruby, Scala, Shell Script, Command-Line Email, GUI, Slack, SMS, Webhook No AWS, Bitbucket, DigitalOcean, Docker, Elastic Beanstalk, GitHub, GitLab, GCE, Heroku, Microsoft Azure, Modulus, Shopify
BuildMaster Cross-platform Proprietary Yes Yes Cross-platform command-line Email, custom No Many
CABIE LAMP GPL2 Unknown Unknown Unknown Web Unknown Unknown
CircleCI Hosted-enterprise Proprietary No Yes Go, Ruby, Python, Node.js, PHP, Java Email, Campfire, HipChat, CCtray Unknown AWS, Heroku, GitHub, Slack
Codeship Hosted Proprietary No Yes Go, Java, Node.js, PHP, Python, Ruby Email, Flowdock, Grove, HipChat, Slack, web No CloudControl, Engine Yard, GitHub, Heroku, Amazon Web Services, Microsoft Azure
Concourse Cross-platform Apache 2.0 Yes Yes Command-line Email, Slack, Twitter, HipChat, HTTP API, custom Atom Amazon S3, BOSH, Cloud Foundry, Docker, Git, GitHub, Pivotal Tracker, Vagrant, Jira, Google Storage, custom[10]
Continua CI Windows Proprietary Ant, Nant, FinalBuilder, MSBuild, Rake, Visual Studio, Powershell Ant Command-line Email, XMPP No GitHub, Bitbucket, Codeplex, Kiln, TFS, FogBugz, Jira, NCover, Opencover, NUnit, DUnitX, jUnit, xUnit, NuGet, 7Zip
continuousphp Hosted Proprietary No No PHP Email, Slack No Bitbucket, GitHub, GitLab, Stash, Zend Server
CruiseControl Cross-platform BSD-style NAnt, Rake, Xcode Phing, Apache Ant, Maven catch-all 'exec' Email, CCTray Eclipse Unknown
CruiseControl.NET Cross-platform BSD-style MSBuild, NAnt, Visual Studio Unknown Command-line Email, CCTray, RSS Unknown Unknown
Distelli Cross-platform Proprietary No Yes Ruby, Java, Python, Node.js, PHP, Clojure, Rake, Go, command-line, Groovy, Scala, Erlang Email, HipChat, Slack No GitHub, Bitbucket, Docker, Mercurial, Windows, Linux, Amazon Web Services, Microsoft Azure
Dockunit Cross-platform GPL Yes Yes Cross-platform Docker based Email, GitHub No GitHub
Drone.io Hosted/Cross-platform Apache 2.0 Unknown Ant, Maven 2, Gradle C, C++, Dart, Go, Node.js, Python, PHP, Ruby, Java, Groovy, Scala, Erlang Email, Slack, Telegram Unknown Heroku, Dotcloud, GitHub, Bitbucket
easyCIS Windows Proprietary MSBuild, NAnt, Visual Studio Unknown Unknown Systray, RSS, Email No No
ElectricCommander Cross-platform Proprietary Yes Yes Command-line Email, GUI, instant messenger, Twitter Eclipse, Visual Studio Jira, Bugzilla, Perl API, command-line
GitLab CI Go MIT Yes Yes Cross-platform command-line Email, Slack, HipChat, Pushover Unknown HTTP API (JSON)
GoCD Cross-platform Apache 2.0 Command-line Command-line Command-line Email, hipchat, Slack, Gerrit, Gitter, Riemann etc No GitHub
Harrow Hosted Proprietary Yes Yes Go, Java, Node.js, PHP, Python, Ruby Email, Slack Unknown GitHub, Bitbucket, Gitlab, Private Repository
Integrity Ruby MIT Command-line Command-line Command-line Email, Web Unknown Unknown
Jenkins-Hudson Web container Creative Commons and MIT MSBuild, NAnt Ant, Maven 2, Kundo Cmake, Gant, Gradle, Grails, Phing, Rake, Ruby, SCons, Python, shell script, command-line Android, Email, Google Calendar, IRC, XMPP, RSS, Twitter, Slack, Catlight, CCMenu, CCTray Eclipse, IntelliJ IDEA, NetBeans Bugzilla, Google Code, Jira, Bitbucket, Redmine, FindBugs, Checkstyle, PMD and Mantis, Trac, HP ALM
LuntBuild Web container Apache 2.0 Unknown Ant, Maven 1-2 Shell script, Rake Unknown Unknown Unknown
Lordui Windows Proprietary Yes Yes Command-line, everything with a user interface Email, possibly any way with user interface No Java, command-line
NCI Node.js MIT No No Command-line Email, XMPP-Jabber No GitHub, Bitbucket
OpenMake Software Meister Cross-platform Proprietary MSBuild, NAnt, Visual Studio Ant, Maven 1-2-3 Shell script, batch script, cross-platform command-line, Groovy, Make, RTC Jazz, TFS Build, Custom Script Interpreter Email, XMPP-Jabber, RSS, Systray Eclipse, Visual Studio Bugzilla, Google Code, Jira, Bitbucket, Redmine, FindBugs, Checkstyle, PMD and Mantis, Trac
Probo.CI Node.js Apache 2.0 No No Node.js Email, HipChat, Slack (all coming soon) No GitHub, Bitbucket, Stash
QuickBuild Cross-platform Proprietary MSBuild, NAnt, Visual Studio Ant, Maven 1, Maven 2 Rake, shell script, command-line Email, XMPP, RSS, Google Talk, Remote API Eclipse, IntelliJ IDEA, Visual Studio Jira
Semaphore Hosted Proprietary Unknown Maven 3 Ruby, Java, Python, Node.js, PHP, Clojure, Rake, command-line Email, Campfire, HipChat, Slack, Flowdock, Webhooks, Remote API Unknown GitHub, Bitbucket, Heroku, Code Climate, Cloud 66
Shippable Hosted Proprietary No Ant, Maven, Gradle Ruby, Python, Node.js, Java, Scala, PHP, Go Email, Slack, HipChat, Webhooks, irc, Campfire No GitHub, Bitbucket, AWS, Kubernetes, Azure, Heroku
Snap CI Hosted Proprietary No Ant, Maven, Gradle, Android C, C++, Clojure, Erlang, Go, Groovy, Haskell, Java, Node.js, Perl, PHP, Python, Ruby, Scala Email, Campfire, HipChat, Webhook No GitHub, Heroku, AWS
Solano CI Hosted, cross-platform, private cloud Proprietary No Ant, Maven, Gradle, Android C, C++, Clojure, Go, Java, Javascript, Node.js, PHP, Python, R, Ruby, Scala, command-line Email, Campfire, HipChat, Flowdock, Slack, Webhook, CCMenu No GitHub, GitHub Enterprise, Bitbucket, Heroku, AWS, Azure, Git, Mercurial, Docker
Strider Node.js BSD No No C, C++, Clojure, Erlang, Go, Groovy, Haskell, Java, Node.js, Perl, PHP, Python, Ruby, Scala Email, Slack, Web, Webhook No GitHub, Bitbucket, Heroku, GitHub Enterprise, Git
Testributor Hosted MIT Command-line Command-line Command-line Email, Slack, Web, Webhook No GitHub, Bitbucket, Git
Travis CI Hosted MIT No Ant, Maven, Gradle[11] C, C++, Clojure, Elixir, Erlang, Go, Groovy, Haskell, Java, Node.js, Perl, PHP, Python, Ruby, Rust, Scala, Smalltalk Email, Campfire, HipChat, IRC, Slack, Catlight, CCMenu, CCTray No GitHub, Heroku
TeamCity Web container Proprietary MSBuild, NAnt, Visual Studio, Duplicates finder for .NET Ant, Maven 2-3, Gradle, IntelliJ IDEA .ipr based and Inspections and Duplicates finder Rake, FxCop, command-line Email, XMPP, RSS, IDE, SysTray Eclipse, Visual Studio, IntelliJ IDEA, RubyMine, PyCharm, PhpStorm, WebStorm Jetbrains Youtrack, Jira, Bugzilla, FishEye, FindBugs, PMD, dotCover, NCover
Team Foundation Server, Visual Studio Team Services (VSTS) Cross-platform Proprietary, MIT MSBuild, Visual Studio Ant, Maven, Gradle, Android C, C++, Go, Groovy, Java, Node.js, Perl, PHP, Python, Ruby Email, SOAP, Catlight Visual Studio, Eclipse, IntelliJ IDEA, Android Studio, Visual Studio Code GitHub, Jenkins, Slack, Hipchat, FindBugs, Checkstyle, PMD
Vexor Hosted Proprietary No Unknown Ruby, Clojure, Scala, Python, Node.js, Go, Rust, Haskell Email, HipChat, Slack Unknown GitHub, Bitbucket, Gitlab

SCM system support

The following table compares the features of some of the most popular[12] Continuous Integration software on the basis of the Source Control Management or the Version Control Management which is an essential part of CI Software system. Some of the popular SCMs are given and if they are supported or not by the CI is what is mentioned in the table.

Name AccuRev BitKeeper CA Harvest ClearCase CVS Darcs Git GNU Bazaar Integrity Mercurial Perforce Plastic PVCS StarTeam Subversion Surround Synergy Team Concert Team Foundation Server Vault Visual SourceSafe
AnthillPro Yes No Yes Yes Yes No Yes No Yes Yes Yes No Yes Yes Yes No Yes Yes Yes Yes Yes
Apache Continuum No No No Yes[2] Yes[2] No Yes[2] Yes[2] No Yes[2] Yes[2] No No Yes[2] Yes[2] No Yes[2] No No No Yes[2]
Apache Gump No No No No Yes No No No No No No No No No Yes No No No No No No
AppVeyor No No No No No No Yes No No Yes No No No No Yes[13] No No No No No No
Bamboo Yes[14] No No Yes Yes No Yes No No Yes Yes No No No Yes No No No Yes[15] No No
Buddy No No No No No No Yes No No No No No No No No No No No No No No
BuildBot No No No No Yes Yes Yes Yes No Yes Yes No No No Yes No No No No No No
BuildMaster Yes No No Yes Yes No Yes No Yes Yes Yes Yes Yes No Yes Yes No No Yes Yes Yes
CABIE No No No No Yes No No No No No Yes No No No Yes No No No No No No
CircleCI No No No No No No Yes No No No No No No No No No No No No No No
node.ci No No No No No No Yes No No No No No No No No No No No No No No
Codeship No Yes No No No No Yes No No Yes No No No No No No No No No No No
Concourse No No No No No No Yes No No Yes Yes No No No No No No No No No No
Continua CI No No No No No No Yes Yes No Yes Yes Yes No No Yes Yes No No Yes Yes No File system
continuousphp No No No No No No Yes No No No No No No No No No No No No No No
CruiseControl No No No Yes Yes Yes Yes No Yes Yes Yes No No Yes Yes Yes No No Yes No Yes
CruiseControl.NET Yes Yes No Yes Yes No Yes No Yes Yes Yes Yes Yes Yes Yes Yes Yes No Yes Yes Yes
Distelli No No No No No No Yes No No Yes No No No No No No No No No No No
Drone.io No No No No No No Yes Yes No Yes No No No No Yes No No No No No No
easyCIS No No No No No No Yes No No Yes No No No No Yes No No No Yes No No
ElectricCommander Yes No No Yes Yes No Yes No No No Yes No Yes Yes Yes No Yes No Yes No No
GitLab CI No No No No No No Yes No No No No No No No No No No No No No No
GO CD No No No No No No Yes No No Yes Yes No No No Yes No No No Yes No No
Integrity No No No No No No Yes No No No No No No No No No No No No No No
Jenkins-Hudson Yes Yes Yes Yes Yes Yes[16] Yes Yes Yes[17] Yes Yes Yes[18] Yes Yes Yes Yes[19] Yes[20] Yes[21] Yes Yes[22] Yes
Koality No No No No No No Yes No No Yes No No No No No No No No No No No
LuntBuild Yes No No Yes (Base and UCM) Yes No No No No No Yes No No Yes Yes No No No No No Yes
Lordui No No No No No No No No No No No No No No No No No No No No No
NCI No No No No No No Yes No No Yes No No No No No No No No No No No
OpenMake Software Meister Yes No Yes Yes Yes No Yes No Yes No Yes No Yes Yes Yes No Yes Yes Yes Yes Yes
QuickBuild[23] Yes No No Yes Yes No Yes Yes No Yes Yes No No Yes Yes No No No Yes No Yes
Semaphore No No No No No No Yes No No No No No No No No No No No No No No
Shippable No No No No No No Yes No No No No No No No No No No No No No No
Snap CI No No No No No No Yes No No No No No No No No No No No No No No
Solano CI No No No No No No Yes No No Yes Yes No No No No No No No No No No
Strider No No No No No No Yes No No No No No No No No No No No No No No
Testributor No No No No No No Yes No No No No No No No No No No No No No No
Travis-CI No No No No No No Yes No No No No No No No No No No No No No No
TeamCity Yes No No Yes Yes No Yes No No Yes Yes No No Yes Yes No No No Yes Yes Yes
Team Foundation Server No No No No No No Yes No No No No No No No Yes No No No Yes No No
Vexor No No No No No No Yes No No No No No No No No No No No No No No

References

  1. ↑ Integration, Continuous (2007). Continuous Integration: Improving Software Quality and Reducing Risk. Pearson Education. ISBN 9780321630148.
  2. 1 2 3 4 5 6 7 8 9 10 11 "Continuum Features". Continuum. Apache Software Foundation. 2013-09-23. Retrieved 2014-03-03.
  3. ↑ "MSBuild".
  4. ↑ "NAnt".
  5. ↑ "Visual Studio".
  6. ↑ "Ant".
  7. ↑ "Maven".
  8. ↑ "Xcode".
  9. ↑ https://confluence.atlassian.com/display/BAMBOO/Phing
  10. ↑ "Resource types"
  11. ↑ "Building a Java project in Travis CI".
  12. ↑ XebiaLabs (2015-06-01). "The Ultimate List of SCM Tools". Retrieved 2016-09-23.
  13. ↑ http://www.appveyor.com/docs/installed-software#version-control-systems
  14. ↑ "AccuRev Repository Plugin".
  15. ↑ "TFS Repository".
  16. ↑ https://wiki.jenkins-ci.org/display/JENKINS/Darcs+Plugin
  17. ↑ https://wiki.jenkins-ci.org/display/JENKINS/PTC+Integrity+Plugin
  18. ↑ https://wiki.jenkins-ci.org/display/JENKINS/PlasticSCM+Plugin
  19. ↑ https://wiki.jenkins-ci.org/display/JENKINS/Surround+SCM+Plugin
  20. ↑ https://wiki.jenkins-ci.org/display/JENKINS/Synergy+Plugin
  21. ↑ https://wiki.jenkins-ci.org/display/JENKINS/Team+Concert+Plugin
  22. ↑ https://wiki.jenkins-ci.org/display/JENKINS/Vault+Plugin
  23. ↑ "PMEase - QuickBuild Features - Continuous integration and deployment solution!".

Further reading


External links

This article is issued from Wikipedia - version of the 12/2/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.