Lean GHTorrent: GitHub Data on Demand

TitleLean GHTorrent: GitHub Data on Demand
Publication TypeConference Paper
Year of Publication2014
AuthorsGousios, G, Vasilescu, B, Serebrenik, A, Zaidman, A
Secondary TitleProceedings of the 11th Working Conference on Mining Software Repositories
Pagination384–387
PublisherACM
Place PublishedNew York, NY, USA
ISBN Number978-1-4503-2863-0
Keywordsdata on demand, dataset, github, msr data showcase
Abstract

In recent years, GitHub has become the largest code host in the world, with more than 5M developers collaborating across 10M repositories. Numerous popular open source projects (such as Ruby on Rails, Homebrew, Bootstrap, Django or jQuery) have chosen GitHub as their host and have migrated their code base to it. GitHub offers a tremendous research potential. For instance, it is a flagship for current open source development, a place for developers to showcase their expertise to peers or potential recruiters, and the platform where social coding features or pull requests emerged. However, GitHub data is, to date, largely underexplored. To facilitate studies of GitHub, we have created GHTorrent, a scalable, queriable, offline mirror of the data offered through the GitHub REST API. In this paper we present a novel feature of GHTorrent designed to offer customisable data dumps on demand. The new GHTorrent data-on-demand service offers users the possibility to request via a web form up-to-date GHTorrent data dumps for any collection of GitHub repositories. We hope that by offering customisable GHTorrent data dumps we will not only lower the "barrier for entry" even further for researchers interested in mining GitHub data (thus encourage researchers to intensify their mining efforts), but also enhance the replicability of GitHub studies (since a snapshot of the data on which the results were obtained can now easily accompany each study).

URLhttp://doi.acm.org/10.1145/2597073.2597126
DOI10.1145/2597073.2597126
Full Text
AttachmentSize
PDF icon lean-ghtorrent.pdf766.66 KB