Crowdsourced User-Testing

Sprinz, Johannah (10. February 2022): Crowdsourced User-Testing. Bachelor Thesis Presentation “Leveraging Human Computation for Quality Assurance in Open Source Communities”. Ludwig-Maximilians-Universität München

Abstract

The presented thesis investigates facilitating software quality assurance in open source communities through a human computation platform. Inexperienced community members can contribute formalized user testing data, which is then aggregated and presented to the developers. The implemented prototype, named open crowdsourced user-testing suite (OPEN-CUTS), was evaluated in a usability study in the UBports Community. The viability of this approach has been demonstrated, and further goals for research and development are proposed.

• Item Type: Lecture
• Keywords: Crowdsourcing; Human Computation; Software Quality Assurance; Software Testing; Ubuntu Touch; UBports
• Faculties: Mathematics, Computer Science and Statistics > Computer Science
• Subjects: 000 Computer science, information and general works > 000 Computer science, knowledge, and systems; 000 Computer science, information and general works > 004 Data processing computer science; 300 Social sciences > 360 Social problems and social services; 600 Technology > 600 Technology
• Language: English

References

M. Aberdour, “Achieving Quality in Open-Source Software,” IEEE Software, vol. 24, no. 1, pp. 58–64, Jan. 2007, doi: 10.1109/MS.2007.2

S. S. Bahamdain, “Open Source Software (OSS) Quality Assurance: A Survey Paper,” Procedia Computer Science, vol. 56, pp. 459–464, Jan. 2015, doi: 10.1016/j.procs.2015.07.236

D. Kulesz and I. Bogicevic, “SystemTestPortal - A Web-Application for managing Manual System Tests,” Nov. 2017, doi: 10.5446/41642

E. Law and L. von Ahn, Human computation. Morgan & Claypool, 2011. doi: 10.2200/S00371ED1V01Y201107AIM013

R. Mühlhoff, “Human-aided artificial intelligence: Or, how to run large computations in human brains? Toward a media sociology of machine learning:” New Media & Society, pp. 1868–1884, Nov. 2019, doi: 10.1177/1461444819885334

E. S. Raymond, “The cathedral and the bazaar,” First Monday, vol. 3, no. 2, Mar. 1998, doi: 10.5210/fm.v3i2.578

G. G. Schulmeyer, Ed., Handbook of software quality assurance, 4th ed. Boston: Artech House, 2008

J. Sprinz, “Leveraging Human Computation for Quality Assurance in Open Source Communities,” LMU Munich, Bachelor Thesis, Jan. 2022, doi: 10.5282/ubm/epub.91046

J. Sprinz, “A collaborative effort to create a user-friendly installer for different mobile operating systems,” submitted to the Journal of Brief Ideas, Feb. 2022, Available: https://beta.briefideas.org/ideas/3f22fbc27fb6dcb3c4c33603ef597f9b

D. Wahyudin, A. Schatten, D. Winkler, and S. Biffl, “Aspects of Software Quality Assurance in Open Source Software Projects: Two Case Studies from Apache Project,” Aug. 2007, pp. 229–236. doi: 10.1109/EUROMICRO.2007.19