Continuous validation for data analytics systems

Mark Staples, Liming Zhu, John Grundy

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

14 Citations (Scopus)

Abstract

From a future history of 2025: Continuous development is common for build/test (continuous integration) and operations (devOps). This trend continues through the lifecycle, into what we call 'devUsage': continuous usage validation. In addition to ensuring systems meet user needs, organisations continuously validate their legal and ethical use. The rise of end-user programming and multi-sided platforms exacerbate validation challenges. A separate trend is the specialisation of software engineering for technical domains, including data analytics. This domain has specific validation challenges. We must validate the accuracy of statistical models, but also whether they have illegal or unethical biases. Usage needs addressed by machine learning are sometimes not specifiable in the traditional sense, and statistical models are often 'black boxes'. We describe future research to investigate solutions to these devUsage challenges for data analytics systems. We will adapt risk management and governance frameworks previously used for software product qualities, use social network communities for input from aligned stakeholder groups, and perform cross-validation using autonomic experimentation, cyber-physical data streams, and online discursive feedback.

Original languageEnglish
Title of host publicationProceedings - 2016 IEEE/ACM 38th IEEE International Conference on Software Engineering Companion, ICSE 2016
EditorsWillem Visser, Laurie Williams
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Pages769-772
Number of pages4
ISBN (Electronic)9781450341615, 9781450342056
DOIs
Publication statusPublished - 2016
Externally publishedYes
EventVisions of 2025 and Beyond 2016 - Austin, United States of America
Duration: 14 May 201622 May 2016
http://2016.icse.cs.txstate.edu/v2025 (Track website)

Conference

ConferenceVisions of 2025 and Beyond 2016
Abbreviated titleV2025 2016
Country/TerritoryUnited States of America
CityAustin
Period14/05/1622/05/16
OtherTrack from International Conference on Software Engineering 2016
Internet address

Keywords

  • Continuous development
  • Data analytics
  • DevOps
  • Ethics
  • Governance
  • Machine learning
  • Software validation

Cite this