Rehn, Adam, Holdsworth, Jason, and Lee, Ickjai (2015) Automated outlier removal for mobile microbenchmarking datasets. In: Proceedings of 2015 10th International Conference on Intelligent Systems and Knowledge Engineering. pp. 578-585. From: IEEE ISKE 2015: 10th International Conference on Intelligent Systems and Knowledge Engineering, 24-27 November 2015, Taipei, Taiwan.

PDF (Published Version) - Published Version Restricted to Repository staff only

Abstract

Microbenchmarking is a useful tool for fine-grained performance analysis, and represents a potentially valuable tool in the development of mobile applications and systems. However, the fine-grained measurements of microbenchmarking are inherently susceptible to noise from the underlying operating system and hardware. This noise includes outliers that must be removed in order to produce meaningful results. Existing microbenchmarking implementations utilise only simple mechanisms for removing outliers. In this paper we propose a heuristic for the automated removal of outliers from mobile microbenchmarking datasets. We then simplify this heuristic for use on mobile devices. Empirical evaluation demonstrates that our outlier removal heuristics are effective across microbenchmarking datasets collected from a range of mobile devices. Our simplified heuristic operates in log-linear time, making it suitable for use on resource-constrained mobile devices. The ability to perform outlier removal on-device without the need for post-processing on desktop or server hardware enhances the utility of mobile microbenchmarking tools. Our results present interesting opportunities for further studies across a broader range of device platforms.

Item ID:	42510
Item Type:	Conference Item (Research - E1)
ISBN:	978-1-4673-9322-5
Keywords:	outlier removal; mobile; microbenchmarking
Date Deposited:	10 Feb 2016 02:45
FoR Codes:	08 INFORMATION AND COMPUTING SCIENCES > 0801 Artificial Intelligence and Image Processing > 080109 Pattern Recognition and Data Mining @ 100%
SEO Codes:	89 INFORMATION AND COMMUNICATION SERVICES > 8902 Computer Software and Services > 890201 Application Software Packages (excl. Computer Games) @ 100%
Downloads:	Total: 7
	More Statistics