Title

PerfDB + PerfML: Supporting Big Data-Driven Research on Fine-Grained Performance Phenomena

Joshua Kimball

Ph.D. Student in Computer Science

School of Computer Science

Georgia Institute of Technology

Date: November 20, 2020

Time: 10:00 AM to 12:00PM EST

Location: https://bluejeans.com/287403017

**Note: this proposal is remote-only. complete meeting info. below.**

Committee

Dr. Calton Pu (Advisor) - School of Computer Science, Georgia Institute of Technology

Dr. Arulaj Joy - School of Computer Science, Georgia Institute of Technology

Dr. Ling Liu - School of Computer Science, Georgia Institute of Technology

Dr. Sham Navathe - School of Computer Science, Georgia Institute of Technology

Dr. Qingyang Wang - School of Computer Science, Louisiana State University

Abstract

The long-tail latency problem is a well-documented problem in large-scale system topologies like cloud platforms. Long-tail latency can lead to degraded quality of experience, potential economic loss and less predictable system performance overall. In the past, platforms have over-provisioned to mitigate tail latency and its effects. Instead, we propose studying these performance bugs systematically and addressing their underlying root cause. In this proposal, we present the first-generation population study of VLRT requests using PerfDB, our data management system. Specifically, we present the first study of VLRT periods on integrated data from 500 experiments. We find evidence that many VLRT coincide with Cross-Tier Queue Overflow (CTQO) induced by millibottlenecks. In our second analysis, we conduct the first study of a phenomenon called Localized Latency Requests (LLR)—requests with latency between 100-500ms. Finally, we propose a machine learning system, PerfML, which employs a teamed-classifier method to automatically isolate and diagnose fine-grained performance anomalies found in a collection of fine-grained (sampling at 50ms intervals) resource monitoring data covering a wide variety of hardware and software configurations spanning hundreds of experiments and terabytes of experimental data. 

-----------------------------------------

Meeting URL

https://bluejeans.com/287403017

Meeting ID

287 403 017

Want to dial in from a phone?

Dial one of the following numbers:

+1.408.419.1715 (United States(San Jose))

+1.408.915.6290 (United States(San Jose))

(see all numbers - https://www.bluejeans.com/numbers)

Enter the meeting ID and passcode followed by #

Connecting from a room system?

Dial: bjn.vc or 199.48.152.152 and enter your meeting ID & passcode