TY - JOUR
T1 - A Decomposition of Total Variation Depth for Understanding Functional Outliers
AU - Huang, Huang
AU - Sun, Ying
N1 - KAUST Repository Item: Exported on 2020-10-01
PY - 2019/2/11
Y1 - 2019/2/11
N2 - There has been extensive work on data depth-based methods for robust multivariate data analysis. Recent developments have moved to infinite-dimensional objects such as functional data. In this work, we propose a notion of depth, the total variation depth, for functional data, which has many desirable features and is well suited for outlier detection. The proposed depth is in the form of an integral of a univariate depth function. We show that the novel formation of the total variation depth leads to useful decomposition associated with shape and magnitude outlyingness of functional data. Compared to magnitude outliers, shape outliers are often masked among the rest of samples and more difficult to identify. We then further develop an effective procedure and visualization tools for detecting both types of outliers, while naturally accounting for the correlation in functional data. The outlier detection performance is investigated through simulations under various outlier models. Finally, the proposed methodology is demonstrated using real datasets of curves, images, and video frames.
AB - There has been extensive work on data depth-based methods for robust multivariate data analysis. Recent developments have moved to infinite-dimensional objects such as functional data. In this work, we propose a notion of depth, the total variation depth, for functional data, which has many desirable features and is well suited for outlier detection. The proposed depth is in the form of an integral of a univariate depth function. We show that the novel formation of the total variation depth leads to useful decomposition associated with shape and magnitude outlyingness of functional data. Compared to magnitude outliers, shape outliers are often masked among the rest of samples and more difficult to identify. We then further develop an effective procedure and visualization tools for detecting both types of outliers, while naturally accounting for the correlation in functional data. The outlier detection performance is investigated through simulations under various outlier models. Finally, the proposed methodology is demonstrated using real datasets of curves, images, and video frames.
UR - http://hdl.handle.net/10754/631101
UR - https://www.tandfonline.com/doi/full/10.1080/00401706.2019.1574241
UR - http://www.scopus.com/inward/record.url?scp=85065659731&partnerID=8YFLogxK
U2 - 10.1080/00401706.2019.1574241
DO - 10.1080/00401706.2019.1574241
M3 - Article
SN - 0040-1706
VL - 61
SP - 445
EP - 458
JO - Technometrics
JF - Technometrics
IS - 4
ER -