Quentin F. Stout
Computer Science and Engineering, University of Michigan
Abstract: This paper gives algorithms for determining weighted isotonic regressions satisfying order constraints given by various ordered sets (directed acyclic graphs, aka DAGs). For the L1 metric a partitioning approach is used which exploits the fact that L1 regression values can always be chosen to be data values. Extending this approach, algorithms for binary-valued L1 isotonic regression are used to find Lp isotonic regressions for 1 < p < ∞. Algorithms are given for trees, 2-dimensional and multidimensional orderings, and arbitrary DAGs. Algorithms are also given for Lp isotonic regression with constrained data and weight values, L1 regression with unweighted data, and L1 regression for DAGs where there are multiple data values at the vertices.
Let n denote the number of vertices and m the number of edges. The algorithms show that one can determine the L1 regression for a
The paper's results for Lp apply for general p, but vary somewhat depending on whether p is 2, 3, 4, or 5, is an even integer, is an odd integer, or is nonintegral. See the paper for an explanation of the complete results and reasons for the differences. To illustrate, the times of the new algorithms for L2 are:
The algorithm for a DAG which is d-dimensional data in arbitrary locations, for d ≥ 3, is based on first creating a new DAG with more vertices but significantly fewer edges in the worst case, and then doing isotonic regression on the new DAG. The construction of the DAG is described in Isotonic Regression for Multiple Independent Variables.
Keywords: weighted isotonic median regression, nonparametric, shape constrained, L1, Lp, partial order, DAG, tree, star, bivariate, multidimensional, classification, unweighted
Complete paper. This appears in Algorithmica 66 (2013), pp. 93-112.
Related work: Here is information about the best isotonic regression algorithms known to date, for a variety of orderings and metrics.
Here are papers on weighted L∞ isotonic regression for arbitrary dags (also known as minimax regression), strict L∞ isotonic regression (this is the limit, as p → ∞, of Lp isotonic regression), L∞ isotonic regression for linear, multidimensional, and tree orders, isotonic regression for multiple independent variables, isotonic regression with a fixed number of level sets, and unimodal regression.
|Copyright © 2009-2016 Quentin F. Stout.|