Fault and Calibration

Sensor data has been a focus of signal processing for decades. In modern sensor applications, engineers are deploying hundreds or thousands of sensors to monitor  the environment, computer networks, vehicle traffic, and many other phenomena of interest. Signal processing for such large datasets can no longer rely on careful maintenance and calibration nor on expert-based outlier detection (i.e. a person looking at the data). We are developing machine learning algorithms to ensure that these data are still useful and enlightening, as well as the supporting theory to give guarantees that we may use data from large deployments with confidence.

Code for robust blind calibration is here and original code for our 2007 paper is here.

1399621 84TPD646 1 chicago-author-date 50 date desc 1 183 http://web.eecs.umich.edu/~girasole/wp-content/plugins/zotpress/
%7B%22status%22%3A%22success%22%2C%22updateneeded%22%3Afalse%2C%22instance%22%3Afalse%2C%22meta%22%3A%7B%22request_last%22%3A0%2C%22request_next%22%3A0%2C%22used_cache%22%3Atrue%7D%2C%22data%22%3A%5B%7B%22key%22%3A%229EJHAU95%22%2C%22library%22%3A%7B%22id%22%3A1399621%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Ganti%20et%20al.%22%2C%22parsedDate%22%3A%222015%22%2C%22numChildren%22%3A2%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%201.35%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BGanti%2C%20Ravi%20Sastry%2C%20Laura%20Balzano%2C%20and%20Rebecca%20Willett.%202015.%20%26%23x201C%3BMatrix%20Completion%20Under%20Monotonic%20Single%20Index%20Models.%26%23x201D%3B%20%26lt%3Bi%26gt%3BProceedings%20of%20the%20Conference%20for%20Advances%20in%20Neural%20Information%20Processing%20Systems%26lt%3B%5C%2Fi%26gt%3B%2C%201864%26%23x2013%3B72.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-ItemURL%26%23039%3B%20href%3D%26%23039%3Bhttp%3A%5C%2F%5C%2Fpapers.nips.cc%5C%2Fpaper%5C%2F5916-matrix-completion-under-monotonic-single-index-models%26%23039%3B%26gt%3Bhttp%3A%5C%2F%5C%2Fpapers.nips.cc%5C%2Fpaper%5C%2F5916-matrix-completion-under-monotonic-single-index-models%26lt%3B%5C%2Fa%26gt%3B.%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Matrix%20Completion%20Under%20Monotonic%20Single%20Index%20Models%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Ravi%20Sastry%22%2C%22lastName%22%3A%22Ganti%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Laura%22%2C%22lastName%22%3A%22Balzano%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rebecca%22%2C%22lastName%22%3A%22Willett%22%7D%5D%2C%22abstractNote%22%3A%22Eletronic%20Proceedings%20of%20Neural%20Information%20Processing%20Systems%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%20conference%20for%20Advances%20in%20Neural%20Information%20Processing%20Systems%22%2C%22conferenceName%22%3A%22Advances%20in%20Neural%20Information%20Processing%20Systems%22%2C%22date%22%3A%222015%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Fpapers.nips.cc%5C%2Fpaper%5C%2F5916-matrix-completion-under-monotonic-single-index-models%22%2C%22ISSN%22%3A%22%22%2C%22language%22%3A%22%22%2C%22collections%22%3A%5B%22DZFDBB6V%22%2C%22WUTP7CH6%22%2C%2284TPD646%22%2C%22ZA8QMDGD%22%2C%22F7QF4T2Q%22%5D%2C%22dateModified%22%3A%222015-12-29T15%3A07%3A01Z%22%7D%7D%2C%7B%22key%22%3A%22HN3FZVH8%22%2C%22library%22%3A%7B%22id%22%3A1399621%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Lipor%20and%20Balzano%22%2C%22parsedDate%22%3A%222014-05%22%2C%22numChildren%22%3A2%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%201.35%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BLipor%2C%20John%2C%20and%20Laura%20Balzano.%202014.%20%26%23x201C%3BRobust%20Blind%20Calibration%20via%20Total%20Least%20Squares.%26%23x201D%3B%20%26lt%3Bi%26gt%3B2014%20IEEE%20International%20Conference%20on%20Acoustics%2C%20Speech%20and%20Signal%20Processing%20%28ICASSP%29%26lt%3B%5C%2Fi%26gt%3B%2C%20May%2C%204244%26%23x2013%3B48.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-ItemURL%26%23039%3B%20href%3D%26%23039%3Bhttp%3A%5C%2F%5C%2Fieeexplore.ieee.org%5C%2Fxpls%5C%2Fabs_all.jsp%3Farnumber%3D6854402%26amp%3Btag%3D1%26%23039%3B%26gt%3Bhttp%3A%5C%2F%5C%2Fieeexplore.ieee.org%5C%2Fxpls%5C%2Fabs_all.jsp%3Farnumber%3D6854402%26amp%3Btag%3D1%26lt%3B%5C%2Fa%26gt%3B.%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Robust%20blind%20calibration%20via%20total%20least%20squares%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22John%22%2C%22lastName%22%3A%22Lipor%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Laura%22%2C%22lastName%22%3A%22Balzano%22%7D%5D%2C%22abstractNote%22%3A%22This%20paper%20considers%20the%20problem%20of%20blindly%20calibrating%20large%20sensor%20networks%20to%20account%20for%20unknown%20gain%20and%20offset%20in%20each%20sensor.%20Under%20the%20assumption%20that%20the%20true%20signals%20measured%20by%20the%20sensors%20lie%20in%20a%20known%20lower%20dimensional%20subspace%2C%20previous%20work%20has%20shown%20that%20blind%20calibration%20is%20possible.%20In%20practical%20scenarios%2C%20perfect%20signal%20subspace%20knowledge%20is%20difficult%20to%20obtain.%20In%20this%20paper%2C%20we%20show%20that%20a%20solution%20robust%20to%20misspecification%20of%20the%20signal%20subspace%20can%20be%20obtained%20using%20total%20least%20squares%20%28TLS%29%20estimation.%20This%20formulation%20provides%20significant%20performance%20benefits%20over%20the%20standard%20least%20squares%20approach%2C%20as%20we%20show.%20Next%2C%20we%20extend%20this%20TLS%20algorithm%20for%20incorporating%20exact%20knowledge%20of%20a%20few%20sensor%20gains%2C%20termed%20partially-blind%20total%20least%20squares.%22%2C%22proceedingsTitle%22%3A%222014%20IEEE%20International%20Conference%20on%20Acoustics%2C%20Speech%20and%20Signal%20Processing%20%28ICASSP%29%22%2C%22conferenceName%22%3A%222014%20IEEE%20International%20Conference%20on%20Acoustics%2C%20Speech%20and%20Signal%20Processing%20%28ICASSP%29%22%2C%22date%22%3A%22May%202014%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Fieeexplore.ieee.org%5C%2Fxpls%5C%2Fabs_all.jsp%3Farnumber%3D6854402%26tag%3D1%22%2C%22ISSN%22%3A%22%22%2C%22language%22%3A%22%22%2C%22collections%22%3A%5B%22DZFDBB6V%22%2C%2284TPD646%22%2C%22ZA8QMDGD%22%5D%2C%22dateModified%22%3A%222015-09-08T16%3A38%3A10Z%22%7D%7D%2C%7B%22key%22%3A%22WZG3UJ3V%22%2C%22library%22%3A%7B%22id%22%3A1399621%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Ni%20et%20al.%22%2C%22parsedDate%22%3A%222009%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%201.35%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BNi%2C%20Kevin%2C%20Nithya%20Ramanathan%2C%20Mohamed%20Nabil%20Hajj%20Chehade%2C%20et%20al.%202009.%20%26%23x201C%3BSensor%20Network%20Data%20Fault%20Types.%26%23x201D%3B%20%26lt%3Bi%26gt%3BACM%20Transactions%20on%20Sensor%20Networks%20%28TOSN%29%26lt%3B%5C%2Fi%26gt%3B%205%20%283%29%3A%2025.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-ItemURL%26%23039%3B%20href%3D%26%23039%3Bhttp%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fcitation.cfm%3Fid%3D1525863%26%23039%3B%26gt%3Bhttp%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fcitation.cfm%3Fid%3D1525863%26lt%3B%5C%2Fa%26gt%3B.%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Sensor%20network%20data%20fault%20types%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Kevin%22%2C%22lastName%22%3A%22Ni%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Nithya%22%2C%22lastName%22%3A%22Ramanathan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Mohamed%20Nabil%20Hajj%22%2C%22lastName%22%3A%22Chehade%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Laura%22%2C%22lastName%22%3A%22Balzano%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Sheela%22%2C%22lastName%22%3A%22Nair%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Sadaf%22%2C%22lastName%22%3A%22Zahedi%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Eddie%22%2C%22lastName%22%3A%22Kohler%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Greg%22%2C%22lastName%22%3A%22Pottie%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Mark%22%2C%22lastName%22%3A%22Hansen%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Mani%22%2C%22lastName%22%3A%22Srivastava%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222009%22%2C%22section%22%3A%22%22%2C%22partNumber%22%3A%22%22%2C%22partTitle%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fcitation.cfm%3Fid%3D1525863%22%2C%22PMID%22%3A%22%22%2C%22PMCID%22%3A%22%22%2C%22ISSN%22%3A%22%22%2C%22language%22%3A%22%22%2C%22collections%22%3A%5B%22DZFDBB6V%22%2C%22427SEM27%22%2C%2284TPD646%22%2C%22UIWU664R%22%5D%2C%22dateModified%22%3A%222013-05-17T18%3A35%3A05Z%22%7D%7D%2C%7B%22key%22%3A%22W9DZZ2A6%22%2C%22library%22%3A%7B%22id%22%3A1399621%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Ganeriwal%20et%20al.%22%2C%22parsedDate%22%3A%222008%22%2C%22numChildren%22%3A2%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%201.35%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BGaneriwal%2C%20Saurabh%2C%20Laura%20K.%20Balzano%2C%20and%20Mani%20B.%20Srivastava.%202008.%20%26%23x201C%3BReputation-Based%20Framework%20for%20High%20Integrity%20Sensor%20Networks.%26%23x201D%3B%20%26lt%3Bi%26gt%3BACM%20Transactions%20on%20Sensor%20Networks%20%28TOSN%29%26lt%3B%5C%2Fi%26gt%3B%204%20%283%29%3A%2015.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-ItemURL%26%23039%3B%20href%3D%26%23039%3Bhttp%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fcitation.cfm%3Fid%3D1362546%26%23039%3B%26gt%3Bhttp%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fcitation.cfm%3Fid%3D1362546%26lt%3B%5C%2Fa%26gt%3B.%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Reputation-based%20framework%20for%20high%20integrity%20sensor%20networks%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Saurabh%22%2C%22lastName%22%3A%22Ganeriwal%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Laura%20K.%22%2C%22lastName%22%3A%22Balzano%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Mani%20B.%22%2C%22lastName%22%3A%22Srivastava%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222008%22%2C%22section%22%3A%22%22%2C%22partNumber%22%3A%22%22%2C%22partTitle%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fcitation.cfm%3Fid%3D1362546%22%2C%22PMID%22%3A%22%22%2C%22PMCID%22%3A%22%22%2C%22ISSN%22%3A%22%22%2C%22language%22%3A%22%22%2C%22collections%22%3A%5B%22DZFDBB6V%22%2C%22427SEM27%22%2C%2284TPD646%22%5D%2C%22dateModified%22%3A%222013-05-17T18%3A31%3A53Z%22%7D%7D%2C%7B%22key%22%3A%228APWRX4C%22%2C%22library%22%3A%7B%22id%22%3A1399621%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Balzano%20and%20Nowak%22%2C%22parsedDate%22%3A%222007%22%2C%22numChildren%22%3A2%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%201.35%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BBalzano%2C%20Laura%2C%20and%20Robert%20Nowak.%202007.%20%26%23x201C%3BBlind%20Calibration%20of%20Sensor%20Networks.%26%23x201D%3B%20%26lt%3Bi%26gt%3BProceedings%20of%20the%206th%20International%20Conference%20on%20Information%20Processing%20in%20Sensor%20Networks%26lt%3B%5C%2Fi%26gt%3B%2C%2079%26%23x2013%3B88.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-ItemURL%26%23039%3B%20href%3D%26%23039%3Bhttp%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fcitation.cfm%3Fid%3D1236372%26%23039%3B%26gt%3Bhttp%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fcitation.cfm%3Fid%3D1236372%26lt%3B%5C%2Fa%26gt%3B.%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Blind%20calibration%20of%20sensor%20networks%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Laura%22%2C%22lastName%22%3A%22Balzano%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Robert%22%2C%22lastName%22%3A%22Nowak%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20the%206th%20international%20conference%20on%20Information%20processing%20in%20sensor%20networks%22%2C%22conferenceName%22%3A%22%22%2C%22date%22%3A%222007%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22http%3A%5C%2F%5C%2Fdl.acm.org%5C%2Fcitation.cfm%3Fid%3D1236372%22%2C%22ISSN%22%3A%22%22%2C%22language%22%3A%22%22%2C%22collections%22%3A%5B%22DZFDBB6V%22%2C%2284TPD646%22%2C%22ZA8QMDGD%22%2C%22UIWU664R%22%2C%22HJQ26QYG%22%5D%2C%22dateModified%22%3A%222013-05-13T21%3A08%3A58Z%22%7D%7D%5D%7D
Ganti, Ravi Sastry, Laura Balzano, and Rebecca Willett. 2015. “Matrix Completion Under Monotonic Single Index Models.” Proceedings of the Conference for Advances in Neural Information Processing Systems, 1864–72. http://papers.nips.cc/paper/5916-matrix-completion-under-monotonic-single-index-models.
Lipor, John, and Laura Balzano. 2014. “Robust Blind Calibration via Total Least Squares.” 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), May, 4244–48. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6854402&tag=1.
Ni, Kevin, Nithya Ramanathan, Mohamed Nabil Hajj Chehade, et al. 2009. “Sensor Network Data Fault Types.” ACM Transactions on Sensor Networks (TOSN) 5 (3): 25. http://dl.acm.org/citation.cfm?id=1525863.
Ganeriwal, Saurabh, Laura K. Balzano, and Mani B. Srivastava. 2008. “Reputation-Based Framework for High Integrity Sensor Networks.” ACM Transactions on Sensor Networks (TOSN) 4 (3): 15. http://dl.acm.org/citation.cfm?id=1362546.
Balzano, Laura, and Robert Nowak. 2007. “Blind Calibration of Sensor Networks.” Proceedings of the 6th International Conference on Information Processing in Sensor Networks, 79–88. http://dl.acm.org/citation.cfm?id=1236372.