{"id":557,"date":"2018-06-21T20:48:04","date_gmt":"2018-06-21T20:48:04","guid":{"rendered":"http:\/\/web.eecs.umich.edu\/~girasole\/?p=557"},"modified":"2026-07-23T02:07:37","modified_gmt":"2026-07-23T02:07:37","slug":"group-owl-regularization-for-deep-nets","status":"publish","type":"post","link":"https:\/\/web.eecs.umich.edu\/~girasole\/?p=557","title":{"rendered":"Group OWL Regularization for Deep Nets"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">My student Dejiao Zhang&#8217;s code for our paper <a href=\"https:\/\/openreview.net\/forum?id=rypT3fb0b\">Learning to Share: Simultaneous Parameter Tying and Sparsification in Deep Nets<\/a> can be found <a href=\"https:\/\/github.com\/Dejiao2018\/GrOWL\">at this link<\/a>. We demonstrated that regularizing the weights in a deep network using the Group OWL norm allows for simultaneous enforcement of sparsity (meaning unimportant weights are eliminated) and parameter tying (meaning co-adapted or highly correlated weights are tied together). This is an exciting technique for learning compressed deep net architectures from data.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>My student Dejiao Zhang&#8217;s code for our paper Learning to Share: Simultaneous Parameter Tying and Sparsification in Deep Nets can be found at this link. We demonstrated that regularizing the weights in a deep network using the Group OWL norm allows for simultaneous enforcement of sparsity (meaning unimportant weights are eliminated) and parameter tying (meaning [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-557","post","type-post","status-publish","format-standard","hentry","category-code","entry"],"_links":{"self":[{"href":"https:\/\/web.eecs.umich.edu\/~girasole\/index.php?rest_route=\/wp\/v2\/posts\/557","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/web.eecs.umich.edu\/~girasole\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/web.eecs.umich.edu\/~girasole\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/web.eecs.umich.edu\/~girasole\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/web.eecs.umich.edu\/~girasole\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=557"}],"version-history":[{"count":4,"href":"https:\/\/web.eecs.umich.edu\/~girasole\/index.php?rest_route=\/wp\/v2\/posts\/557\/revisions"}],"predecessor-version":[{"id":1089,"href":"https:\/\/web.eecs.umich.edu\/~girasole\/index.php?rest_route=\/wp\/v2\/posts\/557\/revisions\/1089"}],"wp:attachment":[{"href":"https:\/\/web.eecs.umich.edu\/~girasole\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=557"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/web.eecs.umich.edu\/~girasole\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=557"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/web.eecs.umich.edu\/~girasole\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=557"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}