{"id":1745,"date":"2020-11-03T16:09:08","date_gmt":"2020-11-03T16:09:08","guid":{"rendered":"https:\/\/bmolab.artsci.utoronto.ca\/?p=1745"},"modified":"2020-11-04T01:07:51","modified_gmt":"2020-11-04T01:07:51","slug":"bmo-lab-paper-accepted-for-the-workshop-on-machine-learning-for-creativity-and-design-neurips-2020","status":"publish","type":"post","link":"https:\/\/bmolab.artsci.utoronto.ca\/?p=1745","title":{"rendered":"BMO Lab paper accepted for the Workshop on Machine Learning for Creativity and Design (NeurIPS), 2020"},"content":{"rendered":"\n<figure class=\"wp-block-gallery columns-3 is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\"><ul class=\"blocks-gallery-grid\"><li class=\"blocks-gallery-item\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"832\" height=\"1024\" src=\"https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/Mengyu-832x1024.jpg\" alt=\"\" data-id=\"1025\" data-full-url=\"https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/Mengyu.jpg\" data-link=\"https:\/\/bmolab.artsci.utoronto.ca\/?attachment_id=1025\" class=\"wp-image-1025\" srcset=\"https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/Mengyu-832x1024.jpg 832w, https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/Mengyu-244x300.jpg 244w, https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/Mengyu-768x946.jpg 768w, https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/Mengyu-1248x1536.jpg 1248w, https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/Mengyu.jpg 1432w\" sizes=\"auto, (max-width: 832px) 100vw, 832px\" \/><figcaption class=\"blocks-gallery-item__caption\">Mengyu Yang<\/figcaption><\/figure><\/li><li class=\"blocks-gallery-item\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"914\" height=\"914\" src=\"https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/IMG-39920-square.jpg\" alt=\"\" data-id=\"1205\" data-full-url=\"https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/IMG-39920-square.jpg\" data-link=\"https:\/\/bmolab.artsci.utoronto.ca\/?attachment_id=1205\" class=\"wp-image-1205\" srcset=\"https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/IMG-39920-square.jpg 914w, https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/IMG-39920-square-300x300.jpg 300w, https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/IMG-39920-square-150x150.jpg 150w, https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/IMG-39920-square-768x768.jpg 768w\" sizes=\"auto, (max-width: 914px) 100vw, 914px\" \/><figcaption class=\"blocks-gallery-item__caption\">Xavier Snelgrove<\/figcaption><\/figure><\/li><li class=\"blocks-gallery-item\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"952\" src=\"https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/David_studio-1024x952.jpg\" alt=\"\" data-id=\"1022\" data-full-url=\"https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/David_studio.jpg\" data-link=\"https:\/\/bmolab.artsci.utoronto.ca\/?attachment_id=1022\" class=\"wp-image-1022\" srcset=\"https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/David_studio-1024x952.jpg 1024w, https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/David_studio-300x279.jpg 300w, https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/David_studio-768x714.jpg 768w, https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/David_studio.jpg 1035w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"blocks-gallery-item__caption\">David Rokeby<\/figcaption><\/figure><\/li><\/ul><\/figure>\n\n\n\n<p>The BMO Lab is proud to announce that the research paper produced by BMO Lab summer intern Mengyu Yang in conjunction with Creative Technologist in Residence Xavier Snelgrove and Lab Director David Rokeby has been accepted for the Workshop on Machine Learning for Creativity and Design at NeurIPS 2020, one of the most important international Machine Learning conferences.<\/p>\n\n\n\n<p>The paper represents the first steps in a larger research program which is looking into ways that enable live performers to directly engage with the &#8216;latent space&#8217; of trained machine learning networks. This particular paper looks at a neural network called StyleGAN2 which generates very realistic faces of non-existent people. It describes a technique by which the machine can learn ways of controlling very specific aspects of the generated face (i.e. changing the various possible positions of the mouth or eyes) without affecting other aspects.<\/p>\n\n\n\n<figure class=\"wp-block-video\"><video controls src=\"https:\/\/bmolab.artsci.utoronto.ca\/wp-content\/uploads\/side_by_side_boy-Large-540p.mov\"><\/video><\/figure>\n\n\n\n<p>Paper: <a href=\"https:\/\/github.com\/bmolab\/masked-gan-manifold\/raw\/8ae57655f9ea34411531fca05dd5019989dc13e0\/masked-gan-manifold.pdf\">pdf<\/a><br>Project Page and Code: <a href=\"https:\/\/github.com\/bmolab\/masked-gan-manifold\">GitHub<\/a><\/p>\n\n\n\n<p>This paper is a direct offshoot of the early experiment presented at the official opening of the BMO Lab where a performer used various aspects of her physical pose to control aspects of a generated face in real-time.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The BMO Lab is proud to announce that the research paper produced by BMO Lab summer intern Mengyu Yang in conjunction with Creative Technologist in Residence Xavier Snelgrove and Lab Director David Rokeby has been accepted for the Workshop on Machine Learning for Creativity and Design at NeurIPS 2020, one of the most important international [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[1],"tags":[],"class_list":{"0":"post-1745","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-blog-posts","7":"entry"},"_links":{"self":[{"href":"https:\/\/bmolab.artsci.utoronto.ca\/index.php?rest_route=\/wp\/v2\/posts\/1745","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bmolab.artsci.utoronto.ca\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bmolab.artsci.utoronto.ca\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/bmolab.artsci.utoronto.ca\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/bmolab.artsci.utoronto.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1745"}],"version-history":[{"count":5,"href":"https:\/\/bmolab.artsci.utoronto.ca\/index.php?rest_route=\/wp\/v2\/posts\/1745\/revisions"}],"predecessor-version":[{"id":1769,"href":"https:\/\/bmolab.artsci.utoronto.ca\/index.php?rest_route=\/wp\/v2\/posts\/1745\/revisions\/1769"}],"wp:attachment":[{"href":"https:\/\/bmolab.artsci.utoronto.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1745"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bmolab.artsci.utoronto.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1745"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bmolab.artsci.utoronto.ca\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1745"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}