34920 2018-05-17 18:28:06 +0300 В версии openstack-nova <17 и версии qemu => 2.10 не работает живая миграция на NFS 2018-06-01 10:48:47 +0300 1 1 4 Development Sisyphus openstack-nova-compute unstable x86_64 Linux CLOSED FIXED https://bugs.launchpad.net/nova/+bug/1718295 patch P3 normal --- 1 sobbi996 shaba shaba snejok qa-sisyphus oldest_to_newest 171130 0 7544 sobbi996 2018-05-17 18:28:06 +0300 Created attachment 7544 применял на openstack-nova-compute-13.1.2 После обновления qemu с репозитория P8 (до версии 2.11) перестала работать живая миграция виртуальных машин в OpenStack. Как воспроизвести: 1) Установить qemu 2.11, Openstack Mitaka. 2) Настроить шару образов виртуалок по NFS (/var/lib/nova/instances). 3) Отправить ВМ на живую миграцию. Реальные результаты: миграция падает с ошибкой Failed to get shared "write" lock Is another process using the image? Ожидаемые результаты: ВМ успешно мигрирует. После применения патча https://git.openstack.org/cgit/openstack/nova/diff/?id=abe566df40a12b5a6c1bf9e8dcc56bd1fa087a3a миграция работает. При запуске ВМ с диска на lvm или при backend настроенном на ceph ВМки мигрируют без ошибок. 171140 1 sobbi996 2018-05-18 10:08:45 +0300 В P8 по тех причинам пока не удаётся повесить на openstack-nova 171491 2 sobbi996 2018-06-01 10:48:47 +0300 В версии 13.1.2-alt0.M80P.4 добавлен патч, решающий проблему живой миграции. 7544 2018-05-17 18:28:06 +0300 2018-05-17 18:28:06 +0300 применял на openstack-nova-compute-13.1.2 migration.patch text/plain 7843 sobbi996 LS0tIC91c3IvbGliL3B5dGhvbjIuNy9zaXRlLXBhY2thZ2VzL25vdmEvdmlydC9kaXNrL2FwaS5w eS5vbGQJMjAxOC0wNS0wNyAxNzoyOToyOS4zMTAxMjkwMTEgKzAzMDAKKysrIC91c3IvbGliL3B5 dGhvbjIuNy9zaXRlLXBhY2thZ2VzL25vdmEvdmlydC9kaXNrL2FwaS5weQkyMDE4LTA1LTA0IDE1 OjUxOjQ5LjQzMTM0NzA5OSArMDMwMApAQCAtMTM3LDE0ICsxMzcsMTQgQEAKICAgICAgICAgICAg ICAgICAgICAgICBydW5fYXNfcm9vdD1ydW5fYXNfcm9vdCkKIAogCi1kZWYgZ2V0X2Rpc2tfc2l6 ZShwYXRoKToKK2RlZiBnZXRfZGlza19zaXplKHBhdGgsIGZvcmNlX3NoYXJlPUZhbHNlKToKICAg ICAiIiJHZXQgdGhlICh2aXJ0dWFsKSBzaXplIG9mIGEgZGlzayBpbWFnZQogCiAgICAgOnBhcmFt IHBhdGg6IFBhdGggdG8gdGhlIGRpc2sgaW1hZ2UKICAgICA6cmV0dXJuczogU2l6ZSAoaW4gYnl0 ZXMpIG9mIHRoZSBnaXZlbiBkaXNrIGltYWdlIGFzIGl0IHdvdWxkIGJlIHNlZW4KICAgICAgICAg ICAgICAgYnkgYSB2aXJ0dWFsIG1hY2hpbmUuCiAgICAgIiIiCi0gICAgcmV0dXJuIGltYWdlcy5x ZW11X2ltZ19pbmZvKHBhdGgpLnZpcnR1YWxfc2l6ZQorICAgIHJldHVybiBpbWFnZXMucWVtdV9p bWdfaW5mbyhwYXRoLCBmb3JjZV9zaGFyZT1mb3JjZV9zaGFyZSkudmlydHVhbF9zaXplCiAKIAog ZGVmIGV4dGVuZChpbWFnZSwgc2l6ZSk6Ci0tLSAvdXNyL2xpYi9weXRob24yLjcvc2l0ZS1wYWNr YWdlcy9ub3ZhL3ZpcnQvaW1hZ2VzLnB5Lm9sZAkyMDE4LTA1LTA3IDE3OjMwOjU3LjcyMTg2Mzgy MyArMDMwMAorKysgL3Vzci9saWIvcHl0aG9uMi43L3NpdGUtcGFja2FnZXMvbm92YS92aXJ0L2lt YWdlcy5weQkyMDE4LTA1LTA0IDE1OjUyOjA2Ljk4NTI2NDQ4NiArMDMwMApAQCAtNDMsNyArNDMs NyBAQAogICAgIGFkZHJlc3Nfc3BhY2U9MSAqIHVuaXRzLkdpKQogCiAKLWRlZiBxZW11X2ltZ19p bmZvKHBhdGgsIGZvcm1hdD1Ob25lKToKK2RlZiBxZW11X2ltZ19pbmZvKHBhdGgsIGZvcm1hdD1O b25lLCBmb3JjZV9zaGFyZT1GYWxzZSk6CiAgICAgIiIiUmV0dXJuIGFuIG9iamVjdCBjb250YWlu aW5nIHRoZSBwYXJzZWQgb3V0cHV0IGZyb20gcWVtdS1pbWcgaW5mby4iIiIKICAgICAjIFRPRE8o bWlrYWwpOiB0aGlzIGNvZGUgc2hvdWxkIG5vdCBiZSByZWZlcnJpbmcgdG8gYSBsaWJ2aXJ0IHNw ZWNpZmljCiAgICAgIyBmbGFnLgpAQCAtNTYsNiArNTYsOCBAQAogCiAgICAgdHJ5OgogICAgICAg ICBjbWQgPSAoJ2VudicsICdMQ19BTEw9QycsICdMQU5HPUMnLCAncWVtdS1pbWcnLCAnaW5mbycs IHBhdGgpCisgICAgICAgIGlmIGZvcmNlX3NoYXJlOgorICAgICAgICAgICAgY21kID0gY21kICsg KCctLWZvcmNlLXNoYXJlJywpCiAgICAgICAgIGlmIGZvcm1hdCBpcyBub3QgTm9uZToKICAgICAg ICAgICAgIGNtZCA9IGNtZCArICgnLWYnLCBmb3JtYXQpCiAgICAgICAgIG91dCwgZXJyID0gdXRp bHMuZXhlY3V0ZSgqY21kLCBwcmxpbWl0PVFFTVVfSU1HX0xJTUlUUykKLS0tIC91c3IvbGliL3B5 dGhvbjIuNy9zaXRlLXBhY2thZ2VzL25vdmEvdmlydC9saWJ2aXJ0L2RyaXZlci5weS5vbGQJMjAx OC0wNS0wNyAxNzozMToyOS43NzE4MjIzMTUgKzAzMDAKKysrIC91c3IvbGliL3B5dGhvbjIuNy9z aXRlLXBhY2thZ2VzL25vdmEvdmlydC9saWJ2aXJ0L2RyaXZlci5weQkyMDE4LTA1LTA0IDE1OjUx OjAyLjc3MzU0MjYzMCArMDMwMApAQCAtNDAzLDYgKzQwMyw3IEBACiAjIGZvciBhbGwgYXJjaGl0 ZWN0dXJlcy9oeXBlcnZpc29ycywgYXMgdGhpcyB2YWx1ZSByaXNlcyB0bwogIyBtZWV0IHRoZW0u CiBNSU5fTElCVklSVF9WRVJTSU9OID0gKDAsIDEwLCAyKQorTUlOX1FFTVVfVkVSU0lPTiA9ICgy LCAxLCAwKQogIyBUT0RPKGJlcnJhbmdlKTogUmUtZXZhbHVhdGUgdGhpcyBhdCBzdGFydCBvZiBl YWNoIHJlbGVhc2UgY3ljbGUKICMgdG8gZGVjaWRlIGlmIHdlIHdhbnQgdG8gcGxhbiBhIGZ1dHVy ZSBtaW4gdmVyc2lvbiBidW1wLgogIyBNSU5fTElCVklSVF9WRVJTSU9OIGNhbiBiZSB1cGRhdGVk IHRvIG1hdGNoIHRoaXMgYWZ0ZXIKQEAgLTQ4Miw2ICs0ODMsMTEgQEAKICMgbGlidmlydCAxLjMg Zml4IGYzOTE4ODlmNGU5NDJlMjJiOWVmOGVjY2E0OTJkZTA1MTA2Y2U0MWUKIE1JTl9MSUJWSVJU X1BGX1dJVEhfTk9fVkZTX0NBUF9WRVJTSU9OID0gKDEsIDMsIDApCiAKKyMgcWVtdSA+PSAyLjEw LjAKKyMgVXNlICctLWZvcmNlLXNoYXJlJyB0byBza2lwIGltYWdlIGxvY2tpbmcgZHVyaW5nIHFl bXUtaW1nIGluZm8KKyMgZXhlY3V0aW9uIGFzIHJ1bm5pbmcgcWVtdSBwcm9jZXNzIG93bnMgdGhl IHdyaXRlIGxvY2suCitNSU5fUUVNVV9GT1JDRV9TSEFSRSA9ICgyLCAxMCwgMCkKKwogIyBwcGM2 NC9wcGM2NGxlIGFyY2hpdGVjdHVyZXMgd2l0aCBLVk0KICMgTk9URShyZm9sY28pOiBTYW1lIGxl dmVscyBmb3IgTGlidmlydC9RZW11IG9uIEJpZyBFbmRpYW4gYW5kIExpdHRsZQogIyBFbmRpYW4g Z2l2aW5nIHRoZSBudWFuY2UgYXJvdW5kIGd1ZXN0IHZzIGhvc3QgYXJjaGl0ZWN0dXJlcwpAQCAt NTgwLDYgKzU4Niw5IEBACiAgICAgICAgIHNlbGYuX3JlbW90ZWZzID0gcmVtb3RlZnMuUmVtb3Rl RmlsZXN5c3RlbSgpCiAKICAgICAgICAgc2VsZi5fbGl2ZV9taWdyYXRpb25fZmxhZ3MgPSBzZWxm Ll9ibG9ja19taWdyYXRpb25fZmxhZ3MgPSBOb25lCisgICAgICAgIAorICAgICAgICAjIEFzc3Vt ZSBwcmUgMi4xMCB2ZXJzaW9uIG9mIHFlbXUgaXMgaW4gdXNlCisgICAgICAgIHNlbGYuX2ZvcmNl X3NoYXJlID0gRmFsc2UKIAogICAgIGRlZiBfZ2V0X3ZvbHVtZV9kcml2ZXJzKHNlbGYpOgogICAg ICAgICByZXR1cm4gbGlidmlydF92b2x1bWVfZHJpdmVycwpAQCAtNjY0LDYgKzY3MywxNiBAQAog ICAgICAgICAgICAgICAgIF8oJ05vdmEgcmVxdWlyZXMgbGlidmlydCB2ZXJzaW9uICVzIG9yIGdy ZWF0ZXIuJykgJQogICAgICAgICAgICAgICAgIHNlbGYuX3ZlcnNpb25fdG9fc3RyaW5nKE1JTl9M SUJWSVJUX1ZFUlNJT04pKQogCisgICAgICAgIGlmIENPTkYubGlidmlydC52aXJ0X3R5cGUgaW4g KCJxZW11IiwgImt2bSIpOgorICAgICAgICAgICAgaWYgc2VsZi5faG9zdC5oYXNfbWluX3ZlcnNp b24oaHZfdmVyPU1JTl9RRU1VX1ZFUlNJT04pOgorICAgICAgICAgICAgICAgIHNlbGYuX2ZvcmNl X3NoYXJlID0gKAorICAgICAgICAgICAgICAgICAgICBzZWxmLl9ob3N0Lmhhc19taW5fdmVyc2lv bihodl92ZXI9TUlOX1FFTVVfRk9SQ0VfU0hBUkUpCisgICAgICAgICAgICAgICAgKQorICAgICAg ICAgICAgZWxzZToKKyAgICAgICAgICAgICAgICByYWlzZSBleGNlcHRpb24uSW50ZXJuYWxFcnJv cigKKyAgICAgICAgICAgICAgICAgICAgXygnTm92YSByZXF1aXJlcyBRRU1VIHZlcnNpb24gJXMg b3IgZ3JlYXRlci4nKSAlCisgICAgICAgICAgICAgICAgICAgIHNlbGYuX3ZlcnNpb25fdG9fc3Ry aW5nKE1JTl9RRU1VX1ZFUlNJT04pKQorCiAgICAgICAgIGlmIChDT05GLmxpYnZpcnQudmlydF90 eXBlID09ICdwYXJhbGxlbHMnIGFuZAogICAgICAgICAgICAgbm90IHNlbGYuX2hvc3QuaGFzX21p bl92ZXJzaW9uKE1JTl9MSUJWSVJUX1BBUkFMTEVMU19WRVJTSU9OKSk6CiAgICAgICAgICAgICBy YWlzZSBleGNlcHRpb24uTm92YUV4Y2VwdGlvbigKQEAgLTE4NTgsMTQgKzE4NzcsMjMgQEAKICAg ICAgICAgIyAgICAgICAgICAgICBpbiBRRU1VIDEuMy4gSW4gb3JkZXIgdG8gZG8gdGhpcywgd2Ug bmVlZCB0byBjcmVhdGUKICAgICAgICAgIyAgICAgICAgICAgICBhIGRlc3RpbmF0aW9uIGltYWdl IHdpdGggdGhlIG9yaWdpbmFsIGJhY2tpbmcgZmlsZQogICAgICAgICAjICAgICAgICAgICAgIGFu ZCBtYXRjaGluZyBzaXplIG9mIHRoZSBpbnN0YW5jZSByb290IGRpc2suCi0gICAgICAgIHNyY19k aXNrX3NpemUgPSBsaWJ2aXJ0X3V0aWxzLmdldF9kaXNrX3NpemUoZGlza19wYXRoLAotICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZvcm1hdD1zb3Vy Y2VfZm9ybWF0KQotICAgICAgICBzcmNfYmFja19wYXRoID0gbGlidmlydF91dGlscy5nZXRfZGlz a19iYWNraW5nX2ZpbGUoZGlza19wYXRoLAotICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICBmb3JtYXQ9c291cmNlX2Zvcm1hdCwKLSAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYmFzZW5hbWU9 RmFsc2UpCisgICAgICAgIHNyY19kaXNrX3NpemUgPSBsaWJ2aXJ0X3V0aWxzLmdldF9kaXNrX3Np emUoCisgICAgICAgICAgICBkaXNrX3BhdGgsCisgICAgICAgICAgICBmb3JtYXQ9c291cmNlX2Zv cm1hdCwKKyAgICAgICAgICAgIGZvcmNlX3NoYXJlPXNlbGYuX2ZvcmNlX3NoYXJlCisgICAgICAg ICkKKyAgICAgICAgc3JjX2JhY2tfcGF0aCA9IGxpYnZpcnRfdXRpbHMuZ2V0X2Rpc2tfYmFja2lu Z19maWxlKAorICAgICAgICAgICAgZGlza19wYXRoLAorICAgICAgICAgICAgZm9ybWF0PXNvdXJj ZV9mb3JtYXQsCisgICAgICAgICAgICBiYXNlbmFtZT1GYWxzZSwKKyAgICAgICAgICAgIGZvcmNl X3NoYXJlPXNlbGYuX2ZvcmNlX3NoYXJlCisgICAgICAgICkKICAgICAgICAgZGlza19kZWx0YSA9 IG91dF9wYXRoICsgJy5kZWx0YScKLSAgICAgICAgbGlidmlydF91dGlscy5jcmVhdGVfY293X2lt YWdlKHNyY19iYWNrX3BhdGgsIGRpc2tfZGVsdGEsCi0gICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICBzcmNfZGlza19zaXplKQorICAgICAgICBsaWJ2aXJ0X3V0aWxzLmNyZWF0 ZV9jb3dfaW1hZ2UoCisgICAgICAgICAgICBzcmNfYmFja19wYXRoLCBkaXNrX2RlbHRhLAorICAg ICAgICAgICAgc3JjX2Rpc2tfc2l6ZSwKKyAgICAgICAgICAgIGZvcmNlX3NoYXJlPXNlbGYuX2Zv cmNlX3NoYXJlCisgICAgICAgICkKIAogICAgICAgICBxdWllc2NlZCA9IEZhbHNlCiAgICAgICAg IHRyeToKQEAgLTY5OTYsOCArNzAyNCwxNCBAQAogCiAgICAgICAgICAgICBkaXNrX3R5cGUgPSBk cml2ZXJfbm9kZXNbY250XS5nZXQoJ3R5cGUnKQogICAgICAgICAgICAgaWYgZGlza190eXBlID09 ICJxY293MiI6Ci0gICAgICAgICAgICAgICAgYmFja2luZ19maWxlID0gbGlidmlydF91dGlscy5n ZXRfZGlza19iYWNraW5nX2ZpbGUocGF0aCkKLSAgICAgICAgICAgICAgICB2aXJ0X3NpemUgPSBk aXNrLmdldF9kaXNrX3NpemUocGF0aCkKKyAgICAgICAgICAgICAgICBiYWNraW5nX2ZpbGUgPSBs aWJ2aXJ0X3V0aWxzLmdldF9kaXNrX2JhY2tpbmdfZmlsZSgKKyAgICAgICAgICAgICAgICAgICAg cGF0aCwKKyAgICAgICAgICAgICAgICAgICAgZm9yY2Vfc2hhcmU9c2VsZi5fZm9yY2Vfc2hhcmUK KyAgICAgICAgICAgICAgICApCisgICAgICAgICAgICAgICAgdmlydF9zaXplID0gZGlzay5nZXRf ZGlza19zaXplKAorICAgICAgICAgICAgICAgICAgICBwYXRoLAorICAgICAgICAgICAgICAgICAg ICBmb3JjZV9zaGFyZT1zZWxmLl9mb3JjZV9zaGFyZQorICAgICAgICAgICAgICAgICkKICAgICAg ICAgICAgICAgICBvdmVyX2NvbW1pdF9zaXplID0gaW50KHZpcnRfc2l6ZSkgLSBka19zaXplCiAg ICAgICAgICAgICBlbHNlOgogICAgICAgICAgICAgICAgIGJhY2tpbmdfZmlsZSA9ICIiCi0tLSAv dXNyL2xpYi9weXRob24yLjcvc2l0ZS1wYWNrYWdlcy9ub3ZhL3ZpcnQvbGlidmlydC91dGlscy5w eS5vbGQJMjAxOC0wNS0wNyAxNzozMTo1NS4yMjI3NDYwMjEgKzAzMDAKKysrIC91c3IvbGliL3B5 dGhvbjIuNy9zaXRlLXBhY2thZ2VzL25vdmEvdmlydC9saWJ2aXJ0L3V0aWxzLnB5CTIwMTgtMDUt MDQgMTU6NTI6MzUuMzM5MTMxMDQ2ICswMzAwCkBAIC03NSw3ICs3NSw3IEBACiAgICAgZXhlY3V0 ZSgncWVtdS1pbWcnLCAnY3JlYXRlJywgJy1mJywgZGlza19mb3JtYXQsIHBhdGgsIHNpemUpCiAK IAotZGVmIGNyZWF0ZV9jb3dfaW1hZ2UoYmFja2luZ19maWxlLCBwYXRoLCBzaXplPU5vbmUpOgor ZGVmIGNyZWF0ZV9jb3dfaW1hZ2UoYmFja2luZ19maWxlLCBwYXRoLCBzaXplPU5vbmUsIGZvcmNl X3NoYXJlPUZhbHNlKToKICAgICAiIiJDcmVhdGUgQ09XIGltYWdlCiAKICAgICBDcmVhdGVzIGEg Q09XIGltYWdlIHdpdGggdGhlIGdpdmVuIGJhY2tpbmcgZmlsZQpAQCAtODcsNyArODcsOCBAQAog ICAgIGNvd19vcHRzID0gW10KICAgICBpZiBiYWNraW5nX2ZpbGU6CiAgICAgICAgIGNvd19vcHRz ICs9IFsnYmFja2luZ19maWxlPSVzJyAlIGJhY2tpbmdfZmlsZV0KLSAgICAgICAgYmFzZV9kZXRh aWxzID0gaW1hZ2VzLnFlbXVfaW1nX2luZm8oYmFja2luZ19maWxlKQorICAgICAgICBiYXNlX2Rl dGFpbHMgPSBpbWFnZXMucWVtdV9pbWdfaW5mbyhiYWNraW5nX2ZpbGUsCisgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZvcmNlX3NoYXJlPWZvcmNlX3NoYXJlKQog ICAgIGVsc2U6CiAgICAgICAgIGJhc2VfZGV0YWlscyA9IE5vbmUKICAgICAjIEV4cGxpY2l0bHkg aW5oZXJpdCB0aGUgdmFsdWUgb2YgJ2NsdXN0ZXJfc2l6ZScgcHJvcGVydHkgb2YgYSBxY293MgpA QCAtMTYzLDI1ICsxNjQsMjcgQEAKICAgICAgICAgcmV0dXJuIE5vbmUKIAogCi1kZWYgZ2V0X2Rp c2tfc2l6ZShwYXRoLCBmb3JtYXQ9Tm9uZSk6CitkZWYgZ2V0X2Rpc2tfc2l6ZShwYXRoLCBmb3Jt YXQ9Tm9uZSwgZm9yY2Vfc2hhcmU9RmFsc2UpOgogICAgICIiIkdldCB0aGUgKHZpcnR1YWwpIHNp emUgb2YgYSBkaXNrIGltYWdlCiAKICAgICA6cGFyYW0gcGF0aDogUGF0aCB0byB0aGUgZGlzayBp bWFnZQogICAgIDpwYXJhbSBmb3JtYXQ6IHRoZSBvbi1kaXNrIGZvcm1hdCBvZiBwYXRoCisgICAg OnBhcmFtIGZvcmNlX3NoYXJlOiBJbmhpYml0IHdyaXRlIGxvY2sgZHVyaW5nIHFlbXUtaW1nIGlu Zm8gY2FsbAogICAgIDpyZXR1cm5zOiBTaXplIChpbiBieXRlcykgb2YgdGhlIGdpdmVuIGRpc2sg aW1hZ2UgYXMgaXQgd291bGQgYmUgc2VlbgogICAgICAgICAgICAgICBieSBhIHZpcnR1YWwgbWFj aGluZS4KICAgICAiIiIKLSAgICBzaXplID0gaW1hZ2VzLnFlbXVfaW1nX2luZm8ocGF0aCwgZm9y bWF0KS52aXJ0dWFsX3NpemUKKyAgICBzaXplID0gaW1hZ2VzLnFlbXVfaW1nX2luZm8ocGF0aCwg Zm9ybWF0LCBmb3JjZV9zaGFyZSkudmlydHVhbF9zaXplCiAgICAgcmV0dXJuIGludChzaXplKQog CiAKLWRlZiBnZXRfZGlza19iYWNraW5nX2ZpbGUocGF0aCwgYmFzZW5hbWU9VHJ1ZSwgZm9ybWF0 PU5vbmUpOgorZGVmIGdldF9kaXNrX2JhY2tpbmdfZmlsZShwYXRoLCBiYXNlbmFtZT1UcnVlLCBm b3JtYXQ9Tm9uZSwgZm9yY2Vfc2hhcmU9RmFsc2UpOgogICAgICIiIkdldCB0aGUgYmFja2luZyBm aWxlIG9mIGEgZGlzayBpbWFnZQogCiAgICAgOnBhcmFtIHBhdGg6IFBhdGggdG8gdGhlIGRpc2sg aW1hZ2UKKyAgICA6cGFyYW0gZm9yY2Vfc2hhcmU6IEluaGliaXQgd3JpdGUgbG9jayBkdXJpbmcg cWVtdS1pbWcgaW5mbyBjYWwKICAgICA6cmV0dXJuczogYSBwYXRoIHRvIHRoZSBpbWFnZSdzIGJh Y2tpbmcgc3RvcmUKICAgICAiIiIKLSAgICBiYWNraW5nX2ZpbGUgPSBpbWFnZXMucWVtdV9pbWdf aW5mbyhwYXRoLCBmb3JtYXQpLmJhY2tpbmdfZmlsZQorICAgIGJhY2tpbmdfZmlsZSA9IGltYWdl cy5xZW11X2ltZ19pbmZvKHBhdGgsIGZvcm1hdCwgZm9yY2Vfc2hhcmUpLmJhY2tpbmdfZmlsZQog ICAgIGlmIGJhY2tpbmdfZmlsZSBhbmQgYmFzZW5hbWU6CiAgICAgICAgIGJhY2tpbmdfZmlsZSA9 IG9zLnBhdGguYmFzZW5hbWUoYmFja2luZ19maWxlKQogCg==