{"id":1953,"date":"2021-11-17T08:00:00","date_gmt":"2021-11-17T05:00:00","guid":{"rendered":"https:\/\/mubert.com\/blog\/?p=1953"},"modified":"2025-07-16T15:11:18","modified_gmt":"2025-07-16T12:11:18","slug":"the-worlds-first-3d-mapping-battle-between-humans-and-ai","status":"publish","type":"post","link":"https:\/\/mubert.com\/blog\/the-worlds-first-3d-mapping-battle-between-humans-and-ai","title":{"rendered":"The world\u2019s first 3D mapping battle between humans and AI","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"\n<p>A project initiated by Sila Sveta, who represented the human part, was created by the studio\u2019s artist Madina Fattakhova with audio composed by Monoleak; and AI \u2014 represented by Alexander Pogrebetsky with audio generated by Mubert.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Human VS AI | Sila Sveta x Mubert\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/QexspVBFXPw?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p><strong>The music<\/strong>: Mubert supplied sounds and audio that were developed by a plethora of technologies and AI.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>For Mubert, this project has been a new experience because the team had to create a soundtrack for AI-generated visuals and it had to fit a certain aesthetic. \u201cArt that is created in this way has a peculiar spirit of distorted perception, not just strange sounds,\u201d Paul Zgordan, Mubert\u2019s co-founder and Chief Content Officer, begins. \u201cWe had to use only artificial intelligence tools with minimal human post-processing.\u201d<\/li>\n\n\n\n<li>Wanting to create an eerie atmosphere that can be observed in Edgar Poe\u2019s poems, Mubert was set on showing \u2014 through the interpolation of the reader\u2019s voice with the raven\u2019s scream \u2014 that the author of this poem could be the raven himself. \u201cAs for aesthetics, one of the paradoxes of machine art is that you want to do something natural with the help of AI,\u201d Paul says. \u201cAt the same time, when you hear a good corresponding result, you may want something utterly non-existent because you want to emphasize the origin of this material, so there are different sounds in our soundtrack, natural and completely artificial.\u201d<\/li>\n\n\n\n<li>The team started by using neural networks to experiment with the sounds \u2014 <a href=\"https:\/\/mubert.com\/render\/instruments\/bells\" title=\"\">bells<\/a>, rustling, knocking, voices, and ravens \u2014 to get interesting textures. Part of the sounds was crossed with <a href=\"https:\/\/mubert.com\/render\">Mubert\u2019s existing samples<\/a> by transferring percussion and musical sounds onto noises.<\/li>\n\n\n\n<li>From the start, Zgordan didn\u2019t see it as a competition as the team just enjoyed the development process. \u201cThe competitive part for us was just extra fun, and at some point, we even thought that the AI was winning. When we found out that \u201chuman\u201d won, we even relaxed because it meant that we live in reality and not in a dream,\u201d he concludes.<\/li>\n<\/ul>\n\n\n\n<p><strong>The event<\/strong>: Sila Sveta initiated the project. Mapping involves turning objects into a display surface by the means of projection.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u201cWe always say that mapping is dead as a genre, it has been mastered a long time ago and the only chance to give it a new meaning is to come up with something completely new, so we traditionally try to bring an experiment,\u201d Alexander Us, Co-founder and Creative Director at Sila Sveta, says, explaining that the battle between AI and humans seemed to fit perfectly into this concept. Nowadays, people often wonder whether AI will be able to make shows, computer graphics, and create art in the near future, which was why it seemed so cool to test it out on this project.<\/li>\n\n\n\n<li>In order to make it a fair competition, Sila Sveta took a classic literature work, divided it into two parts, and put both parties in equal conditions. \u201cIt all became possible with algorithms on the AI side and only one designer on the human side,\u201d Sveta Yermolayeva, Sila Sveta\u2019s Creative Producer, adds. Looking for classic American literature which would be similar to the works of Alexander Pushkin, have a rich visual language, and have many layers of meaning that could be interpreted in different ways, the team chose Allan Edgar Poe\u2019s <em>The Raven <\/em>poem. \u201cIt fits very well visually because the raven itself is an interesting animal with different meanings,\u201d Alexander elucidates. \u201cPlus, the work is quite compact, it took 7 minutes, but in the end, we had to cut it a little and make it 5 minutes.\u201d<\/li>\n\n\n\n<li>For the company, this has been the first project where it had to work with a small studio team representing the \u201chuman\u201d side and having AI take part too.<\/li>\n\n\n\n<li>When discussing AI, Sveta thinks it&#8217;s just a tool in the hands of humans. \u201cHowever, over the years people will give it an increasingly complex structure \u2026 and perhaps people will somehow incorporate to it a desire to self-develop, to be famous, and so on,\u201d Alex says. He also believes that in art where hand-craft plays an important role and technique is crucial, AI will certainly be able to do it more skillfully.<\/li>\n\n\n\n<li>In this battle, the winner was chosen by voting. After the show, people were able to scan a QR code on the building\u2019s facade and vote on a website for either human or AI-based on whosever part they liked more.<\/li>\n\n\n\n<li>The show was projected onto the National Bank building facade in Binghamton, which was chosen by LUMA producers, and it appeared to suit the initial concept perfectly.<\/li>\n<\/ul>\n\n\n\n<p><strong>The art<\/strong>: Alexander Pogrebetsky\u2019s main idea was to demonstrate what modern machine learning algorithms can produce as a piece of visual art.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u201cThe visuals have been designed by AI completely,\u201d he says, explaining that the neural network was trained on thousands of images relevant to Allan Edgar Poe\u2019s poem.<\/li>\n\n\n\n<li>Overall, Pogrebetsky thinks AI is very exclusive as of right now but will be very popular in the future.<\/li>\n\n\n\n<li>From the battle, the designer expected a draw. Overall, Alexander hopes that this is \u201cthe last battle\u201d and that we all step into a world where AI and humans are \u201cBFFs.\u201d<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/mubert.com\/blog\/wp-content\/uploads\/2021\/11\/SILA_SVETA-1080x1080-1-1024x1024.jpg\" alt=\"Mubert &amp; Sila Sveta collaboration\" class=\"wp-image-1958\" srcset=\"https:\/\/mubert.com\/blog\/wp-content\/uploads\/2021\/11\/SILA_SVETA-1080x1080-1-1024x1024.jpg 1024w, https:\/\/mubert.com\/blog\/wp-content\/uploads\/2021\/11\/SILA_SVETA-1080x1080-1-300x300.jpg 300w, https:\/\/mubert.com\/blog\/wp-content\/uploads\/2021\/11\/SILA_SVETA-1080x1080-1-150x150.jpg 150w, https:\/\/mubert.com\/blog\/wp-content\/uploads\/2021\/11\/SILA_SVETA-1080x1080-1-768x768.jpg 768w, https:\/\/mubert.com\/blog\/wp-content\/uploads\/2021\/11\/SILA_SVETA-1080x1080-1-24x24.jpg 24w, https:\/\/mubert.com\/blog\/wp-content\/uploads\/2021\/11\/SILA_SVETA-1080x1080-1-48x48.jpg 48w, https:\/\/mubert.com\/blog\/wp-content\/uploads\/2021\/11\/SILA_SVETA-1080x1080-1-96x96.jpg 96w, https:\/\/mubert.com\/blog\/wp-content\/uploads\/2021\/11\/SILA_SVETA-1080x1080-1.jpg 1080w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><strong>Why it\u2019s important<\/strong>: 3D mapping is very popular entertainment that has a wide audience. \u201cBy contrasting AI and humans, several goals can be achieved \u2014 first, to show that AI is still far from the results that can be achieved by living artists, [which] can reassure people who are afraid of innovations,\u201d Paul shares. On the other hand, the result is something unique and interesting, so people get used to understanding AI as an artistic tool, and this can inspire them to take part in the development of technologies that will work for the good.<\/p>\n\n\n\n<p>As AI technologies advance, there will be more presentations of successful outcomes through art, and, as Mubert\u2019s CCO said earlier, people will perceive it more easily even as artificial intelligence gets closer to giving out more human-like results. \u201cIt is very important to show people that algorithms can be used to create something beautiful and that all our work is aimed at reducing the barrier that prevents people from revealing their creativity,\u201d Zgordan concludes. The use of AI will enable more people to make art while allowing them to create more complex art objects at the same time.<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"<p>The world\u2019s first 3D mapping battle between humans and AI took place during the Luma festival on September 10 and 11, 2021 in Binghamton, New York.<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":1954,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[74,37,34],"tags":[6,87],"class_list":["post-1953","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-collaborations","category-events","category-news","tag-collaborations","tag-news"],"aioseo_notices":[],"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/mubert.com\/blog\/wp-json\/wp\/v2\/posts\/1953","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mubert.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mubert.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mubert.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mubert.com\/blog\/wp-json\/wp\/v2\/comments?post=1953"}],"version-history":[{"count":6,"href":"https:\/\/mubert.com\/blog\/wp-json\/wp\/v2\/posts\/1953\/revisions"}],"predecessor-version":[{"id":2932,"href":"https:\/\/mubert.com\/blog\/wp-json\/wp\/v2\/posts\/1953\/revisions\/2932"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mubert.com\/blog\/wp-json\/wp\/v2\/media\/1954"}],"wp:attachment":[{"href":"https:\/\/mubert.com\/blog\/wp-json\/wp\/v2\/media?parent=1953"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mubert.com\/blog\/wp-json\/wp\/v2\/categories?post=1953"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mubert.com\/blog\/wp-json\/wp\/v2\/tags?post=1953"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}