{"id":48,"date":"2021-03-28T12:30:33","date_gmt":"2021-03-28T12:30:33","guid":{"rendered":"https:\/\/ainsleyphillipsprojects.com\/blog\/?p=48"},"modified":"2021-03-30T07:10:08","modified_gmt":"2021-03-30T07:10:08","slug":"the-first-instruments","status":"publish","type":"post","link":"https:\/\/ainsleyphillipsprojects.com\/blog\/2021\/03\/28\/the-first-instruments\/","title":{"rendered":"The First Instruments"},"content":{"rendered":"\n<p>I\u2019m building each instrument individually in Isadora. I want to make sure they all work on their own and then I\u2019ll start to try out different configurations in Isadora to put them together and create the audio visual jamming tool. In my work, I create by layering video, images and sound &#8211; so thinking about the individual instruments as the creators of a layer makes sense to me. So that the tool will contain instruments that offer different ways to create layers that form the projected output. Of course, some of the instruments use layering themselves . . . layers within layers, then. All good.<\/p>\n\n\n\n<p>I want to focus on getting each instrument to be as simple as possible in terms of the Isadora set-up and also what the physical interface looks like. In Isadora they need to run using as little computer resources as possible, so everything runs smoothly together. As physical interfaces they need to be easy to understand and access \u2013 I feel like it\u2019s important to make them friendly looking, like something anyone can have a go with.<\/p>\n\n\n\n<p>I\u2019ll include images of the Isadora setup, the physical interface and an example of the output, as I talk about the instruments. At this point, I\u2019m looking to see how I can put things together and identify any potential problems. The output of the jams is to video which will be projected in the jamming space. All thoughts and comments (including \u2018What on earth do you think you\u2019re doing?\u2019) warmly welcomed. Here\u2019s the first two instruments:<\/p>\n\n\n\n<div style=\"height:1px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p><strong>The Video Mixer<\/strong><\/p>\n\n\n\n<p>Mixing layers of video is core to my own practice, so first up I wanted to make an instrument to mix videos. This is an instrument to mix 8 videos. The videos are short loops \u2013 so the imagery is focused on symbolism, colour, form and texture, rather than narrative, although short spurts of narrative action would be possible. In terms of participatory projects, the idea is to be able to load participants video into the instrument \u2013 after I\u2019ve re-encoded it to play nicely in Isadora.<\/p>\n\n\n\n<p>The hardware is an Akai LPD8 with 8 pads and 8 swivel knobs (this controller has useful software to alter the functions of it\u2019s pads and knobs). I\u2019ve added number stickers to the pads and knobs, as I found myself counting to ID controllers when I was trying the interface out. I do think this helps and I also plan to make a printed layout card with space for a thumbnail still printout from each video so the player has a real world visual identifier for each video.<\/p>\n\n\n\n<p>In Isadora I\u2019ve set-up the knobs to control the opacity of each video and the pads to switch a Desaturate filter on and off (fully saturated \/ 50% desaturated). Once I start to explore using the instruments together, I\u2019ll need to consider where the videos sit layer wise with the other still image and generative elements. Building this has also highlighted that running eight videos at once is resources intensive, as I go forward I\u2019ll need to consider options around reducing the resolution of the videos or reducing the number of videos in play at any one time.<\/p>\n\n\n\n<div style=\"height:1px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"298\" src=\"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Video-Mixer.jpg?resize=800%2C298&#038;ssl=1\" alt=\"\" class=\"wp-image-50\" srcset=\"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Video-Mixer.jpg?w=1000&amp;ssl=1 1000w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Video-Mixer.jpg?resize=300%2C112&amp;ssl=1 300w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Video-Mixer.jpg?resize=768%2C286&amp;ssl=1 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption>Physical interface for Video Mixer<\/figcaption><\/figure>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"305\" src=\"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Video-Mixer-Isadora-Setup_closeup-1.png?resize=800%2C305&#038;ssl=1\" alt=\"\" class=\"wp-image-51\" srcset=\"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Video-Mixer-Isadora-Setup_closeup-1.png?resize=1024%2C391&amp;ssl=1 1024w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Video-Mixer-Isadora-Setup_closeup-1.png?resize=300%2C114&amp;ssl=1 300w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Video-Mixer-Isadora-Setup_closeup-1.png?resize=768%2C293&amp;ssl=1 768w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Video-Mixer-Isadora-Setup_closeup-1.png?w=1266&amp;ssl=1 1266w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption>Isadora set-up for Video Mixer (x 8)<\/figcaption><\/figure>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-vimeo wp-block-embed-vimeo wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Video Mixer example output.mp4\" src=\"https:\/\/player.vimeo.com\/video\/529755774?dnt=1&amp;app_id=122963\" width=\"800\" height=\"450\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><figcaption>Example video output from Video Mixer<\/figcaption><\/figure>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p><strong>The Image Mixer<\/strong><\/p>\n\n\n\n<p>An instrument to mix 8 still images. Here I wanted to make something that can enable collage creation, I wanted the images to be able to sit on top of each other, but also alongside each other. Like the videos, participants will be invited to get their images into the instrument for jamming. I make the images 1920 x 1080 px at 150 dpi (to allow for zooming)<\/p>\n\n\n\n<p>The hardware is a Korg NanoKontrol2 with 8 sliders, 8 knobs and three press buttons for each slider\/knob. This controller also has some buttons on the left hand panel which I may bring into play as I experiment but I haven\u2019t as yet \u2013 I may decide to cover these buttons somehow if they\u2019re not going to be used, to simplify the interface. I\u2019ve numbered each track (or image) for clarity.<\/p>\n\n\n\n<p>In Isadora I\u2019ve set-up the sliders to alter the opacity and the knobs to alter the size of each image (from 30% to 200%). To discourage too much intense focus on exact positioning, I\u2019ve decided to make the position selector a button (\u2018R\u2019) that selects a random position. The \u2018S\u2019 button switches blur on and off and the \u2018M\u2019 button switches a 50% Desaturation filter on and off. I\u2019ve made image 1 a base layer image that can\u2019t be zoomed out beyond 100%, so that, as long as this instrument is being used, this image will form the canvas.<\/p>\n\n\n\n<div style=\"height:1px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"272\" src=\"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Image-Mixer.jpg?resize=800%2C272&#038;ssl=1\" alt=\"\" class=\"wp-image-56\" srcset=\"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Image-Mixer.jpg?w=1000&amp;ssl=1 1000w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Image-Mixer.jpg?resize=300%2C102&amp;ssl=1 300w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Image-Mixer.jpg?resize=768%2C261&amp;ssl=1 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption>Physical inteface for Image Mixer<\/figcaption><\/figure>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"450\" src=\"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Image-Mixer-Isadora-Setup_closeup.png?resize=800%2C450&#038;ssl=1\" alt=\"\" class=\"wp-image-55\" srcset=\"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Image-Mixer-Isadora-Setup_closeup.png?resize=1024%2C576&amp;ssl=1 1024w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Image-Mixer-Isadora-Setup_closeup.png?resize=300%2C169&amp;ssl=1 300w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Image-Mixer-Isadora-Setup_closeup.png?resize=768%2C432&amp;ssl=1 768w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Image-Mixer-Isadora-Setup_closeup.png?resize=1536%2C864&amp;ssl=1 1536w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Image-Mixer-Isadora-Setup_closeup.png?w=1920&amp;ssl=1 1920w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/Image-Mixer-Isadora-Setup_closeup.png?w=1600&amp;ssl=1 1600w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption>Isadora set-up for Image Mixer (using DX \u2013 KORG NANOKONTROL2 user plugin)<\/figcaption><\/figure>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"500\" src=\"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/IsadoraTemp21032113253701.jpg?resize=800%2C500&#038;ssl=1\" alt=\"\" class=\"wp-image-57\" srcset=\"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/IsadoraTemp21032113253701.jpg?resize=1024%2C640&amp;ssl=1 1024w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/IsadoraTemp21032113253701.jpg?resize=300%2C188&amp;ssl=1 300w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/IsadoraTemp21032113253701.jpg?resize=768%2C480&amp;ssl=1 768w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/IsadoraTemp21032113253701.jpg?resize=480%2C300&amp;ssl=1 480w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/IsadoraTemp21032113253701.jpg?resize=640%2C400&amp;ssl=1 640w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/IsadoraTemp21032113253701.jpg?w=1440&amp;ssl=1 1440w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption>Example still from Image Mixer output<\/figcaption><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>In my work, I create by layering video, images and sound &#8211; so thinking about the individual instruments as the creators of a layer makes sense to me. <\/p>\n","protected":false},"author":1,"featured_media":57,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[3,16,10,9],"tags":[15,11,13],"class_list":["post-48","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-av-jamming","category-av-jamming-instruments","category-isadora","category-jamming-tool","tag-audio-visual-jamming-2","tag-isadora","tag-isadora-software"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/IsadoraTemp21032113253701.jpg?fit=1440%2C900&ssl=1","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/posts\/48","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/comments?post=48"}],"version-history":[{"count":7,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/posts\/48\/revisions"}],"predecessor-version":[{"id":61,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/posts\/48\/revisions\/61"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/media\/57"}],"wp:attachment":[{"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/media?parent=48"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/categories?post=48"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/tags?post=48"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}