{"id":40,"date":"2021-03-20T11:13:33","date_gmt":"2021-03-20T11:13:33","guid":{"rendered":"https:\/\/ainsleyphillipsprojects.com\/blog\/?p=40"},"modified":"2021-03-20T11:13:33","modified_gmt":"2021-03-20T11:13:33","slug":"plans-to-create-a-tool-for-audio-visual-jamming","status":"publish","type":"post","link":"https:\/\/ainsleyphillipsprojects.com\/blog\/2021\/03\/20\/plans-to-create-a-tool-for-audio-visual-jamming\/","title":{"rendered":"Plans to Create a Tool for Audio Visual Jamming"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"527\" src=\"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/MIDI-controllers.jpg?resize=800%2C527&#038;ssl=1\" alt=\"\" class=\"wp-image-44\" srcset=\"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/MIDI-controllers.jpg?w=1000&amp;ssl=1 1000w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/MIDI-controllers.jpg?resize=300%2C198&amp;ssl=1 300w, https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/MIDI-controllers.jpg?resize=768%2C506&amp;ssl=1 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/figure>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"has-normal-font-size\">Our current focus in the studio is on developing a tool to facilitate audio visual jamming. This is something we started to explore with the <a href=\"https:\/\/ainsleyphillipsprojects.com\/inside-out.html\">Lochgelly project<\/a> last year. That project was our first time using Isadora software to make a space to enable interactive exploration of sound and video. We had some MIDI controllers and webcams as controls and live video\/sound inputs into an Isadora setup with the output projected onto a wall. It made for an exciting and chaotic space. We only managed a six week run of open studio afternoon sessions before everything closed down. And not being able to work alongside people since then has meant everything\u2019s been on hold with this project for a year. A year when we\u2019ve been working with care homes to develop resources to support front line care staff to get co-creative stuff happening themselves with our <a href=\"https:\/\/ainsleyphillipsprojects.com\/jam-today.html\">Jam Today<\/a> project (but that\u2019s another story).<\/p>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"has-normal-font-size\"><strong>Moving Forward<\/strong><\/p>\n\n\n\n<p class=\"has-normal-font-size\">With spring 2021 upon us and the hope of things opening up once more later this year, now seems like a great time to get back into figuring out how to use Isadora to make a functional and accessible A-V jamming tool to use in sessions. Our initial sessions in Lochgelly highlighted for me the importance of creating some sort of clear order for the jamming to happen inside of. For these sessions, I\u2019d created minimal order, focusing instead on maximum possibilities \u2013 all that lovely chaos and fluidity, but it is possible to have too much of a good thing. When you want to make an activity accessible and friendly, order does help. The people who joined us for a jam did join in and have a good time, but I do think that I can improve things \u2013 both in terms of the co-creative experience, and the audio visual stuff we all make together &#8211; by making something more structured. Also, it was all a bit exciting (stressful) for me never quite knowing how everything with the hardware devices and software would interact together as we delivered the sessions. Time to embrace a little order.<\/p>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"has-normal-font-size\"><strong>The Back Story<\/strong><\/p>\n\n\n\n<p class=\"has-normal-font-size\">In my practice, I create video and sound work using other people\u2019s software and I\u2019ve long been curious about trying some creative coding myself. I do plan to explore some coding \u2013 I\u2019ve learnt HTML and CSS to build this site as a first step and I want to learn about Processing and explore the possibilities of building interactive input devices using Arduino. This is a longer term plan and I\u2019m not prepared to wait until I\u2019ve learnt to code to be able to dig in with creating our jamming tool. So, this is where Isadora comes in. The idea behind the software \u2013 created by musician Mark Coniglio \u2013 is to offer creative practitioners a tool to put together creative software spaces without the need to code things themselves. Ideal for me, right now. \u00a0<\/p>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"has-normal-font-size\"><strong>The Plan<\/strong><\/p>\n\n\n\n<p class=\"has-normal-font-size\">I\u2019m going to write (at least) weekly here on the blog as I develop the tool, as a way to think things through as I learn and experiment. Isadora works by giving you building blocks (actors) that interact with each other and with inputs from devices (like MIDI controllers and drawing tablets) and sources (like webcams and mics). It\u2019s all about interaction. It offers a massive range of possibilities and I know that a big challenge for me will be to reign-in everything I\u2019d like to build \u2013 and so avoid a big pile of controllers and wires and the possibility of creating stuff that looks and sounds just messy. So, the plan is to focus first on building individual A-V jamming instruments that are stable and accessible. What I\u2019m looking to do is create instruments that will impact the projected video output in real time. Some will also have an audio element. The video imagery will consist of layers of recorded video, still images, live video input and generated elements \u2013 you see the potential for chaos! Pre-recorded video, still image and audio resource slots will be available to load participants material.\u00a0 The musical input into the jam will mainly happen live in the space with acoustic instruments.<\/p>\n\n\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"has-normal-font-size\"><strong>The Potential Instruments<\/strong><\/p>\n\n\n\n<p class=\"has-normal-font-size\">Here\u2019s the wish list for now (I\u2019ll write here about them as I put them together):<\/p>\n\n\n\n<ul class=\"has-normal-font-size wp-block-list\"><li>A Soundscape\/Texture Keyboard \u2013 using a small 25 key MIDI keyboard to trigger individual (looped and single-shot) sounds that can be played together in real time. The keys will also trigger still images to create a visual texture layer.<\/li><li>A Coloured Shapes Keyboard \u2013 using a small 25 key MIDI keyboard to trigger and manipulate generated coloured squares, altering size, colour, position and opacity.<\/li><li>A Live Drawing Tablet \u2013 using a tablet with pen input and programmable buttons to draw onto the video output.<\/li><li>A Picture Mixer \u2013 using a Korg NanoKontrol2 MIDI device to mix 8 still images \u2013 altering size, position and opacity of each, output to a picture layer.<\/li><li>A Video Mixer \u2013 using an Akai LPD8 MIDI controller to select and mix 8 videos.<\/li><li>A Sharing Stuff Webcam \u2013 using a webcam to offer the ability to share things visually in real time, output to the screen<\/li><\/ul>\n\n\n\n<p class=\"has-normal-font-size\">I also want to explore how to use webcams to capture sound and movement in the space and how this may impact on the visual output. And how to use mics to allow specific directional input of sounds in the space and how these may impact on the visuals. All quite vague with these as of now. I do have a Kinnect movement sensor that I\u2019ll be having a play with too \u2013 apparently these work well with Isadora.<\/p>\n\n\n\n<p class=\"has-normal-font-size\">Early days, but keen to get cracking.<\/p>\n\n\n\n<p class=\"has-normal-font-size\">Find out more about Isadora on the Troikatronix website here: \u00a0<a rel=\"noreferrer noopener\" href=\"https:\/\/troikatronix.com\/\" target=\"_blank\">https:\/\/troikatronix.com\/<\/a><\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"has-normal-font-size\">Emma<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Our current focus in the studio is on developing a tool to facilitate audio visual jamming. <\/p>\n","protected":false},"author":1,"featured_media":44,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[3,10,9],"tags":[15,11,13,14],"class_list":["post-40","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-av-jamming","category-isadora","category-jamming-tool","tag-audio-visual-jamming-2","tag-isadora","tag-isadora-software","tag-troikatronix"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/ainsleyphillipsprojects.com\/blog\/wp-content\/uploads\/2021\/03\/MIDI-controllers.jpg?fit=1000%2C659&ssl=1","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/posts\/40","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/comments?post=40"}],"version-history":[{"count":4,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/posts\/40\/revisions"}],"predecessor-version":[{"id":46,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/posts\/40\/revisions\/46"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/media\/44"}],"wp:attachment":[{"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/media?parent=40"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/categories?post=40"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ainsleyphillipsprojects.com\/blog\/wp-json\/wp\/v2\/tags?post=40"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}