My current challenge is to find ways to connect Grotto to a gallery space for my final show. I’d like to avoid falling into the same pattern of “Thing projected on a wall” that you see at a lot of these shows. So far I have been concentrating on esp32 microcontrollers or headless raspberry pi’s that can get information from Grotto’s API. I’d like to use lights and sounds and weird tactile interfaces as much as possible.
I have a few ideas I’ve been researching-
- I’ve imagined a doorknob mounted on a rotary encoder as a novel way to move a character around in the game. an esp32 gets player information from Grotto with the security token. It pulls the connected exits from the current room. rotating the encoder cycles through the doors, visualized by an rgb led inside a keyhole (exits have rgb color values in Grotto). The doorknob is connected to a cog/ratchet/solenoid lock assembly- if the “door” is locked, the solenoid locks the cog, otherwise the knob can be turned, flipping a limit switch that sends a command to Grotto to enter the connecting room. A bright RGB light fills the gallery space with the color of the current room.
where this is at:
surprisingly I was able to get json from the grotto api on the esp32 pretty quickly (sometimes different platforms act sticky about the auth token). I now can cycle through exits with the rotary encoder (and change a neopixel led color to match each door), and button presses with the limit switch working. I don’t have the solenoid lock working yet (I’ve tested the part though) and I don’t have sending the use exit command done yet. I also have multiple functions firing off at different times in the circuitpython sketch for the esp32 (I switched from arduino to circuitpython because https never worked on the arduino), and I don’t know how to get them to work properly (they currently both fire off when the longest timer runs out) ask Chandler about this
Here’s the circuitpython code-
hardware wise- I have laser cut some mdf cogs and a ratchet, I’m currently gluing a little spring piece to keep the lightweight mdf ratchet in place. I need to secure the knob axel(?) on the side opposite of the knob, but there’s no nut metric or customary that seems to fit it. Once I have this prototype working well, I’ll 3d model the assembly and cut aluminum parts, then a wooden housing. I imagined the housing to be shaped like a prism stood on one end, and the wood of the base to be riddled with termite damage-like patterns.
Why any of this??
I like the idea of a doorknob as a game controller for a game that gives feedback without a screen (or maybe a minimal screen like e-ink or a led matrix). There’s the touch sensation of the knob (I have antique knobs given to me by my mother with family history and interesting weight and touch). There’s the familiar action of turning it. but the ‘door’ must be imagined. heavy crockery doorknob my uncle gave my mother at my grandmother’s funeral
- Related to the doorknob (“the phantom doorknob”), It would be great to have detailed audio feedback as well as rgb lighting to give an impression of the room in the game. I’ve been experimenting with sonic pi, which presumably should be able to connect to Grotto’s api, get information about the current room, and then play loops at different volume and with varying reverb as a result.
where this is at: This is new to me and it’s been a while since I tried writing any ruby. The sonic pi sketch isn’t connecting to the API and I can’t tell if it’s because of the authentication token or not. Here’s what my program looks like now, (with a redacted auth token)
When I run this I get:
*Runtime Error: [buffer 0, line 17] - Errno::ENOENT
No such file or directory @ rb_sysopen - https://www.mudroom.rip/api/v1/game/tableau/* (I tried the url with and without
?format=json at the end)
Which I guess could be the auth token bouncing, but it’s formatted just like it is in my old unity project Mud Room, which works.
- Working off the idea that I avoid using overkill computers with displays, I had started using Sonic Pi because it could be run on my Rpi 4. I liked the idea of having multi-channel audio in the space, so I did a little investigating and found that a cheap usb audio interface could be used for surround sound. Unfortunately the surround sound speakers DMA has to test with have digital in only, and after more time experimenting than I would have liked, I found out that my usb audio device only does surround through phone jacks and its optical output just does stereo. I could keep pursuing this with some different speakers, but my concern is that when I run speaker-test a couple of times in a row on the rpi, it sometimes gives me a
playback open error: -16,Device or resource busywhich doesn’t inspire confidence.
So- the path of least resistance here is to submit to having a ‘real’ computer as part of the piece. Since api calls work fine in unity and presumably unity knows what to do with surround sound speakers, I could just build the audio part in unity, and if I end up needing some projection visuals too I can add those to the new unity project, which would already have a lot of work already done since I could reuse code from Mud Room. I know it’s the best way forward but it’s a little disappointing.
- I’d like to have elements of the past two shows in the gallery, and I was thinking of replacing the overhead projector from Archon with this thing- It’s an antique opaque projector, meaning I don’t need to make transparency slides for it, you could just stick a book in it (I’d like to make a book for this show like I did for Archon) The bulb that is in it is faint though. I did a brief test with Ariel and stuck very powerful LED’s in it, which worked well, and were cooler than the original incandescent bulb.
where I’m at with this- I have to wire up the led’s and figure out how to mount them inside, then I’d like to cut another wood pedestal with a built-in bookshelf in it, like in Archon
- Print book- This seems not too hard. New output from my tilepaintings/wave function collapse + my thesis writing in a book, like a big version of the Archon book. It’d be nice to have some fold-out pages and other design features.
- set up a new unity project based on Mud Room with 5.1 audio output
- get the solenoid lock working on the esp32
- get the use exit api post working in the circuitpython sketch for the esp32
- figure out how to have coroutines working on different timers in circuitpython ask Chandler
- find a way to secure the doorknob
- make a pedestal for the opaque projector
- supercharge the opaque projector
- start laying out the new book