Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
Jam: Collaborative AI Live-Coding Music
Experience live-coding music and visuals where agents generate hot-reloadable micro-apps on the fly, seamlessly integrating new instruments and effects into a collaborative jam.
Jam is a local-first live-coding music venue that runs in the browser: a shared 2D canvas where every instrument, sequencer, shader, and visualizer is a hot-reloadable micro-app that coding agents write and edit while the music is playing.
Everyone in the physical room joins the same jam over LAN; one laptop is the host and feeds the speakers/projector, while every other client connects. You ask a server-side agent (“build me a 909 drum machine”, “add an acid bassline”, “connect that LFO to the synth filter”), it writes code that is hot-reloaded on the next bar boundary.
What I’ll show live:
Begin writing music and visuals using domain specific languages Strudel and Hydra. Music plays. Prompt → agent writes an element file → bar-aligned hot-reload into a running track, no audio dropout. The jam evolves.
Depending on sandboxing, I will invite the audience to connect to my IP address, join the jam and prompt anything they want or write Strudel/Hydra code.
Collaborative Web Audio/canvas live-coding venue using local-network hot-reloaded agents.
- ClaudeClaude is Anthropic's flagship family of large language models (LLMs): a high-performance, Constitutional AI system built for safety, complex reasoning, and expert-level collaboration.Claude is a next-generation AI assistant developed by Anthropic, a research firm prioritizing AI safety. The models (including Opus, Sonnet, and Haiku) leverage Constitutional AI to ensure helpful, honest, and harmless outputs, a key differentiator from competitors. Claude excels at complex enterprise tasks: processing massive context windows for in-depth data analysis, generating and reviewing code, and providing expert-level summarization for documents up to 200,000 tokens. It is deployed as a conversational chatbot and via API, offering scalable AI solutions for developers and businesses.
- Web AudioA high-performance browser API for synthesizing, routing, and manipulating audio directly in the web browser.The Web Audio API gives developers precise control over audio operations inside an AudioContext, using a modular routing graph of AudioNodes to link sources to destinations. You can generate sound effects with oscillators, apply real-time spatial effects (like 3D panning), and extract frequency data using the AnalyserNode for visualizers. Because the heavy lifting runs on optimized, low-level browser code (often written in C++), it handles complex audio processing and synthesis with minimal latency, making it the standard choice for web-based games, interactive music apps, and digital audio workstations.
- YjsA high-performance CRDT implementation for building local-first, real-time collaborative applications.Yjs enables seamless shared state across distributed clients using Conflict-free Replicated Data Types (CRDTs). It powers collaborative features in platforms like JupyterLab and Hocuspocus by syncing data types (arrays, maps, and text) with sub-millisecond local updates. The framework remains network-agnostic: you can plug it into WebRTC, WebSocket, or Matrix providers to handle concurrency without a central authority. Its performance scales to thousands of operations per second, making it the industry standard for robust, conflict-free peer-to-peer synchronization.
- HydraHydra is an open-source Python framework that simplifies the development of complex applications by dynamically composing hierarchical configurations.Developed by Meta Research, Hydra eliminates the boilerplate code typically required for command-line argument parsing and logging. It allows you to compose your application's configuration from multiple sources (files or the command line) just before execution, making it a staple for machine learning experiments where hyperparameters change frequently. Key features like the Multirun flag enable you to launch dozens of jobs with varying parameters using a single command, while its pluggable architecture supports seamless integration with remote launchers like Slurm or AWS. By providing type safety through OmegaConf and dynamic tab completion in the shell, Hydra ensures that scaling from a local script to a distributed cluster remains efficient and error-free.
- Web MIDIA browser API that connects web applications directly to physical MIDI hardware (like synthesizers and controllers) over USB, Bluetooth, or virtual ports.The Web MIDI API bridges the gap between web applications and physical music hardware by enabling direct, low-level communication with MIDI devices. Using the `navigator.requestMIDIAccess()` method in secure contexts (HTTPS), developers can query connected hardware, listen to incoming performance data (such as note-on messages and pitch-bend values), and transmit outbound system-exclusive (SysEx) commands. This standard turns the browser into a fully functional host for web-based synthesizers, digital audio workstations, lighting controllers, and interactive physical installations.