🎵 CodeSonify — Hear Your Code

Every line of code has a melody. CodeSonify transforms source code into real music. Functions become melodies, loops become rhythms, conditionals become chord changes, and bugs sound dissonant. Export to MIDI, sonify git diffs, and hear the evolution of your codebase — all integrated into GitHub Copilot via MCP.

🎬 Demo

📹 Watch the demo video →

Try it yourself: Clone the repo, run npm start, and open http://localhost:3000

🌟 Features

🎵 Code → Music Engine

Paste any code — JavaScript, TypeScript, Python, Java, C#, Go, Rust — and hear it as music. Each programming construct maps to a distinct musical element:

🎹 MIDI Export

Export any sonification as a real .mid file that opens in GarageBand, FL Studio, Ableton, Logic Pro, or any DAW. Your code becomes real, editable, shareable music.

🔄 Diff Sonification

Sonify git diffs and code changes:

• Added lines → Bright, ascending melodies in major key
• Removed lines → Dark, descending bass in minor key
• Context → Soft ambient background
• Hear a refactoring as a musical journey from tension to resolution

🎨 5 Musical Styles

🔧 MCP Server — 5 Tools for GitHub Copilot

CodeSonify integrates directly into VS Code via MCP, giving GitHub Copilot 5 powerful tools:

🌐 Web Application

A polished, real-time web interface featuring:

• Code editor with syntax highlighting
• Real-time canvas visualization with animated note particles
• Live audio playback using Tone.js Web Audio synthesis
• Stats dashboard showing tempo, key, complexity, notes, duration, tracks
• Track breakdown with per-instrument volume bars
• Musical interpretation — human-readable description of what the music represents
• Diff Mode — compare old vs new code versions visually and musically
• MIDI download — one-click export to .mid file

🚀 Quick Start

Prerequisites

• Node.js v18 or later
• VS Code with GitHub Copilot (for MCP integration)

Installation

# Clone the repository
git clone https://github.com/YOUR_USERNAME/codesonify.git
cd codesonify

# Install dependencies
npm install

# Start the web application
npm start

Open http://localhost:3000 in your browser. Paste code, pick a style, and click Sonify Code. 🎵

Using the MCP Server with GitHub Copilot

1. Open the project folder in VS Code
2. Open .vscode/mcp.json — click the "Start" button that appears
3. Open Copilot Chat (Ctrl+Shift+I) → switch to Agent Mode
4. Try these prompts:

Sonify this code: function fibonacci(n) { if (n <= 1) return n; return fibonacci(n-1) + fibonacci(n-2); }

Analyze the code structure of my current file

Export this as MIDI: const greet = (name) => console.log(`Hello ${name}`)

Sonify the diff between these: 
Old: "function add(a,b) { return a+b; }"  
New: "const add = (a: number, b: number): number => a + b;"

📁 Project Structure

codesonify/
├── src/
│   ├── core/                  # Core analysis and music engine
│   │   ├── types.ts           # TypeScript type definitions (40+ types)
│   │   ├── parser.ts          # Code structure analyzer & tokenizer
│   │   ├── mapper.ts          # Code-to-music mapping engine (8 scales, 5 styles)
│   │   ├── composer.ts        # Composition orchestrator
│   │   ├── midi.ts            # Pure TypeScript MIDI file generator (zero dependencies)
│   │   ├── diff.ts            # Git diff parser & sonification engine
│   │   └── index.ts           # Module exports
│   ├── mcp/                   # MCP Server for VS Code / GitHub Copilot
│   │   └── index.ts           # MCP server with 5 tools
│   └── web/                   # Web application
│       ├── server.ts          # Express API server (5 endpoints)
│       └── public/
│           └── index.html     # Frontend (Tone.js + Canvas visualization)
├── docs/
│   └── copilot-usage/         # Screenshots of GitHub Copilot usage
├── .vscode/
│   └── mcp.json               # MCP server configuration for VS Code
├── .gitignore
├── package.json
├── tsconfig.json
├── LICENSE
└── README.md

🤖 GitHub Copilot Usage

GitHub Copilot was instrumental throughout the entire development of CodeSonify. Here's how AI-assisted development shaped this project:

🧠 Architecture & Design (Copilot Chat)

• Brainstormed the mapping between programming constructs and musical elements
• Designed the TypeScript type system with 40+ types for code analysis and music composition
• Explored which musical scales best represent each programming language
• Debugged audio timing issues with Tone.js Web Audio API

⚡ Code Acceleration (Copilot Suggestions)

• Auto-completed musical scale definitions (major, minor, pentatonic, blues, dorian, mixolydian, lydian, chromatic)
• Generated Express route handlers with input validation
• Suggested the canvas visualization algorithm for animated note particles
• Completed the MIDI binary format implementation (variable-length quantities, track chunks)

🎨 Creative Exploration

• Used Copilot to explore different approaches to code complexity scoring
• Generated example code snippets that showcase diverse musical outputs
• Helped design the diff-to-music mapping logic (ascending = additions, descending = deletions)

🔧 MCP Server Development

• Copilot Chat helped structure the MCP tool definitions with proper Zod schemas
• Generated the formatted markdown output for each tool response
• Assisted with the comparison table formatting in compare_code_musically

📸 Screenshots of these interactions are in docs/copilot-usage/

🔌 API Reference

POST /api/sonify

Transform code into music.

Request:

{
  "code": "function hello() { console.log('world'); }",
  "language": "javascript",
  "style": "classical"
}

Response: Full composition with tracks, notes, analysis, and visualization data.

POST /api/export-midi

Export code as a downloadable MIDI file.

Request: Same as /api/sonify

Response: Binary .mid file download.

POST /api/sonify-diff

Sonify code changes.

Request:

{
  "old_code": "function add(a,b) { return a+b; }",
  "new_code": "const add = (a: number, b: number): number => a + b;",
  "style": "electronic"
}

GET /api/examples

Get example code snippets for demo.

GET /api/health

Health check.

🏆 Evaluation Criteria Alignment

🛠️ Technologies

🎯 Use Cases

1. Code Review — Sonify a pull request diff and hear if the changes feel harmonious or chaotic
2. Education — Help students understand code structure through musical metaphor
3. Accessibility — Provide auditory feedback for visually impaired developers
4. Team Building — Turn your team's code into a collaborative soundtrack
5. Art — Generate music from open-source projects and create "code albums"
6. Quality Monitoring — Complexity score as tempo: if your code sounds like speed metal, maybe refactor

📝 License

MIT License — free to use, modify, and distribute.

🙏 Acknowledgments

• Built for Agents League 2026 by Microsoft
• Powered by GitHub Copilot
• Audio synthesis by Tone.js
• MCP integration via @modelcontextprotocol/sdk