Orchestral Stem Separation: Classical Music in the AI Era

Orchestral music presents the hardest possible challenge for AI stem separation. Strings, brass, woodwinds, and percussion all share harmonic space in ways that are fundamentally different from a pop record. Yet the results are often surprising — and always illuminating.

Why Classical Music Is Harder

The Demucs model was trained primarily on popular music — rock, pop, electronic, jazz. These genres have relatively clear instrument separation by convention (drums in the low-mid, guitars in the mid, vocals above). Orchestral music doesn't follow these conventions. A French horn can be in the same frequency range as a cello section, which overlaps with the viola section, which overlaps with the bass clarinet.

Moreover, the "four stem" model (vocals, drums, bass, other) maps poorly to orchestral forces. What is "vocals" in a Beethoven symphony? What is "bass"? The model answers these questions based on frequency and temporal patterns, not on musical intent.

What You Can Expect

When you extract from a classical recording:

• Vocals stem — may capture solo instruments in the high register (solo violin, oboe, flute) as well as any choral elements
• Drums stem — timpani and percussion are often isolated reasonably well, though with bleed from low brass
• Bass stem — double bass section and bass trombone/tuba often appear here
• Other — the bulk of the orchestra

Why It's Still Worth Trying

Even with imperfect separation, the orchestral stems can be musically interesting. Producers have found unexpected gold in misclassified orchestral stems — a strings-and-brass blend that was partially separated creates textural sounds that no synthesizer or sample library matches. These "impure" stems become raw material for something genuinely new.

Practical Use: Film Scoring and Trailer Music

Film composers and trailer music producers often need orchestral stems for mockup work or layering. Using AI separation on reference recordings — not for release, but for workflow purposes — can give you a rough sense of the arrangement decisions without transcribing every line by ear. This is a legitimate use case for personal, non-commercial work.

Copyright in Classical Recordings

Note: the copyright in a classical recording is separate from the copyright in the composition. A Brahms symphony is out of copyright as a composition — but the 2019 Berlin Philharmonic recording of that symphony is still protected as a sound recording. You can freely transcribe, analyze, and study the music; you cannot freely distribute stems of a recent commercial recording.