Create new stems for Unmix Stems

Post questions and find answers on the latest SpectraLayers release here.
Post Reply
edwardkort
New Member
Posts: 5
Joined: Tue Dec 13, 2016 7:25 pm
Contact:

Create new stems for Unmix Stems

Post by edwardkort »

Is there any capability to create different stem types (like guitar, flute, etc.) for use in the Unmix Stems procedure? If not now, any plans for the future?

Thanks,
Edward Kort

Robin Lobel
Moderator
Posts: 469
Joined: Wed Jul 03, 2019 3:39 pm
Contact:

Re: Create new stems for Unmix Stems

Post by Robin Lobel »

These unmixing process are driven by deep learning AI models, which requires thousands of examples for each instrument and days of computing to train proper separation model. Experiments were made to train it on flute and guitar, but unfortunately it does not work as well as flute is pretty close to vocals in term of spectral signature, and guitar spectral signature is so wide that it's hard to properly capture it and discriminate it from say piano for instance. That being said, it may evolve in the future.
Robin Lobel - SpectraLayers creator and lead developer

edwardkort
New Member
Posts: 5
Joined: Tue Dec 13, 2016 7:25 pm
Contact:

Re: Create new stems for Unmix Stems

Post by edwardkort »

Thank you for the quick reply.

Cheers,
Edward Kort

nkf
Member
Posts: 289
Joined: Fri Jan 07, 2011 12:49 am
Contact:

Re: Create new stems for Unmix Stems

Post by nkf »

Robin Lobel wrote:
Mon Aug 03, 2020 6:18 pm
These unmixing process are driven by deep learning AI models, which requires thousands of examples for each instrument and days of computing to train proper separation model. Experiments were made to train it on flute and guitar, but unfortunately it does not work as well as flute is pretty close to vocals in term of spectral signature, and guitar spectral signature is so wide that it's hard to properly capture it and discriminate it from say piano for instance. That being said, it may evolve in the future.
I just want to say, that I appreciate these kind of answers from a developer - no nonsensical promises, but straight to the facts and limitations of the technology. Well done.

User avatar
HowlingUlf
Senior Member
Posts: 2244
Joined: Wed Dec 15, 2010 4:58 pm
Contact:

Re: Create new stems for Unmix Stems

Post by HowlingUlf »

nkf wrote:
Mon Aug 03, 2020 9:08 pm
Robin Lobel wrote:
Mon Aug 03, 2020 6:18 pm
These unmixing process are driven by deep learning AI models, which requires thousands of examples for each instrument and days of computing to train proper separation model. Experiments were made to train it on flute and guitar, but unfortunately it does not work as well as flute is pretty close to vocals in term of spectral signature, and guitar spectral signature is so wide that it's hard to properly capture it and discriminate it from say piano for instance. That being said, it may evolve in the future.
I just want to say, that I appreciate these kind of answers from a developer - no nonsensical promises, but straight to the facts and limitations of the technology. Well done.
Yepp! Now we know that! 8-)
Gothenburg, Sweden
Steinberg Cubase Pro 11 | Steinberg WaveLab 10 | Steinberg Absolute 4 | Steinberg SpectralLayers 7
Win10 Pro | ASUS ATX Z170-P | Intel Core i7-6700K Skylake | 32GB RAM |
Steinberg Midex8 | Steinberg UR824 | Nektar Panorama P6 | Akai MPD218 |

JesusSheep00a
New Member
Posts: 26
Joined: Wed Jul 15, 2020 3:31 pm
Contact:

Re: Create new stems for Unmix Stems

Post by JesusSheep00a »

Robin Seems to have Mic Bleed .Instruments are getting left in Vocal Layer.

Robin Lobel
Moderator
Posts: 469
Joined: Wed Jul 03, 2019 3:39 pm
Contact:

Re: Create new stems for Unmix Stems

Post by Robin Lobel »

A future update could add sensitivity parameters for each instrument.
Robin Lobel - SpectraLayers creator and lead developer

JesusSheep00a
New Member
Posts: 26
Joined: Wed Jul 15, 2020 3:31 pm
Contact:

Re: Create new stems for Unmix Stems

Post by JesusSheep00a »

Robin Check out this reaper video and download : https://youtu.be/L3iZSIC5XrE:)

JesusSheep00a
New Member
Posts: 26
Joined: Wed Jul 15, 2020 3:31 pm
Contact:

Re: Create new stems for Unmix Stems

Post by JesusSheep00a »

Also add add more instruments In AI.Like Keyboards ,Synths..
You could add a way that instruments could be added to the AIs collection of instruments.

Howl
Junior Member
Posts: 134
Joined: Fri Mar 09, 2018 9:29 am
Contact:

Re: Create new stems for Unmix Stems

Post by Howl »

Robin Lobel wrote:
Tue Aug 04, 2020 9:08 pm
A future update could add sensitivity parameters for each instrument.
that is great. perhaps, spectralayers has the ability, by hand, but unmix components, you can in way transpose to unmix stems, or layers of sounds. by amplitude, transients, etc. enough under the hood, to extract frequencies, like factorsynth 2 (M4L device, i own it, so perhaps..).
by hand is to most "creative" way, but dissecting a waveform in spectral components, can deliver new ideas. this is more for sounddesign of course.
and in a way all the tools are already there, i must work with spectralayers pro 7 more, if it would be real addition.
perhaps a niche question and yes, the tools available, i repeat are perhaps enough, it is more for another workflow, another perspective.
perhaps it is only me...
Cubase Pro 11. Spectralayers Pro 7.0.20. Wavelab Pro 10.0.40. I7 6700K, 32 Gb, 3 x SSD, 1 x HD, 1060gtx 6gb. Windows 10 Pro 64 (2004). motu ultralite mk3 hybrid. Mackie Control Universal. Behringer BCR 2000 - FCB 1010. Novation Zero SL MKII + SL 49 MKII. Nektar Panorama P1. Maschine MK3 + Jam. Roland MMP-2 pre-amp. rode NT1A. Wacom Bamboo CTH-461. push 2 + ableton live 10 suite. bitwig studio 3.3. reason 11 suite. reaper 6.x. NI komplete 11 ultimate + komplete 13. arturia v collection 7 & FX Bundle & spark 2 (+ CDM controller) & pigments 2. IK multimedia t-racks 5 standard with 40 "processors". softube modular. voltage modular. unfiltered audio, glitchmachines, meldaproduction, waves (gold + 25 or so). etc. etc.

https://soundcloud.com/sada-exposada

JesusSheep00a
New Member
Posts: 26
Joined: Wed Jul 15, 2020 3:31 pm
Contact:

Re: Create new stems for Unmix Stems

Post by JesusSheep00a »

Have SpectraLayers Be able to add addional instruments to is AI .It is now calling Synth Other.Will it be able to Put all pianos in the piano stem Same with Drums ect?

Robbie D
New Member
Posts: 3
Joined: Wed Aug 12, 2020 4:51 pm
Contact:

Re: Create new stems for Unmix Stems

Post by Robbie D »

Robin Lobel wrote:
Mon Aug 03, 2020 6:18 pm
These unmixing process are driven by deep learning AI models, which requires thousands of examples for each instrument and days of computing to train proper separation model. Experiments were made to train it on flute and guitar, but unfortunately it does not work as well as flute is pretty close to vocals in term of spectral signature, and guitar spectral signature is so wide that it's hard to properly capture it and discriminate it from say piano for instance. That being said, it may evolve in the future.
Hi Robin,

Often, when I want to do this kind of work, I may have a small sample of the same instrument I want to isolate/extract/unmix (maybe from a intro, break, or different take).

Is it possible you could add the option to “feed” the AI a clean snippet of the instrument you want to unmix to give a more accurate result?

Geppastro
Member
Posts: 266
Joined: Wed Dec 15, 2010 11:22 pm
Location: Italy
Contact:

Re: Create new stems for Unmix Stems

Post by Geppastro »

Robin Lobel wrote:
Mon Aug 03, 2020 6:18 pm
These unmixing process are driven by deep learning AI models, which requires thousands of examples for each instrument and days of computing to train proper separation model. Experiments were made to train it on flute and guitar, but unfortunately it does not work as well as flute is pretty close to vocals in term of spectral signature, and guitar spectral signature is so wide that it's hard to properly capture it and discriminate it from say piano for instance. That being said, it may evolve in the future.
About guitars: I think of electric and acoustic ones as sonically different instruments. Maybe concentrating (initially at least) on just acoustics would be a little easier? Acoustics I would think have a less wide spectral signature. At the same time, they are present in a lot of recordings, maybe steel strings ones more so. Wouldn' t a gradual approach (i.e. starting for example with just acoustic steel strings) be more feasible?
Paolo (Cubase user since 1995 -> Cubase Audio on Atari Falcon)
Hardware (desktop): i7-880 3.06 Ghz ; 16 Gig RAM ; Asus P7H55-M/USB3 ; Echo Gina 24 PCI sound card ; ESI M8U XL 8x8 midi interface ; Steinberg CMC-TP.
Software (desktop): : Windows 10 Enterprise (64 bit) / Cubase Pro 11 v11.0.0 (64 bit) / WaveLab Pro 9.5 v9.5.50 (64 bit) / HALion 6 v6.1.0 (64 bit) / SpectraLayers Pro 7 v7.0.21 / HALion Symphonic Orchestra / Synthogy Ivory II American Concert D.
Software (laptop Sony VAIO i5-4200U 2.29 Ghz ; 8 Gig RAM): Windows 10 Home (64 bit) / Cubase Elements 9.5 v9.5.50 (64 bit).

Post Reply

Return to “SpectraLayers 7”

Who is online

Users browsing this forum: Robin Lobel and 1 guest