Audio Clustering Based on Spectral Features
Use spectral features to find clusters in a list of audio objects.
In[1]:=
![Click for copyable input](assets.en/audio-clustering-based-on-spectral-features/In_65.png)
a = ExampleData[{"Audio", "Drums"}, "Audio"]
Split the recording where transients happen.
In[2]:=
![Click for copyable input](assets.en/audio-clustering-based-on-spectral-features/In_66.png)
samples =
Select[AudioSplit[a,
FindPeaks[AudioLocalMeasurements[a, "Novelty"]]["Times"]],
Duration@# > Quantity[50, "ms"] &];
samples = Audio[#, Appearance -> "Minimal"] & /@ samples
Out[2]=
![](assets.en/audio-clustering-based-on-spectral-features/O_30.png)
Plot the resulting samples in positions defined by their spectral centroid and spectral spread.
In[3]:=
![Click for copyable input](assets.en/audio-clustering-based-on-spectral-features/In_67.png)
ListPlot[Partition[
AudioMeasurements[#, {"SpectralCentroid", "SpectralSpread"},
"List"] & /@ samples, 1],
PlotMarkers -> (Audio[#, Appearance -> "Minimal"] & /@ samples),
AxesLabel -> {Style["Centroid", Italic], Style["Spread", Italic]},
ImageSize -> Medium]
Out[3]=
![](assets.en/audio-clustering-based-on-spectral-features/O_31.png)
Find similar sounds using the "SpectralCentroid" and "SpectralSpread" measurements.
In[4]:=
![Click for copyable input](assets.en/audio-clustering-based-on-spectral-features/In_68.png)
FindClusters[
AudioMeasurements[#, {"SpectralCentroid", "SpectralSpread"},
"List"] & /@ samples -> samples]
Out[4]=
![](assets.en/audio-clustering-based-on-spectral-features/O_32.png)