Skip to main content

Changelog 2022-10-27

· 2 min read
Mika Zimina

We are happy to introduce our new Voiceover Classifier. This part of our music analysis detects any voices not belonging to the track, like extra announcements, advertisements and just people talking over the recording!

Voiceover Classifier

You can now access voiceover classifier information through any queries that return AudioAnalysisV6Result, like libraryTrack, libraryTracks and spotifyTrack. The new fields available are:

  • voiceoverDegree - a number showing the certainty that there is a voice over the track
  • voiceoverExists - a boolean value indicating the existence of the voiceover in this track (same as voiceoverDegree > 0.5, just already calculated for convenience)
caution

If the track was not yet analysed by our new analyser both values above will be ‘null’. The reanalysis process takes time, and new data is not yet available for all the tracks. Contact our sales team sales@cyanite.ai if you wish to speed up the process.

Example: libraryTracks​

Request​

{
  libraryTracks {
    edges {
      node {
        id
        audioAnalysisV6 {
          ... on AudioAnalysisV6Finished {
            result {
              __typename
              voiceoverExists
              voiceoverDegree
            }
          }
        }
      }
    }
  }
}

Response​

{
 "data": {
  "libraryTracks": {
   "edges": [
    {
     "node": {
      "id": "20",
      "audioAnalysisV6": {
       "result": {
        "__typename": "AudioAnalysisV6Result",
        "voiceoverExists": true,
        "voiceoverDegree": 0.6
       }
      }
     }
    },
    {
     "node": {
      "id": "19",
      "audioAnalysisV6": {
       "result": {
        "__typename": "AudioAnalysisV6Result",
        "voiceoverExists": false,
        "voiceoverDegree": 0.4
       }
      }
     }
    }
   ]
  }
}

Example: libraryTrack​

Request​

{
  libraryTrack(id: 20) {
    ... on LibraryTrack {
      id
      audioAnalysisV6 {
        ... on AudioAnalysisV6Finished {
          result {
            __typename
            voiceoverExists
            voiceoverDegree
          }
        }
      }
    }
  }
}

Response​

{
 "data": {
  "libraryTrack": {
   "id": "20",
   "audioAnalysisV6": {
    "result": {
     "__typename": "AudioAnalysisV6Result",
      "voiceoverExists": true,
      "voiceoverDegree": 0.6
    }
   }
  }
 }
}

Example: spotifyTrack​

Request​

{
  spotifyTrack(id: "0ClYnjaw9VjNcyYx4hjy6v") {
    ... on SpotifyTrack {
      id
      audioAnalysisV6 {
        ... on AudioAnalysisV6Finished {
          result {
            __typename
            voiceoverExists
            voiceoverDegree
          }
        }
      }
    }
  }
}

Response​

{
 "data": {
  "spotifyTrack": {
   "id": "0ClYnjaw9VjNcyYx4hjy6v",
   "audioAnalysisV6": {
    "result": {
     "__typename": "AudioAnalysisV6Result",
     "voiceoverExists": null,
     "voiceoverDegree": null
    }
   }
  }
 }
}