This week I teamed up with Schuyler to create a web music application. The idea is that the user is given a canvas to draw, we will then find a song that correlates to the drawing and play it for them.
The sketch is accessible here. (Though for now, you’ll need to fetch the access token manually, instructions are in the sketch source code).
The way it works is that we use DoodleNet, a machine learning model that can recognize drawings to get a prediction of what the user is drawing. We then use that information to search for a song based on the drawing result using Spotify’s web player and web API.
