1. Is it possible to do live rhythm detection?
It'll be great to make an app which will help people to detect the rhythm on unfamiliar song on the fly. Even if the app will be bounded to a few genres.
I.e. Salsa Beat Machine, but they work offline on predefined music. Is that possible to do the same on the fly using mobile's microphone? Actually I don't need all that functionality, but only the artist who says "One, Two, Three..."
I'm new in audio processing, I've read only few articles, among them the GameDev article. From this article I know "energy analisys" is not precise for complex music event with frequency subbands analisys enhacements. "Filtering rhythm detection" is the most precise but too heavy for live streaming. 2. Aren't modern devices powerfull enough to detect rhythm on the fly?
I'm asking because haven't seen any similar app (only tempo detection) but there are lots of rhythm based games which allow you to use custom music. Fro example, 3. How BEAT MP3 2.0 work? Does it analyze music on the fly?
Given an audio file, most contemporary mobile devices are more than powerful enough to do a lot of heavy DSP analysis (rhythm, key, genre, fingerprinting, etc.) while playing the file. A live detector would need to categorize (or be given) the genre first and be smart enough to skip the intro and rhythm breaks.
Comparing the input audio fingerprint to a database of tune fingerprints might also work (similar to how many song recognition apps work). Then just print out the tempo on the scoresheet if recognized and found in the database. Training a DNN on fingerprints from a large set of sample songs from the genre might also work.