There's not much latency on my Nexus 5. However some older Android devices have pretty laggy audio support. I think it's system wide - try testing a different (native?) app and see if it's the same. Which devices are you testing exactly and what version of Android are they running?
Hi Ashley, here are the audio latency results, in Chrome for Android, for all my android devices:
Samsung galaxy core plus, Android 4.2.2, Chrome 35.0.1916.141: 231ms
LG L4, Android 4.1.2, Chrome 35.0.1916.138:297ms
Asus Memopad hd 7 tablet, Android 4.2.2, Chrome 35.0.1916.141: 297ms
Growing Wolf quad core, Android 4.2.1, Chrome 35,0.1916.141: 297ms
The audio lag is similar in Chrome beta.
None of these devices come close to my iPad 2/Safari, with no lag at all.
The performance of these devices with native apps seems to be ok.