No Islam: Hindu or Buddhist Swahili Coast?

Inspired on https://www.alternatehistory.com/forum/threads/buddhism-in-east-africa.221493/ and https://www.alternatehistory.com/forum/threads/african-hindu-state.405642/, I'll reformulate those ideas: If Islam never existed, how plausible would it be for a Hindu or Buddhist Swahili Coast to exist?
Without Islam, could Hindu or Buddhist Indian traders have traded with the Swahili Coast and converted the local Bantus to Hinduism or Buddhism?
If so, what would a Hindu or Buddhist Swahili Coast look like?
 
I imagine the sect of hinduism the converted bantu have would incorporate the native species of elephant (L. africana and L. cyclotis) into depictions of Ganesha over Ganesha's original head (E. maximus).
 
It seems far more plausible that Christianity would spread south from Ethiopia. I note that OTL, Christianity spread to India as early as 100-200 CE, but there is no record of either Hinduism or Buddhism spreading west.
 
Top