First of all, Academia SE grew from Stack Exchange (Overflow), Programmers SE, etc. It's no surprise that many of our audience come from computer science.
Compared to other SE sites, I think Academia SE is not that bad. By its nature, academians are minorities in most societies. So, it's no surprise that we have a little less readership than other SEs.
Of course, that's not to say that we don't want to grow. We do.
I live in Taiwan. The population here is 23 million. There are approximately 1 million people here who's got masters/PhDs. But, it seems to me that there are only a few people in Taiwan hanging around on this site. I can tell that by observing the activity of this site during the local time interval 1pm - 3pm.
I do have friends in Taiwan who are academians and have encountered issues. Some of them came to me to ask for help. In some cases, I pass the links on our site to answer their questions. Sometimes, I cannot find the right Q&A for them.
In those cases, I tried to encourage them to ask their questions on Academia SE themselves. So far, my attempts have not been successful. The major reasons I failed are:
1. English.
They know how to write their field-specific papers in English. But, they have problems with stating their academia-specific issues in English. Sometime, it's really hard to do so. If you're a native-English speaker, you can tell that I am not a native-English speaker. The reason I can write in the way most people can understand is because I lived in US over 30 years and I have many years of hard time writing in English after a lot practices. And I still do have hard time with writing in English. For example, it took me an hour to write this answer. I suggested them to use our English Language & Usage SE. Some of them did. I myself looker at that site sometimes. I saw quite a bit down-votes and closed questions, much worse than our site. I am just stating my observation here. No complaint.
2. Anonymity.
Everyone I talked to expressed anonymity concern. One of the reasons is again, English writing. They are so afrid that they are going to be laughed at when their questions get down-voted or closed due to poor writing. I told them don't worry. People will help to edit. Still, no avail. Again, I am simply stating my observation. No complaint.
Most of our participants on this site are fluent English speakers. I can tell that because they write better English than mine. So, I think we can attract more people from everywhere by helping others to encourage them to ask questions when the questions are not so well-written in English. The help can be in many ways. We can help them by editing the questions. We can help them by making comments to ask questions to clarify what they are asking, etc. Just my two-cents here.