(This is tangentially related to the question about identifying native speakers.)
At present, answers to questions appear to derive from the following sources (in my subjective order of decreasing reliability):
- Grammar texts (the good ones)
- Personal experience (as a native speaker or fluent learner)
- Statements from a Japanese teacher
- Japanese Q&A sites and other internet resources
- Old classroom memories and hearsay
Seeing as we can contribute to the proliferation of bad information just as easily as we can good information, if we wish to make this into a valuable site for students of Japanese, it would behoove us to have a high standard for accepting answers. While I don't propose we start tagging unreferenced statements with  akin to Wikipedia, I do think we should attempt to ensure credibility in answers. A mere upvote can mean many things. We all hope it means, "Yes, I have checked this answer and can confirm it to be true," but it could easily mean, "I don't know if this is correct or not, but it makes sense to me."
Off the top of my head, here are some possible solutions:
- Ask answerers to voluntarily provide a "References" section below their answer (面倒くさい for the answerer).
- Ask high-reputation users to comment their concurrence when they upvote (面倒くさい for the upvoter).
- Implement a standard of "minimum reference credibility" and draw the line somewhere inside the above list.
I'm not sure if I'm bringing up an issue worth discussing at this point, but I look forward to seeing everyone's comments nonetheless.