I believe I can bring a unique perspective into this conversation. I will tell you what I think, then I will give my real life justification on why I think what I think (I know this sentence sounds confusing, but please, read my entire post, then you would understand).
First, it is true that our senses can provide the brain with wrong data, which happens all the time. However, a rational person would be able to use his other senses to verify if one sense is giving him incorrect information.
A person who’s mind is in a rational state would realize that he (or she) would either require more information before making a judgement (e.g. merging lanes on a freeway, that’s why you need to look over your shoulder and look in the mirrors before merging) or realize that the brain is malfunctioning and the individual needs medical attention (e.g. if an individual sees a pink elephant).
How do I know this is to be true? Because in my life, I have experienced both of these phenomena in my brain. In the first case, I can “see” music and sounds. Different sounds produce different shades of colors depending on the instrument used, pitch, and “blending”. When I was younger, I used to describe to my friends how much I like a song because of the type of color it makes. I have since learned that most people do not have this ability and that music can not produce or change colors. So whenever I hear music, or hear something, I disregard the color that it makes (unless the colors - and music - gives me pleasure, in that case, I indulge myself in it). I have since taught myself that music is caused by vibrations of air, hitting my ear-drum, and the ear-drum “transporting and encoding” those sounds to my brain, and not some type of color producing event.
For the second type of phenomena that I experienced (hallucinating), that was done because of drugs. I was put on a pain killer which I found out later to be allergic. About 30 minutes of taking this drug, I noticed that my keyboard, and desk, felt smooth and cool like glass. Because my brain, at that time, was still functioning, I ignored the feelings because every other sense was telling me (correctly) that I was sitting at the desk, typing. Then, I started hearing things (I was hearing voices of people, but I couldn’t make out what they were saying). Because there was no one else in the room, I ignored those voices as well. As time passed, I started having a harder time remember things (remembering what I read 6 words ago became a very hard chore), and I started being “in places” that I never was in. At this point, It became a hard struggle for me to think of the words “Stop! Not real!” and went up the stairs to my friends room, who took me to the Hospital. The conclusion of this was my mind was “out of focus” and no longer functioning properly. Thankfully, I had enough reason left, and knowledge on how to interpret what is real and what isn’t, to allow me to seek medical attention.
Short version of the above paragraph: our senses need not to be perfect, but our brains must be focused on reality. Once our brain is struggling to identify what is real, and what isn’t, that is the time to seek medical attention. However, as long as the brain is focused, then the senses can tell us whatever it is that is real or not, and we can acquire more information to find out if its real, or we can dismiss it.