To me, it depends on the person. Nowadays people hold this notion that people are divided into two groups: artistic/creative people and left brained people. This is just wrong on so many levels because all of us use both sides of our brains. No one is 100% right brained or 100% left brained. I'm personally a big fan of Da Vinci because he was an artist, a crafts person and an inventor. I embrace this Renaissance model and try to have an understanding of many fields. By the I suggest you to read "Mastery" by Robert Greene. In that book he talks about how masters such as Da Vinci, Darwin, Einstein etc. had a rounded knowledge instead of concentrating on just one area.
"I got a comment from that boss saying "you were the worst person in history of our company that we hired" and another colleague told me "you were nothing" which was confusing to know what he meant by "you were nothing".
I wouldn't make a decision of what I'm capable of based on what a couple of people said. While getting feedback from people is crucial in your professional development, not everyone knows what they're talking about. For example in my last internship the boss decided to test my design skills. How did he do that? He gave me a sketch of a navigation menu and he asked me to design the buttons of that menu. He said, "here is your 60x20px button, design it and place it on the menu" without giving me any context.. no website, no mock-up just a 60x20px button. I couldn't do it, I panicked and I failed to style the button. He said I didn't have any design talent and ended my internship two weeks later. Now am I going to believe I'm not a designer based on his feedback? No. Because to me design is not making buttons pretty but solving problems within their context.
Only you can find out whether or not you can design or program. Do some projects, learn and test your skills. Change your learning methods to see if it makes a difference. If you're trying to learn a programming language for example find an exciting project that requires executing that language, that way you will feel more motivated to learn that language.