Learning English is never easy. Afterall English is not our mother tongue. Let me take myself as an example. I spoke Hokkien as a child and I am still using the dialect, though not as frequent as I used to. I went to an English school, picked up English there and started using it wherever and whenever possible. At the same time I picked up some Mandarin along the way. Ha...sounds quite interesting. No boasting or showing off. So you see it's more of a kind of 'rojak' language as time goes on. However I did not allow my English to rust or rot and I'm proud I did not grow up with only one language. My sister was an English teacher but sad to say we use our mother tongue most of the time. However English was there and is there in our conversation and wherever we go. We do not bury the language and English WILL always be part and parcel of our life.
So there you are. Your attitude towards the language is very important. Never mind the mistakes you had made, are making and will be making. Mistakes are part of our growing up and you can never run away from mistakes. Go ahead with all the broken and chop up English and enjoy it. Believe me, those who are reading and will be reading this, you CAN only improve if you keep on with wharever English you have with you. Let your friends laugh and you laugh with them but at the same time do not stop using English, no matter how broken it may be.
I am from Ulu Kelantan and if an orang ulu can pick up the language, there's no reason you cannot. I hope to see some comment from you. Stop worrying about your English. Start living in the language NOW.