Let me tell you a little story:
Way back in '05 when I was a brown belt, I traveled to Tokyo and had the amazing fortune of being invited to roll on several occasions with a group of some of the best lightweight pros in Japanese MMA at the time. I rolled with Shinya Aoki, Naoya Uematsu, Rumina Sato, Satoru Kitaoka, Kazuyuki Miyata among many others. I was treated really well and I trained well too.
Here's the thing, grapplers. No one spoke English. And, people did say "oss." But, they said it way less than you do, grappler. And, they were Japanese ... and way cooler than you. I think you catch my drift. Stop saying "oss" so much and go back to saying things like "I agree with you" and "Cool" or, even, "OK."
Check out Mike Jen's kickass 3rd episode on this very issue.