Units have no meaning without the context of what you're modeling.

I fully agree with that statement ! But some addition of units are widely accepted because their associated model is almost universal on earth, let's say adding mass (kg) of two different objects

Yes, that's why we're having this conversation. It's so common that some people reasonably infer a stronger connection between units and physics.