Meaning is context-dependent, but many properties of language (should) remainthe same even if we transform the context. For example, sentiment, entailment,or speaker properties should be the same in a translation and original of atext. We introduce language invariant properties: i.e., properties that shouldnot change when we transform text, and how they can be used to quantitativelyevaluate the robustness of transformation algorithms. We use translation andparaphrasing as transformation examples, but our findings apply more broadly toany transformation. Our results indicate that many NLP transformations changeproperties like author characteristics, i.e., make them sound more male. Webelieve that studying these properties will allow NLP to address both socialfactors and pragmatic aspects of language. We also release an application suitethat can be used to evaluate the invariance of transformation applications.