Synonyms for By rights:

n.

by rights (noun)
properly.