Bring Your Own Language Model