I choose “French” for all text, but it doesn’t stick.
Assuming you want French to be the default language try the following:
Go Tools (menu) > Options… > Language Settings > Languages
Make sure that your Locale Setting is set to whatever version of French you want to use.
Make sure the Default Languages for Documents: Western setting is set to whatever version of French you want to use.