I noticed a thing there before that when you have ancient merchant inheritance scroll that is currently activated and you try to switch mode, it won't do the thing.
You can just double click the scroll effect to remove it.