The Frege-Geach problem challenges non-cognitivist theories of ethics by questioning how moral statements can retain their meaning in different contexts, particularly in logical arguments, if they do not express beliefs. It highlights the difficulty in maintaining logical consistency and validity in moral discourse when moral statements are treated as expressions of attitudes rather than truth-apt propositions.