How Good Is GPT-4 At Solving Riddles?

Much better, and sometimes worse, than I thought.

Drawing by the author

As a way to see how good GPT-4 is at solving unique problems, I decided to test Microsoft Copilot (formally Bing Chat) with a series of riddles that friends and I developed last year.

They were geared towards podcast super-fans, and each riddle consisted of a four line poem and a custom…