No AI chatbot I asked this simple English language question from could answer it correctly

The question is:

How many Rs are there in the word strawberry, and in what positions do they occur in the word?

Now you can replace R with any other letter, and strawberry with any other word. As you should, actually. Try other words (at least 7 letters long).

I did find that some chatbots answered the question correctly, but upon asking the same question in a new chat, they failed to replicate the correct results. So it’s important to test this question in multiple chats, with different words and letters.

It’s worth noting all I have are free models to test (except for Grok 2) since they are too expensive here in India. For context, in India, a month of ChatGPT Plus costs 17 times more than a month of Spotify (individual plan).

I tried ChatGPT-4o Mini, Claude Sonnet 3.5, Grok 2, Meta Llama 3.1 (70B), Perplexity, Google Gemini and Microsoft Copilot.

Does anyone have access to o1? I’m curious as to how o1 will do on the prompt discussed in this post.