Which of the two would you pick and why? Or do you try to get both?

I made a comparison post before based on the view of non-Reddit people on two models. After testing two models extensively in the last few days I feel like I have to share "my honest thoughts" on this. First and foremost GPT-4-Turbo is significantly better than GPT-4 so I'll only include that in comparison.

- GPT-4-Turbo is better at reasoning and logical deductions. Gemini Advanced may succeed at some where GPT-4-Turbo fails, but still GPT-4-Turbo is better at majority of them. In reality even Gemini Pro seems a bit better than Advanced (Ultra) at this. That's not saying a lot though because if a reasoning test is not in their training data all of the models are bad. They can't really generalize. GPT-4-Turbo Win

- GPT-4-Turbo is better at coding as well. Gemini Advanced gives better explanations but makes more mistakes. Again if a coding problem is not in their training data, they're both bad. Like I wrote before, they can't generalize. As a side not Gemini Pro seems tiny bit better than Advanced (Ultra), again. GPT4-Turbo Win

- GPT-4-Turbo definitely hallucinates less even if the search is involved. Actually Gemini Advanced can't even search properly right now. Although the hallucination rate seems similar, Gemini Pro is again better than Advanced at browsing capabilities. GPT4-Turbo Win

- Gemini Advanced destroys GPT-4-Turbo at creative writing. It's a few levels above. Even Gemini Pro is better than GPT-4 Turbo. Gemini Advanced Win

- The translation quality: Not enough data since Ultra only accepts English queries. - ?

- Text summarization: Couldn't test enough. - ?

- In general conversations Gemini Advanced seems to be more human and more intelligent. Even Gemini Pro seems better than GPT-4-Turbo at this. - Gemini Advanced Win

- Gemini Advanced is about 2-3 times faster compared to GPT-4-Turbo once it gets going but its time to first token is huge. - Gemini Advanced Win

- Gemini Advanced has no message cap. - Gemini Advanced Win

- Gemini Advanced refuses to do tasks more compared to GPT-4. Again, even Gemini Pro is better than Gemini Advanced in that regard. GPT-4-Turbo Win

- Gemini Advanced only works for English queries as of now and its multi-modal aspects are not enabled yet. Even Gemini Pro's image recognition is enabled but Advanced does it via Google Lens (which is not great), not itself. Also GPT-4 has more plugins like Code Interpreter at the moment. GPT-4-Turbo Win for Now

GPT-4-Turbo: 5 Wins (At most important areas)

Gemini Advanced: 4 Wins

Honorable Mention: Gemini Pro

What I found most interesting is Gemini Pro seems better than Gemini Advanced at the moment except creative writing and general conversations. As a free alternative it's near the vanilla GPT-4 level so Google did a very good job with that one. Microsoft Copilot is better as a free alternative though (most of the time it uses GPT-4-Turbo and GPT-4). But if you're going to do back and forth and in need of long answers, Copilot is really bad. And it refuses tasks a lot. In that case Gemini Pro is useful.

However I can't quiet put my finger on why Advanced (Ultra) is around the Pro level at the moment (actually worse at some important areas). It's quite obvious they rushed it and didn't finetune it a lot but I'm not sure if a fine-tuning phase affects a model this much. Pro admittedly has improved a lot since its release in just a couple of months though. If Advanced improves that well, it can surpass GPT-4-Turbo, but as of this moment GPT-4-Turbo is the better model overall. Gemini Advanced is so much better at creativity, sounding human and response speed though. And it has no message caps.

Considering all of this, I'll wait to see if Gemini Advanced improves in the next couple of months to subscribe once my trial period ends. If not, there's absolutely no reason to subscribe. Lastly, I'm disappointed by LLMs' ability to generalize. Currently they can only mix things up in their training data very well but they can't really extrapolate. Definitely new breakthroughs are needed in this field.

Edit: I'll update the translation and summarization sections once I get enough data. But in my limited tests so far Gemini Advanced seems to be better, and some users in the comments below also think Gemini Advanced is better in those regards.

I use Chat GPT for more philosophical discussion to pick my own brain and sometimes text or picture analysis. Not the more complex coding or problem solving stuff I see on here. For me this is more of a curiosity than a tool.

Gemini Adv is vastly behind at this more casual usage in my experience. It seems to want to push me towards media services and sometimes completely misunderstands me without the ability to correct. It also has very strong filters on anything that could be controversial and is bad at following rules even when encoded in the "gem" feature.

GPT will correct itself and will adapt well to new parameters.It also doesn't try to push me way from the platform and will discuss more controversial topics without needing a 'hack'.

For the person that is more focused on the social and philosophical capabilities of a chat bot Chat GPT has been vastly superior at this.

Just wanted to throw in my two cents.