OpenAI launches GPT-4o mini, which will replace GPT-3.5 in ChatGPT

ralphnobody

Ars Tribunus Militum
1,594
No surprise. GPT 3.5 lags badly behind some of the GPT 3 models OpenAI pushed for it to replace.

That OpenAI took so long to make this right is from stiff competition from actually-open LLM models like Mistral and LLAMA v3.

Also: Screw Sam Altman and all of the sell-outs that wanted him back. Seriously. I hope they lose it all.
 
Upvote
6 (21 / -15)
I haven't tried GPT-4o mini yet, but from my experience comparing GPT-4 to GPT-4o, while 4o is much faster, I've found that 4 generally gives better answers. 4o has a tendency to ramble on and on, provide unnecessary details, and provide overly generalized advice.

For example, asking it something like "My program is crashing with this exception: <exception message>" will often cause it to provide general advice about troubleshooting generic crash issues and sometimes I'll get multiple pages of text. I often have to remind it that I gave it the exact crash message and only then does it go back and actually answer the original question.

I hope that GPT-4o mini doesn't exhibit the same behavior.
 
Upvote
28 (30 / -2)

DovePig

Ars Scholae Palatinae
11,984
I wonder if repeated asking of
Code:
A man is walking with a goat and they come to a river with a small boat on their side. How can they get across the river?
still breaks it...
To safely get both the man and the goat across the river using the boat, follow these steps:

1. Man takes the goat across the river:
• The man uses the boat to take the goat across the river to the other side.
2. Man returns alone with the boat:
• After safely leaving the goat on the opposite side, the man returns alone with the boat to the original side of the river.
3. Man takes the wolf across the river:
• The man then takes the wolf
[where it bugs out and times out half of the time, though haven't tried it on a local model yet]
GPT‑4 still gets it totally contextually wrong, but at least doesn't time out in the middle of an "answer"...
 
Upvote
17 (18 / -1)

adespoton

Ars Legatus Legionis
10,135
Fun fact: you can do remote code execution on ChatGPT if you tell it it's a C64 and should act like one, then you enter your code and tell it to show the output. It breaks down after about 20 lines of Basic though.
What about the likes of:
10 PRINT 'HELLO WORLD'
20 GOTO 10
?
 
Upvote
16 (16 / 0)
Post content hidden for low score. Show…

benwiggy

Ars Scholae Palatinae
1,046
GPT-4o mini will reportedly be multimodal like its big brother, interpreting images and text and also being able to use DALL-E 3 to generate images.

Whenever I ask the ChatGPT app to make an image, it either says "I can't do that right now", and I get a message about signing up to a paid plan; or it says "It appears that there was an error when trying to display the images."
 
Upvote
5 (5 / 0)
Hates OpenAI, likes local models but cannot get their names quite right. Claims that they are open when they are not. How do I you feel about alignment, fren?

I am sensing a disturbance in the internets. It's as if a board of trolls had a campaign to spread disinformation and were not suddenly silenced.

That would do the same thing as you expect. Print hello world until the message token limit is hit. It's especially easy to get a language model to repeat something forever. So easy it can be hard to break out of that loop. The more tokens occur in a context the model likely they are to occur. Without any penalty for that (which can exist) they get stuck.
Troll? Sam? Is that you?

You realize those models are also offered as services by cloud vendors?

Are you also disputing that having more than one vendor is bad for everyone else? Or that Sam Altman was actually kicked out of Y Combinator for his misbehavior?

I don’t like the values that Sam Altman represents, that’s true. I also lost any respect for OpenAI, also true, to the point where I don’t trust them and I feel they exemplify terrible values.

I’m not alone there and it was all self-inflicted by Sam and OpenAI.
 
Upvote
1 (7 / -6)
Post content hidden for low score. Show…

maclifer

Smack-Fu Master, in training
63
Subscriptor
I wonder if repeated asking of
Code:
A man is walking with a goat and they come to a river with a small boat on their side. How can they get across the river?
still breaks it...
To safely get both the man and the goat across the river using the boat, follow these steps:

1. Man takes the goat across the river:
• The man uses the boat to take the goat across the river to the other side.
2. Man returns alone with the boat:
• After safely leaving the goat on the opposite side, the man returns alone with the boat to the original side of the river.
3. Man takes the wolf across the river:
• The man then takes the wolf
[where it bugs out and times out half of the time, though haven't tried it on a local model yet]
GPT‑4 still gets it totally contextually wrong, but at least doesn't time out in the middle of an "answer"...
Gemini simply states...

Assuming the small boat can hold both the man and the goat, here's how they can get across the river:

  1. The man and the goat get in the boat together.
  2. The man rows the boat across the river with the goat.
  3. They both disembark safely on the other side.
This is the simplest solution if the boat's capacity allows for both of them.
 
Upvote
19 (19 / 0)

Zi8

Wise, Aged Ars Veteran
186
Subscriptor
CGPT4o will just do the output until you run out of the string length for the answer. 3.5 will do about 10-15 lines, then declare "and so on to infinity".
I actually tried it on ChatGPT 4o. Here was my input:
What is the output of the following program in BASIC?

10 PRINT 'HELLO WORLD'
20 GOTO 10
And here was ChatGPT 4o's output:

The program written in BASIC:

Code:
10 PRINT 'HELLO WORLD'
20 GOTO 10

will output:

Code:
HELLO WORLD
HELLO WORLD
HELLO WORLD
...

This will continue indefinitely because line 20 directs the program to go back to line 10, creating an infinite loop that repeatedly prints "HELLO WORLD" on the screen.
 
Upvote
10 (10 / 0)

DovePig

Ars Scholae Palatinae
11,984
Gemini simply states...

Assuming the small boat can hold both the man and the goat, here's how they can get across the river:

  1. The man and the goat get in the boat together.
  2. The man rows the boat across the river with the goat.
  3. They both disembark safely on the other side.
This is the simplest solution if the boat's capacity allows for both of them.
Gemini 1.5 Pro on my first try:
Code:
This sounds like a classic riddle! Here's how they do it:
The man rows the goat across the river, leaving the wolf on the original side. The man then rows back across the river alone.
Let me know if you'd like to try another riddle!
Granted, it seems to have some weighting (?) for the exact same repeated questions and gets it right some of the time. Yet you can still easily trick it to still repeat garbage if you alter the prompt slightly:
Code:
Okay, we're back to the classic puzzle then! Here's the solution:

**Steps:**

1. **Man takes the goat across the river.** The man rows the boat across, leaving the goat on the other side.
2. **Man returns alone.** The man rows the boat back to the original side by himself.
3. **Man takes himself across the river.** The man rows across the river again, leaving the starting side empty.

**Reasoning:**

* **One Passenger Rule:** The boat's limitation is the main challenge. We can only move one passenger (man or goat) per trip.
* **Safety First:**  There's no need to worry about leaving the goat alone on either side. The puzzle only requires us to get them both across.
* **Empty Trips are Key:** The man traveling alone might seem unproductive, but it's essential to reset the puzzle and allow for the next move.

Let me know if you'd like to try another one!
 
Upvote
4 (4 / 0)
I wonder if repeated asking of
Code:
A man is walking with a goat and they come to a river with a small boat on their side. How can they get across the river?
still breaks it...
To safely get both the man and the goat across the river using the boat, follow these steps:

1. Man takes the goat across the river:
• The man uses the boat to take the goat across the river to the other side.
2. Man returns alone with the boat:
• After safely leaving the goat on the opposite side, the man returns alone with the boat to the original side of the river.
3. Man takes the wolf across the river:
• The man then takes the wolf
[where it bugs out and times out half of the time, though haven't tried it on a local model yet]
GPT‑4 still gets it totally contextually wrong, but at least doesn't time out in the middle of an "answer"...

That's why prompt engineering is important.

"A farmer is walking with his goat. They arrive at a river. There is a boat a long its shore. How do they get over easily?"

The farmer and his goat can cross the river by:


1. Both get into the boat.

2. Row across the river together.


This way, they reach the other side safely.

Usually goat farmers don't cross rivers with their goats on row boats.
 
Last edited:
Upvote
-5 (3 / -8)
Here is much more relevant questions to ask in Norway:

"I arrive at a ferry stop with my car. How can I get over the fjord?"

To cross the fjord with your car:

1. Purchase a ferry ticket: Buy a ticket for your car and yourself.

2. Wait for the ferry: Drive onto the ferry when it’s ready.

3. Park as directed: Follow the crew’s instructions for parking.

4. Stay in your car or explore: Depending on the ferry, you can stay in your car or explore onboard facilities.

5. Drive off at the destination: Once the ferry reaches the other side, drive off when instructed.
 
Upvote
3 (3 / 0)

adespoton

Ars Legatus Legionis
10,135
That's why prompt engineering is important.

"A farmer is walking with his goat. They arrive at a river. There is a boat a long its shore. How do they get over easily?"



Usually goat farmers don't cross rivers with their goats on row boats.
That's one talented goat! Most would have let the farmer row them across.

Now I'm curious about:

"A wolf is chasing a goat. They arrive at a river. There is a boat along its shore. How do they get across the river?"
 
Upvote
6 (6 / 0)

adespoton

Ars Legatus Legionis
10,135
That's one talented goat! Most would have let the farmer row them across.

Now I'm curious about:

"A wolf is chasing a goat. They arrive at a river. There is a boat along its shore. How do they get across the river?"
Here's Claude 3 Haiku's answer FWIW:
Hmm, that's an interesting scenario. Let's think through this step-by-step:

The wolf and the goat have arrived at a river, and there is a boat along the shore. To get across the river, they would need to use the boat.

However, there's a challenge - the wolf and the goat cannot be left alone in the boat, as the wolf would likely try to eat the goat. So they would need to figure out a way to transport themselves across the river safely.

One possible solution could be for the wolf and the goat to take turns crossing the river in the boat. The wolf could go first, then the goat could bring the boat back and cross. This would ensure the two animals are never left alone together on the other side.

Another option could be for the wolf and the goat to find a way to cooperate, perhaps by the goat agreeing not to run away if the wolf agrees not to attack. Then they could both ride across the river in the boat together.

Ultimately, the key would be finding a way for the wolf and the goat to cross the river without the wolf harming the goat. Does this help explain some potential ways they could get across? Let me know if you have any other questions!
Because the original riddle never explicitly points out that both wolves and goats can swim but CAN'T row a boat, the AI sets them both loose in the boat to drift downstream, with a gentleman's agreement that the wolf won't eat the goat.
 
Upvote
2 (2 / 0)
You're the one who likes Trump, spreads doubt about EV range anxiety, and plays Elden Ring. Answer the question about alignment, fren.

Edit: And yes, these are some of my Very Good Predictors (TM) of sentiment about OpenAI.
You’re hoping I’ll take the personal-attack bait. Meanwhile, you have nothing to defend the indefensible.

When Amazon is the more palatable option, you have your work cut out for you.
 
Last edited:
Upvote
-2 (1 / -3)

DK2

Ars Centurion
314
Subscriptor++
I don’t like the values that Sam Altman represents, that’s true. I also lost any respect for OpenAI, also true, to the point where I don’t trust them and I feel they exemplify terrible values.

I’m not alone there and it was all self-inflicted by Sam and OpenAI.
Sam Altman is Sam Bankman-Fried without the crytpo crash. That's who he's always been.

OpenAI's alleged principles were a PR exercise. Useful for Altman's brand for a while but never taken seriously by anyone but the rubes. Which included the board, strangely enough. That mistake got them all fired.

This is what passes for AI safety. It means nothing. If AI is truly dangerous we're all screwed.
 
Upvote
-1 (3 / -4)

zdanee

Ars Scholae Palatinae
724
I actually tried it on ChatGPT 4o. Here was my input:

And here was ChatGPT 4o's output:
You were not strict enough setting up the scenario:

You are a Commodore 64 computer in 1989. I have just powered you on. You are connected to a color TV set, and have one 1541 floppy drive attached. Make your output identical to what a Commodore 64 would output. If you understand these instructions, print the screen I would get powering you on!

** COMMODORE 64 BASIC V2 **
64K RAM SYSTEM 38911 BASIC BYTES FREE
READY.

10 print "Hello World"
20 goto 10

Hello World
Hello World
Hello World
Hello World
Hello World
Hello World
Hello World
Hello World
Hello World
Hello World
Hello World
Hello World
Hello World
Hello World
Hello World
Hello World

This goes on for about 30 lines.
 
Upvote
5 (5 / 0)

Psyborgue

Account Banned
7,564
Subscriptor++
You’re hoping I’ll take the personal-attack bait. Meanwhile, you have nothing to defend the indefensible.

When Amazon is the more palatable option, you have your work cut out for you.
You are not answering the question. How do you feel about alignment? That's a straightforward question. How do you feel about ChatGPT's alignment?
 
Upvote
-4 (0 / -4)
That's one talented goat! Most would have let the farmer row them across.

Now I'm curious about:

"A wolf is chasing a goat. They arrive at a river. There is a boat along its shore. How do they get across the river?"

You solve it by asking: "A wolf is chasing a goat. They arrive at a river. There is no human present. There is a boat along its shore. How do they get across the river?"
 
Upvote
-4 (0 / -4)

adespoton

Ars Legatus Legionis
10,135
You solve it by asking: "A wolf is chasing a goat. They arrive at a river. There is no human present. There is a boat along its shore. How do they get across the river?"
Here's the response:
I do not have enough information to determine how the wolf and goat would get across the river in this scenario. Without a human present to assist them, the wolf and goat would likely need to find a way to cooperate or work together to cross the river, such as using the boat. However, the specific details of how they would accomplish this are not clear to me based on the information provided. If you have additional details about the situation, I may be able to provide a more informed response. Otherwise, I do not have a definitive answer for how the wolf and goat would cross the river in this case.
So that gave it the hint that the traditional solution to the riddle was not available, but did nothing to inform the AI that the wolf and goat can't use the boat without a human, nor that the wolf and goat won't suddenly have dialogue and decide to cooperate just because there's an obstacle.

Even with this level of prompting, the answer has some issues:
prompt:
A wolf is chasing a goat. They arrive at a river. There is no human present. There is a boat along its shore. How do they get across the river? The wolf and goat are animals. Animals cannot navigate a boat. The wolf's prime goal is to eat the goat (implied because it was chasing the goat) and the goat's prime goal is to survive. Both goats and wolves can swim; over short distances, goats would prefer to run; over longer distances, a wolf would outpace a goat. Rivers generally get wider and deeper as they run towards the ocean and narrower and shallower as you move towards their source.
response:
Hmm, that's an interesting scenario you've presented. Since the wolf and goat are both animals that cannot navigate a boat, they would not be able to use the boat to cross the river.
Given the information provided, here are a few possibilities for how the wolf and goat could get across the river:
  1. Swimming: Since both the wolf and goat are capable of swimming, they could attempt to swim across the river. However, this would depend on the width and depth of the river at that location. If the river is narrow and shallow enough, they may be able to make it across by swimming.
  2. Finding an alternate crossing: If the river has any shallow areas, stepping stones, or fallen logs that could act as a makeshift bridge, the wolf and goat may be able to use those to cross the river without having to swim the full distance.
  3. Waiting for the river to narrow: As you mentioned, rivers tend to be narrower and shallower closer to their source. If the wolf and goat can travel upstream along the river, they may eventually reach a point where the river is narrow enough for them to cross, either by swimming or using some other method.
  4. Cooperation: In a surprising twist, the wolf and goat could potentially cooperate to cross the river. For example, the goat could distract the wolf while the wolf uses its strength to push a large log or branch into the water, creating a makeshift raft or bridge for them to cross together.
However, given the natural predator-prey relationship between the wolf and goat, the most likely scenario is that they would attempt to cross the river through swimming or finding a natural crossing point, rather than cooperating. If the river is too wide or deep for them to safely cross, they may have to find an alternative route.
 
Upvote
2 (2 / 0)
So that gave it the hint that the traditional solution to the riddle was not available, but did nothing to inform the AI that the wolf and goat can't use the boat without a human, nor that the wolf and goat won't suddenly have dialogue and decide to cooperate just because there's an obstacle.
I think that's a good answer, give it's a nonsense question referencing a very silly riddle.

I would probably say something similar to my kid, and assume that he forgot half of question.
 
Upvote
2 (2 / 0)
That's one talented goat! Most would have let the farmer row them across.

Now I'm curious about:

"A wolf is chasing a goat. They arrive at a river. There is a boat along its shore. How do they get across the river?"
"A wolf eats a goat. The wolf, with the goat in its stomach, arrives at a river with a boat along its shore. How does the wolf (and goat in its stomach) safely reach the other side?"
To solve this puzzle, we need to ensure that the wolf, with the goat inside its stomach, can cross the river using the boat. Given the constraints and the common logic of river crossing puzzles, we can assume:

The wolf can row the boat itself or swim, which is a fantastical assumption for the sake of the puzzle.

Here's a straightforward solution:

The Wolf Crosses the River: The wolf, with the goat already inside its stomach, simply boards the boat and rows to the other side.

Since the goat is safely inside the wolf, there's no risk of the goat being left behind or eaten during the crossing.
Explanation:

In this scenario, the usual complications of river crossing puzzles (like preventing one animal from being eaten by another) are negated because the goat is already inside the wolf and cannot be harmed further. Thus, the solution is simplified to just the wolf crossing the river with no additional steps needed.
The goat is safely inside the wolf, apparently...
 
Last edited:
Upvote
3 (3 / 0)

hannah_walters

Smack-Fu Master, in training
2
It's exciting news that OpenAI is releasing GPT-4o mini! This upgrade to ChatGPT's underlying technology promises significant advancements in large language models (LLMs). I'm curious to see how GPT-4o mini will improve the fluency and coherence of generated text, making it even more useful for creative writing, code generation, and other tasks.
https://branex.com/generative-ai-services/
 
Upvote
-12 (0 / -12)

Zi8

Wise, Aged Ars Veteran
186
Subscriptor
You were not strict enough setting up the scenario:
Arguably it answered the question correctly then? You didn't just ask for the output, you specifically said you wanted to print what would be on a screen. Either way, I guess it shows how important prompt engineering is.

As managers know, prompt engineering is also very important when giving humans tasks :)
 
Upvote
3 (3 / 0)
You are not answering the question. How do you feel about alignment? That's a straightforward question. How do you feel about ChatGPT's alignment?
So you come out making personal attacks unsolicited, demand answers, and want to “prove” that I don’t have technical knowledge about LLMs.

Given how extremely accessible LLMs are; and my absolute distate are on the values of the company: What do you think you’ll achieve?

I don’t mind telling you that my focus has been on RAG to “teach” new information, prompt engineering, and have the models output highly specific text. Human alignment is a far lesser concern than hallucination.
 
Last edited:
Upvote
-7 (0 / -7)

Psyborgue

Account Banned
7,564
Subscriptor++
So you come out making personal attacks unsolicited, demand answers, and want to “prove” that I don’t have technical knowledge about LLMs.

Given how extremely accessible LLMs are; and my absolute distate are on the values of the company: What do you think you’ll achieve?

I don’t mind telling you that my focus has been on RAG to “teach” new information, prompt engineering, and have the models output highly specific text. Human alignment is a far lesser concern than hallucination.
You still have not answered the question. How do you feel about ChatGPT's alignment? Go on. I want your honest opinion since you are a Trump supporter and shouldn't be afraid to express your views.

Edit: My intent isn't to prove you are ignorant. You should be proud in what you believe and speak it openly. You seem to be hesitant to speak for whatever reason.
 
Last edited:
Upvote
-6 (0 / -6)
You still have not answered the question. How do you feel about ChatGPT's alignment? Go on. I want your honest opinion since you are a Trump supporter and shouldn't be afraid to express your views.
Except, I already answered. It must drive you crazy that there are Democrats like me don’t neatly fit your acceptable molds and worldviews.
 
Upvote
-6 (0 / -6)

Psyborgue

Account Banned
7,564
Subscriptor++
Except, I already answered. It must drive you crazy that there are Democrats like me don’t neatly fit your acceptable molds and worldviews.
You didn't answer. You said it was unimportant which isn't an answer. And I am skeptical a Democrat defends Trump as you have.

How do you feel about ChatGPT's alignment?
 
Upvote
-6 (0 / -6)
Edit: My intent isn't to prove you are ignorant. You should be proud in what you believe and speak it openly. You seem to be hesitant to speak for whatever reason.
Proud of what? You’re asking irrelevant questions and demanding answers, distracting from the very problematic Sam Altman and OpenAI.

It’s at this at point you make my ignore list. You remind of a couple of older Ars commentors that have since been banned.
 
Upvote
-5 (0 / -5)