Fix, or Flub? AI Edition

Our recent blog about the inaccurate, nutty, and occasionally dangerous things people say online about Airstream repairs seemed to have struck a nerve. We received a number of comments from folks who also wince when they read the answers on social media and forum posts.

So we decided to write up another installment. We're calling it "FIX, or FLUB?" 

This one is about the eye-rolling things you might hear from AI chatbots like ChatGPT and Google's Gemini. Warning: You're about to enter bizarro-land. 

Rub-a-dub-flub

A customer recently wrote to us asking if our teak shower mat would fit his 2025 Airstream Globetrotter 27FBQ. The answer is of course, yes.

But why did he ask?

He asked us because he'd already queried Google's AI, and got the strange answer quoted at right. Was this a FIX, or a FLUB?

FLUB. Most of the first paragraph is complete nonsense: the shower hasn't changed, the shower head is still in the same place, and separate fans for the bath and shower is nothing new. 

This shows that, while AI-generated answers are quick and easy, they're not reliable. Ask the same question with slightly different wording, and you'll get different answers. Ask it again tomorrow, and you may get yet another answer.

It's kind of like asking any random unqualified person. The AI doesn't really know, it's just parroting things it read or watched on the Internet.

Puerto Rico—a popular RV'ing destination? 

Another customer contacted us because he wanted his order shipped to Puerto Rico. That's an unusual request, because RV'ing isn't really much of a thing on islands in general. Was it possible that I was missing some great camping opportunities?

After all, the website "vanbuild" has an AI-generated page which starts with this statement:

"Puerto Rico is a popular destination for recreational vehicle (RV) enthusiasts, with its tropical climate, beautiful beaches, and rich culture."

Setting aside the obvious question ("how do the RV enthusiasts drive there?"), my curiosity was piqued. So I asked ChatGPT if there were RV parks in Puerto Rico, and it said there were. In fact, it listed nine "RV parks".

Was this a FIX, or a FLUB?

FLUB. Upon checking all of the sites listed, it turned out (of course) that none of them actually have RV sites. Most of them offer tent camping. The first one listed is actually a coffee plantation. So why did ChatGPT and Vancamp think they were RV parks?

In this case, one of the sources was Hipcamp's website. Hipcamp seems to have many computer-generated pages, one of which is entitled "RV camping in Puerto Rico".

None of the locations on the Hipcamp site are actual RV parks. The best you might get would be a parking space. So, here we have a case of artificially-generated answers based on an algorithmically-generated web page, based on a poor understanding of why "RV parks" are not the same as "RV parking".

In other words, one computer was told to make up a page about "RV camping" and other computers believed it without question. It's up to you, the human, to be more discerning. (After all, AIs don't go camping.) 

So there goes my dream of an Airstream trip in Puerto Rico. After cross-referencing a lot of sources, it seems the best opportunity is to travel there would be in a locally-rented Class B van—with a lot of boondocking. 

I'll give you five guesses

We decided to test ChatGPT's ability to diagnose a simple and common problem. This is the same question that we discussed in the previous blog, which was asked and answered (poorly) on Facebook. I wondered, could the AI do better than the humans?

So I entered this question:

I have a 2010 20ft Flying Cloud. Wondering why my fresh water tank filled up the other day when I was connected to city water. Why?

ChatGPT gave five possible causes. Let's look at each one and see whether it offered a FIX, or a FLUB:

1. **Bypass Valve Position**: Many RVs have a bypass valve that can direct water either to the fresh water tank or directly to the plumbing system. If this valve is set to fill the tank, it will do so even when connected to city water.

FLUB. It is true that motorhomes often have this sort of valve. I give credit to ChatGPT for being too polite to label this as "human error" (which it would be). But the question was about an Airstream travel trailer which doesn't have such a valve, so the answer is unhelpful.

2. **City Water Connection**: When connected to city water, the pressure from the city supply can sometimes cause the fresh water tank to fill if the system is not designed to prevent backflow. This can happen if there is a malfunction in the pressure regulator or if the system is not properly configured.

FLUB. The AI is confusing three different components: check valve, backflow preventer, and pressure regulator. (All Airstreams built in the last several decades have all three of these devices built in.) The problem is the check valve or bypass valve, not the other items. 

3. **Check Valve Failure**: There may be a check valve in the system that is supposed to prevent water from flowing back into the fresh water tank when connected to city water. If this valve is faulty or stuck, it could allow water to flow into the tank.

FIX. Good job, AI!  You finally guessed the right answer.

4. **Tank Overflow**: If the fresh water tank is full and the overflow vent is blocked or malfunctioning, it may not be able to drain properly, leading to an overflow situation.

FLUB. The AI should have quit while it was ahead. It's describing a situation where you are intentionally filling the water tank. It's not really answering the question.  

5. **Water Pump Activation**: If the water pump is activated while connected to city water, it may inadvertently draw water into the fresh water tank, especially if there are issues with the plumbing system.

FLUB. That's not what the water pump does. The water pump removes water from the tank, it doesn't add water.

Hmmm... One right answer out of five. Not awesome. But to cover its butt, ChatGPT added this:

If the problem persists, consulting a professional RV technician may be necessary to diagnose and resolve the issue.

You could always say that, couldn't you?  

It seems that you get what you pay for, at least at this stage of AI development. I wouldn't trust any answers generated by chatbots without thoroughly double-checking everything with reliable sources. At best, these things are good for generating a summary of the Internet's thoughts, so you have a starting point for finding the true answer.

Just remember this warning that Google puts at the bottom of every AI-generated answer: