Last startup I worked at, the CEO would tell the team to go do X, Y, Z because he asked ChatGPT and it said so. Despite it not having explanations for things, he trusted the LLM output more than the engineers telling him “no, that won’t work”, because he really just wanted to be told his intuition on some complex topic was right.
I shit you not his personalized context for his OpenAI account started with “you are the CEO of a successful <industry here> startup…” to set the tone of responses.
I didn’t last very long there.