> Has Google/Alphabet publicly released any of their AI models yet?
You mean NLP field changing models from Google like BERT [1]? or Transformers paper [2]? or T5 model [3] (used by company doing ChatGPT like search currently on the front page on HN)?
I read a lot on Twitter about the so-called "culture" of Google that prevents them from making AI based products, meanwhile OpenAI has made ChatGPT and is going to replace Google search within the next two months or so. I think this is the same narrative that's being expressed by the GP comment.
I'm going to guess that the only reason they don't use larger models is because of the compute cost. ChatGPT at 4 billion users with today's hardware is an unsustainable business. However, that thought leads me to imagining: if Google offered Search "Premium" using the latest LLMs, how much would people pay for it?
> if Google offered Search "Premium" using the latest LLMs, how much would people pay for it?
I think they need to solve hallucination problem first, they are already working on optimization eg FLAN-T5 (smaller LLM models same performance) and RETRO (retrieval transformer that can use data index outside of the model) that takes them closer to use it in search.
Some of the commenters in this thread are remarking on the lack of functional examples that they can interact with and others are saying they feel the existence of published technical papers is sufficient. They're talking through each other a bit.
You mean NLP field changing models from Google like BERT [1]? or Transformers paper [2]? or T5 model [3] (used by company doing ChatGPT like search currently on the front page on HN)?
1. https://arxiv.org/abs/1810.04805 code+models: https://github.com/google-research/bert
2. https://arxiv.org/abs/2112.04426
3. https://arxiv.org/abs/1910.10683 code+models: https://github.com/google-research/text-to-text-transfer-tra...