Posted by DigiNomad on 14th of May 2024 at 01:33 pm
GOOG just announced large increase in AI prompt size. 2 million
tokens. The larger it gets the closer we are for consumers to be
able to drop in say the code and all historical data for their
websites and then prompt on top (essentially very easy custom LLMs)
but there are lots of benefits to increasing prompt size.
It's interesting to see The AI wars heat up in the developers
lifting guardrails that they probably really don't want to lift so
quickly simply for product cycle reasons. I mean, technology moves
much quicker in Asia because they don't throttle it like the US
does for product cycle reasons. For example, backup sonar has been
mandatory in Singapore for way over a decade now. It's still a
premium feature in the United States. Product cycles.
Newsletter
Subscribe to our email list for regular free market updates
as well as a chance to get coupons!
GOOG just announced large increase
Posted by DigiNomad on 14th of May 2024 at 01:33 pm
GOOG just announced large increase in AI prompt size. 2 million tokens. The larger it gets the closer we are for consumers to be able to drop in say the code and all historical data for their websites and then prompt on top (essentially very easy custom LLMs) but there are lots of benefits to increasing prompt size.
It's interesting to see The AI wars heat up in the developers lifting guardrails that they probably really don't want to lift so quickly simply for product cycle reasons. I mean, technology moves much quicker in Asia because they don't throttle it like the US does for product cycle reasons. For example, backup sonar has been mandatory in Singapore for way over a decade now. It's still a premium feature in the United States. Product cycles.