OpenAI opens GPT-3.5 Turbo up for custom tuning – The Verge
By Wes Davis, a weekend editor who covers the latest in tech and entertainment. He has written news, reviews, and more as a tech journalist since 2020.
OpenAI has announced that businesses can now fine-tune GPT-3.5 Turbo using their own data — OpenAI claims the resulting custom model can match or exceed the abilities of GPT-4 for certain tasks. Later this fall, the company says it will open up the arguably more advanced GPT-4 for the same purpose.
Fine-tuning lets businesses essentially hone ChatGPT to a more focused model that’s especially efficient for certain tasks. The supervised training would make a bot that’s unique to the client company so that it offers, say, reliable responses in a specific language or with more concise wording. Until now, business customers were limited to GPT-3 variants for this, like davinci-002 or babbage-002.
The model would come pre-trained, like GPT-4, up to September 2021 before being fed company data. OpenAI says that none of that data, nor any input or output, will be used to train models outside of the client company.
Other uses include ensuring the bot is trained to mimic brand voices so they’re more consistent — think ad copy or internal communications at least partially written by AI (not that we don’t already see plenty). Software companies could use it for routine code like API calls or to dependably format and complete snippets of code.
GPT-3.5 Turbo is a model family the company debuted earlier this year that it said was ideal for use cases that aren’t chat-specific. It can handle 4,000 tokens at a time, which OpenAI says is double what previously offered models could interpret. The company added that early testers have been able to make 90 percent shorter prompts after priming GPT-3.5 with fine-tuned instructions.
Pricing for GPT-3.5 is $0.0080 per 1,000 tokens for training, $0.0120 per 1,000 tokens for input usage, and $0.0120 per 1,000 tokens of the chatbot’s output.
Microsoft also offers refinable GPT-based models as part of its AI Builder and Power Virtual Agents services, intended to be connected to a company’s internal data to craft responses. Microsoft pitches them as a way to summarize information or generate content for email campaigns. Like OpenAI’s fine-tuning bots, Microsoft’s customizable AI bots can connect to company data to generate responses from a business’ knowledge base.
/ Sign up for Verge Deals to get deals on products we’ve tested sent to your inbox daily.
The Verge is a vox media network
© 2023 Vox Media, LLC. All Rights Reserved
