OpenAI is at all times making slight changes to its fashions and pricing, and right now isn’t any exception. The corporate has released a handful of new models and dropped the value of API entry — that is primarily of curiosity to builders, but additionally serves as a bellwether for future shopper choices.
GPT-3.5 Turbo is the mannequin most individuals work together with, often by way of ChatGPT, and it serves as a type of business customary now — in case your solutions aren’t nearly as good as ChatGPT’s, why trouble? It’s additionally a preferred API, being decrease price and quicker than GPT-4 on a variety of duties. So paying customers can be happy to listen to that enter costs are dropping by 50% and output by 25%, to $0.0005 per thousand tokens in, and $0.0015 per thousand tokens out.
As folks play with utilizing these APIs for text-intensive functions, like analyzing total papers or books, these tokens actually begin to add up. And as open supply or self-managed fashions catch as much as OpenAI’s efficiency, the corporate wants to verify its clients don’t simply depart. Therefore the regular ratcheting down of costs — although it’s additionally a pure results of streamlining the fashions and enhancing their infrastructure.
GPT-3.5 Turbo additionally will get a brand new mannequin model, 0125 (i.e., right now’s date) that features “varied enhancements” however apparently little that OpenAI thought value mentioning. The final model was 0613, so it’s a bit of stunning they don’t point out extra.
GPT-4 Turbo will get a brand new preview mannequin for API use, additionally 0125, which has an fascinating repair:
This mannequin completes duties like code era extra totally than the earlier preview mannequin and is meant to cut back circumstances of “laziness” the place the mannequin doesn’t full a activity.
Maybe the mannequin realized the flawed classes from the builders whose habits it ingested and embodied! Possibly AI is already quiet quitting. Good for AI!
That is nonetheless in preview mode. However GPT-4 Turbo with imaginative and prescient (i.e., GPT-4 V) will launch to normal availability “within the coming months.”
There are additionally a handful of recent and improved textual content embedding fashions, that are extra for the folks on the technical facet. And the corporate additionally launched a brand new model of its free moderation API — which identifies doubtlessly dangerous textual content. Search for model 007 for those who’re experimenting with utilizing this to enhance your moderation wants.