Back to Blog

Why the Best AI Model Is No Longer Enough

WaveSpeedAI founder and CEO Zeyi Cheng on the Convo AI World podcast.

"The best model wins."

That was a fair description of the first wave of generative AI. Each release produced a visible leap in quality, and the model itself was the story. Once developers began turning those models into products, the question changed. A breakthrough demo can attract attention, but a product also has to work reliably as traffic, costs, and model choices change.

That distinction stayed with me after my conversation with Zeyi Cheng, founder and CEO of WaveSpeedAI. He has worked across open-source models, inference optimization, and product development. His argument was practical: the model is one part of a larger system. Developers also need a reliable way to evaluate, deploy, and replace it without becoming GPU operators.

The Hard Part Starts After the Demo

WaveSpeedAI grew out of a deployment problem. Image and video models were improving quickly, yet putting them into production still demanded GPU capacity planning, CUDA troubleshooting, inference tuning, concurrency management, and constant work to support new releases. None of that was the product developers wanted to build.

What stood out to me was how Zeyi's focus expanded from speeding up inference to making deployment easier from end to end. A stable platform can absorb traffic spikes, capacity limits, and model updates behind one interface. When that infrastructure works, developers can think about the customer experience instead of the GPU fleet behind it.

Model Choice Should Be Reversible

The pace of model development makes long-term bets unusually risky. Today's leading image or video model may be displaced next month, and the best option already depends on the job. One model may handle image editing well, while another produces stronger talking videos. Results can also vary by market, language, and visual preference.

What I found compelling was Zeyi's argument that a model choice should not become an architectural commitment. A unified API lets teams compare outputs and switch providers without rebuilding the application each time. He also described practical cost choices, such as generating at a lower resolution and upscaling when the use case allows it. Product teams have to balance output quality with the time and cost required to produce it.

Developers Judge the Whole Workflow

A benchmark for throughput or inference speed tells only part of the story. For developers, the practical question is whether they can ship a virtual try-on feature, generate campaign assets, or build a creative workflow without spending their time managing infrastructure. A large model catalog is only useful when teams can identify the right model, test it quickly, and move into production with confidence.

That is why WaveSpeedAI is expanding beyond APIs into an AI Studio for comparing models and experimenting with workflows. Zeyi made the need for evaluation concrete with examples of regional preferences. A model that produces convincing faces or language for one market may perform differently in another. Builders need to see those differences in the context of the product they are creating.

Coding Agents Change How Teams Write Software

Zeyi also raised a second shift that deserves attention. Documentation and project structure are no longer written only for human engineers. Coding agents such as Claude Code and OpenAI Codex now read the docs, inspect repositories, and implement integrations. Teams that make their systems legible to both people and agents can move from an idea to a working product more quickly.

My takeaway from the conversation is that model innovation still matters, but product teams do not need to chase every release themselves. Zeyi's advice was to use APIs and coding tools for work that does not differentiate the product, then invest engineering effort in the parts customers notice. The advantage comes from making frequent model changes manageable while keeping the product dependable for users.

The full episode explores inference optimization, unified APIs, regional model preferences, cost-conscious generation, AI-native development, and how Zeyi sees the generative AI platform layer evolving.

Watch the full episode here: https://www.youtube.com/watch?v=L_5oYLGJYDA

Ready to build?

RTE Telehealth 2023
Join us for RTE Telehealth - a virtual webinar where we’ll explore how AI and AR/VR technologies are shaping the future of healthcare delivery.

Learn more about Agora's video and voice solutions

Ready to chat through your real-time video and voice needs? We're here to help! Current Twilio customers get up to 2 months FREE.

Complete the form, and one of our experts will be in touch.

Try Agora for Free

Sign up and start building! You don’t pay until you scale.
Try for Free