IBM today announced it has committed itsModelMeshinference service to open source.
Artificial intelligence is a backbone technology that nearly all enterprises rely on.
The majority of our coverage here onNeuraltends to discuss the challenges involved in training and developing AI models.
Think about it: you get in to your banking account and theres a discrepancy.
You tap the How can we help?
icon at the bottom of your screen and a chat window opens up.
It’s free, every week, in your inbox.
You enter a query such as Why isnt my balance reflecting my most recent transactions?
What youve done is sent an inference request to a machine learning model.
But what if it stalls or doesnt load the inferences?
You end up wasting your time with a chat bot and still need your problem solved.
IBM is now contributing the inference platform to theKServeopen source community.
Designed for high-scale, high-density, and frequently-changing model use cases, ModelMesh can help developers scale Kubernetes.
There could be millions of users querying a single interface simultaneously.
And those millions of queries could require service from thousands of different models.
ModelMesh manages both the loading and unloading of models to memory to optimize functionality and minimize redundant power consumption.
you could learn more about ModelMesh here on IBMswebsite.
