Which is why IBM is introducing ModelMesh, a model serving management layer for Watson products that is designed to cope with high scale, high density and frequently changing model use cases. It intelligently loads and unloads AI models to and from memory to strike an optimized trade off between responsiveness to users and computational footprint. ModelMesh already underpins many of Watson cloud services including Watson Natural Language Understanding. It open source and includes ModelMesh...

Read the full article at Betanews