i

igor.kurylo

07/09/2023, 12:50 PM
Hi All, We are have a deep learning team, which need platform for model inference, I would appreciate for some information could help me how build solution for this. Thanks.
a

Andrew Fong

07/09/2023, 3:21 PM
None of the saas or cloud platforms will work? Building from scratch takes awhile and will probably have poor ergonomics
you’re probably best just buying databricks at this point if you need AI infra.
i

igor.kurylo

07/10/2023, 5:23 AM
Saas cloud platform should work, that i want recommendation for one, and if some of open source is should good also.
a

Andrew Fong

07/10/2023, 12:41 PM
Why? Its going to cost as much and be subpar in the experience
Snowflake and databricks at this point have shown that unless you’re a hyperscaler you’re better off selecting them in this space.
i

igor.kurylo

07/11/2023, 7:55 AM
Snowflake and databricks should give option to serving models?
i

igor.kurylo

07/11/2023, 10:54 AM
Ok. thaks
a

Andrew Fong

07/11/2023, 11:01 AM
I’d reach out to their sales teams and eval. I’ve done evals of both and both are really good products. You should probably think of them as “AI Cloud Service Providers” the same way that GCP/AWS/Azure are for traditional services
i

igor.kurylo

07/11/2023, 11:01 AM
🙂 Good nice.