I would love to know how others are building LLM p...
# general
m
I would love to know how others are building LLM platform in production. I think we have sufficient blogs/papers/books and details about training the models but interested to know how you are using it effectively like cost, reliability consideration etc.
k
@Patryk Bak will be sharing this on Zurich Meetup in August :)
v
Can I watch the meetup online?
k
m
Yeah I think if it can be streamed online that would be great
j
I'm trying as much as possible to reuse existing tools and infrastructure. For example, observability is a huge problem for LLMs and Agents. We're seeing a whole new set of tools crop up for LLM observability. However, I think in many cases you can get by reusing existing solutions. For example, my observability story is centered around structured logging and I reuse my existing logging infrastructure (Cloud Logging)