https://platformengineering.org logo
#general
Title
# general
w

Wayne Allan

10/26/2022, 1:00 AM
Is anyone here working in a company that requires their app to host thousands or even millions of images on s3 or something similar? I’d love to chat about your challenges, I have an idea brewing but want to validate the problem first.
r

Romaric Philogène

10/26/2022, 8:00 AM
Is it a problem that you have or you anticipate?
w

Wayne Allan

10/26/2022, 8:10 AM
Hey Romaric, It’s actually a problem my co-founder and I know how solve well from previous companies. We are trying to gauge if it’s a problem enough that others will pay us to solve it for them.
r

Romaric Philogène

10/26/2022, 8:12 AM
Oh ok, it makes sense to ask then 👍
a

Andre Marcelo-Tanner

10/26/2022, 1:03 PM
What are the problems that are usually associated with such scale?
m

Michael Smith

10/26/2022, 2:54 PM
We hosted quite a number of photos at Yik Yak when I was there. It was a basic S3 upload / share via Cloudfront kinda stack with moderation triggers, etc.
w

Wayne Allan

10/26/2022, 10:50 PM
We found CloudFront + S3 can get expensive fast when you need compute to resize images on the fly - at realestate.com.au we had crazy amounts of images that needed to be delivered at different aspect ratios, resolutions watermarking etc. With the volume we were doing it was cheaper to use EC2 over lambdas. Seems like the out of the box solutions are very expensive beyond a point and in some cases not as fast as as they need to be either. What’s not clear to me is if people needs something as fast and cost effective as we did. I’m working on an MVP to do it faster, cheaper and easy to configure and adopt, if anyone’s interested to give it a go let me know.
m

Michael Smith

10/27/2022, 4:03 PM
We were lucky in that we just shrank and resized once and served the much smaller file out to the feed. I imagine people selling there houses like their pictures in pretty high resolution so I can see your problem.
j

Jon Stevens

10/30/2022, 5:03 PM
We serve millions of media content through GCS which is mostly images and some PDFs
50 Views