Hey guys. I would like to spin virtual place in th...
# generall
Luna Crafts
12/22/2023, 9:14 AMHey guys. I would like to spin virtual place in the cloud for each of users. This virtual place should be able to handle kafka instance, postgres and http/ws services.
Currently I have CRD that I replicate with terraform.
I would like to craft additional features (like scaling to zero if no usage, scaling up if traffic, respawning machines from zero etc).
Can your recommend any way to automate it in scale?
k
Krzysztof Wrobel
12/22/2023, 1:41 PMYou would need to apply a golden path and self service concepts.
Krzysztof Wrobel
12/22/2023, 1:42 PMYou would need an automation (CI/CD pipeline or a page on IDP) that allows users to create infra from preimplemented templates.
Krzysztof Wrobel
12/22/2023, 1:43 PMThen user should be able to remove it, recreate it, scale it up and down.
Krzysztof Wrobel
12/22/2023, 1:44 PMAll that is created should be placed in some kind of infra catalog, which contains information who owns what, when was it created, etc.
Krzysztof Wrobel
12/22/2023, 1:45 PMThings like scaling up and down depending on traffic would usually be baked in in each of the templates
Krzysztof Wrobel
12/22/2023, 1:45 PMfor each technology separately. If you are using k8s it is easy to setup Keda autoscaling based on multiple metrics like http traffic but also numer of messages in queue/topic in kafka
Krzysztof Wrobel
12/22/2023, 1:45 PMWith Infrastructure catalog you could also iterate through your resources and shut them down and spin them up at certain hours, or depending on metrics
Krzysztof Wrobel
12/22/2023, 1:49 PMThe bigger the scale the more difficult the task.
Krzysztof Wrobel
12/22/2023, 1:50 PMIf you have 200 devs using that, the costs will add up quickly, so you need to be able to say who pays for what 😅
Krzysztof Wrobel
12/22/2023, 1:50 PMGood luck 🙂
g
Gyan Kapur
12/22/2023, 3:30 PMYou could spin up vclusters for this: https://www.vcluster.com/pro/