Slackbot
05/18/2023, 1:40 PMJakub Olbrysz
05/18/2023, 1:51 PMTomek Fiechowski
05/18/2023, 2:01 PMBradley Sickles
05/18/2023, 2:05 PMBradley Sickles
05/18/2023, 2:07 PMTomek Fiechowski
05/18/2023, 2:10 PMBradley Sickles
05/18/2023, 2:20 PMMark Cheshier
05/18/2023, 4:51 PMVivek Dwivedi
05/19/2023, 4:36 AMPayam Azadi
05/20/2023, 2:31 AMYngvar Kristiansen
07/04/2023, 7:16 PMTomek Fiechowski
07/05/2023, 9:46 AMTomek Fiechowski
07/05/2023, 9:48 AMWe're building a golden path, so for instance we've decided our devs should use AWS fargate.Have you already agreed on the abstraction layer? Fargate will cover the containerised environment but what about other resources, like queues, databases or something more fancy? Are developers expected to have good knowledge about Cloud resources and IaC behind these or you are creating some abstraction over this?
Tomek Fiechowski
07/05/2023, 9:49 AMYngvar Kristiansen
07/07/2023, 11:16 AMit's a tool worth recommendingOK good to know!
Yngvar Kristiansen
07/07/2023, 11:25 AMHave you already agreed on the abstraction layer?We are trying to not to invent our own abstraction layer (a possibly huge topic), but we're mostly relying on terraform-aws-modules for the various AWS resources out there, for instance ECS. They're quite flexible and supports the various needs teams have. We have agreed upon using a set of basic AWS services: ECS with Fargate, and for Aurora postgres serverless v2 for databases, unless people have very specific needs. Otherwise most teams just use standard AWS stuff like VPC, ALB, Parameter store or Secrets manager. We haven't covered the observability stack yet, but it looks like we're going for Grafana, possibly managed Prometheus / AMP and Cloudwatch as data sources, and using the OpenTelemetry stack.
Yngvar Kristiansen
07/07/2023, 11:27 AMYngvar Kristiansen
07/07/2023, 11:31 AMAre developers expected to have good knowledge about Cloud resources and IaC behind these or you are creating some abstraction over this?We are aiming for our devs to know the cloud resources they are using. I can talk a lot about this topic though π Some find it easy, some find it hard, some are not interested in learning those things at all.
Yngvar Kristiansen
07/07/2023, 11:36 AMIt leads to confusion what they can modify or notWe have tried to very clearly communicate that teams have the responsibility for their own infrastructure, but with good help from the platform team (my team) and AWS support. So we are spending most of our time helping teams, and unfortunately don't have much time to improve our platform product. At this point in time, I find that some people/teams don't really have the competence to upgrade aws providers in Terraform and Terraform providers if there are breaking changes, however.
Yngvar Kristiansen
07/07/2023, 11:41 AMIt leads to confusion what they can modify or notInteresting, we might be heading in that direction as well. How template lifecycle / updates are handled is probably strongly related to this. Perhaps simply putting most configuration in Terraform variables rather than in the middle of the resources can provide a good enough separation of what the team normally should be touching and not.
Yngvar Kristiansen
07/07/2023, 11:41 AMto automatically update majority of the services through creating PRsYou haven't by chance open sourced this? π
Tomek Fiechowski
07/21/2023, 8:20 AMAurora postgres serverless v2How do you manage updating the database versions? I think we use the same, but there are already some pending updates to newer versions. Not sure if our Platform should do it or the dev teams π€
Tomek Fiechowski
07/21/2023, 8:21 AMJust a few teams use queues, they use SQS I believe.How local development looks like, if they need an SQS?
Tomek Fiechowski
07/21/2023, 8:22 AMYou haven't by chance open sourced this? πNot yet π But I shared an idea with the team to make a presentation about it on one of the upcoming Platform/DevOps conferences - will let you know if we do it πͺ We could also jump on a call some time and involve some members of our teams to exchange experiences πͺ
Yngvar Kristiansen
08/03/2023, 6:16 AMHow do you manage updating the database versions?We haven't done it yet, we're on 13 still. For minor versions, AWS updates automatically. Usually, we document how to do changes and upgrades, so teams can follow a guide. For more complex operations, a guide would not be a suitable fit, and then we either do it together (mob programming), or we do it for them.
Yngvar Kristiansen
08/03/2023, 6:17 AMHow local development looks like, if they need an SQS?I don't know for SQS specifically, I haven't used it myself.
Yngvar Kristiansen
08/03/2023, 6:21 AMwill let you know if we do it πͺ We could also jump on a call some time and involve some members of our teams to exchange experiences πͺCool, sounds good π