Platform engineering is the discipline of designing and building toolchains and workflows that enable self-service capabilities for software engineering organizations in the cloud-native era.

Platform Engineering

k3s + Wireguard VPN for multi-site setup.

But your workload must be multi-instance, not multi-threaded.

Wireguard is working with Flannel CNI to create a VPN between pods. Every node in the cluster is getting it's own subnet for pods in the mesh VPN.

1. You could start with getting your AI workload to work inside one or more Docker containers. 
2. Once you get this working, the next step would be to use a bridge or <https://docs.docker.com/network/overlay/|overlay> network to allow communication between the Docker containers.
To access GPUs from Docker, you can use <https://github.com/NVIDIA/nvidia-docker|nvidia-docker>.