Νew Cloud TPU VMs makes it easier than ever before to use the industry-leading TPU hardware by providing direct access to TPU host machines, offering a new and improved user experience to develop and deploy TensorFlow, PyTorch, and JAX on Cloud TPUs. Instead of accessing Cloud TPUs remotely over the network, Cloud TPU VMs let us set up our own interactive development environment on each TPU host machine.
We can write and debug an ML model line-by-line using a single TPU VM, then scale it up on a Cloud TPU Pod slice to take advantage of the super-fast TPU interconnect. We have root access to every TPU VM you create, so we can install and run any code we wish in a tight loop with our TPU accelerators. We can use local storage, execute custom code in your input pipelines, and more easily integrate Cloud TPUs into our research and production workflows.
https://cloud.google.com/blog/products/compute/introducing-cloud-tpu-vms