Terraform an Athena Database on Google Colab

Sometimes you need more resources than what Google Colab can provide for even short-lived data analysis, wrangling or ad hoc science.

Google Colab is a remarkable resource for hosted Jupyter Notebooks.

Colaboratory, or “Colab” for short, is a product from Google Research. Colab allows anybody to write and execute arbitrary python code through the browser, and is especially well suited to machine learning, data analysis and education. More technically, Colab is a hosted Jupyter notebook service that requires no setup to use, while providing free access to computing resources including GPUs

https://research.google.com/colaboratory/faq.html

Free notebook instances provided by Colab have quite generous, though somewhat vague resource limits.

  • What are the usage limits of Colab?Colab is able to provide free resources in part by having dynamic usage limits that sometimes fluctuate, and by not providing guaranteed or unlimited resources. This means that overall usage limits as well as idle timeout periods, maximum VM lifetime, GPU types available, and other factors vary over time. Colab does not publish these limits, in part because they can (and sometimes do) vary quickly.

The Pro and Pro + plans are also very impressive, for the cost, both providing more of the following:

  • Faster GPUs — Access to faster GPUs and TPUs means you spend less time waiting while your code is running.More memory — More RAM and more disk means more room for your data.Longer runtimes — Longer running notebooks and fewer idle timeouts mean you disconnect less often.

In addition to even more of the above, Pro + also includes:

Background execution - Notebooks keep executing even after you close your browser.

Summary of Google Colab Plans

NOTE: some of the specs are estimates, based on the disclaimers mentioned above and referenced from the Colab FAQ.

Previous
Previous

November 2021

Next
Next

Apache Spark with Java on Jupyter