The hottest Google Cloud Substack posts right now

Serverless technology is becoming more mainstream and standardized.
Google Cloud is leading in container-based serverless adoption growth.
AWS offers a variety of services, leaving customers to choose based on their needs.

Combining common ideas can lead to great results. The fundamentals of utilizing serverless architecture and CDNs like Google Cloud and Fastly CDN were key to Khan Academy handling increased traffic.
CDNs are important for scalability. They consist of servers distributed worldwide, enabling faster user interactions by caching content and optimizing server resources.
Serverless architecture provides scalability and performance. By hosting applications on external servers, like those at Khan Academy, the system handled increased traffic efficiently without manual intervention.

Malloy offers an innovative way to analyze data with a focus on user experience.
Google Cloud Shell simplifies GCP environment setup with necessary libraries and resources.
To start analyzing BigQuery data with Malloy, install the VS Code extension and connect to your GCP Project.

Approach data engineering like software products, applying software engineering SDLC principles can help automate Google Cloud Dataflow with GitLab CI/CD pipelines.
A Dataflow flex-template consists of a Dockerfile and a template specification JSON file, offering advantages like separating implementation from deployment and enabling different teams to work on the pipeline.
Using GitLab's CI/CD for deploying Dataflow flex-templates is beneficial due to its intuitive UI, CI Linting feature, out-of-the-box security, and environment integration tools.

Plenty of resources are available for setting up a Cloud Composer environment in a single GCP project, but integrating it into a professional enterprise environment with a Shared VPC network can pose challenges with communication and permissions.
Setting up two GCP projects, a service project, and a host project is essential. Understanding how to create and configure a Shared VPC network and subnet for the Cloud Composer environment is crucial for data and infrastructure engineers.
Permissions preparation is key, including roles like Compute Shared VPC Admin and Project IAM Admin, and setting up the necessary permissions for Google APIs service accounts, GKE service accounts, and Composer Agent Service Accounts at both project and subnet levels.

Get a weekly roundup of the best Substack posts, by hacker news affinity: