The hottest AWS Substack posts right now

And their main takeaways
Category
Top Technology Topics
The Orchestra Data Leadership Newsletter 79 implied HN points 28 Mar 24
  1. A detailed guide to running dbt Core in production in AWS on ECS is outlined, focusing on achieving cost-effective and reliable execution.
  2. Running dbt in production is not highly compute-intensive, as it primarily serves as an orchestrator, making it more cost-efficient compared to running Python code that utilizes compute resources.
  3. By setting up dbt Core on ECS in AWS and using Orchestra, you can achieve a scalable, cost-effective solution for self-hosting dbt Core with full visibility and control.
Data Engineering Central 137 implied HN points 24 Jul 23
  1. Data Engineers may have a love-hate relationship with AWS Lambdas due to their versatility but occasional limitations.
  2. AWS Lambdas are under-utilized in Data Engineering but offer benefits like cheap solutions, ease of use, and driving better practices.
  3. AWS Lambdas are handy for processing small datasets, running data quality checks, and executing quick logic while reducing architecture complexity and cost.
Get a weekly roundup of the best Substack posts, by hacker news affinity:
Rodrigo Kamada 58 implied HN points 22 Mar 23
  1. Create a serverless API using AWS Lambda and Node.js with TypeScript and Express.js.
  2. Learn to configure an account on AWS Lambda, create access keys, build a Node.js application with Express.js, and deploy it on AWS Lambda.
  3. Test the serverless API on AWS Lambda by sending requests to the created routes.
Making It Up 39 implied HN points 27 Feb 23
  1. DNS management in AWS is now even easier with the release of AWS CDK Split Horizon DNS v0.0.9.
  2. You can import existing hosted zones into the SplitHorizonDns construct without recreating records.
  3. A new safeguard called `disallowPrivateZone` has been added to allow isolation of private zone resources.
AnyCable Broadcasts 19 implied HN points 07 Apr 23
  1. AnyCable connects Twilio streams with Hanami, utilizing features like Phlex, Vite, and CableReady.
  2. Exploring the potential of serverless WebSockets reveals challenges in handling long-lived, stateful connections in a serverless environment.
  3. Implementing pub/sub components for serverless WebSockets requires extra consideration for optimizing resources and scalability.
Cloud Weekly 26 implied HN points 27 May 23
  1. There are 4 main disaster recovery techniques: Backup & Restore, Pilot Light, Warm StandBy, and Multi-Site Active/Active.
  2. The techniques aim to optimize for RPO (Recovery Point Objective) and RTO (Recovery Time Objective), which determine how much data loss and downtime are acceptable.
  3. The choice of technique depends on factors like cost, recovery speed, and the criticality of the application, with each method having its own advantages and trade-offs.
Cloud Weekly 8 implied HN points 03 Jun 23
  1. Autoscaling allows you to adjust resources automatically based on traffic, ensuring your application stays performant and resilient.
  2. Auto Scaling Groups in AWS help manage resources by defining minimum, desired, and maximum instances, allowing for easy scaling up and down.
  3. AWS Auto Scaling Groups provide strategies like simple scaling, target scaling, and step scaling to optimize costs and react to traffic based on predefined metrics.
Bit by Bit 3 implied HN points 29 Jun 23
  1. Amazon CloudWatch Logs Live Tail helps developers follow cloudwatch logs in real-time with features like dynamic filters and highlights.
  2. Live Tail can stream logs in around 2 seconds from when they are ingested in CloudWatch, while using CLI can vary between 2 to 9 seconds.
  3. Live Tail's pricing model is per-second and includes a free tier of 1,800 minutes per month, making it a useful addition to AWS console tool set for real-time log monitoring.
Bit by Bit 3 implied HN points 08 Jun 23
  1. AWS made changes to S3 default settings for improved security by blocking public access and custom ACL rules for new buckets.
  2. While enhancing security, the process of creating public buckets has become more complex and requires explicit steps to disable block policies.
  3. The complexities of managing storage like S3 in the cloud call for solutions that balance simplicity, security, and extensibility.
Bit by Bit 2 HN points 18 Apr 23
  1. Transitioning to running your dev environment on the cloud, like Amazon EC2, can offer more versatility and improved performance.
  2. Key components of setting up a development environment on Amazon EC2 include VPC, Autoscaling Group, and EC2 Instance with specific configurations.
  3. Optimizations like adding tailscale, hibernating instances, using vscode for connection, and utilizing reserved instances can further enhance the cloud-based development setup.
Cloud Weekly 1 HN point 19 Mar 23
  1. Consider using FIFO queues in AWS for order processing to ensure messages are processed in the right order and avoid duplicates.
  2. Re-design solutions to leverage asynchronous communication over synchronous for a more resilient system.
  3. Implement retry mechanisms and explore Dead Letter Queues to handle failures and define thresholds for message processing.
realkinetic 0 implied HN points 19 Mar 24
  1. When developing AWS data pipelines with Lambda and S3, setting up unit tests early can catch bugs and speed up development time.
  2. Using tools like VSCode and Jest can help streamline the testing process for AWS infrastructure code.
  3. Utilizing mock libraries like aws-sdk-client-mock allows for effective testing of data processing functions in Lambda.
Thoughts from the trenches in FAANG + Indie 0 implied HN points 09 Jun 23
  1. AWS Lambda allows you to run code without managing servers, making it a great choice for many developers.
  2. Using AWS CLI to stream logs from Lambda to your terminal is much faster and more efficient than using the AWS Console.
  3. You need to know the log group for your Lambda function, but once you do, setting up log streaming is a simple process.