This article explains why temporary AWS credentials obtained from an EC2 instance role can be copied to a local machine, how to retrieve them via the instance metadata service, and the security risks and best‑practice alternatives for debugging and access control.
The article explains how using AWS AssumeRole for temporary, scoped credentials transforms static access keys into dynamic, short‑lived permissions, dramatically reducing attack windows, enforcing least‑privilege, simplifying cross‑account management, and improving auditability compared to granting permanent IAM user rights.
This guide explains why long‑lived IAM user keys are risky, introduces IAM roles and temporary security credentials, details trust and permissions policies, and provides step‑by‑step commands and profile configurations for safely using AWS STS assume‑role in production environments.
This guide explains why storing AWS access keys in config files is risky, how IAM roles eliminate those risks, and provides a three‑step, code‑free process to grant a Java application running on EC2 secure, temporary credentials via the AWS SDK.
A massive outage on June 12, 2025 crippled Google Cloud, AWS, and Azure, exposing the hidden risks of multi‑cloud architectures as a simple NullPointerException cascaded into a global digital infrastructure failure.
This article outlines a comprehensive, financial‑grade security blueprint for a three‑person operations team using AWS services such as IAM, Secrets Manager, Session Manager, GuardDuty, and WAF, emphasizing Zero Trust, Least Privilege, and Defense‑in‑Depth to protect against external attacks, internal risks, and to enable clear audit trails for incident investigation.
This guide explains why an AWS EKS ALB Ingress with target‑type ip can mark pods as unhealthy despite internal connectivity, and provides step‑by‑step instructions to correctly configure the ALB and pod security groups, health‑check sources, NACLs, and debugging tips.
This article explains why a Golang service running on AWS EC2 failed to use the system‑level DNS cache provided by nscd, causing excessive DNS queries that triggered request timeouts, and describes the investigation and optimization steps that resolved the issue.
This article explains the AWS CloudWatch Container Insights pod_cpu_utilization metric, its calculation as a percentage of node CPU, compares it with kubectl top, and introduces the related Pod CPU utilization over pod limit metric for effective Kubernetes resource monitoring.
The author recounts the high hopes and subsequent frustrations of adopting the community‑maintained terraform‑aws‑eks module for AWS EKS, detailing hidden complexities, limited AI assistance, and practical lessons on embracing complexity, critical use of open‑source modules, and the importance of rest during tough debugging sessions.
An AWS EC2 instance behind an Elastic Load Balancer became unresponsive due to repeated TCP out‑of‑memory errors, which were resolved by examining kernel messages, adjusting tcp_mem‑related kernel parameters, and rebooting the server after a long uptime.
This article explains how to combine Jenkins pipelines with Terraform to automate the provisioning, configuration, and lifecycle management of AWS cloud resources, offering a practical DevOps workflow that enhances efficiency, reliability, and scalability through Infrastructure as Code and CI/CD practices.
This guide walks through the complete process of modifying the max_connections setting for an AWS RDS MySQL instance by creating a custom parameter group, updating the parameter via the AWS CLI, binding the group to the instance, and restarting the database to apply the change.
When using AWS EKS API authentication, many users encounter the “the server has asked for the client to provide credentials” error despite having AdministratorAccess, because the newer API mode requires explicit Access Entries for each IAM identity, a detail often missed in documentation and troubleshooting.
To bypass policy restrictions that block direct AWS Bedrock access from China, the team implemented an Nginx stream‑mode reverse proxy with ssl_preread to route Claude model requests, updated Dify’s docker‑compose hosts, and restarted services, achieving low‑cost, minimal‑impact access without migrating data centers.
Learn how to use HashiCorp Packer to create a custom Ubuntu AMI pre‑installed with Docker and JDK 17, then integrate it with Jenkins’ AWS EC2 plugin to dynamically launch consistent, cost‑optimized agents for your CI/CD pipelines.
This guide explains the systematic naming convention of AWS EC2 instance types, breaking down families, generations, metal indicators, and size specifications, and provides detailed examples to help you quickly identify the right instance for your workload.
This guide explains how to bring manually created or modified AWS resources under Terraform management using import, refresh, and plan commands, while avoiding unintended changes and ensuring infrastructure-as-code consistency and traceability.
This guide explains step‑by‑step how to modify the instance_type of an AWS EC2 instance using Terraform, covering in‑place updates, required stop‑modify‑start cycles, plan inspection, apply execution, and post‑change verification to ensure the root EBS volume remains intact.
This guide explains how Terraform workspaces let you isolate dev, staging, and prod environments, reuse a single codebase, and switch contexts with simple commands while showing practical examples, variable strategies, and a hands‑on exercise.
This step‑by‑step guide walks you through AWS EKS core concepts, cluster provisioning with eksctl, kubectl configuration, node monitoring, taints and tolerations, GitLab deployment via Helm, persistent storage with EBS, optional object storage, Istio service‑mesh installation, and troubleshooting API server access issues.
This guide explains why an Istio Ingress Gateway on AWS EKS often remains in EXTERNAL-IP pending state, analyzes root causes such as subnet tags, IAM permissions, and resource quotas, and provides step‑by‑step remediation to get a functional load balancer.
At AWS re:Invent 2024, Amazon unveiled its self‑designed AI hardware trio—Graviton 4 CPU, Nitro 5 DPU, and Trainium 2 accelerator—explaining the innovation, efficiency, and cost advantages driving the strategy, and detailing how these chips power next‑generation cloud services, ultra‑high‑performance servers, and massive AI super‑computing clusters.
This tutorial guides readers through creating an AWS account, configuring the AWS CLI, uploading and downloading CSV files to S3, and using Python with pandas to clean, deduplicate, and aggregate the data before re‑uploading the results, illustrating end‑to‑end cloud data processing.
Amazon’s AI division is expanding at over three times the early growth rate of its cloud business, driven by rapid advances in generative AI, custom chips, strategic startup investments, and the launch of the Q Developer platform.
AWS's open‑source Finch CLI, originally macOS‑only, has been updated to run directly on Linux, allowing developers to build, run, and publish container images across macOS, Windows, and Linux without any virtualization layer.
This article examines the current top Python packages on PyPI, revealing that AWS‑related libraries such as Boto3, urllib3, Botocore, aiobotocore, and Requests lead the rankings, and provides installation commands, usage notes, and environment‑variable setup details.
A seemingly tiny 8‑byte request body size restriction caused a production outage in a serverless education platform, leading the team through extensive debugging, discovery of an AWS WAF payload limit, and ultimately a fix that highlighted the importance of proper documentation and infrastructure awareness.
This article details how a solo engineer built and operated a SaaS platform on AWS using Kubernetes, covering infrastructure overview, automatic DNS, TLS, load balancing, CI/CD rollouts, autoscaling, caching, secret management, monitoring, logging, error tracking, and cost‑effective operations.
Elastic's CTO Shay Banon explains the shift from Apache 2.0 to AGPL for Elasticsearch and Kibana, detailing how licensing changes aim to curb unauthorized cloud services, respond to AWS's OpenSearch fork, and reshape the open‑source search market.
This article reviews the most downloaded Python packages on PyPI over the last year, explaining each library's purpose, key features, usage examples, and why they are popular among developers, covering tools for HTTP, compatibility, AWS, data handling, security, and more.
This step‑by‑step tutorial explains how to configure version control, provision an AWS EC2 instance, install Java and Jenkins, set up Docker and SonarQube, write a Jenkinsfile, and deploy the application automatically with ArgoCD on a Kubernetes cluster.
AWS announced the deprecation of nine services, including CodeCommit and QLDB, as part of a strategic shift under its new CEO, sparking debate among users about the impact on existing workloads, migration challenges, and the future focus on core cloud innovations.
This article details how a team evaluated and improved etcd cluster write performance on AWS by testing gp2 volume IOPS limits, using etcdctl and fio, upgrading to GP3, and analyzing latency and throughput to identify storage bottlenecks and achieve faster synchronization.
This step‑by‑step tutorial explains how to configure a full CI/CD pipeline using Jenkins, Maven, Docker, SonarQube, Helm, and ArgoCD on an AWS EC2 instance with Kubernetes, covering version‑control setup, instance provisioning, credential management, pipeline scripting, and automated deployment.
In a shareholder letter, Amazon CEO Andy Jassy outlines the company’s generative AI strategy, describing it as the most significant technological transformation since cloud computing, detailing AWS’s infrastructure investments, new services like Bedrock, and the broader impact on developers and customers.
This article details how Instagram grew from zero to 14 million users in just over a year using three engineers by applying three core principles and a reliable AWS‑based tech stack covering frontend, load balancing, backend, PostgreSQL sharding, S3 storage, Redis caching, asynchronous task queues, and comprehensive monitoring.
After four years running infrastructure at a fast‑growing startup, the author reviews almost every major decision—from choosing AWS over GCP and adopting EKS, RDS, and Redis, to automating post‑mortems with Slack bots, standardising IaC with Terraform and GitOps, and evaluating SaaS tools like DataDog, PagerDuty, and Notion—highlighting the benefits, regrets, and practical lessons learned.
A technical deep‑dive shows how a team managing dozens of Kubernetes clusters diagnosed a write‑ahead‑log bottleneck in etcd, measured IOPS and latency with etcdctl and fio, upgraded gp2 volumes to gp3, and discovered diminishing returns beyond 3000 IOPS while explaining the role of fdatasync in storage performance.
As public IPv4 addresses become scarce and providers like AWS, Fly.io, and Supabase begin charging per‑hour fees, organizations must confront rising costs, evaluate mitigation strategies, and overcome ISP and tooling challenges to adopt IPv6 for long‑term scalability.
This article details how upgrading AWS EBS volumes from gp2 to GP3 and adjusting instance types improved etcd cluster write throughput, analyzes IOPS bottlenecks using iostat and fio, and explains why further IOPS gains remain constrained by storage and OS caching.
This guide explains how to install the AWS SDK for PHP, configure an S3 client, perform bucket and object operations, paginate and filter objects, generate presigned URLs, compress downloaded objects with ZipArchive, and set up CORS for AWS S3 buckets.
This article presents a detailed performance comparison of cloud RDS MySQL services across major providers, examining x86 versus ARM architectures, various storage options, and cost‑performance ratios, and concludes with practical recommendations for choosing the most suitable configuration.
This article reviews the most downloaded Python packages on PyPI over the last year, explaining each library's purpose, key features, and example code snippets, while highlighting their popularity and relationships within the Python ecosystem.
Prime Video’s engineers detail how abandoning a costly micro‑service and serverless setup for a streamlined monolithic architecture on EC2/ECS cut infrastructure expenses by over 90 % while boosting scalability, challenging the prevailing cloud‑native hype.
This article walks through a real‑world Kubernetes incident where a node’s disk usage exceeded the eviction threshold, causing pods to enter the Evicted state, and details the investigation steps, root‑cause analysis, and practical remediation actions.
This article introduces Amoro, a lakehouse management platform built on Apache Iceberg, explains why Webex adopted it to overcome Hive limitations, details its AWS GlueCatalog and S3 integration with DynamoDB lock management, and provides step‑by‑step Helm‑based deployment instructions on Kubernetes.
The guide explains AWS Transit Gateway as a cloud router linking VPCs, VPNs, Direct Connect and on‑premises networks, details attachment types, route tables, MTU limits, step‑by‑step creation, custom routing, verification, and best‑practice design recommendations for scalable, highly available deployments.
This article breaks down Instagram’s rapid growth from zero to 14 million users by examining its three guiding principles, AWS‑based infrastructure, Django‑Python backend, PostgreSQL sharding, Redis caching, load balancing, push notification pipeline, and monitoring tools.
Starting February 1, 2024, AWS will charge $0.005 per hour for each public IPv4 address across all services to manage scarce IPv4 resources, encourage IPv6 migration, and introduce a Public IP Insights tool for better usage monitoring.
This guide explains the cloud‑native lakehouse concept, outlines its advantages and challenges, compares lake‑table projects such as Iceberg, and provides a step‑by‑step AWS deployment of Apache Iceberg and Amoro—including environment setup, AMS installation, catalog configuration, optimizer launch, data ingestion with Flink, and query verification with Spark.
AWS announced that, beginning February 1 2024, each public IPv4 address will cost $0.005 per hour, a move driven by the exhaustion of IPv4 space that pushes users toward IPv6 while reshaping cloud cost structures and prompting new tooling for IP management.
AWS will start charging $0.005 per hour for every public IPv4 address on February 1, 2024, a move that reflects the scarcity of IPv4, pushes IPv6 adoption, and impacts cloud users who must now manage costs or migrate to newer protocols.
An in‑depth analysis of Amazon Prime Video’s monitoring service reveals how the team abandoned a costly serverless micro‑service architecture in favor of a streamlined monolith on EC2/ECS, cutting infrastructure expenses by over 90% while improving scalability, prompting industry leaders to reassess cloud‑native design assumptions.
This article presents a comprehensive design and implementation of a serverless delayed message queue on AWS, evaluating various solutions such as RabbitMQ, ActiveMQ, RocketMQ, Redis, and ultimately proposing a hybrid Kafka‑SQS‑DynamoDB architecture with performance optimizations and operational insights.
This article provides a thorough overview of DevOps fundamentals, differences from Agile, popular tools, lifecycle stages, CI/CD concepts, AWS roles, version control, SSH, Git commands, Jenkins architecture, Ansible, Puppet, Chef, Docker, Kubernetes, and related interview questions to help candidates prepare for DevOps engineering positions.
The Prime Video engineering team replaced a costly, scaling‑limited serverless microservice architecture with a streamlined monolithic solution on EC2/ECS, achieving more than a 90% reduction in infrastructure expenses while improving scalability, sparking widespread debate about the true value of microservices and serverless approaches.
Amazon Prime Video’s engineering team revealed that moving from a distributed micro‑service architecture to a single‑process monolith on EC2 and ECS slashed infrastructure expenses by over 90% while improving scalability, challenging the prevailing belief that serverless and micro‑services are always the most cost‑effective cloud solutions.
A Prime Video case study shows that moving from a costly serverless micro‑service architecture to a streamlined monolith on EC2/ECS reduced infrastructure expenses by over 90% while improving scalability, sparking a heated debate about the true value of microservices and serverless in large‑scale video streaming.
The article examines the evolution of big‑data technologies, outlines the operational, cost and security challenges enterprises face, and presents serverless data—particularly AWS’s cloud‑native services—as a scalable, low‑cost solution that eliminates maintenance while enabling real‑time processing and advanced analytics.
In a recent reClojure 2022 keynote, Java creator James Gosling shared his journey from designing Java to working at AWS, highlighting Java’s critical role in cloud services, performance optimization, functional programming preferences, and the importance of clear communication for technology adoption.
In a reClojure 2022 keynote, Java’s creator James Gosling discussed how Java underpins AWS’s core services, the massive team optimizing its garbage collection, his love for functional programming, the challenges of turning research into practice, and his confidence in Oracle’s current stewardship of the language.
This article explains what Spot (preemptible) instances are, compares them with on‑demand and reserved instances, details AWS Spot pricing and signals, and provides practical strategies—including node‑group design, Kubernetes scheduling, health checks, and rollback plans—to reliably reduce cloud costs while maintaining application availability.
This article presents a detailed performance benchmark of the new open‑source memory cache Dragonfly against Redis 7.0, describing test methodology, hardware setup, command configurations, and the resulting throughput and latency differences across various GET and SET workloads.
Netflix delivers billions of hours of video by compressing and transcoding raw movies into multiple formats, splitting them into small chunks processed in parallel on AWS, storing them in S3, and distributing them via its custom Open Connect CDN to ensure low‑latency, high‑quality playback worldwide.
The article explains the fundamental concepts and distinctions among databases, data warehouses, and data lakes, describes how each serves transactional or analytical workloads, introduces the emerging lake‑house architecture that integrates lake and warehouse capabilities, and outlines AWS services such as S3, Lake Formation, Glue, Athena, Redshift Spectrum that enable these solutions.
Hulu’s data platform team describes how they migrated large‑scale Spark workloads from Yarn to native Spark on Kubernetes, leveraging AWS services such as EKS, S3, and custom operators to achieve dynamic scaling, unified monitoring, cost‑effective resource management, and improved stability for search, recommendation, and advertising pipelines.
This article explains how Amazon EMR Serverless leverages serverless architecture to simplify, scale, and reduce the cost of big data analytics by providing managed Hadoop‑based services, flexible resource allocation, built‑in security, and seamless integration with the AWS data lake ecosystem.
This article reviews the evolution of data warehouse architectures, explains Amazon's serverless real-time data lake design and its key services, and details Amazon Redshift's cloud-native real-time data warehouse features, streaming ingestion, and integrated machine learning capabilities.
AWS switched S3 log compression from gzip to Zstandard, saving roughly 30% of storage space—equivalent to exabytes—by changing the internal storage method, a move confirmed by employee comments and a coinciding 31% price drop in late 2021.
This guide explains how to create a robust GitHub Actions CI/CD workflow that automatically tests Apache Airflow DAGs using pytest, flake8, and Black, then securely deploys them to Amazon Managed Workflows for Apache Airflow (MWAA) with optional Git hooks and fork‑and‑pull collaboration models.
The presentation details how Amazon Web Services’ intelligent data lake architecture integrates big data and machine learning to overcome marketing challenges, improve data governance, and provide scalable, real‑time analytics for personalized, data‑driven marketing across enterprises.
This article provides a comprehensive overview of data lakes, explaining their definition, key characteristics, architectural evolution, and detailed comparisons of major cloud providers' solutions, while also presenting typical use cases, construction processes, and future development directions for this emerging big‑data infrastructure.
The case study describes how LifeMiles migrated its legacy monolithic system to AWS and adopted Kubernetes for container orchestration, achieving a 50% reduction in infrastructure costs, a three‑fold increase in deployment frequency, and a doubling of usable resources while dramatically shortening time‑to‑market.
This guide explains why cloud cost optimization is essential, shares real‑world savings from companies like Pinterest, Zoom and Spotify, and provides practical steps—including bill analysis, right‑sizing, Spot instance usage, reserved capacity planning, and automation tools—to help organizations reduce cloud expenses and improve financial predictability.
This article explains the DevOps methodology in the context of AWS, defines its relationship to cloud operations, and introduces three core AWS CI/CD services—CodeCommit, CodePipeline, and CodeBuild—detailing their features and benefits for accelerating software delivery.
In early 2021 Notion transformed its monolithic PostgreSQL into a horizontally partitioned fleet by sharding the block table and related data, using workspace IDs as the partition key, migrating through double‑write, backfill, and verification steps, and learning hard lessons about timing, zero‑downtime, and schema design.
Learn step‑by‑step how to configure the AWS CLI, create a security group, generate a key pair, write a bootstrapping script, and launch an Amazon EC2 instance running an Apache web server, including opening ports and testing the deployment.
This article details Ctrip's experience migrating its high‑traffic hotel search service to AWS, covering microservice architecture challenges, API‑level deployment, persistence strategies with Redis, MySQL, XPipe and DRC, file sharing via S3, and lessons learned for future cloud‑native designs.
This article examines common serverless anti‑patterns such as monolithic Lambdas, orchestration misuse, Lambda‑to‑Lambda calls, and event loops, and presents practical design patterns—including Command, Messaging, Priority Queue, Fan‑out, and Pipe‑Filter—to help architects build scalable, maintainable, and cost‑effective cloud applications.
Shuffle sharding assigns each tenant a random small subset of nodes, dramatically lowering the chance that a noisy‑neighbor tenant shares resources with many others, thus providing isolation, elasticity and cost‑effective scaling in multi‑tenant cloud systems like AWS HyperPlane.
Deploying and managing hundreds of production‑ready Kubernetes clusters is complex, but Qovery’s open‑source engine automates provisioning, operation, and upgrades on AWS using Terraform, Helm, and Rust, cutting setup time from days to minutes while ensuring reliability across global workloads.
This article explains micro‑frontend architecture, its benefits over monolithic frontends, the challenges of parent/child integration, and practical implementation approaches on AWS, including web‑component and module‑based integration with code examples and deployment considerations.
The article analyzes how cloud providers are shifting focus to the lowest layers of the stack, compares the evolution of services like Redshift and Snowflake, examines profit models and market dynamics, and forecasts major technological and business changes in cloud computing over the next decade.
The article summarizes Amazon Web Services CTO Werner Vogels' vision from re:Invent 2021, highlighting three emerging trends—robotics as a still‑young field, sustainability becoming a core cloud pillar, and computing expanding beyond Earth to edge, satellite and space platforms—while outlining AWS initiatives supporting each direction.
The article traces the evolution of commercial open‑source companies, examines recent licensing battles sparked by Amazon’s Elasticsearch service and MongoDB’s license change, and analyzes how these tensions reshape software development, investment, and delivery in the era of public cloud dominance.
This article explores how integrating Serverless into SaaS platforms can simplify operations, improve tenant isolation, reduce costs, and enable scalable multi‑tenant architectures that better serve large enterprises while addressing the challenges faced by both SaaS providers and Serverless services.
The article explains what a data lake is, compares various vendor definitions, outlines its four essential components, describes three evolutionary architecture stages from self‑hosted Hadoop to cloud‑native storage‑compute separation, and discusses the benefits and challenges of adopting data lake solutions in modern big‑data platforms.
This article details Ctrip’s migration of its hotel direct‑connect service to AWS, describing the background challenges, cloud‑native architectural redesign with EKS, bandwidth and latency optimizations, use of spot instances, DNS caching, cross‑AZ traffic reduction, and the resulting performance and cost benefits.
This guide walks through installing kubectl on an EC2 instance, configuring the kubeconfig to point to a specific Amazon EKS cluster, and verifying the setup by listing cluster nodes, providing all commands and expected outputs.
Elastic's recent client‑library changes restrict connections to AWS‑hosted OpenSearch and older Elasticsearch versions, prompting AWS to fork multiple official clients and sparking a heated debate over open‑source licensing and developer freedom.
This article describes how SmartNews integrated Flink into its Airflow‑driven Hive batch pipeline to cut the actions table generation latency from three hours to about thirty‑four minutes, detailing the technical challenges, design decisions, and production results.
This article explains the fundamental differences between databases, data warehouses, and data lakes, describes how they complement each other, and introduces the Lake House concept that integrates transactional and analytical workloads using cloud services such as Amazon S3, Redshift Spectrum, and Athena.
This article, based on a live stream by NetEase Cloud Communication backend engineer Ge Xinni, explains the fundamentals of AWS Serverless, details how Lambda integrates with services like API Gateway, S3, CloudFront, and demonstrates building a simple web service, message-driven architectures, and best‑practice considerations.
This article examines Netflix's massive video‑streaming platform, detailing its migration to AWS, micro‑service architecture, client‑backend‑CDN components, playback flow, design goals such as high availability and low latency, trade‑offs, resilience techniques, and scalability mechanisms that support millions of users worldwide.
Over more than a decade, the article examines the development of cloud infrastructure, comparing the strategies and product evolution of AWS, Azure, and Alibaba Cloud, and highlights how elastic IT resources, hybrid cloud solutions, AI integration, and scale economies have shaped the competitive landscape of China's cloud computing market.
AWS introduces a new EMR Studio IDE to accelerate data science workflows, while the Linux community bans University of Minnesota contributions over malicious patches and Google Chrome adopts Intel‑Microsoft hardware‑enforced stack protection to harden browser security.
Learn how to monitor, limit, and optimize Kubernetes expenses with nine practical techniques—including resource constraints, autoscaling, right-sized instances, Spot instances, sleep schedules, regular clean‑ups, and tagging—to dramatically reduce cloud costs while maintaining performance.
AWS introduced OpenSearch, an Apache‑licensed, fully open‑source fork of Elasticsearch and Kibana that removes commercial restrictions, offers advanced features like security and machine‑learning, and promises seamless migration for existing users while gaining broad industry support.
This article provides an in‑depth technical overview of how Pinterest scales its distributed cache layer using Memcached and Mcrouter on AWS, covering architecture, performance, high availability, load balancing, trade‑offs, and future directions.