Contact
Contact
Stay up to date
We'll highlight new content in your collectives with a blue activity indicator on navigation items and posts.
Manage preferences
Can you answer these questions?
View all unanswered questionsThese questions still don't have an answer
Best practices
0
votes
0
replies
51
views
Achieving Atomic Ingestion for a 70-100 GB Daily Stream Using PyArrow and MinIO
The Architecture
I'm designing the ingestion (Bronze) layer of a data pipeline. The data source provides A daily bulk update delivered as a massive ZIP file, reaching up to 70-100 GB per day.
To save ...
- reputation score 1
0
votes
0
answers
29
views
Alexa RangeController for thermostat fan speed not invoking Lambda — "I don't know how to set [device] to that setting"
I have an Alexa Smart Home skill exposing a thermostat/AC endpoint with Alexa.PowerController, Alexa.ThermostatController, and Alexa.RangeController (for fan speed). The same RangeController pattern ...
- reputation score 73
Advice
0
votes
0
replies
36
views
Why might PyTorch batch_isend_irecv have poor performance on AWS G5 instances?
I found the following function in a distributed PyTorch checkpointing implementation:
def _snapshot_torch_p2p_fn(input_tensor: Tensor,
output_tensor: Tensor,
...
- reputation score 33
1
vote
0
answers
86
views
How to stream and convert 50GB+ Zip of CSVs to Parquet in S3/MinIO without local disk?
I'm writing a Python script as a component of data pipeline that takes a zipped archive of CSV files from the landing bucket, extracts the files, converts them to Parquet, and puts them back into ...
- reputation score 43600
Advice
0
votes
0
replies
52
views
Amazon Bedrock - Custom response based on data in an RDS database
I've been planning to use Amazon Bedrock to let users generate content rather than write it themselves.
However, every person has a unique style for the data they produce; some write very generic ...
- reputation score 1137
Recommended answers
View all recommended answersThese answers have been recommended
Best practices
0
votes
1
replies
64
views
Best practice for managing secret credentials in Spring Boot using Bitbucket
I am working on a Java Spring Boot application and would like to follow a professional approach for managing secret credentials (such as database passwords, API keys, etc.).
I have the following ...
- reputation score 80190
Answer
Some ideas at Integrate AWS Secrets Manager in Spring Boot.
View answer
- reputation score 80190
Advice
0
votes
1
replies
97
views
What is the well-architected framework from AWS?
What is AWS well-architected framework used for? Can someone please answer me correctly.
I could not find anything on google. I already checked the actual websites. https://aws.amazon.com/architecture/...
- reputation score 80190
Answer
If the AWS documentation doesn't explain it well enough for you then try YouTube videos.
View answer
- reputation score 80190
Advice
0
votes
3
replies
76
views
Is it possible to use Webiny CMS without a NAT Gateway in a production environment?
Webiny is a serverless and headless CMS framework that provides a self-hosted deployment system on AWS, but it uses a NAT Gateway in the background, which increases infrastructure costs. Is it ...
- reputation score 1273
Answer
It looks like webiny deploys an Elasticsearch cluster which is likely what forces them to deploy everything into VPC and this brings NAT Gateway into scope. If you don't need Elasticsearch ...
View answer
- reputation score 80190
Advice
0
votes
4
replies
206
views
AWS IAM Authentication on DB level
I have an Intance with multiple DB's in it and I would like to provide access to DB's using the IAM but I am not sure if that is possible with AWS IAM on a DB level. I am pretty sure I can do it on ...
- reputation score 1673
Answer
When you say 'instance', do you mean RDS instance or EC2 instance? The one place that you can use IAM with databases is MariaDB, MySQL, and PostgreSQL when served by Amazon RDS.
View answer
- reputation score 80190
Advice
0
votes
2
replies
145
views
Update just the tags for CloudFormation stack?
I got a health alert recently that "Beginning July 31, 2026, CloudFormation will enforce stricter character validation on stack tag keys and values to align with AWS-wide tagging standards." ...
- reputation score 1
Answer
Wonder if create_change_set would work? FYI the health alert excluded underscore but I believe that underscore is actually legal.
View answer
- reputation score 80190
See what's trending
View all trending questionsThese are the most active questions in AWS Collective
1159
votes
44
answers
996k
views
Downloading an entire S3 bucket?
I noticed that there does not seem to be an option to download an entire s3 bucket from the AWS Management Console.
Is there an easy way to grab everything in one of my buckets? I was thinking about ...
- reputation score 3095
1016
votes
42
answers
771k
views
"UNPROTECTED PRIVATE KEY FILE!" Error using SSH into Amazon EC2 Instance (AWS) [closed]
I've created a new linux instance on Amazon EC2, and as part of that downloaded the .pem file to allow me to SSH in.
When I tried to ssh with:
ssh -i myfile.pem <public dns>
I got:
@@@@@@@@@@@@@...
- reputation score 60882
338
votes
71
answers
733k
views
Amazon S3 - How to fix 'The request signature we calculated does not match the signature' error?
I have searched on the web for over two days now, and probably have looked through most of the online documented scenarios and workarounds, but nothing worked for me so far.
I am on AWS SDK for PHP V2....
- reputation score 1211
485
votes
38
answers
353k
views
How to get an AWS EC2 instance ID from within that EC2 instance?
How can I find out the instance id of an ec2 instance from within the ec2 instance?
- reputation score 41
556
votes
23
answers
643k
views
Change key pair for ec2 instance
How do I change the key pair for my ec2 instance in AWS management console? I can stop the instance, I can create new key pair, but I don't see any link to modify the instance's key pair.
- reputation score 70182
Learn something new
These are the most recent articles in AWS Collective
1
vote
438
views
1 minute read
AWS Management Console now supports simultaneous sign-in for multiple AWS accounts
AWS has changed the way we interact with AWS console for sign-in. Jan 16, 2025 AWS has announced the support for multiple console sessions for signing into different aws accounts in the same browser.
...
- reputation score 12006
4
votes
671
views
8 minute read
How to achieve fast, scalable, robust & cost optimized scaling of tasks on AWS ECS
Summary
There are multiple use cases to containerize and host proprietary applications on AWS ECS which is “a fully managed container orchestration service that makes it easy for you to deploy, manage,...
- reputation score 3025
8
votes
709
views
2 minute read
Overcoming Front-End Back-End Coupling with AWS Event-Driven Architecture
introduction
As a developer, I've always been interested in event-driven architectures (EDAs) and how they can improve the overall performance and scalability of web applications. However, I never ...
- reputation score 1055
6
votes
1k
views
1 minute read
Always-on access for your data in Amazon S3, using cross-Region replication and Multi-Region Access Points (MRAP)
To improve durability of your data in the cloud, you should replicate it to multiple locations. For data in Amazon S3, it is automatically stored across multiple devices spanning a minimum of three ...
- reputation score 1125
6
votes
1k
views
3 minute read
Local development, testing, and debugging of serverless applications defined in Terraform using AWS SAM CLI
One question we hear from developers using Terraform and AWS Lambda functions is how to locally test the Lambda function. Here’s a great example — I have a simple terraform file with a Lambda function....
- reputation score 159
Members can contribute articles
Simply submit a proposal, get it approved, and publish it.
See how the process works
Simply submit a proposal, get it approved, and publish it.
See how the process works
