222 Commits

Author SHA1 Message Date
Bert Blommers
1f56b75ccf
Techdebt: MyPy SQS (#6251) 2023-04-24 16:46:01 +00:00
Bert Blommers
2cf0130d13
Prep Release 4.1.7 (#6201) 2023-04-11 14:31:46 +00:00
rafcio19
201e57585b
SQS: Improve deduplication logic (#6184) 2023-04-09 10:13:28 +00:00
Bert Blommers
8bc856a631
SQS: Align receive_message() response with AWS (#5773) 2022-12-14 22:40:18 -01:00
Brian Pandola
7c44e48670
Fix: SQS fails to get newly-visible messages when long polling (#5733)
The [original commit to remove the `sleep` call][1], only considered newly-arriving
messages; but didn't take into account that existing messages could become visible
in a much shorter time duration than the wait timeout.  This commit addresses this
by checking for newly-visible messages at the visibility timeout granularity (seconds),
which is still a major improvement over the original 10 millisecond polling.

[1]: <d560ff002d> "Remove Sleep Call"
2022-12-04 18:00:56 -08:00
Rahi Bhensdadia
97b5e8b3ab
SQS: Implement DelaySeconds validation (#5703) 2022-11-27 20:47:18 -01:00
Bert Blommers
ba4104c38e
Techdebt: Replace string-format with f-strings (for s* dirs) (#5692) 2022-11-21 18:21:34 -01:00
Bert Blommers
ea8718d402
TechDebt: Move BackendDict to base_backend (#5645) 2022-11-10 08:43:20 -01:00
David Laban
d560ff002d
Remove microsleep (#1903)
Use `threading.Condition` instead of `sleep()` to prevent high cpu usage while SQS long polling on an empty queue. 

Ref: #871
Ref: #1916

Co-authored-by: Brian Pandola <bpandola@gmail.com>
2022-11-05 06:09:58 -07:00
Bert Blommers
4f84e2f154
TechDebt - enable pylint rule redefined-outer-scope (#5518) 2022-10-04 16:28:30 +00:00
Bert Blommers
aa7d68a688
Feature: Ability to seed Moto, and make random ID's deterministic (#5492) 2022-09-28 09:35:12 +00:00
Bert Blommers
3d913f8f15
MultiAccount support (#5192) 2022-08-13 09:49:43 +00:00
Bert Blommers
79a2a9d423
Preparation for MultiAccount support (#5157) 2022-06-04 11:30:16 +00:00
Bert Blommers
0fe30b0440
MD5 - set usedforsecurity-parameter for all uses (#5190) 2022-06-03 09:41:30 +00:00
Thomas Rausch
e911341e6a
add indirection to access account id (#5098) 2022-05-08 22:25:40 +00:00
Bert Blommers
56806fb310
SQS - Accept queue-names as QueueUrl-parameter (#5073) 2022-04-27 22:51:51 +00:00
Bert Blommers
647c612c7a
Docs - add SQS:receive_message() (#4958) 2022-03-21 20:58:49 -01:00
Bert Blommers
eed32a5f72
Pylint - Enable more rules on source and tests-directory (#4929) 2022-03-11 20:28:45 -01:00
Bert Blommers
29d01c35bc
Update Black + formatting (#4926) 2022-03-10 13:39:59 -01:00
Bert Blommers
aa522b11ca
SNS Docs - do not specify default region (#4909) 2022-03-03 22:25:06 -01:00
Bert Blommers
f49c81037b
SQS - Use full URL as the physical resource ID (#4864) 2022-02-15 22:26:36 -01:00
Cristopher Pinzón
c25aae0d9a
Allow "True" in SQS Queue boolean attributes (#4830) 2022-02-07 22:53:25 -01:00
Bert Blommers
aa70ee254d
Remove deprecated decorators + boto dependency (#4378) 2022-01-18 14:18:57 -01:00
Sami Jaktholm
ca327e399d
SQS - Improve delete_message_batch() error responses (#4765) 2022-01-15 20:45:43 -01:00
Bert Blommers
d118d592ca
Pylint remaining source code (#4760) 2022-01-14 18:51:49 -01:00
Cristopher Pinzón
b7f0dee4a7
escape windows return character (#4729) 2021-12-30 09:54:15 -01:00
Bert Blommers
cf87e75d6e
Feature: Mock region (#4699) 2021-12-24 20:02:45 -01:00
Todd Morse
ce9fb90663
SQS - prevent a missing policy json (#4706) 2021-12-21 09:34:54 -01:00
rolsen
17c0cedbb2
Add support to remove RedrivePolicy from SQS. (#4664) 2021-12-06 21:42:11 -01:00
Bert Blommers
cbfe962b70
SQS - Align logic around receipt_handles with AWS (#4655) 2021-12-04 21:51:51 -01:00
Kamil Turek
26a732a0e9
Validate message group ID for standard queues (#4635) 2021-11-25 22:32:25 -01:00
Dominik Schubert
88e1aef254
SQS - Fix message attributes disappearing on multiple receives (#4599) 2021-11-19 22:24:47 -01:00
Bert Blommers
f923d0d1e0
Feature: Custom cloudformation resources (#4512) 2021-11-03 20:00:42 -01:00
Bert Blommers
14a69c7524
Techdebt: Enable pylint rules (#4432) 2021-10-18 19:44:29 +00:00
Bert Blommers
8526013e61
Parallelize tests - Part 1 (#4368) 2021-10-05 17:11:07 +00:00
kbalk
3a203d35c9
Implement EC2 describe_vpc_endpoint_services() (#4322) 2021-09-24 16:01:09 +00:00
Bert Blommers
d87a2eab49
SQS - Allow XML content to be received as a message attr (#4337) 2021-09-23 18:55:22 +00:00
Silvio
79f70aa0c8
Change message deletion behavior of SQS queue to use discard (#4287) 2021-09-15 20:05:45 +00:00
Miguel Gagliardo
85f38859c3
Fix: Issue with empty tags created on SQS queues (#4254) 2021-09-01 11:57:45 +01:00
Bert Blommers
07bb843214
Fix regex URLs so that a dot is actually interpreted as a dot (#4110) 2021-08-28 13:42:45 +01:00
Bert Blommers
ec70d3cd14
SQS - get_queue_attributes() might not have AttributeNames-parameter (#4236) 2021-08-28 09:34:33 +01:00
Bert Blommers
6f4b6080f8
SQS - Raise error message when providing an invalid value for the queue_url parameter (#3657) 2021-08-28 06:19:01 +01:00
Anton Grübel
e865362791
Add fifo high throughput (#4224) 2021-08-26 16:23:17 +01:00
Bert Blommers
11883a1fda
Remove unnecessary dependencies EC2/SQS (#4094)
* Add missing dependencies for EFS
2021-07-29 06:38:16 +01:00
Miguel Gagliardo
f9f93531e8
Fix: Adding empty tags to SQS queue on creation time (#4087)
* Fix: Adding tags to SQS queue on creation time
2021-07-27 08:24:38 +01:00
Miguel Gagliardo
44624593f1
Fix: Adding fix when setting empty policy attr to queue (#4091) 2021-07-27 06:04:24 +01:00
Waldemar Hummer
f4f8527955
Merge LocalStack changes into upstream moto (#4082)
* fix OPTIONS requests on non-existing API GW integrations

* add cloudformation models for API Gateway deployments

* bump version

* add backdoor to return CloudWatch metrics

* Updating implementation coverage

* Updating implementation coverage

* add cloudformation models for API Gateway deployments

* Updating implementation coverage

* Updating implementation coverage

* Implemented get-caller-identity returning real data depending on the access key used.

* bump version

* minor fixes

* fix Number data_type for SQS message attribute

* fix handling of encoding errors

* bump version

* make CF stack queryable before starting to initialize its resources

* bump version

* fix integration_method for API GW method integrations

* fix undefined status in CF FakeStack

* Fix apigateway issues with terraform v0.12.21
* resource_methods -> add handle for "DELETE" method
* integrations -> fix issue that "httpMethod" wasn't included in body request (this value was set as the value from refer method resource)

* bump version

* Fix setting http method for API gateway integrations (#6)

* bump version

* remove duplicate methods

* add storage class to S3 Key when completing multipart upload (#7)

* fix SQS performance issues; bump version

* add pagination to SecretsManager list-secrets (#9)

* fix default parameter groups in RDS

* fix adding S3 metadata headers with names containing dots (#13)

* Updating implementation coverage

* Updating implementation coverage

* add cloudformation models for API Gateway deployments

* Updating implementation coverage

* Updating implementation coverage

* Implemented get-caller-identity returning real data depending on the access key used.

* make CF stack queryable before starting to initialize its resources

* bump version

* remove duplicate methods

* fix adding S3 metadata headers with names containing dots (#13)

* Update amis.json to support EKS AMI mocks (#15)

* fix PascalCase for boolean value in ListMultipartUploads response (#17); fix _get_multi_param to parse nested list/dict query params

* determine non-zero container exit code in Batch API

* support filtering by dimensions in CW get_metric_statistics

* fix storing attributes for ELBv2 Route entities; API GW refactorings for TF tests

* add missing fields for API GW resources

* fix error messages for Route53 (TF-compat)

* various fixes for IAM resources (tf-compat)

* minor fixes for API GW models (tf-compat)

* minor fixes for API GW responses (tf-compat)

* add s3 exception for bucket notification filter rule validation

* change the way RESTErrors generate the response body and content-type header

* fix lint errors and disable "black" syntax enforcement

* remove return type hint in RESTError.get_body

* add RESTError XML template for IAM exceptions

* add support for API GW minimumCompressionSize

* fix casing getting PrivateDnsEnabled API GW attribute

* minor fixes for error responses

* fix escaping special chars for IAM role descriptions (tf-compat)

* minor fixes and tagging support for API GW and ELB v2 (tf-compat)

* Merge branch 'master' into localstack

* add "AlarmRule" attribute to enable support for composite CloudWatch metrics

* fix recursive parsing of complex/nested query params

* bump version

* add API to delete S3 website configurations (#18)

* use dict copy to allow parallelism and avoid concurrent modification exceptions in S3

* fix precondition check for etags in S3 (#19)

* minor fix for user filtering in Cognito

* fix API Gateway error response; avoid returning empty response templates (tf-compat)

* support tags and tracingEnabled attribute for API GW stages

* fix boolean value in S3 encryption response (#20)

* fix connection arn structure

* fix api destination arn structure

* black format

* release 2.0.3.37

* fix s3 exception tests

see botocore/parsers.py:1002 where RequestId is removed from parsed

* remove python 2 from build action

* add test failure annotations in build action

* fix events test arn comparisons

* fix s3 encryption response test

* return default value "0" if EC2 availableIpAddressCount is empty

* fix extracting SecurityGroupIds for EC2 VPC endpoints

* support deleting/updating API Gateway DomainNames

* fix(events): Return empty string instead of null when no pattern is specified in EventPattern (tf-compat) (#22)

* fix logic and revert CF changes to get tests running again (#21)

* add support for EC2 customer gateway API (#25)

* add support for EC2 Transit Gateway APIs (#24)

* feat(logs): add `kmsKeyId` into `LogGroup` entity (#23)

* minor change in ELBv2 logic to fix tests

* feat(events): add APIs to describe and delete CloudWatch Events connections (#26)

* add support for EC2 transit gateway route tables (#27)

* pass transit gateway route table ID in Describe API, minor refactoring (#29)

* add support for EC2 Transit Gateway Routes (#28)

* fix region on ACM certificate import (#31)

* add support for EC2 transit gateway attachments (#30)

* add support for EC2 Transit Gateway VPN attachments (#32)

* fix account ID for logs API

* add support for DeleteOrganization API

* feat(events): store raw filter representation for CloudWatch events patterns (tf-compat) (#36)

* feat(events): add support to describe/update/delete CloudWatch API destinations (#35)

* add Cognito UpdateIdentityPool, CW Logs PutResourcePolicy

* feat(events): add support for tags in EventBus API (#38)

* fix parameter validation for Batch compute environments (tf-compat)

* revert merge conflicts in IMPLEMENTATION_COVERAGE.md

* format code using black

* restore original README; re-enable and fix CloudFormation tests

* restore tests and old logic for CF stack parameters from SSM

* parameterize RequestId/RequestID in response messages and revert related test changes

* undo LocalStack-specific adaptations

* minor fix

* Update CodeCov config to reflect removal of Py2

* undo change related to CW metric filtering; add additional test for CW metric statistics with dimensions

* Terraform - Extend whitelist of running tests

Co-authored-by: acsbendi <acsbendi28@gmail.com>
Co-authored-by: Phan Duong <duongpv@outlook.com>
Co-authored-by: Thomas Rausch <thomas@thrau.at>
Co-authored-by: Macwan Nevil <macnev2013@gmail.com>
Co-authored-by: Dominik Schubert <dominik.schubert91@gmail.com>
Co-authored-by: Gonzalo Saad <saad.gonzalo.ale@gmail.com>
Co-authored-by: Mohit Alonja <monty16597@users.noreply.github.com>
Co-authored-by: Miguel Gagliardo <migag9@gmail.com>
Co-authored-by: Bert Blommers <info@bertblommers.nl>
2021-07-26 15:21:17 +01:00
Bert Blommers
7693d77333
Remove Py2 support (#3915) 2021-07-26 07:40:39 +01:00
Grégoire Charvet 黑瓜
00be464c05
Fix #3996 (#4051)
* Fix #3996

* Don't delete any message when duplicate handles
2021-07-07 08:59:16 +01:00
Grégoire Charvet 黑瓜
b44ab23c63
Fix #4009 (#4052)
Correctly raises an error when MessageGroupId is missing when sending a
batch of messages to a FIFO queue.
2021-07-04 07:40:39 +01:00