Steve Pulec
d73a548bb0
Remove duplicate StorageClass in S3_MULTIPART_LIST_RESPONSE.
2020-01-22 19:45:27 -06:00
Waldemar Hummer
bcc4a74869
avoid rendering "None" as S3 Prefix value
2019-12-21 12:08:13 +01:00
Fabio Dias
743dd46399
black linting
2019-12-16 21:25:20 -05:00
Fabio Dias
fd9ac4b9a5
ACCOUNT_ID moved to moto.core, MOTO_ACCOUNT_ID env var override
2019-12-16 21:05:29 -05:00
Fabio Dias
fb9ebe5a47
linting fixes
2019-12-16 19:56:11 -05:00
Fabio Dias
b83a750630
Added references to moto.iam.models.ACCOUNT_ID instead of hardcoded id
2019-12-16 19:56:11 -05:00
Mike Grima
84ccdbd1cd
Implemented S3 Public Access Block
2019-12-12 17:45:31 -08:00
Niklas Janlert
b51d5ad65f
Support x-amz-tagging-directive in s3 copy_object
2019-11-23 00:38:26 +01:00
Asher Foa
96e5b1993d
Run black on moto & test directories.
2019-10-31 10:36:05 -07:00
Mike Grima
1cde5d37eb
Merge pull request #2483 from thincal/fix/list-objects-with-truncation
...
s3 list_object: return the NextMarker info if it's truncated
2019-10-22 09:57:15 -07:00
LS
d3ed7ee240
s3 list_object: return the NextMarker info if it's truncated
2019-10-21 09:40:05 +08:00
Harrison Termotto
df2de373b2
Add tagging to versioned s3 objects.
2019-10-17 00:16:16 -04:00
Mike Grima
ab0853cddc
Made fixes to the S3 Lifecycle mocks to be more consistent with the API.
2019-10-05 12:29:09 -07:00
Chih-Hsuan Yen
6c0a2dc374
Fix copying S3 objects with question marks in keys
...
PR #2062 fixes copy for unicode keys. However, the change breaks keys
with question marks. Here is an alternative fix that works for both
emojis and question marks.
I notice this when running the test suite of aiobotocore. One of the
tests [1] is broken with moto >= 1.3.8.
[1] https://github.com/aio-libs/aiobotocore/blob/0.10.3/tests/test_basic_s3.py#L314-L329
2019-09-29 23:55:52 +08:00
Jesse Vogt
3b4cd1c27b
switch from calling clean in loop to undoing clean in delete_keys
2019-09-24 17:07:58 -05:00
Gapex
1c36e1e2c5
update unit test and fix StartAfter
2019-09-17 10:42:10 +08:00
Gapex
4946f8b853
'lint'
2019-09-16 15:31:57 +08:00
Gapex
59f87e30ba
split truncated keys by type
2019-09-16 15:20:24 +08:00
Gapex
47635dc82e
update key of sort
2019-09-16 13:33:53 +08:00
Gapex
a36b84b3aa
fix MaxKeys in list_objects_v2
2019-09-16 11:35:36 +08:00
Gapex
d6ef01b9fd
lint
2019-09-12 18:40:07 +08:00
Gapex
eea67543d1
MaxKeys limits the sum of folders and keys
2019-09-12 17:54:02 +08:00
Vury Leo
71241f1c3f
make linter happy
2019-08-20 15:17:17 +08:00
Vury Leo
1249ba8d3b
fix KeyCount in s3.list_objects_v2
2019-08-20 15:01:37 +08:00
Berislav Kovacki
b7884ef903
Add S3 support for INTELLIGENT_TIERING, GLACIER and DEEP_ARCHIVE storage
...
* Add INTELLIGENT_TIERING, GLACIER and DEEP_ARCHIVE as valid storage
classes for objects
* Add ObjectNotInActiveTierError error on PUT object copy for GLACIER
and DEEP_ARCHIVE storage class objects
2019-08-05 17:34:39 +02:00
Steve Pulec
69d86cbd54
Merge pull request #2300 from acsbendi/master
...
Basic IAM authentication, authorization
2019-07-28 17:22:52 -05:00
acsbendi
f3f47d44ac
Fixed error in python 2 and did some refactoring.
2019-07-26 21:05:04 +02:00
acsbendi
290f8f9fd5
Fixed host header not included in S3 requests sometimes.
2019-07-26 19:50:24 +02:00
acsbendi
45a380a807
Fixed host not present in headers for S3 requests.
2019-07-24 21:29:00 +02:00
Steve Pulec
5abe56fd2b
Merge pull request #2250 from szczeles/s3_delete_objects_boto3
...
Raising MalformedXML exception when using boto3 client and s3.delete_objects()
2019-07-23 22:41:45 -05:00
acsbendi
95799b99bc
Fixed incorrect authentication error handling in S3.
2019-07-16 16:27:50 +02:00
Ruslan Kuprieiev
2c2dff22bc
moto: s3: support partNumber for head_object
...
To support it, we need to keep multipart info in the key itself when
completing multipart upload.
Fixes #2154
Signed-off-by: Ruslan Kuprieiev <ruslan@iterative.ai>
2019-07-15 20:47:29 +03:00
acsbendi
419fcf2ee9
Merge branch 'master' of https://github.com/spulec/moto into spulec-master
2019-07-13 13:43:19 +02:00
Mariusz Strzelecki
f32db6e64a
Raising MalformedXML exception when using boto3 client and s3.delete_objects()
2019-07-11 09:53:23 +02:00
acsbendi
86758182a7
Removed print.
2019-07-04 16:42:11 +02:00
acsbendi
5dbec8aee5
Implemented checking if S3 action is permitted.
2019-07-04 16:38:53 +02:00
Aden Khan
b2adbf1f48
Adding the functionality and test so that the If-Modified-Since header is honored in GET Object
...
Signed-off-by: Aden Khan <aakhan@sep.com>
2019-07-03 14:25:08 -04:00
Alexander Mohr
7271fb9391
Fix S3 backend operations with VersionId ( #2055 )
...
* fix s3 issues
* fix merge conflict
* fix and add test cases
2019-05-25 20:19:33 +01:00
Gregory Bataille
d952410965
1987 support transfer acceleration ( #2018 )
...
* chore(): remove executable flag on moto/s3/response.py
* chore(): ignore .eggs temp file
* feat(#1987 ): get bucket acceleration support
* feat(#1987 ): put bucket acceleration support
* feat(#1987 ): suspend undefined bucket is a no-op
* feat(#1987 ): validate accelerate_configuration status
* feat(#1987 ): bucket containing dots do not support acceleration
* doc(#1987 ): update implementation coverage
2019-05-25 11:19:00 +01:00
Gilbert Gilb's
dedb53371e
[S3] Support null version ids for buckets with versioning disabled
2019-03-09 10:21:49 +01:00
Domenico Testa
74ff2ccc95
Reformatting to get better coverage results
2019-03-04 09:16:43 +01:00
Domenico Testa
6897a118ed
Fixing S3 copy_key error when using unicode.
2019-02-16 16:42:00 +01:00
Steve Pulec
dec665be43
Merge pull request #1986 from okomestudio/ts/fix-s3-common-prefix-pagination
...
Activate proper pagination for S3 common prefixes
2018-12-28 21:22:07 -05:00
Taro Sato
2038fa92be
Activate proper pagination for S3 common prefixes
2018-12-05 16:17:28 -08:00
Grégory Bataille
34ac5c72b9
feat( #1959 ): bucket in us-east-1 return None as LocationConstraint
2018-11-20 19:50:42 +01:00
Grégory Bataille
437eb892e2
feat( #1959 ): LocationConstraint us-east-1 is not accepted by the CreateBucket operation
2018-11-20 18:57:05 +01:00
Jordan Guymon
8e909f580a
MockAWS implementation using botocore event hooks
2018-10-29 09:12:22 +01:00
Steve Pulec
27ca96519b
Fix extra whitespace in s3. Closes #1844 .
2018-10-15 01:37:38 -04:00
Jon Beilke
ea4fcaa82a
add support for NoncurrentVersionTransition, NoncurrentVersionExpiration, and AbortIncompleteMultipartUpload actions to s3 lifecycle rules
2018-10-03 00:40:28 -05:00
Jordan Upiter
756b5d6671
Add support for multiple delete markers on an s3 object
2018-09-11 10:41:01 -04:00
Alexander Mohr
93a404ec37
pep
2018-05-03 02:10:17 -07:00
Alexander Mohr
7a57dc2034
fix errors
2018-05-03 01:40:49 -07:00
Mike Grima
4184acc0d2
Added Filtering support for S3 lifecycle ( #1535 )
...
* Added Filtering support for S3 lifecycle
Also added `ExpiredObjectDeleteMarker`.
closes #1533
closes #1479
* Result set no longer contains "Prefix" if "Filter" is set.
2018-04-02 14:19:14 -07:00
Colin Jones
1a8a4a084d
S3 Ignore Subdomain for Bucketname Flag ( #1419 )
...
* Some circumstances need subdomains to be ignored rather that interpreted as bucketname, this patch allows such behaviour to be configured
* Adding helper case whereby localstack features as path based exception
* Remove whitespace :(
2018-03-21 09:33:09 -07:00
Mike Grima
cc14114afe
Implemented S3 get/put_notification_configuration ( #1516 )
...
closes #973
2018-03-21 09:11:24 -07:00
Steve Pulec
ece7507eec
Merge pull request #1430 from OwnZones/urldecode_fix
...
Url decode x-amz-copy-source for S3 copyObject requests
2018-03-06 22:26:15 -05:00
Steve Pulec
326698f3fa
Merge pull request #1460 from okomestudio/s3-region-from-url
...
Support both virtual-hosted and path-style URLs for region name parsing
2018-03-06 21:57:57 -05:00
Taro Sato
5e70d0ce4c
Support both virtual-hosted-style and path-style URLs for region name parsing
2018-01-30 16:10:43 -08:00
Taro Sato
c7bcbadc6e
Fix the S3 HEAD response body
2018-01-30 13:48:04 -08:00
ciprianaradulescu
c431a3a774
Merge branch 'master' into urldecode_fix
2018-01-14 19:58:48 +02:00
Ciprian Radulescu
ef9b229acc
url decode x-amz-copy-source as per s3 nodejs documentation
2018-01-14 18:49:47 +02:00
Mike Grima
770281aef2
Added put_bucket_logging support ( #1401 )
...
- Also added put acl for XML
- Put logging will also verify that the destination bucket exists in the same region with the proper ACLs attached.
2018-01-02 20:47:57 -08:00
Waldemar Hummer
cdb7305dac
use S3 path style addressing when running in kubernetes ( #1315 )
2017-11-15 19:37:39 +00:00
Terry Cain
d447929d29
utf 8 in key deletions V2 ( #1321 )
...
* supporting utf-8 in key deletions
* Fixed decoding of version body when regexing
* Fixed some more random errors
* Possible fix
* Fixed unused import
* Added UTF comment Py2
2017-11-06 13:39:08 -08:00
Brian Pandola
68a1e41286
Fix #1318
2017-11-02 23:03:54 -07:00
Mike Grima
7167e09ca5
Fixed bug in S3 put_bucket_tagging. Closes #1181 .
2017-09-22 13:35:00 -07:00
Jack Danger
390fe85137
supporting httpretty requests
2017-09-22 10:44:55 -07:00
Jack Danger
ea66a71765
supporting signed urls for private keys
2017-09-22 10:44:37 -07:00
Jack Danger
ca7661bc1e
S3 keys inherit bucket ACL
2017-09-20 19:04:23 -07:00
Jack Danger
2055bb62f5
enforce s3 acls
2017-09-16 12:49:07 -07:00
Julien Duchesne
83dd9559db
Handle "max-keys" in list-objects
2017-09-10 10:42:17 -07:00
Julien Duchesne
14dec68f15
Remove superfluous space
2017-09-09 00:27:54 -04:00
Julien Duchesne
0ddbcb5464
Handle 'marker' paginating parameter in the list-objects query
2017-09-09 00:25:02 -04:00
Mike Grima
5d8cd22b01
Fixed S3 lifecycle error message. ( #1110 )
...
Fixes #1109
Also added PutBucketTagging support
Also added Bucket CORS support
2017-09-07 11:30:05 -07:00
Alexander Mohr
2447725e98
fix list-object-versions with prefix ( #1045 )
...
fix list-object-versions with prefix
2017-08-10 17:14:31 -07:00
Taro Sato
38fa6809c0
Make HEAD bucket throw ClientError instead of NoSuchBucket on boto3
2017-07-20 15:39:45 -07:00
eric-weaver
abf3078c28
implement s3 object tagging
2017-07-15 22:36:12 -04:00
Steve Pulec
113bfcb4ea
Fix duplicate bucket creation with LocationConstraint. Closes #970 .
2017-06-03 19:29:59 -04:00
Jack Danger
6163363c15
Merge pull request #960 from spg/feat-s3-if-modified-since
...
feat(s3) HeadObject: honor If-Modified-Since header
2017-06-01 09:10:20 -07:00
Simon-Pierre Gingras
a2a6514936
attempt at fixing tests
2017-05-23 11:29:01 -07:00
Kate Heddleston
a21413f4ea
NoSuchKey error in S3 is actually '404'
...
Fixes #571 and #953
2017-05-22 19:08:12 -07:00
Simon-Pierre Gingras
517416c4d9
feat(s3) HeadObject: honor If-Modified-Since header
2017-05-19 15:59:25 -07:00
georgepsarakis
9a861a367d
Enable DeleteMarker support for versioned buckets
...
- Add object version deletion
- Add DeleteMarker in versioned key store as latest version
- GetObject returns NoSuchKey for objects with DeleteMarker as latest
version
- Enable IsLatest in response when listing object versions
2017-05-14 19:56:25 +03:00
Steve Pulec
152d71e4f3
Merge pull request #922 from georgepsarakis/bug/s3_list_versions_valueerror
...
ValueError when calling boto3 list_object_versions
2017-05-10 22:06:26 -04:00
Jack Danger Canty
a2fd72d2f8
Require content-length header
...
fixes #908
2017-05-01 12:13:12 -07:00
georgepsarakis
617e994ac6
Specify integer value for MaxKeys in S3 response
2017-04-29 22:35:25 +03:00
Steve Pulec
e9bf74d8e3
Merge pull request #904 from ambrusadrianz/master
...
Fixed S3 copyObject compatibility with the Java AWS SDK
2017-04-15 23:46:21 -04:00
Ambrus Adrian
121a68be49
Fixed compatibility issue with the Java AWS SDK
...
Issue is described here: https://github.com/spulec/moto/issues/900
2017-04-15 01:06:28 +03:00
Dmytro Milinevskyy
6e61ee4caa
s3: handle WebsiteRedirectLocation
...
spulec/moto#821
2017-04-14 13:32:52 +02:00
Waldemar Hummer
b8a41c5605
fix domain handling for local domain names in S3 API
2017-04-08 15:28:51 +10:00
Steve Pulec
446843e756
Fix py3 s3 prefix decoding.
2017-03-15 23:13:09 -04:00
Steve Pulec
3899eee648
Fix S3 filtering by unicode prefix. Closes #838
2017-03-15 22:53:27 -04:00
Steve Pulec
5f3fbff627
Standardize on one account id (123456789012).
2017-03-15 22:21:04 -04:00
Steve Pulec
f37bad0e00
Lints.
2017-02-23 21:37:43 -05:00
Steve Pulec
cad185c74d
Cleanup headers and encoding.
2017-02-16 22:51:04 -05:00
Steve Pulec
fde721bed7
Testing new version of decorator.
2017-02-15 22:35:45 -05:00
Stefan Nordhausen
1a01bae74e
Implement list_objects_v2() for S3 buckets ( #814 )
...
This adds/fixes the following things:
- Add missing KeyCount in result (fixes #734 ).
- Do not hard code MaxKeys to 1000.
- Truncate result if it has more than MaxKeys items. Set IsTruncated
and NextContinuationToken accordingly.
- Support the StartAfter parameter.
- Return Owner information only when FetchOwner=True is given.
- "Prefix" in response is now "" instead of None when omitted in request.
- "Delimiter" is now omitted from response when not given in request.
2017-02-08 21:21:43 -05:00
mfranke
5dc8e59fab
Fix s3bucket_path ( #784 )
...
* check HTTP header for IPv4 or IPv6 addresses and default to path based S3
* improved IPv4 and IPv6 checking with optional ports
* typo
* subdomain bucket creation with trailing '/' did not work
* Use regex for Host field check to determine IPv4/IPv6
* add testcases for trailing slash, IPv4 and IPv6
2016-12-03 18:15:24 -05:00
Tom V
c54985a39f
Fix for #748 . Turn on autoescape for S3 templates. ( #779 )
2016-12-03 18:13:24 -05:00
mfranke
040c2cd8cc
Fix s3bucketpath handling for IP based requests ( #765 )
...
* check HTTP header for IPv4 or IPv6 addresses and default to path based S3
* improved IPv4 and IPv6 checking with optional ports
* typo
2016-11-23 19:05:34 -06:00
