Commit Graph

57 Commits

Author SHA1 Message Date
kbalk
b89b0039e4
Add some basic Firehose service APIs (#4246) 2021-09-14 09:39:39 +00:00
Bert Blommers
07bb843214
Fix regex URLs so that a dot is actually interpreted as a dot (#4110) 2021-08-28 13:42:45 +01:00
Garreth Golding
6ae37046f0
UnboundLocalError is thrown when creating a Firehose delivery stream. (#4144) 2021-08-07 09:42:23 +01:00
Bert Blommers
79f0cc9e9e
Tech debt - remove dead DynamoDB code and add RDS tests (#4136) 2021-08-04 17:24:26 +01:00
Bert Blommers
7693d77333
Remove Py2 support (#3915) 2021-07-26 07:40:39 +01:00
Shubham Gupta
a48c811069
#4067: Add support for kinesis retention hours (#4068) 2021-07-14 15:36:30 +01:00
Brian Pandola
f96ac40fca
Fix: ApproximateArrivalTimestamp should be epoch with millisecond precision (#3764)
The Record class was already capturing a unix timestamp, but it was incorrectly
converting it to ISO format when sending back to the client.

Updating the model to return the correct timestamp necessitated a minor change
to one of the tests because `botocore` converts non-timezone aware timestamps
to local time.
2021-03-11 08:54:21 +00:00
Toshiya Kawasaki
25161c0c18
Add kinesisvideo (#3271)
* kinesisvideo create_stream

* add kinesis video stream description

* add kinesisvideo describe_stream

* add kinesisvideo list_streams

* add kinesisvideo delete_stream

* remove unused comment

* remove duplicated definition

* add kinesis video exceptions

* pass region_name to kinesisvideo client in test

* fix kinesisvideo url path

* resolve conflict of kinesisvideo url and kinesis url

* specify region name to kinesisvideobackend

* Add get-dataendpoint to kinesisvideo

* include stream name in ResourceInUseException of kinesisvideo

* use ACCOUNT_ID from moto.core in kinesisvideo

* add server test for kinesisvideo

* split up kinesisvideo test
2020-09-02 08:51:51 +01:00
jweite
49d92861c0
Iam cloudformation update, singificant cloudformation refactoring (#3218)
* IAM User Cloudformation Enhancements: update, delete, getatt.

* AWS::IAM::Policy Support

* Added unit tests for AWS:IAM:Policy for roles and groups.  Fixed bug related to groups.

* AWS:IAM:AccessKey CloudFormation support.

* Refactor of CloudFormation parsing.py methods to simplify and standardize how they call to the models.  Adjusted some models accordingly.

* Further model CloudFormation support changes to align with revised CloudFormation logic.  Mostly avoidance of getting resoure name from properties.

* Support for Kinesis Stream RetentionPeriodHours param.

* Kinesis Stream Cloudformation Tag Support.

* Added omitted 'region' param to boto3.client() calls in new tests.

Co-authored-by: Joseph Weitekamp <jweite@amazon.com>
2020-08-27 10:11:47 +01:00
jweite
da07adae52
* Support for CloudFormation update and delete of Kinesis Streams (#3212)
* Support for CloudFormation stack resource deletion via backend resource method
  delete_from_cloudformation_json() via parse_and_delete_resource().
* Correction to the inappropriate inclusion of EndingSequenceNumber in open shards.
  This attribute should only appear in closed shards.  This regretfully prevents
  confirmation of consistent record counts after split/merge in unit tests.
* Added parameters/decorator to CloudFormationModel method declarations to calm-down Pycharm.

Co-authored-by: Joseph Weitekamp <jweite@amazon.com>
2020-08-03 16:04:05 +01:00
Adam Richie-Halford
9a9a1d8413
Decentralize cloudformation naming responsibilities (#3201)
* #3127 - Decentralize CF naming responsibilities

* Decentralize CloudFormation naming responsibilities

* Update URLs in cloudformation_resource_type functions

* Fix flake8 errors

* Black formatting

* Add a bunch of imports to populate CloudFormationModel.__subclasses__

* Add noqa to s3 models import statement in cloudformation/parsing.py

* Black formatting

* Remove debugging print statement

Co-authored-by: Bert Blommers <info@bertblommers.nl>
2020-08-01 15:23:36 +01:00
gruebel
9d9b620878 Fixed linter errors 2019-12-26 21:03:49 +01:00
gruebel
d7ba355a65 Add missing regions to all services 2019-12-26 17:12:22 +01:00
Fabio Dias
fd9ac4b9a5 ACCOUNT_ID moved to moto.core, MOTO_ACCOUNT_ID env var override 2019-12-16 21:05:29 -05:00
Fabio Dias
b83a750630 Added references to moto.iam.models.ACCOUNT_ID instead of hardcoded id 2019-12-16 19:56:11 -05:00
Asher Foa
96e5b1993d Run black on moto & test directories. 2019-10-31 10:36:05 -07:00
Jack Danger
0723fcf6e7 Supporting more modern Firehose features
This implements ExtendedS3DestinationConfiguration, allowing
serialization to Parquet and ORC formats as part of a Firehose
destination.
2019-10-10 17:44:09 -07:00
Steve Pulec
75d9707e8e
Merge pull request #2099 from ssoulier/master
fix bug in Stream init (wrong number of shards)
2019-07-01 22:27:33 -05:00
sergejs-katusenoks
6628567cbc Fix base64 deprecated methods in kinesis.utils (#2209)
* Fix base64 deprecated methods

Using right encode and decode methods according to python version.

* moved imports on top

E402 module level import not at top of file
2019-05-21 17:47:35 +01:00
Alexey Firsov
f13e4e41cd add implemented kinesis method describe_stream_summary (#2023) 2019-05-21 00:02:36 +01:00
stephane soulier
92ca7aee12 comply with coding style 2019-03-08 17:03:56 +01:00
stephane soulier
fa3fd729d1 fix bug in Stream init (wrong number of shards) 2019-03-08 16:27:24 +01:00
Henadzi Tsaryk
46dd351965 Add ApproximateArrivalTimestamp and MillisBehindLatest to Kinesis get_records response (#1715)
* Add ApproximateArrivalTimestamp to Kinesis response

* Add MillisBehindLatest to Kinesis get_records response
2018-07-13 10:06:28 +01:00
Devin Bjelland
0a4d2037df fix bug with Kinesis ResourceInUse exception (#1544) 2018-03-29 16:42:53 -07:00
Brian Cavagnolo
d2eea02774 add support for kinesis AT_TIMESTAMP shard iterator (#1376)
Fixes #813
2017-12-08 10:57:05 +00:00
Waldemar Hummer
115b9cee3e add CloudFormation model for Kinesis streams 2017-07-20 14:37:53 +10:00
Steve Pulec
0adebeed24 Merge #913. 2017-05-10 21:58:42 -04:00
Steve Pulec
6d422d1f37 Add BaseModel to all models. 2017-03-11 23:41:12 -05:00
Steve Pulec
f37bad0e00 Lints. 2017-02-23 21:37:43 -05:00
Steve Pulec
81836b6981 Get standalone server mode working for all tests. 2017-02-23 19:43:48 -05:00
Steve Pulec
d0fe1a0956 Remove pdb. 2017-02-18 09:31:47 -05:00
Steve Pulec
cad185c74d Cleanup headers and encoding. 2017-02-16 22:51:04 -05:00
Steve Pulec
fde721bed7 Testing new version of decorator. 2017-02-15 22:35:45 -05:00
Steve Pulec
d3df810065 Generalize decorator code. 2017-02-12 00:22:29 -05:00
Steve Pulec
ddf2f5a754 Fix firehose to work without Redshift config. 2016-10-09 20:24:09 -04:00
root
89e46d87bd fix unicode encoding 2015-12-05 12:42:57 +00:00
root
b2af81eab5 use six.string_types instead of basestring 2015-12-05 12:39:03 +00:00
root
6eaea9aa6e fix integer division for Py3 2015-12-05 12:31:58 +00:00
root
480a30e922 fix for python 3 compatibility 2015-12-05 11:27:16 +00:00
root
80688ea2b2 - implement basic sharding scheme
- add API for merge_shards and split_shard
 - add some parater typ checking for put_record(s)
2015-12-05 11:13:34 +00:00
root
fca96c935d exception must be raise instead returning a response 2015-12-04 08:56:49 +00:00
root
03cd1e47c1 add kinesis API:
- AddTagsToStream
 - ListTagsForStream
 - RemoveTagsFromStream
2015-12-03 11:53:57 +00:00
mfranke
7220969feb typo 2015-11-17 18:18:02 +01:00
mfranke
f93b9a86e9 add put_records API
fix create_stream API to get right response in case of stream already exists
2015-11-12 10:05:02 +01:00
Steve Pulec
d9faab3e5e Fix error for describing kinesis stream that has not been created. 2015-11-02 13:25:31 -05:00
Steve Pulec
1b1cf40af8 handle optional compression format. 2015-10-30 14:18:29 -04:00
Steve Pulec
7fcf84b32a easier fallback. 2015-10-30 10:13:57 -04:00
Steve Pulec
127625bdc3 fix typo. 2015-10-30 10:10:49 -04:00
Steve Pulec
015e7ea9a2 py3 fix. 2015-10-30 10:05:53 -04:00
Steve Pulec
ac1bb336c8 firest draft of firehose support. 2015-10-30 09:59:57 -04:00