46 Commits

Author SHA1 Message Date
Bert Blommers
3682cc633b
Techdebt: Reuse parsed URL across services (#6635) 2023-08-12 07:00:16 +00:00
steffyP
33c665fc21
EMR: fix handling of Properties for job flows (#6513) 2023-07-12 17:30:58 +00:00
Bert Blommers
a1a43e3f74
Techdebt: MyPy EMR (#6005) 2023-03-03 18:42:11 -01:00
Daniel Roschka
0588db704a
Remove dependency on pytz (#5749) 2022-12-09 22:56:08 -01:00
Bert Blommers
6ab2497a12
Techdebt: Replace string-format with f-strings (for e* dirs) (#5668) 2022-11-14 21:34:02 -01:00
Bert Blommers
3d913f8f15
MultiAccount support (#5192) 2022-08-13 09:49:43 +00:00
Bert Blommers
eed32a5f72
Pylint - Enable more rules on source and tests-directory (#4929) 2022-03-11 20:28:45 -01:00
Deepesh J
9a8be5ce28
Add support for EMR AutoScalingRole (#4630) 2021-11-24 09:37:30 -08:00
Dominik Schubert
f717e494d3
Core - Use json module for error_json exception type rendering instead of jinja2 (#4587) 2021-11-17 15:19:03 -01:00
Anay Nayak
13f985115b
EMR: Rename get_cluster to describe_cluster (#4504) 2021-10-30 11:08:03 +00:00
Bert Blommers
14a69c7524
Techdebt: Enable pylint rules (#4432) 2021-10-18 19:44:29 +00:00
Bert Blommers
7693d77333
Remove Py2 support (#3915) 2021-07-26 07:40:39 +01:00
Brian Pandola
b0e2a750dc
Disallow termination of protected EMR job flows (#4015)
Error message verified against real AWS backend.
2021-06-17 12:20:45 +01:00
khneal
8b523c3fe1
EMR and SWF - add arn to response (#3873)
* emr: add ClusterArn to describe_cluster response

* emr: add ClusterArn to list_clusters response

* emr: add ClusterArn to put_auto_scaling_policy response

* emr: add ClusterArn to run_job_flow response

* emr: rename property "cluster_arn" to simply "arn"

* emr: generalize arn for account_id and region

* swf: add arn to list_domains response

* black reformat source code

* fix double import

* swf: require region on Domain object

Co-authored-by: Kevin Neal <Kevin_Neal@intuit.com>
2021-04-23 15:20:36 +01:00
Deepesh J
c31dffcc92
List instances Implementation in EMR (#3871)
* Implemented list instances in EMR

* removed import from tests

* make format

* fix W291 trailing whitespace

* removed to work for py2.7

* Storing only ec2_id and instance group in Fake instance

Co-authored-by: J <jdeepe@147dda1b0833.ant.amazon.com>
2021-04-23 08:03:06 +01:00
Brian Pandola
53a3e52c67
Fix: EMR ReleaseLabel validation does not respect semantic versioning (#3489)
Fixes #3474
2020-11-22 18:54:59 +00:00
jweite
5fe921c2bc
Added support for EMR Security Configurations and Kerberos Attributes. (#3456)
* Added support for EMR Security Configurations and Kerberos Attributes.

* Revised exception-raising test to work with pytest api.

* Added htmlcov to .gitignore; upgrading botocore to 1.18.17, per commit d29475e.

Co-authored-by: Joseph Weitekamp <jweite@amazon.com>
2020-11-17 10:54:34 +00:00
jweite
9bc6bded6e
EMR: Support for StepConcurrencyLevel. (#3351)
Co-authored-by: Joseph Weitekamp <jweite@amazon.com>
2020-10-02 14:07:13 +01:00
jweite
cd20668e9c
Support for autoscaling policies in run_jobflow, add_instance_group and list_instance_groups. (#3288)
Support for cluster_id parameter substitution in autoscaling policy cloudwatch alarm dimensions.
New operations put_autoscaling_policy and remove_autoscaling_policy support

Co-authored-by: Joseph Weitekamp <jweite@amazon.com>
2020-09-23 11:21:45 +01:00
Bert Blommers
c32c17a13e Remove duplicated method 2020-03-30 13:49:19 +01:00
addomafi
a6c1d47412 Reformat 2020-03-07 08:21:27 -03:00
addomafi
155cf82791 Keeping support to python 2 2020-03-07 07:43:59 -03:00
addomafi
c8dfbe9575 #2784 Adding missing support for EbsConfiguration on EMR instance groups 2020-03-06 15:12:44 -03:00
Bert Blommers
7205ab7785 #1427 - EMR - Return start time of first step 2020-02-20 08:59:21 +00:00
Asher Foa
96e5b1993d Run black on moto & test directories. 2019-10-31 10:36:05 -07:00
Jordan Sanders
4cce4defac Support CustomAmiId in EMR (#2037) 2019-05-25 11:19:26 +01:00
Steve Pulec
f4767c805e Uncomment EMR FailureDetails. Closes #1891. 2018-12-28 19:38:09 -05:00
Ash Berlin-Taylor
1b20f21a75 Escape EMR template fields to avoid invalid XML responses (#1467)
I had an EMR step that contained a `&` and this caused the ListStep call to fail.

I've added the `| escape` filter to handle it in this case and a few other cases that look like they could suffer the same fate.
2018-03-21 08:57:50 -07:00
Steve Pulec
3c0c4c2996 Fix tests for py3. 2017-02-23 22:28:09 -05:00
Steve Pulec
0dda687762 Fix urlparse for py3. 2017-02-23 21:41:05 -05:00
Steve Pulec
f37bad0e00 Lints. 2017-02-23 21:37:43 -05:00
Steve Pulec
81836b6981 Get standalone server mode working for all tests. 2017-02-23 19:43:48 -05:00
Taro Sato
484faa54c4 Implement filters and pagers for some EMR end points 2016-10-20 10:03:17 -07:00
Taro Sato
7cd404808b Better EMR coverage and boto3 request/response handling
This revision includes:

- A handler for requests for which content-type is JSON (from boto3).

- A decorator (generate_boto3_response) to convert XML responses to
  JSON (for boto3). This way, existing response templates for boto can
  be shared for generating boto3 response.

- Utility class/functions to use botocore's service specification data
  (accessible under botocore.data) for type casting, from query
  parameters to Python objects and XML to JSON.

- Updates to response handlers/models to cover more EMR end points and
  mockable parameters
2016-10-13 16:48:07 -07:00
Akira Chiku
9b3fa83730 Use content-type for detecting client 2015-11-28 19:25:10 +09:00
Akira Chiku
7a11500171 Implement JSON responses for EMR (for Boto3) 2015-11-15 17:24:36 +09:00
Akira Chiku
91edbb21bf Make EMR multi-region 2015-07-12 19:32:16 +09:00
Shulman Evgeny
e498c95807 feature emr: set_termination_protection call implementation
feature emr: support for instance_groups param in run_jobflow
2015-07-08 10:26:58 +03:00
Steve Pulec
95b1fa42b2 Add EMR clusters and tagging. 2015-02-14 12:00:14 -05:00
Steve Pulec
56007660d8 Cleanup parameter parsing. 2014-12-31 13:23:08 -05:00
dreadpirateshawn
9affa7753d Performance: Leverage jinja2's Environment to cache compiled Templates. 2014-12-12 12:46:07 -08:00
David Baumgold
4201e6b430 from __future__ import unicode_literals 2014-08-27 11:33:55 -04:00
Steve Pulec
3bddbb4af3 Test out py26 with new HTTPretty 2013-10-03 20:34:13 -04:00
Steve Pulec
62b72377bd Add visibletoallusers and normalizedinstancehours to EMR 2013-08-10 20:03:57 -04:00
Steve Pulec
e251fd8930 Add job_flow_role param or EMR 2013-08-08 10:40:29 -04:00
Steve Pulec
cea25e75c5 basic emr done 2013-08-07 20:32:29 -04:00