Skip to content

Feature: Firehose/Kinesis: Add resharding (split merge) kinesis event stream validated tests #10177

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 25 commits into
base: main
Choose a base branch
from
Draft

Feature: Firehose/Kinesis: Add resharding (split merge) kinesis event stream validated tests #10177

wants to merge 25 commits into from

Conversation

maxhoheiser
Copy link
Member

Motivation

Changes

maxhoheiser and others added 25 commits January 31, 2024 11:27
@maxhoheiser
feat: use cleanup fixture for cleaning up firehose stream
24c8925
@maxhoheiser
feat: align firehose delivery stream creation fixture
f8b8438
@maxhoheiser
feat: align kinesis create stream fixture
f75ae4b
@maxhoheiser
feat: add test name for role and policy if not given
5827f4a
@maxhoheiser
feat: add snapshot test for multiple firehose delivery stream consumers
c983f14
@maxhoheiser
feat: add snapshot
1e93ef9
@maxhoheiser
feat: mark as validated
beb1192
@maxhoheiser
feat: make default message reusable
f3d1962
@maxhoheiser
fix: use correct log groupe name
cbb6007
@maxhoheiser
feat: wait for role propagation instead of retry this handles differe…
ef8e9ed 
…nt failures better
@maxhoheiser
feat: fix typo
1462ab2
@maxhoheiser
feat: align naming
4b5b9e0
@maxhoheiser
feat: align naming
41655fd
@maxhoheiser
fix: align updated names with snapshots
7f2d90a
@maxhoheiser
feat: add unique dynamo db lease table for each version of kcl
cbb11ff
@simonrw @maxhoheiser
CFn: improve error message for invalid ref (#10149)
6ddf1b4
@whummer @bentsku @maxhoheiser
enhance parity for DynamoDB to Kinesis stream integration (#10143)
bf16771 
Co-authored-by: Benjamin Simon <benjh.simon@gmail.com>
@viren-nadkarni @maxhoheiser
Fix scenario tests failing in non-default region (#9149)
54a8e73
@bentsku @maxhoheiser
fix Kinesis rejection of log level (#10158)
9230626
@sannya-singal @maxhoheiser
cloudwatch: fix functionality of metrics for multi-accounts and region (
baf352c 
#9945)
@MEPalma @maxhoheiser
StepFunctions, SNS Optimised Integration: Automatic Stringification o…
17e9613 
…f Message Arguments (#10165)
@thrau @maxhoheiser
fix dynamodb router rule removal (#10172)
75b10a1
@viren-nadkarni @maxhoheiser
Fix bootstrap tests failing in non-default region (#10152)
ad8fdc2
@maxhoheiser
feat: add resharding split test
e231c6a
@maxhoheiser
feat: add snapshot test for shard merging kinesis stream
b8689a7
@maxhoheiser maxhoheiser added aws:firehose Amazon Data Firehose aws:kinesis Amazon Kinesis semver: minor Non-breaking changes which can be included in minor releases, but not in patch releases labels Feb 5, 2024
@maxhoheiser maxhoheiser self-assigned this Feb 5, 2024
@maxhoheiser maxhoheiser changed the title Feat/firehose/add resharding validated test Feature: Firehose/Kinesis: Add resharding (split merge) kinesis event stream validated tests Feb 5, 2024
@maxhoheiser maxhoheiser added this to the Playground milestone Feb 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@MEPalma MEPalma Awaiting requested review from MEPalma MEPalma will be requested when the pull request is marked ready for review MEPalma is a code owner

@joe4dev joe4dev Awaiting requested review from joe4dev joe4dev will be requested when the pull request is marked ready for review joe4dev is a code owner

@gregfurman gregfurman Awaiting requested review from gregfurman gregfurman will be requested when the pull request is marked ready for review gregfurman is a code owner

@pinzon pinzon Awaiting requested review from pinzon pinzon will be requested when the pull request is marked ready for review pinzon is a code owner

@viren-nadkarni viren-nadkarni Awaiting requested review from viren-nadkarni viren-nadkarni will be requested when the pull request is marked ready for review viren-nadkarni is a code owner

@giograno giograno Awaiting requested review from giograno giograno will be requested when the pull request is marked ready for review giograno is a code owner

@dominikschubert dominikschubert Awaiting requested review from dominikschubert dominikschubert will be requested when the pull request is marked ready for review dominikschubert is a code owner

@simonrw simonrw Awaiting requested review from simonrw simonrw will be requested when the pull request is marked ready for review simonrw is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

@maxhoheiser maxhoheiser

Labels
aws:firehose Amazon Data Firehose aws:kinesis Amazon Kinesis semver: minor Non-breaking changes which can be included in minor releases, but not in patch releases
Projects
None yet
Milestone
Playground
Development

Successfully merging this pull request may close these issues.
8 participants
@maxhoheiser @simonrw @whummer @viren-nadkarni @bentsku @sannya-singal @MEPalma @thrau