Enable SqsTemplate to send more than 10 messages at once

[tomazfernandes]

As discussed here, currently SqsTemplate fails if more than 10 messages are provided in a batch with an error from AWS SDK.

We can add support for this use case by partitioning the message list in batches of 10, while also sending the batches in parallel.

This change would likely be around here:

spring-cloud-aws/spring-cloud-aws-sqs/src/main/java/io/awspring/cloud/sqs/operations/SqsTemplate.java

Lines 350 to 356 in 562b933

	protected <T> CompletableFuture<SendResult.Batch<T>> doSendBatchAsync(String endpointName,
	Collection<Message> messages, Collection<org.springframework.messaging.Message<T>> originalMessages) {
	logger.debug("Sending messages {} to endpoint {}", messages, endpointName);
	return createSendMessageBatchRequest(endpointName, messages).thenCompose(this.sqsAsyncClient::sendMessageBatch)
	.thenApply(response -> createSendResultBatch(response, endpointName,
	originalMessages.stream().collect(Collectors.toMap(MessageHeaderUtils::getId, msg -> msg))));
	}

[levys17]

@tomazfernandes I started to work on it...If it's ok, can you assign this issue to me?

[techadri]

@tomazfernandes I'd be happy to provide a PR for this topic, in case you (@levys17) aren't working on it anymore.

[levys17]

@tomazfernandes I'd be happy to provide a PR for this topic, in case you (@levys17) aren't working on it anymore.

I didn't have time to finish that and I've barely worked on it in last weeks....so for me it'll be nice if you do that :D

[techadri]

@tomazfernandes
Currently, doSendBatchAsync sends all messages in a single batch request using the sqsAsyncClient, ensuring that FIFO queues maintain the order of messages. If we change to partitioning messages and sending batches in parallel, only messages within each batch will retain order, but the order of the batches may vary. What are your thoughts on this?

[tomazfernandes]

Oh, that's a great point.

I think the ideal solution would be partitioning batches per message group for fifo queues and then sending each batch in parallel.

A simpler solution would be sending batches in parallel for Standard queues and sequentially for FIFO queues.

WDYT?

[joseiedo]

Hello. I couldn't find existing PRs and the error was still happening. Opened a PR #1659 following the approach suggested here, I'm happy to receive feedbacks!