Before you dive right into layers and use it as a replacement for good old NPM packages, keep in mind that it introduces a number of challenges to your workflow including making testing more difficult.
As for packing the AWS-SDK, you should include your own copy of AWS-SDK in your deployment artefacts, and I explained why in this post. And it’s also the recommendation from the official documentation.