1. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

2. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
, !
Amazon EC2
AWS
DevOps Engineer

3. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1. EC2 Compute overview
2. AWS Nitro (Hypervisor, SSD, Security)
3. Amazon EC2 (Intel, AMD, Graviton)
4. Amazon EC2 (HPC/TRN/INF)
5.
Agenda

4. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2

5. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Elastic Compute Cloud (EC2)
A W S ,
Amazon EC2
•
• ,
•
• ARM | X86 | AMD
• OS : Linux | Windows | MAC
• Packaged | Custom | Community AMIs
• : On-Demand, RI, Spot, Savings Plans

6. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
M
T
C
R
( I/O) I
D
GPU P
G
Elastic Block Store (EBS)
Elastic Fabric Adapter
Elastic Inference
Elastic Graphics
Linux, Unix, Windows,
macOS
(AWS Graviton, Intel, AMD)
( 4.5 GHz)
( 24 TiB)
(HDD NVMe)
(GPU ,FPGA & ASIC)
( 800 Gbps)
(Nano 112xlarge)
https://aws.amazon.com/ko/ec2/instance-types/
600+

7. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2
General purpose
Compute optimized
Memory optimized
Storage optimized
Mac T4g T3 T3a M6g M6i M6a A1
C7g C6i C6a Hpc6a
R6g R6a R6i X2g X2iezn
High
Memory
z1d
P4 G5 DL1 Trn1 Inf1 F1 VT1
I4g I41 D3 H1
M1 R7g
M7g
Hpc6id

8. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2
(Size)
(Generation)
C 5 d . 2xlarge
•
• ( , ,..)
•
•
•
• d : NVMe SSD
• e :
• n :
• z : CPU
• i : Intel
• a : AMD
• g : AWS Graviton
• Mac :
•
• T-shirt

9. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
2 0 1 7 2 0 1 8 2 0 1 9 2 0 2 0
2 0 1 6
2 0 1 5
2 0 1 4
2 0 1 3
2 0 1 2
2 0 1 1
2 0 1 0 2 0 2 1
ENHANC ED
NETWOR K I N G
NITRO
SYSTEM
X EN
ENHANC ED
STOR AG E
GRAVITON
NIT RO SSD
INFERENTIA
GRAV IT ON2
Amazon EC2
2 0 2 3
2 0 2 2
Trainium
Inf2
Nitro 시스템 도입 이후
인스턴스 개수 및 성능 비약적 개선

10. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
?
.
+

11. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2
,
/ 72%,
90%

12. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro

13. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro
,
• , ,
Amazon EC2 Nitro

14. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro
,
• , ,
Amazon EC2 Nitro

15. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro v5
• 2x
• DRAM 50%
• PCIe 2
• 60% PPS
• 30%
• 40%
AWS Nitro
C7gn

16. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S P E C I N T 2 0 1 7
AWS Vendor
A
Vendor
B
M E M C A C H E D
AWS Vendor
A
Vendor
B
N G I N X
W E B S E R V I N G
R E D I S
-15%
-22%
-8%
-16%
-11%
-27%
AWS Vendor
A
Vendor
B
AWS Vendor
A
Vendor
B
Nitro
A M A ZO N E C 2 1 5 %

17. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro
Nitro Cards Nitro Nitro
CPU
VPC
Amazon Elastic Block Store
(Amazon EBS)
Nitro SSDs
System Controller

18. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
200 Gbps
400 Gbps
800 Gbps
2021
50 Gbps
2019
25 Gbps
2013 2015
2011
2008
2006
AWS Nitro
100 Gbps
1600 Gbps
High scale workloads
Network optimized
Baseline
Trn1
Trn1n

19. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
6 EC2-
EBS
2
, Telco
EC2 EBS
80Gbps EBS
,
200Gbps
200Gbps
NEW
C6i, M6i, and R6i

20. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro SSD
Nitro
AES-256
AWS Nitro
I/O
60%
AWS SSD

21. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Intel
Amazon EC2 X86
• 3 Intel Xeon Scalable (Ice Lake)
• 128 vCPU, 1TiB , 75Gbps
• 30TiB AWS Nitro SSD NVMe
• I3 30%
• I/O 60%
• Microsoft SQL Server, Oracle ,NoSQL
•

22. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Graviton 2, 3
Amazon EC2
• 64 CPU , 256Gb 100Gbps
• I3 40%
• TB 44%
• , NoSQL ,
•
• 32 CPU , 192Gb 50Gbps
• I3en 45%
• TB 15%
• , ,
Graviton 2
Graviton 2
• IOS(SSD) EBS M7g, R7g, C7gn ( )
Graviton 3

23. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2
(Intel, AMD, AWS Graviton)

24. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AMD EPYC
processors
Intel Xeon
scalable processors
AWS Graviton
processors Mac Instances

25. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
350 Amazon EC2
Intel
AWS
Ice Lake
1 6 A W S
NEW NEW NEW
M6i(d)n C6i(d)n R6i(d)n
• 3 Intel Xeon Scalable
•
NEW
R7iz
• 4 Intel Xeon Scalable
•
•

26. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
3 Intel Xeon Scalable NVMe EC2
Amazon EC2 C6i(d)n, M6i(d)n R6i(d)n
NEW
• 7.6TB NVMe SSD
• C5d, M5d R5d 15%
• 2 20%
TME(Total Memory Encryption)
•

27. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 R7iz
4 Intel Xeon Scalable
NEW
• 128 vCPU, 1TiB
• 2.6 vCPU
• 20%
• DDR5
• 2.4
• 4 Intel Xeon
• EDA(Electronic Design Automation),
, ,

28. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AMD
X 8 6 1 0 %
Amazon EC2
AMD
AMD
C6A
M6A R6A
NEW NEW NEW
• 3 AMD EPYC
• 2.5
• 2 EBS
10%
M5a/R5a 35%
C5a 15%

29. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Graviton2
40%
Linux
AWS ISV
x86
40%
256 DRAM
Graviton2

30. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DDR4 50%
DDR5
CPU
60%
Graviton2
25%
2
AWS Graviton3
✓ ML 3x
Graviton3
NEW
DDR5
C7g
NEW
Graviton Nitro v5
ARM EC2 ,
AI/ML
C7gn

31. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Graviton AWS
G R A V I T O N
Amazon
DocumentDB
Amazon
Aurora
Amazon RDS Amazon
ElastiCache
Amazon
MemoryDB
Amazon
Neptune
Amazon
OpenSearch
Service
Amazon
EMR
Analytics Compute and containers
AWS
Lambda
AWS
Fargate
AWS Elastic
Beanstalk
Amazon Elastic
Kubernetes
Service (EKS)
Amazon Elastic
Container
Service (ECS)
AI/ML
Amazon
SageMaker

32. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Graviton
G R A V I T O N 2 , 3 T C O
20% 40%
AWS Graviton ,
40%

33. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2
(HPC/TRN/INF)

34. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon FSx
for Lustre
AWS ParallelCluster
AWS Batch
HPC
H P C
, HPC
Graviton3E EFA
2023
AMD CPU
Elastic Fabric Adapter
+100 Gbps networking
NEW NEW
3 CPU SSD
NEW

35. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
x86
FEA(Finite Element Analysis)
HPC 2.2
200Gbps
Amazon EC2 Hpc6id
Amazon EC2 HPC
HPC
,
,
FEA
1TB 15.2TB NVMe
HPC 2
Elastic Fabric Adapter
NEW

36. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
200Gbps
Nitro v5
2
EFA 25%
HPC
HPC
Amazon EC2 Hpc7g
Amazon EC2 HPC
AWS ParallelCluster
AWS
Hpc7g
Graviton 3E
x86
CFD
60%

37. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
M L
TRN1/TRN1n
AWS TRAINIUM
Training ( )
P4DE
NVIDIA A100
TENSOR CORE
Inference( )
INF2
AWS INFERENTIA
NEW
NEW
NEW 4
1/10
Trainium Inferentia

38. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 Trn1/Trn1n
NEW
• 16 Trainium Accelerator
(512GiB HBM2 , 800Gbps(Trn1), 1600Gbps(Trn1n)
8TB NVMe )
• Amazon EC2
• Trainium
Amazon EC2 UltraCluster
• GPU 50%
• , , ,
• PyTorch, Tensor Flow

39. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 Inf2
NEW
• 100B
• Inf1 4 10
• 12 Inferentia2
• 384GB HBM2e
• 192GB/s
• PyTorch TensorFlow
• GPU 45%

40. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
(EC2 )
• (200Gbps)6
• M, R, C , , 200Gbps
• EBS ( 80Gbps), PPS 2
• Nitro v5
• , 60% PPS, 30%
• 40% , c7gn( )
• AWS Graviton 3
• Graviton 3
• c7g, c7gn( )
• HPC
• Hpc7g(Graviton HPC )
• Hpc6id( Xeon Scalable )
• /
• TRN1/TRN1n
• INF2

41. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

42. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
➢ hc99.kim@samsung.com
➢ skycube99@gmail.com
DevOps Engineer, 13
➢ Mobile TVPlus, Samsung Podcast 4
2012 AWS
Kubernetes
Terraform
Serverless (Fargate, AuroraDB)

43. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
배경
EKS + EC2(x86)
3 ,
Container : Alpine Linux
APM : Datadog
Application : Java8 / Spring
CI/CD : GitHub, GitAction
Image Repository : AWS ECR

44. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ARM (Apple M1, AWS Graviton )
ESG
CPU,
EC2

45. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
어떻게 문제를 해결 하였는지
. (EC2)
3 Graviton
Managed Service EC2 .
Graviton arm .
Application EC2 x86 arm
?

46. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Graviton
POD

47. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
>
1) S/W AMD/ARM
• awscli2
ARM/AMD
• ARM/AMD S/W
• Yum/apt Linux
CPU
ANSIBLE
멀티플랫폼 이미지빌드 트러블슈팅
호환성 확인

48. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (1/3)
2)
x86 ARM
.
k8S DEPLOMENT
CPU Arch
.
Docker hub
MULTI PLATFORM .
DOCKER BUILDX !
DOCKER BUILDX
.
!

49. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (2/3)
2)
x86 arm arch
?
!
QEMU emulator !
QEMU
CPU .

50. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (3/3)
3)
ECR MULTI .
URL CPU .
x86 arm .

51. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (1/4)
4) - 1
STG
pod
!
• pod CPU 100%
• pod

52. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (2/4)
4) – 1
ALPINE LINUX
1
JDK ALPINE LINUX
.
2
JDK ALPINE
JAVA
ALPINE LINUX APK
JDK
!

53. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (3/4)
4) – N
ALPINE LINUX JDK
.
!
•
• JDK FIX ARM64 .
• ALPINE LINUX Debian LINUX ( )
• JAVA ( )

54. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (4/4)
4) –
100
pod
APM DATADOG
Datadog Agent
POD
.
K8S POD
Dependency .
.
!
POD
DATADOG

55. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
API
.
APPLICATION
ARM .
15%
CLASS 15%
.
인스턴스 타입 인스턴스 비용($)
교체 전 C5.2xlarge $0.34
교체 후 C7g.2xlarge $0.29
절감 비율 15%
* US WEST Oregon
응답속도 개선
P50 5.6%
P75 4.5%
P90 48.2%

56. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
향후
Graviton
Managed Service Graviton
JAVA17 . ?
JDK ARM64
JAVA

57. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
감사합니다.