三．AWS ParallelCluster
An open-source cluster management tool to deploy and manage High Performance Computing (HPC) clusters on AWS.
(资料图片仅供参考)
Uses a simple text file to model and provision all the resources needed for your HPC applications in an automated and secure manner.
Supports multiple instance types and job submission queues, and job schedulers like AWS Batch and Slurm. Reference https://aws.amazon.com/tw/hpc/parallelcluster/
1. Architecture of cluster deployed by AWS ParallelCluster + Several manual STEPS
2. Before installing AWS ParallelCluster
•A Linux environment is required.
•Current latest version of AWS ParallelCluster is 3.3.0
-We have tested Linux node on-premises with CentOS 7 and RHEL 8, and both of them can only get latest AWS ParallelCluster as version 3.1.4.
•We have installed AWS ParallelCluster on EC2 instance with Amazon Linux 2 as the operating system. In this environment the latest AWS ParallelCluster installed is 3.3.0.
-This guide is based on AWS ParallelCluster 3.3.0, therefore use Amazon Linux 2 to install AWS ParallelCluster is strongly recommended.
(1)Create EC2 instance for installing AWS ParallelCluster (Create VPC)
•Log in AWS Console –> Search VPC –> Create VPC
•Set Name tag auto-generation as “amazonlinux”
•Number of Availability Zones (AZs) set to 1. Number of private subnets set to 0. NAT gateways ($) set to None. VPC endpoints set to None. –> Press “Create VPC” button.
(2) Create EC2 instance for installing AWS ParallelCluster (Launch EC2 instance)
•Go to service -> EC2 and press “Launch instance”
•Name: amazonlinux
•OS: select Amazon Linux 2 AMI
•Instance type: select t2.micro
•Key pair:
▪Press “Create new key pair”
▪Key pair name: awsparallelcluster
▪Key pair type: RSA
▪Private key file format: .pem
▪Press “Create key pair”
-Download awsparallelclsuter.pem
•Please confirm
▪Key pair name
▪Network settings
-Network: amazonlinux-vpc
-Subnet: amazonlinux-subnet-public1-??
-Press “Edit” and change auto-assign public IP from “Disable” to “Enable”
•Press “Launch instance”
(3) Create EC2 instance for installing AWS ParallelCluster (Connect to EC2 instance)
•At AWS Console –> EC2 instance –> Find the public IP of the EC2 instance (name: amazonlinux)
•Download and install PuTTY
▪https://www.putty.org/
•Run “PuTTYgen”
▪Load “awsparallelcluster.pem”
▪Enter “key passphrase” and “confirm”
▪Press “Save private key”
▪Type filename as “awsparallelcluster.ppk”
•Run PuTTY -> Type Host name of EC2 instance (amazonlinux)
•Go to Connection->SSH->Auth -> Browse the ppk file created in last page
•Press “Open”
•Press “Accept”
•Login as: please enter “ec2-user”
•Enter passphrase for PPK key (awsparallelcluster.ppk)
Now you have created the Linux environment to install AWS ParallelCluster 3.3.0.