Table of Contents |
---|
Key Points
...
Table of Contents |
---|
Key Points
- AWS services can come at 3 layers: iaas, paas, saas
- Most references to AWS refer to paas - EC2 instances and the services that run on them
- EC2 instances can be Windows or Linux
- A low-cost iaas option is LightSail - a VPS server that is fixed price, low-cost with internet connectivity etc - easier to plan than EC2 costs
- Effective cost management of AWS resources and services is a HUGE issue for most companies
- EBS - elastic block storage - can be mounted and file system created for use. can be attached to any single instance
...
Reference_description_with_linked_URLs_________________________________ | Notes_________________________________________________________ | |||
---|---|---|---|---|
https://aws.amazon.com/ | AWS | |||
https://us-east-2.console.aws.amazon.com/console/home?region= us-east-2# | AWS account mgt console | |||
https://us-east-2.console.aws.amazon.com/console/home?region= us-east-2# | AWS account mgt console - has good starting exercises | |||
https://lightsail.aws.amazon.com/ls/webapp/create/instance? region=us-east-1 | AWS Lightsail home page | |||
Lightsail for research page with predefined VPCs for use cases | ||||
https://aws.amazon.com/architecture/back-to-basics/ | AWS architecture concepts - many good basic video lessons *** | |||
AWS Training and Certification | ||||
https://aws.amazon.com/training/?nc1=f_cc | Training home page | |||
https://aws.amazon.com/certification/ | Certifications home page | |||
https://www.udemy.com/course/aws-concepts/ | AWS Concepts - free intro course 1.5 hours | |||
https://www.udemy.com/course/linux-academy-aws-essentials-2019/learn/lecture/13741352#overview | AWS Essentials - free certification prep course for practiioner exam | |||
https://linuxacademy.comCloud Essentials - Knowledge Badge Readiness Path - skillbuilder | Cloud Essentials - Knowledge Badge Readiness Path - skillbuilder *** | |||
AWS ramp up technology learning doc | AWS ramp up technology learning doc *** | |||
AWS Cloud Practioner learning plan page | AWS Cloud Practioner learning plan page *** | |||
https://linuxacademy.com/pricing/ https://drive.google.com/file/d/1QEJ7fkvAy7C17vJO8ONh0qjlA58flbbh/view?usp=sharing | Linux Academy - billable certifications - $32 per month for courses Essentials course outline | |||
https://aws.amazon.com/certification/certified-solutions-architect-associate/ | AWS Associate Architect cert - online multiple choice | AWS Products and Services Best Practices | ||
https://awsreinvent.amazonawsevents.com/products/?nc2=h_m1AWS Cloud products menuon-demand/ | reinvent 2023 ondemand videos | |||
https://awswww.amazonyoutube.com/solutions/?trk=sl_cmp_2019Q2_namer_psoc_ fb&sc_campaign&sc_publisher=FB&sc_category=Business+Applicatio ns&sc_country=NAMER&sc_geo=NAMER&sc_outcome=aware&sc_ detail=1200x628&sc_content=FB_ITPros&sc_matchtype=xx&sc_ segment=xx&sc_medium=PAC-EDM-P%7CFB%7CSocial-P%7CAll%7CAW%7CBusiness+Applications%7CAWS+Solutions%7CNAMER %7CEN%7CImage%7Cxx%7C&fbclid=IwAR0B9R9JSsVH9_1B-MMR- PsGgY3A63aiSJ-Ln5O8A9gPOViXHLD3xBEOOp0&solutions-all.sort-by=item.additionalFields.footerInfoText&solutions-all.sort-order=desc AWS Solution Architectures - pre-defined solution stacks AWS Solutions are built using services from AWS. They are designed to help you solve common problems and build faster using the AWS platform. All AWS Solutions are vetted by AWS architects and are designed to be operationally effective, reliable, secure, and cost effective. Every AWS Solution comes with detailed architecture, a deployment guide, and instructions for both automated and manual deployment.playlist?list=PL2yQDdvlhXf8iyzg7ziZI924PxC8a8M-U | reinvent 2023 AI playlist | |||
https://www.youtube.com/playlist?list=PL2yQDdvlhXf8qWcdB_8mKLyAOHk0cVK6B | reinvent 2023 Architecture playlist | |||
https://www.youtube.com/playlist?list=PL2yQDdvlhXf8_GOWzkJwOsoDLgBw80nfi | reinvent 2023 Analytics ANT playlist | |||
https://www.youtube.com/playlist?list=PL2yQDdvlhXf8r-2SvM2pmCzd62_umw_FJ | reinvent 2023 apps videos | |||
https://www.youtube.com/playlist?list=PL2yQDdvlhXf-MKQE31qHsOE_eSDR1T2Kq | reinvent 2023 cloud operations | |||
https://www.youtube.com/watch?v=DY9ENcGQRto&list=PL2yQDdvlhXf-CN3ykMq_dYH9nmPRRbR7O&index=16 | reinvent 2023 aws graviton EC2 efficiency | |||
https://www.youtube.com/watch?v=sSpJ8tWCEiA&list=PL2yQDdvlhXf-CN3ykMq_dYH9nmPRRbR7O&index=19 | reinvent 2023 aws get AI in AWS console | |||
AWS Products and Services Best Practices | ||||
https://aws.amazon.com/products/?nc2=h_m1 | AWS Cloud products menu | |||
https://aws.amazon.com/architecturequickstart/?cardssolutions-all.sort-by=item.additionalFields.sortDate&cardssolutions-all.sort-order=desc&awsf.filter-content-type=*all&awsf.methodology=*all&awsf.filter-tech-category=*all&awsf.industriesfilter-industry=*all | AWS Architecture Best Practices Guides, Diagrams ** | https://docs.aws.amazon.com/ec2/index.html | AWS EC2 docs Quickstart solution deployments for simple solutions *** good place to test simple solution types | |
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/index.html | AWS EC2 Linux docs ** | AWS pricing | AWS Environment Services | |
https://aws.amazon.com/ec2/ https://aws.amazon.com/ec2/instance-types/ | AWS EC2 instance types | |||
https://aws.amazon.com/pricing/services/ | AWS Storage types | |||
https://aws.amazon.com/pricing/services/ | AWS Database service options | |||
https://aws.amazon.com/free/?all-free-tiersolutions/?trk=sl_cmp_2019Q2_namer_psoc_ fb&sc_campaign&sc_publisher=FB&sc_category=Business+Applicatio ns&sc_country=NAMER&sc_geo=NAMER&sc_outcome=aware&sc_ detail=1200x628&sc_content=FB_ITPros&sc_matchtype=xx&sc_ segment=xx&sc_medium=PAC-EDM-P%7CFB%7CSocial-P%7CAll%7CAW%7CBusiness+Applications%7CAWS+Solutions%7CNAMER %7CEN%7CImage%7Cxx%7C&fbclid=IwAR0B9R9JSsVH9_1B-MMR- PsGgY3A63aiSJ-Ln5O8A9gPOViXHLD3xBEOOp0&solutions-all.sort-by=item.additional FieldsadditionalFields.SortRankfooterInfoText&solutions-all-free-tier.sort-order=ascAWS free tierdesc | AWS Solution Architectures - pre-defined solution stacks AWS Solutions are built using services from AWS. They are designed to help you solve common problems and build faster using the AWS platform. All AWS Solutions are vetted by AWS architects and are designed to be operationally effective, reliable, secure, and cost effective. Every AWS Solution comes with detailed architecture, a deployment guide, and instructions for both automated and manual deployment. | |||
https://wwwaws.janbasktrainingamazon.com/blog/what-is-aws-lightsail/Differences between normal EC2 instances and Lightsail serversarchitecture/?cards-all.sort-by=item.additionalFields.sortDate&cards-all.sort-order=desc&awsf.content-type=*all&awsf.methodology=*all&awsf.tech-category=*all&awsf.industries=*all | AWS Architecture Best Practices Guides, Diagrams ** | |||
https://docs.aws.amazon.com/lightsail/pricing/?opdp1=pricing | Lightsail - Linux servers $10 / mo - 2 GB Memory 1 Core Processor 60 GB SSD Disk 3 TB Transfer* $20 / mo - 4 GB Memory 2 Core Processor 80 GB SSD Disk 4 TB Transfer* $40 / mo - 8 GB Memory 2 Core Processor 160 GB SSD Disk 5 TB Transfer* $80 / mo - 16 GB Memory 4 Core Processor 320 GB SSD Disk 6 TB Transfer* highly available SSD-backed storage for your Linux or Windows virtual server. Block storage starts at 8 GB and costs 0.10 USD per allocated GB | https://docs.ec2/index.html | AWS EC2 docs | |
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/index.html | AWS EC2 Linux docs ** | |||
AWS pricing | ||||
AWS Environment Services | ||||
https://aws.amazon.com/ec2/ https://aws.amazon.com/ec2/instance-types/ | AWS EC2 instance types | |||
https://aws.amazon.com/pricing/services/ | AWS Storage types | |||
https://aws.amazon.com/whitepaperspricing/latestservices/cost-optimization-laying-the-foundation/cost-optimization-pillars.htmlAWS | cost optimizationAWS Database service options | |||
https://aws.amazon.com/pricing/cost-optimization/ | AWS cost planning - Planning Dashboard for systems, services | https://awstcocalculator.com/?refid=NY_summit_LS_2019 | AWS cost calculator over on-premise systemsfree/?all-free-tier.sort-by=item.additional Fields.SortRank&all-free-tier.sort-order=asc | AWS free tier |
https://awswww.amazonjanbasktraining.com/pricing/services/AWS cloud services pricingblog/what-is-aws-lightsail/ | Differences between normal EC2 instances and Lightsail servers | |||
https://aws.amazon.com/lightsail/freepricing/?all-free-tier.sort-by=item.additional Fields.SortRank&all-free-tier.sort-order=asc | AWS free tier | |||
https://calculator.s3.amazonaws.com/index.html | AWS cost calculator - monthly | |||
https://go.cloudhealthtech.com/rs/933-ZUR-080/images/10-best- https://drive.google.com/open?id=1sHsXhkf83v3vK-3uHhEvl-g8ywuvrf8t | Cost Optimization in AWS - Best Practices | AWS architecture | ||
https://mindmajix.com/aws-architect-interview-questions | AWS architect questions | |||
https://mindmajix.com/aws-ec2-instance-types | AWS EC2 instance types | |||
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AmazonEBS.html | AWS EC2 documentation | AWS services | ||
https://www.theregister.com/2020/11/03/aws_container_reg/ | AWS offering free Docker container service without throttling restrictions | |||
AWS Aurora RDB for MySQL also SQL Server, Oracle available | ||||
https://aws.amazon.com/rds/postgresql/?nc=sn&loc=3&dn=3 | AWS Aurora RDB for Postgres | |||
https://drive.google.com/open?id=153fxjcVnuov2wtJqoLfeSP55iY5rKQbZ | AWS Lambda Tutorial | |||
https://docs.aws.amazon.com/redshift/latest/mgmt/welcome.html | AWS Redshift big data warehouse | AWS SNS - simple notification service | Building solutions on AWS | |
https://developer.okta.com/blog/2020/05/27/serverless-java-aws AWS-java-serverless-developer.okta.com-Serverless Java with Amazon Web Services.pdf | Serverless Java with Amazon Web Services | |||
https://aws.amazon.com/partners/saas-boost/ | AWS SAAS migration tools from servers for ISVs - open source toolset * | AWS Lambda functions and serverless in Java | External Products on AWS | |
https://docs.couchbase.com/server/current/cloud/couchbase-aws-marketplace.html | Couchbase on AWS |
https://console.aws.amazon.com/console/home?region=us-east-1#
pSyn$pjm9yz3
RAC594585551661CAR
AWS and Lightsail
Training Resources
Ed Izzo AWS Tips
Great catching up as always, Jim. Maybe we'll finally meet in person post-vaccination this summer!
...
https://console.aws.amazon.com/console/home?region=us-east-1#
pSyn$pjm9yz3
RAC594585551661CAR
AWS and Lightsail
Training Resources
Ed Izzo AWS Tips
Great catching up as always, Jim. Maybe we'll finally meet in person post-vaccination this summer!
...
EBS volumes are highly available and reliable storage volumes that can be attached to any running instance that is in the same Availability Zone. EBS volumes that are attached to an EC2 instance are exposed as storage volumes that persist independently from the life of the instance. With Amazon EBS, you pay only for what you use. For more information about Amazon EBS pricing, see the Projecting Costs section of the Amazon Elastic Block Store page.
AWS Startup Resources Map
aws-startup-interactive-map-explore-galaxy-of-startup-resources.pdf. link
AWS Cost Management Strategies
...
AWS Lambda was designed for use cases such as image or objects uploads to Amazon S3, updates to DynamoDB tables,responding to website clicks or reacting to sensor readings from an IoT connected device. AWS Lambda can also be used toautomatically provision back-end services triggered by custom HTTP requests, and "spin down" such services when not in use,to save resources
AWS Systems Manager Agent (SSM Agent) is Amazon software that can be installed and configured on an Amazon EC2 instance, an on-premises server, or a virtual machine (VM). SSM Agent makes it possible for Systems Manager to update, manage, and configure these resources. The agent processes requests from the Systems Manager service in the AWS Cloud, and then runs them as specified in the request. SSM Agent then sends status and execution information back to the Systems Manager service by using the Amazon Message Delivery Service (service prefix: ec2messages
)With Amazon Lambda the level of abstraction is put even one step higher. With Lambda you no longer care about virtualmachines and their scale out yourself. All you have to do is to provide Amazon some code (typically in form of a prepared jarfile) and Amazon cares about its execution on behalf of you. In contrast to Amazon Beanstalk you . In contrast to Amazon Beanstalk you do not care about the numberof virtual machines used for the execution nor the number of load balancers. Amazon promises to execute your code as often as itis requested. And you pay only for the time used for its execution, not for the time your virtual machines are running.
Stateless function programs
Receive all data as parms, return a value.
Good for lower-level, reactive calculations driven by events from an event source
AWS Serverless Java Lambda Tutorial
lambda-java-programming-aws-lambda-cockroach-labs
AWS Serverless Java services - okta
https://developer.okta.com/blog/2020/05/27/serverless-java-aws
AWS-java-serverless-developer.okta.com-Serverless Java with Amazon Web Services.pdf
- Choose Between Java Serverless Options
- Sign Up for AWS Account with Billing
- Create AWS Access Keys
- Install and Configure AWS CLI
- Create AWS Role
- Download the Project from GitHub
- Configure Okta JWT Auth
- Create the Lambda
- Create an AWS API Gateway
- Test Your API Gateway URL
- Generate a JWT Token
- Test the Protected Serverless Function
- Learn More about AWS and Java
Apache OpenWhisk
Cloud Serverless Cost Calculator - AWS, Azure, IBM, GCP
AWS Events - CloudWatch and SNS
AWS Events - CloudWatch and SNS down
https://cloudonaut.io/loosing-trust-in-aws-sns-broken-for-24-days/
https://drive.google.com/file/d/1UKJ4Lo5ZeKDDe9QNTFjvDjPTQqA6Gfq2/view?usp=sharing
AWS Concepts and Terms
AWS SSM - Systems Manager
https://docs.aws.amazon.com/systems-manager/latest/userguide/ssm-agent.html
do not care about the numberof virtual machines used for the execution nor the number of load balancers. Amazon promises to execute your code as often as itis requested. And you pay only for the time used for its execution, not for the time your virtual machines are running.
Stateless function programs
Receive all data as parms, return a value.
Good for lower-level, reactive calculations driven by events from an event source
AWS Serverless Java Lambda Tutorial
lambda-java-programming-aws-lambda-cockroach-labs
AWS Serverless Java services - okta
https://developer.okta.com/blog/2020/05/27/serverless-java-aws
AWS-java-serverless-developer.okta.com-Serverless Java with Amazon Web Services.pdf
- Choose Between Java Serverless Options
- Sign Up for AWS Account with Billing
- Create AWS Access Keys
- Install and Configure AWS CLI
- Create AWS Role
- Download the Project from GitHub
- Configure Okta JWT Auth
- Create the Lambda
- Create an AWS API Gateway
- Test Your API Gateway URL
- Generate a JWT Token
- Test the Protected Serverless Function
- Learn More about AWS and Java
Apache OpenWhisk
Cloud Serverless Cost Calculator - AWS, Azure, IBM, GCP
AWS Events - CloudWatch and SNS
AWS Events - CloudWatch and SNS down
https://cloudonaut.io/loosing-trust-in-aws-sns-broken-for-24-days/
https://drive.google.com/file/d/1UKJ4Lo5ZeKDDe9QNTFjvDjPTQqA6Gfq2/view?usp=sharing
AWS Concepts and Terms
AWS SSM - Systems Manager
https://docs.aws.amazon.com/systems-manager/latest/userguide/ssm-agent.html
AWS Systems Manager Agent (SSM Agent) is Amazon software that can be installed and configured on an Amazon EC2 instance, an on-premises server, or a virtual machine (VM). SSM Agent makes it possible for Systems Manager to update, manage, and configure these resources. The agent processes requests from the Systems Manager service in the AWS Cloud, and then runs them as specified in the request. SSM Agent then sends status and execution information back to the Systems Manager service by using the Amazon Message Delivery Service (service prefix: ec2messages
).
AWS Data Store Options
EOS Databases: MySQL, SQLite, Postgres, CouchDB, MongoDB
AWS Databases: RDS, Aurora
Object DBs: use S3 storage
EclipseStore DB EOS
Introduction to EclipseStore Coding - youtube - 20 mins
https://eclipsestore.io/#c3371
https://docs.eclipsestore.io/manual/intro/system-requirements.html
just JDKs on servers, local systems - works with any cloud object store ( AWS, Azure, GCP )
https://github.com/eclipse-store/store
demo app
https://github.com/eclipse-store/bookstore-demo
https://eclipsestore.io/#c3371
POJO Object graphs
Your Java classes define your data model. With EclipseStore, there are no specific requirements to your classes. You can just use plain Java objects (POJOs). There is no need for specific superclasses, interfaces, annotations, mappings, or any other internal configurations.
- Use plain Java objects (POJOs)
- No superclass, interfaces, annotations
- No other internal configurations required
- All Java types supported
- Using inheritance is trouble-free
Storing Objects
ACID Transaction-Safe
To persist objects in the storage, you just have to call a simple store method. By default, EclipseStore persists only new and changed objects (the delta). You decide explicitly, if and when objects are persisted. The objects are stored in a binary file appended to the file storage. Every store an atomic all-or- nothing blocking operation which is ACID transaction-safe and full consistent.
- Atomic all-or-nothing operation
- Blocking operation
- ACID transaction-safe
- Full consistency
- Append-log strategy
- Micro snapshot to store latest changes (delta)
- Rollback for operations on the object graph
- High IO speed through Eclipse Serializer
- Max IO speed by multithreaded IO ops
query customers
DataRoot root = EclipseStoreDemo.root();
root.getCustomers().add(customer);
EclipseStoreDemo.store(root.getCustomers());
CSV export / import
By using CSV Import/Export or other converters, any data can be migrated at any time in both directions easily.
9/17/24 Free 4 hour course for EclipseStore – test w Java, Groovy, WAS Liberty on AWS
COURSE CONTENT
- Functional principle and architecture of EclipseStore
- Download and setup EclipseStore
- Create a new object graph (in-memory-database) and storage instance
- CRUD operations
- Add new objects to your object-graph (CREATE)
- Edit objects (UPDATE)
- Remove objects (DELETE)
- Store objects and subgraphs persistently into the storage
- Using Lazy-Loading to reduce memory consumption
- Using Java 8 Streams API for searching and filtering data
- Migrating existing MicroStream projects to EclipseStore 1.2.0.
SSH connection to EC2 instance at Paramount
...
- 69% for core business;
- 67% for internal apps;
- 67% for finance apps;
- 61% customer-facing apps; and
- 60% for AI/ML.
Potential Challenges
Candidate Solutions
...
- and
- 60% for AI/ML.
Potential Challenges
Candidate Solutions
AWS free tier services - Getting Started
https://aws.amazon.com/getting-started/
AWS Tutorials List
https://aws.amazon.com/free/?all-free-tier/getting-started/hands-on/?pg=gs&sec=lyfa&getting-started-all.sort-by=item.additionalFields.SortRanksortOrder&allgetting-freestarted-tierall.sort-order=asc&awsf.getting-started-category=*all&awsf.getting-started-level=*all&awsf.getting-started-content-type=*all
AWS cost planning - Planning Dashboard for systems, services
...
Case ID 7197414421 - can I use AWS services from Lightsail?
Lightsail provides a base set of resources available 24x7 in different configurations for compute, storage, memory, network access. From a Lightsail account, console do I have access to normal AWS services as an option?
Step-by-step guide for Example
...
create an admin user acct
If you don't already have an access key for your AWS account root user, don't create one unless you absolutely need to. Instead, use your account email address and password to sign in to the AWS Management Console and create an IAM user for yourself that has administrative permissions.
rjm0g$psyn#pz9
create 2 admins - jmason, smason
user key files downloaded
swt1-aws-new_user_credentials-v1.csv
Created user jmason
Attached policy AdministratorAccess to user jmason
Attached policy AmazonAPIGatewayAdministrator to user jmason
Created access key for user jmason
Created login profile for user jmason
welcome email to jm9g
You now have access to the AWS Management Console for the account ending in 1661. ------
Sign-in URL: https://594585551661.signin.aws.amazon.com/console
User name: jmason
Your password will be provided separately by your AWS account administrator.
welcome email smason
You now have access to the AWS Management Console for the account ending in 1661. ------
Sign-in URL: https://594585551661.signin.aws.amazon.com/console
User name: smason
Your password will be provided separately by your AWS account administrator.
Created an org - swt1
Info |
---|
...