Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Key Points

...

Table of Contents

Key Points

  1. AWS services can come at 3 layers: iaas, paas, saas
  2. Most references to AWS refer to paas - EC2 instances and the services that run on them
  3. EC2 instances can be Windows or Linux
  4. A low-cost iaas option is LightSail - a VPS server that is fixed price, low-cost with internet connectivity etc - easier to plan than EC2 costs
  5. Effective cost management of AWS resources and services is a HUGE issue for most companies
  6. EBS - elastic block storage - can be mounted and file system created for use. can be attached to any single instance

...

Reference_description_with_linked_URLs_________________________________Notes_________________________________________________________
https://aws.amazon.com/AWS
https://us-east-2.console.aws.amazon.com/console/home?region=
us-east-2#
AWS account mgt console
https://us-east-2.console.aws.amazon.com/console/home?region=
us-east-2#
AWS account mgt console - has good starting exercises


https://lightsail.aws.amazon.com/ls/webapp/create/instance?
region=us-east-1
AWS Lightsail home page
Lightsail for research page with predefined VPCs for use cases
https://aws.amazon.com/architecture/back-to-basics/AWS architecture concepts - many good basic video lessons ***


AWS Training and Certification


https://aws.amazon.com/training/?nc1=f_ccTraining home page
https://aws.amazon.com/certification/Certifications home page
https://www.udemy.com/course/aws-concepts/AWS Concepts - free intro course 1.5 hours
https://www.udemy.com/course/linux-academy-aws-essentials-2019/learn/lecture/13741352#overviewAWS Essentials - free certification prep course for practiioner exam
https://linuxacademy.comCloud Essentials - Knowledge Badge Readiness Path - skillbuilderCloud Essentials - Knowledge Badge Readiness Path - skillbuilder ***
AWS ramp up technology learning doc AWS ramp up technology learning doc ***
AWS Cloud Practioner learning plan page AWS Cloud Practioner learning plan page ***

https://linuxacademy.com/pricing/

https://drive.google.com/file/d/1QEJ7fkvAy7C17vJO8ONh0qjlA58flbbh/view?usp=sharing

Linux Academy - billable certifications - $32 per month for courses

Essentials course outline

https://aws.amazon.com/certification/certified-solutions-architect-associate/AWS Associate Architect cert - online multiple choice
https://reinvent.awsevents.com/on-demand/reinvent 2023 ondemand videosAWS Products and Services Best Practices
https://awswww.amazonyoutube.com/products/playlist?nc2=h_m1AWS Cloud products menulist=PL2yQDdvlhXf8iyzg7ziZI924PxC8a8M-Ureinvent 2023 AI playlist
https://awswww.amazonyoutube.com/quickstart/?solutions-all.sort-by=item.additionalFields.sortDate&solutions-all.sort-order=desc&awsf.filter-content-type=*all&awsf.filter-tech-category=*all&awsf.filter-industry=*all

AWS Quickstart solution deployments for simple solutions ***

good place to test simple solution typesplaylist?list=PL2yQDdvlhXf8qWcdB_8mKLyAOHk0cVK6B
reinvent 2023 Architecture playlist
https://awswww.amazonyoutube.com/solutions/playlist?trklist=sl_cmp_2019Q2_namer_psoc_
fb&sc_campaign&sc_publisher=FB&sc_category=Business+Applicatio
ns&sc_country=NAMER&sc_geo=NAMER&sc_outcome=aware&sc_
detail=1200x628&sc_content=FB_ITPros&sc_matchtype=xx&sc_
segment=xx&sc_medium=PAC-EDM-P%7CFB%7CSocial-P%7CAll%7CAW%7CBusiness+Applications%7CAWS+Solutions%7CNAMER
%7CEN%7CImage%7Cxx%7C&fbclid=IwAR0B9R9JSsVH9_1B-MMR-
PsGgY3A63aiSJ-Ln5O8A9gPOViXHLD3xBEOOp0&PL2yQDdvlhXf8_GOWzkJwOsoDLgBw80nfi
reinvent 2023 Analytics ANT playlist
https://www.youtube.com/playlist?list=PL2yQDdvlhXf8r-2SvM2pmCzd62_umw_FJreinvent 2023 apps videos
https://www.youtube.com/playlist?list=PL2yQDdvlhXf-MKQE31qHsOE_eSDR1T2Kqreinvent 2023 cloud operations
https://www.youtube.com/watch?v=DY9ENcGQRto&list=PL2yQDdvlhXf-CN3ykMq_dYH9nmPRRbR7O&index=16reinvent 2023 aws graviton EC2 efficiency
https://www.youtube.com/watch?v=sSpJ8tWCEiA&list=PL2yQDdvlhXf-CN3ykMq_dYH9nmPRRbR7O&index=19reinvent 2023 aws get AI in AWS console


AWS Products and Services Best Practices


https://aws.amazon.com/products/?nc2=h_m1AWS Cloud products menu
https://aws.amazon.com/quickstart/?solutions-all.sort-by=item.additionalFields.footerInfoTextsortDate&solutions-all.sort-order=desc

AWS Solution Architectures - pre-defined solution stacks

AWS Solutions are built using services from AWS. They are designed to help you solve common problems and build faster using the AWS platform. All AWS Solutions are vetted by AWS architects and are designed to be operationally effective, reliable, secure, and cost effective. Every AWS Solution comes with detailed architecture, a deployment guide, and instructions for both automated and manual deployment.&awsf.filter-content-type=*all&awsf.filter-tech-category=*all&awsf.filter-industry=*all

AWS Quickstart solution deployments for simple solutions ***

good place to test simple solution types

https://aws.amazon.com/architecture/?cards-all.sort-by=item.additionalFields.sortDate&cards-all.sort-order=desc&awsf.content-type=*all&awsf.methodology=*all&awsf.tech-category=*all&awsf.industries=*allAWS Architecture Best Practices Guides, Diagrams **
https://docs.aws.amazon.com/ec2/index.htmlAWS EC2 docs
https://docs.solutions/?trk=sl_cmp_2019Q2_namer_psoc_
fb&sc_campaign&sc_publisher=FB&sc_category=Business+Applicatio
ns&sc_country=NAMER&sc_geo=NAMER&sc_outcome=aware&sc_
detail=1200x628&sc_content=FB_ITPros&sc_matchtype=xx&sc_
segment=xx&sc_medium=PAC-EDM-P%7CFB%7CSocial-P%7CAll%7CAW%7CBusiness+Applications%7CAWS+Solutions%7CNAMER
%7CEN%7CImage%7Cxx%7C&fbclid=IwAR0B9R9JSsVH9_1B-MMR-
PsGgY3A63aiSJ-Ln5O8A9gPOViXHLD3xBEOOp0&solutions-all.sort-by=item.additionalFields.footerInfoText&solutions-all.sort-order=desc

AWS Solution Architectures - pre-defined solution stacks

AWS Solutions are built using services from AWS. They are designed to help you solve common problems and build faster using the AWS platform. All AWS Solutions are vetted by AWS architects and are designed to be operationally effective, reliable, secure, and cost effective. Every AWS Solution comes with detailed architecture, a deployment guide, and instructions for both automated and manual deployment.

https://aws.amazon.com/AWSEC2/latest/UserGuide/index.htmlAWS EC2 Linux docs **

AWS pricing

AWS Environment Servicesarchitecture/?cards-all.sort-by=item.additionalFields.sortDate&cards-all.sort-order=desc&awsf.content-type=*all&awsf.methodology=*all&awsf.tech-category=*all&awsf.industries=*allAWS Architecture Best Practices Guides, Diagrams **
https://docs.aws.amazon.com/ec2/index.htmlAWS EC2 docs
https://docs.aws.amazon.com/AWSEC2/ec2latest/instance-types/UserGuide/index.htmlAWS EC2 instance typeshttps:Linux docs **


AWS pricing



AWS Environment Services
https://aws.amazon.com/ec2/
https://aws.amazon.com/ec2/instance-types/
AWS EC2 instance types
https://aws.amazon.com/pricing/services/AWS Storage types
https://aws.amazon.com/pricing/services/AWS Database service options
https://aws.amazon.com/free/?all-free-tier.sort-by=item.additional
Fields.SortRank&all-free-tier.sort-order=asc
AWS free tier
https://www.janbasktraining.com/blog/what-is-aws-lightsail/Differences between normal EC2 instances and Lightsail servers
https://aws.amazon.com/lightsail/pricing/?opdp1=pricing

Lightsail - Linux servers

$10 / mo  - 2 GB Memory   1 Core Processor   60 GB SSD Disk   3 TB Transfer*

$20 / mo - 4 GB Memory   2 Core Processor    80 GB SSD Disk    4 TB Transfer*

$40 / mo - 8 GB Memory   2 Core Processor    160 GB SSD Disk   5 TB Transfer*

$80 / mo - 16 GB Memory   4 Core Processor    320 GB SSD Disk   6 TB Transfer*

highly available SSD-backed storage for your Linux or Windows virtual server. Block storage starts at 8 GB and costs 0.10 USD per allocated GB

https://docs.aws.amazon.com/whitepapers/latest/cost-optimization-
laying-the-foundation/cost-optimization-pillars.html
AWS cost optimization
https://aws.amazon.com/pricing/cost-optimization/AWS cost planning - Planning Dashboard for systems, services
https://awstcocalculator.com/?refid=NY_summit_LS_2019AWS cost calculator over on-premise systems
https://aws.amazon.com/pricing/services/AWS cloud services pricing
https://aws.amazon.com/free/?all-free-tier.sort-by=item.additional
Fields.SortRank&all-free-tier.sort-order=asc
AWS free tier
https://calculator.s3.amazonaws.com/index.htmlAWS cost calculator - monthly

https://go.cloudhealthtech.com/rs/933-ZUR-080/images/10-best-
practices-reducing-aws-spend.pdf

https://drive.google.com/open?id=1sHsXhkf83v3vK-3uHhEvl-g8ywuvrf8t

Cost Optimization in AWS - Best Practices


AWS architecture
https://mindmajix.com/aws-architect-interview-questionsAWS architect questions
https://mindmajix.com/aws-ec2-instance-typesAWS EC2 instance types
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AmazonEBS.htmlAWS EC2 documentation






AWS services
https://www.theregister.com/2020/11/03/aws_container_reg/AWS offering free Docker container service without throttling restrictions

https://aws.amazon.com/rds/aurora/mysql-features/

https://aws.amazon.com/rds/aurora/pricing/

AWS Aurora RDB for MySQL

also   SQL Server, Oracle available

https://aws.amazon.com/rds/postgresql/?nc=sn&loc=3&dn=3AWS Aurora RDB for Postgres

https://javacodegeeks.tradepub.com/?p=w_java82&w=d&email=jim.
mason@skywebteam.com&key=Tr0kNAvnki5CgqASyWsh&ts=7073
4&u=0730160400251573229663&e=amltLm1hc29uQHNreXdlYn
RlYW0uY29t&s=fup-3

https://drive.google.com/open?id=153fxjcVnuov2wtJqoLfeSP55iY5rKQbZ

AWS Lambda Tutorial
https://docs.aws.amazon.com/redshift/latest/mgmt/welcome.htmlAWS Redshift big data warehouse


https://cloudonaut.io/loosing-trust-in-aws-sns-broken-for-24-days/

AWS SNS - simple notification service




Building solutions on AWS


https://developer.okta.com/blog/2020/05/27/serverless-java-aws

AWS-java-serverless-developer.okta.com-Serverless Java with Amazon Web Services.pdf

Serverless Java with Amazon Web Services

https://aws.amazon.com/partners/saas-boost/AWS SAAS migration tools from servers for ISVs - open source toolset *

AWS Lambda functions and serverless in Java

lambda-java-programming-aws-lambda-cockroach-labs










External Products on AWS




https://docs.couchbase.com/server/current/cloud/couchbase-aws-marketplace.htmlCouchbase on AWS




...

Training Resources


Ed Izzo AWS Tips 


Great catching up as always, Jim. Maybe we'll finally meet in person post-vaccination this summer!

Here are Amazon's Leadership Principles. If you can relate those principles (and their sub-principles) to your career and tell a compelling story, you'll have an excellent chance of joining the company. Of course, watching this year's re:Invent keynotes doesn't hurt either.

...

EBS volumes are highly available and reliable storage volumes that can be attached to any running instance that is in the same Availability Zone. EBS volumes that are attached to an EC2 instance are exposed as storage volumes that persist independently from the life of the instance. With Amazon EBS, you pay only for what you use. For more information about Amazon EBS pricing, see the Projecting Costs section of the Amazon Elastic Block Store page.


AWS

...

hire someone who has managed a "limited data" phone plan successfully - same concepts apply here .. needs agressive cost management ( 3rd party app opportunity with alerts / automated responses ??? )

Startup Resources Map

https://god1.cloudhealthtechawsstatic.com/rs/933-ZUR-080/images/10-best-practices-reducing-aws-spend.pdf

https://drive.google.com/open?id=1sHsXhkf83v3vK-3uHhEvl-g8ywuvrf8t

AWS Reserved Instances - RI

The most mature AWS customers are running more than 80% of their EC2 infrastructure covered by RI purchases. A best practice is to not let this number dip below 60% for maximum efficiency.

AWS Cost management can be improved for most companies

https://www.zdnet.com/article/cloud-computing-sticker-shock-is-on-the-rise-and-containing-it-may-be-a-new-career-path/

The most oft-used tools used for managing cloud costs include AWS Cost Explorer, Cloudability (Apptio), CloudHealth (VMWarepsc-digital/2023/gc-a4sup/sup-interactive-map/interactive-map-explore-galaxy-of-startup-resources.pdf

aws-startup-interactive-map-explore-galaxy-of-startup-resources.pdf.  link


AWS Cost Management Strategies

hire someone who has managed a "limited data" phone plan successfully - same concepts apply here .. needs agressive cost management ( 3rd party app opportunity with alerts / automated responses ??? )

https://go.cloudhealthtech.com/rs/933-ZUR-080/images/10-best-practices-reducing-aws-spend.pdf

https://drive.google.com/open?id=1sHsXhkf83v3vK-3uHhEvl-g8ywuvrf8t

AWS Reserved Instances - RI

The most mature AWS customers are running more than 80% of their EC2 infrastructure covered by RI purchases. A best practice is to not let this number dip below 60% for maximum efficiency.


AWS Cost management can be improved for most companies

https://www.zdnet.com/article/cloud-computing-sticker-shock-is-on-the-rise-and-containing-it-may-be-a-new-career-path/

The most oft-used tools used for managing cloud costs include AWS Cost Explorer, Cloudability (Apptio), CloudHealth (VMWare), Azure Cost Management, GCP Cost Tools, and Cloudcheckr. About half, 46%, use cloud native tooling as their primary technology, 43% use a 3rd party platform, and 11% use home grown tools or spreadsheets. At the same time, many FinOps practitioners still rely on data collection, collation, and analysis via spreadsheet. Almost all practitioners use a combination of tooling, while still relying on spreadsheets for some tasks -- with forecasting being the biggest Excel use.

...


Apache OpenWhisk

Cloud Serverless Cost Calculator - AWS, Azure, IBM, GCP 

...

AWS Systems Manager Agent (SSM Agent) is Amazon software that can be installed and configured on an Amazon EC2 instance, an on-premises server, or a virtual machine (VM). SSM Agent makes it possible for Systems Manager to update, manage, and configure these resources. The agent processes requests from the Systems Manager service in the AWS Cloud, and then runs them as specified in the request. SSM Agent then sends status and execution information back to the Systems Manager service by using the Amazon Message Delivery Service (service prefix: ec2messages).



AWS Data Store Options 


EOS Databases:  MySQL, SQLite, Postgres, CouchDB, MongoDB 


AWS Databases:  RDS, Aurora


Object DBs:  use S3 storage 



EclipseStore DB EOS

Introduction to EclipseStore Coding - youtube - 20 mins

https://eclipsestore.io/#c3371

Image Added



https://docs.eclipsestore.io/manual/intro/system-requirements.html

just JDKs on servers, local systems - works with any cloud object store ( AWS, Azure, GCP )

https://github.com/eclipse-store/store

demo app

https://github.com/eclipse-store/bookstore-demo


https://eclipsestore.io/#c3371

POJO Object graphs

Your Java classes define your data model. With EclipseStore, there are no specific requirements to your classes. You can just use plain Java objects (POJOs). There is no need for specific superclasses, interfaces, annotations, mappings, or any other internal configurations.

  • Use plain Java objects (POJOs)
  • No superclass, interfaces, annotations
  • No other internal configurations required
  • All Java types supported
  • Using inheritance is trouble-free

Storing Objects 
ACID Transaction-Safe


To persist objects in the storage, you just have to call a simple store method. By default, EclipseStore persists only new and changed objects (the delta). You decide explicitly, if and when objects are persisted. The objects are stored in a binary file appended to the file storage. Every store an atomic all-or- nothing blocking operation which is ACID transaction-safe and full consistent.

  • Atomic all-or-nothing operation
  • Blocking operation
  • ACID transaction-safe
  • Full consistency
  • Append-log strategy
  • Micro snapshot to store latest changes (delta)
  • Rollback for operations on the object graph
  • High IO speed through Eclipse Serializer
  • Max IO speed by multithreaded IO ops 

query customers 

DataRoot root = EclipseStoreDemo.root();
root.getCustomers().add(customer);
EclipseStoreDemo.store(root.getCustomers());


CSV export / import

By using CSV Import/Export or other converters, any data can be migrated at any time in both directions easily.


9/17/24 Free 4 hour course for EclipseStore – test w Java, Groovy, WAS Liberty on AWS

COURSE CONTENT

  • Functional principle and architecture of EclipseStore
  • Download and setup EclipseStore
  • Create a new object graph (in-memory-database) and storage instance
  • CRUD operations
  • Add new objects to your object-graph (CREATE)
  • Edit objects (UPDATE)
  • Remove objects (DELETE)
  • Store objects and subgraphs persistently into the storage
  • Using Lazy-Loading to reduce memory consumption
  • Using Java 8 Streams API for searching and filtering data
  • Migrating existing MicroStream projects to EclipseStore 1.2.0.



SSH connection to EC2 instance at Paramount

...

Case ID 7197414421 - can I use AWS services from Lightsail?

Lightsail provides a base set of resources available 24x7 in different configurations for compute, storage, memory, network access. From a Lightsail account, console do I have access to normal AWS services as an option?


Step-by-step guide for Example

...

create an admin user acct 

If you don't already have an access key for your AWS account root user, don't create one unless you absolutely need to. Instead, use your account email address and password to sign in to the AWS Management Console and create an IAM user for yourself that has administrative permissions.

rjm0g$psyn#pz9

create 2 admins - jmason, smason 

user key files downloaded

swt1-aws-new_user_credentials-v1.csv

Created user jmason
Attached policy AdministratorAccess to user jmason
Attached policy AmazonAPIGatewayAdministrator to user jmason
Created access key for user jmason
Created login profile for user jmason


welcome email to jm9g 

You now have access to the AWS Management Console for the account ending in 1661. ------





















Sign-in URL: https://594585551661.signin.aws.amazon.com/console










User name: jmason





















Your password will be provided separately by your AWS account administrator.

welcome email smason 

You now have access to the AWS Management Console for the account ending in 1661. ------





















Sign-in URL: https://594585551661.signin.aws.amazon.com/console










User name: smason





















Your password will be provided separately by your AWS account administrator.





















Created an org - swt1






Info

...