s SQL and data solutions

Key Points

  1. SQL basics
  2. SQL procs, functions, events
  3. SQL in applications
  4. SQL event streams
  5. NoSQL databases using SQL
  6. common data tools - Squirrel, BIRT, Grails, more
  7. data source mappings
  8. data transformations - FMR
  9. data visualizations tools - BIRT, PowerBI, R
  10. data editing tools - Grails, SQL clients
  11. data roles - goalie, janitor, whisperer, therapist
  12. data modeling
  13. process modeling - JEPLD - Jim's Event Processing Language with Decisions


References

Reference_description_with_linked_URLs_______________________Notes______________________________________________________________


SQL and Data Management Concepts.pptx

Jim's basics on SQL and data management *** ( high level but thorough ) 

covers basics on SQL statements, functions, procedures, Groovy SQL, Java streams, Grails database web app, BIRT web data visualization tools

https://drive.google.com/file/d/1O8yaO-K7IbQNGlWqRVvG-q_VD
eHvvGcx/view?usp=sharing

jim-mason-advanced-sql-for-ibmi-2017.pdf

Advanced SQL pdf

Advanced SQL doc


https://drive.google.com/file/d/1qfMBH9UuN9z7DF0Z
qcCdDRwliWrarfRp/view?usp=sharing
SQL-Transactional vs Analytical 2up-Nemug-181128.pdf
https://drive.google.com/file/d/1SJ4jG-PJfG89UZACvew1QvHsj5bbuR7F/view?usp=sharingsql-Advanced SQL. Jim Mason. www.ebt-now.com Web solutions for iseries engineer, build, deploy, support, train 508-728-4353. jemason@ebt-now..pdf
https://drive.google.com/file/d/19WcI-2021zdn54fF
DBxHqmcMYh-PNUIe/view?usp=sharing
NEMUG - June Meeting - Ted Holt - 30 SQL tips in 60 minutes.pdf
https://drive.google.com/file/d/0BxqKQGV-b4WQVDdTNnZaV3hBUUk/view?usp=sharingsql - hierarchical_tree_design_queries1.pdf
m DatabaseDatabase concepts

m MySQL overview

m MySQL Workbench

MySQL

includes ingestion, export via csv ( json ?? )

https://drive.google.com/file/d/0BxqKQGV-b4WQVGczZlR5c0FWWU0/view?usp=sharingswtip_mysql_quickstart_.docx
https://drive.google.com/file/d/0BxqKQGV-b4WQR2JEVHc5YUd0VDQ/view?usp=sharingmysql-procedures-dynamic-sql-How to overload MySQL procedures.pdf
https://drive.google.com/file/d/1WHwBTvfzPl_x0-ULZlBKd_doofmQnyyy/view?usp=sharingmysql-upsert-3-ways-MySQL UPSERT INSERT or UPDATE Whichever is Applicable.pdf
https://drive.google.com/file/d/0BxqKQGV-b4WQUU1HZTgwNndvT0E/view?usp=sharingnodejs-Using MySQL with Node.pdf
https://drive.google.com/file/d/0BxqKQGV-b4WQZUxCQVhqN19hXzg/view?usp=sharingmysql-create_user_dba.sql
https://drive.google.com/file/d/0BxqKQGV-b4WQQlhtR0Q5VnNndzA/view?usp=sharing4432_original_table_source.sql
https://drive.google.com/file/d/0BxqKQGV-b4WQMUJxc1lQWFVydU0/view?usp=sharingMA8_change_4432_forward.sql
https://drive.google.com/file/d/0BxqKQGV-b4WQQVF5aEZqMW1FTTg/view?usp=sharing   MA8_change_4432_forward_validation.sql
https://drive.google.com/file/d/0BxqKQGV-b4WQNGdCUUhzeUZWQVE/view?usp=sharing4432_split_ods_dm_servers_test.sql
https://drive.google.com/file/d/0BxqKQGV-b4WQcGNVM256UEtJMUU/view?usp=sharingMA8_change_4432_rollback.sql




m MongoDB

m Mongoose for MongoDb

MongoDB
https://drive.google.com/file/d/1-Fn82227dOXTtcdN6Euur5
0jdQ6SvN74/view?usp=sharing
MongoDB using Groovy data scripts ppt
https://drive.google.com/file/d/0BxqKQGV-b4WQWW13Vml1QUtGSDQ/view?usp=sharingmysql-json-tutorial-How to Use JSON Data Fields in MySQL Databases.pdf
https://drive.google.com/file/d/0BxqKQGV-b4WQY2VsMS1rZGJUemc/view?usp=sharingsqlitetutorial.net-Querying Data in SQLite Database from Nodejs Applications.pdf
m Data CouchDbCouchDB
https://drive.google.com/file/d/1kQy5QgOx7Xk6CbIh
jdBrj2hkuJOGG5IL/view?usp=sharing
Jim edx-nodejs-couchdb.docx
https://drive.google.com/file/d/0BxqKQGV-b4WQNU8zWWlkUHM1RmM/view?usp=sharingJim Mason Beyond Relational Data - NOSQL Data.pdf
https://drive.google.com/file/d/0BxqKQGV-b4WQSl9RWkcxWUw0bGM/view?usp=sharingJim Mason Beyond Relational Data - NOSQL Data.docx
m Apache Data Services




Other
https://drive.google.com/file/d/0BxqKQGV-b4WQcTljV01zZXJGLTQ/view?usp=sharingRunJdbcTester7.groovy - batch insert using JDBC example
https://drive.google.com/file/d/0BxqKQGV-b4WQRk5Ib09VX2FhV0E/view?usp=sharingbasic groovy examples with expando - gtest1702b.groovy

Read Jesse's IBM i open source deck
https://drive.google.com/file/d/1qYSsLQqLsngT6jjrCYeViSa84NAgC
YgY/view?usp=sharing
Jim's EOS data solutions stacks
https://drive.google.com/file/d/0BxqKQGV-b4WQb0lKUlNlSmVX
Z2c/view?usp=sharing
Jim's EOS visual reporting


https://drive.google.com/file/d/0BxqKQGV-b4WQMGNfU05STFFWT0k/view?usp=sharingjim-mason-groovy-universal-scripting-handout.pdf
https://drive.google.com/file/d/0BxqKQGV-b4WQRGdOT2dXbmU5ekk/view?usp=sharinggroovy-universal-scripting.ppt



Grails CRUD apps
mason_2009_eos_grails_web_database_app_LAB_HANDOUT_v2.docMy Lab Handout for Books and Authors - should be able to repeat on Grails 4 with minor changes
JPassion Grails 101 basics.pdf slide deckBasic Grails CRUD concepts
https://drive.google.com/file/d/0BxqKQGV-b4WQTFAxMjVfem8
5dmM/view?usp=sharing
Grails GORM
gorm-basics-tutorial-relations-maps.pptxGrails GORM concepts
https://drive.google.com/file/d/1Y1jBKFM7N52yynnVzEpK2ru56
rM0Sakq/view?usp=sharing
Grails GORM data maps ppt 2015
https://drive.google.com/file/d/1vCoYNw530_VRUKw7YlL_N
3yMTq442479/view?usp=sharing
GORM-v61-Whats_New-gorm.grails.org-Whats New in GORM 61.pdf
https://drive.google.com/file/d/1qGNrTXoWlk3EAawX7yoH
9RMkvVDw8NqE/view?usp=sharing
_Qwtip_3201_Grails_gorm_services1.docx


https://drive.google.com/file/d/1sHplRLNeLYSl-m9O8LNLB-tDSMF8n11o/view?usp=sharinglibre-base-jdbc-mysql-techrepublic.com-How to connect LibreOffice Base to a remote MySQL database.pdf

https://drive.google.com/file/d/0BxqKQGV-b4WQSGQta3RV
VzhxRzg/view?usp=sharing

https://drive.google.com/file/d/1HRcib2UeaErg3gJJE0y
KutZUlLRxK4QD/view?usp=sharing

article java stored procedures - part 1


aej_0206_Java_stored_procedures_put_RPG_on_the_web_part1.doc

https://drive.google.com/file/d/0BxqKQGV-b4WQS0o5NEp
5djA4TGM/view?usp=sharing

https://drive.google.com/file/d/1lOwTyB5UVYcq0a3zA1
nr8BWaq0VANTGx/view?usp=sharing

article java stored procedures - part 2


aej_0210_Java_stored_procedures_put_RPG_on_the_web_part2.doc

https://drive.google.com/file/d/1do8cN32DNf_xd4KKk
C7qOZPY-WVV2w4-/view?usp=sharing
_Qwtip_3101_SOA_data_services_procedures1.docx


https://drive.google.com/file/d/1k3vC3trdtsdgOfye8Xq-p1
CAKEWg5vuF/view?usp=sharing
BIRT report presentation pptx
https://drive.google.com/file/d/1k3vC3trdtsdgOfye8Xq-p1C
AKEWg5vuF/view?usp=sharing
swt-BIRT_Report_Customization.pptx 2020
https://drive.google.com/file/d/18iThjlUgwMICVEtMQyZ3mPK
qr7f28jDh/view?usp=sharing
Advanced BIRT presentation ppt 2014
https://drive.google.com/file/d/1zHB1-hPuRGG31S9tty7
ZkFo9wZH4XONJ/view?usp=sharing
BIRT report customization ppt 2014
https://drive.google.com/file/d/1DNkUKkaUI3X0ZSAiwn0g
Qp8FEg_eOMKR/view?usp=sharing
Create Web Data Mart with MySQL presentation pdf
https://drive.google.com/file/d/1DNkUKkaUI3X0ZSAi
wn0gQp8FEg_eOMKR/view?usp=sharing
jim-mason-create-web-data-mart-transscript-docplayer.net-NEMUG Feb Create Your Own Web Data Mart with MySQL.pdf
https://drive.google.com/file/d/18kZk3nja1QRyN1bQx
hmcE961RZaEhn1Q/view?usp=sharing
Snowflake cloud DB - lab_scripts_OnlineZTS.sql
https://drive.google.com/file/d/1ehSBoJzxsfCUcMkB
m5ujo6e6YwH0Sy_W/view?usp=sharing
snowflake-lab2-buildhandsonlabguide1589843730977.pdf
https://drive.google.com/file/d/1t2yfB6R0o-DTkpiAoW
HsyEyUK3G-bYva/view?usp=sharing
Hadoop workshop 2016 - data kitchen pdf
https://drive.google.com/file/d/1iXJuEf7_NIpd
sSH88p3nWSOE3d4-1HZN/view?usp=sharing
hadoop-hiveSQL-Hortonworks.CheatSheet.SQLtoHive.pdf
https://drive.google.com/file/d/1-6KmSUNOezXADF76L-7FNr_hClHYdOhf/view?usp=sharingspark-A-Gentle-Introduction-to-Apache-Spark.pdf


https://drive.google.com/file/d/0BxqKQGV-b4WQQ3dNSG5
aS195TnM/view?usp=sharing
ibm_i_solution_strategies.docx


https://drive.google.com/file/d/0BxqKQGV-b4WQTHlkLXBDN0pNbVU/view?usp=sharingHow to update iSeries databases using JDBC, SQL-jim-mason.pdf
https://drive.google.com/file/d/1fnTGH0wds2w0MG6uO7
t5deW2LfsK6lCv/view?usp=sharing

Apache Calcite - Streaming SQL

calcite-streaming-sql-apex-2017-170404191828.pdf




Groovy data streams . groovy





Key Concepts


session: SQL and Data Management Concepts 


SQL and good Data Management are key to every organization's success.

Everyone knows having the right data with the right quality is always important.

This session covers a lot of ground at a high level, quickly on SQL and data management concepts:

  1. Databases and data sources ( SQL, NoSQL etc )
  2. Application access to Data ( Java, RPG, more )
  3. SQL basics
  4. SQL functions
  5. SQL sub queries and pipelines
  6. SQL filter, map, reduce queries
  7. SQL Stored procedures 
  8. External Stored procedures 
  9. Java example of SQL event streams for real-time, automation
  10. Simple example of a Java Lambda expression 
  11. Simple example of an AWS Serverless function
  12. A few simple examples of Java data analytics services 
  13. Logical diagram of a Cloud data analytics solution from data source, transformation, map-reduce and visualization
  14. Some options for frameworks and tools to use for data management 


Jim Mason 

Jim helps clients turn technologies ( data, services, blockchain, analytics ) into improved operations results, infrastructure, trust, compliance, performance, lower costs, lower risks.

Jim’s background includes:
• Blockchain Practice leader at Sky Web Team
• DMX Foundry Director led cloud analytics, Hyperledger blockchain
• Work on the Hyperledger Fabric Documentation Team
• MOBI Core team for Vehicle Identity standards
• Data services, data warehouse architect
• Director of Infrastructure & Architecture at Fidelity
• Over 100 presentations at COMMON and articles




Advanced SQL Presentation that has some new updates I created I have yet to add as slides that might be fairly relevant:

1>  SQL Stream support for streaming events - sample code

2> Lambda functions ( Serverless ) - for anyone creating simple services in the cloud

3> Some Groovy data analytics examples - for data scripting, services, data quality etc

4> Logical diagram on how Cloud data services work as a model ( similar for GCP, Azure, AWS and IBM Cloud )

This is the old version I've attached but the 3 items above are quick to add to make the new presentation.



Potential Value Opportunities



Potential Challenges



Candidate Solutions



Step-by-step guide for Example



sample code block

sample code block
 



Recommended Next Steps