Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Reference_description_with_linked_URLs_______________________Notes______________________________________________________________




https://projects.apache.org/projects.html?category

Apache Big Data projects
https://www.educba.com/my-courses/dashboard/Data engineering education site:  educfba
m Apache Data Services




Kafka
https://kafka.apache.org/Apache Kafka home
https://kafka.apache.org/quickstartKafka quickstart
https://kafka.apache.org/usesKafka use cases
https://kafka.apache.org/documentation/Kafka documentation

https://drive.google.com/open?id=1s05zoAUC3kkW6ZDX_LGjMRptySCToZ_a

https://gist.github.com/fagossa/ff43fb522369efb2c88a82c8c72dec80

https://www.datadoghq.com/blog/collecting-kafka-performance-metrics/

https://www.datadoghq.com/blog/monitor-kafka-with-datadog/

Kafka concepts overview

part 1

part 2

part 3

https://www.cloudkarafka.com/blog/2016-11-30-part1-kafka-for-beginners
-what-is-apache-kafka.html

part1-kafka-for-beginners-what-is-apache-kafka
Kafka overview 1 pager

https://www.cs.rutgers.edu/~pxk/417/notes/kafka.html

kafka-course.rutgers-Kafka.pdf

Kafka overview - Rutgers *


https://github.com/aidtechnology/lf-k8s-hlf-webinar

https://drive.google.com/open?id=17S6ONAr7n3FyIY7-dknBsIs2vKFrY3xr

Kafka on Kubernetes Tutorial
https://drive.google.com/open?id=1mOk7UJ_cF0EIXt2QWVeWCFJg7bIm8Nc1A Nodejs client app using Kafka overview
https://drive.google.com/open?id=1gwyX26VkGlI1wOiU2bgLk_ZaJIQNJ6aqebook - Kafa Streams in Action
https://www.confluent.io/online-talks/Kafka talks online
https://drive.google.com/open?id=1mYlwU0z8hirNQrlPJYtWFqaUh9P6xnhyKafka event streams with MongoDB connector
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+ProposalsKafka Improvement Proposals
https://cwiki.apache.org/confluence/display/KAFKA/KIP-500%3A+Replace+
ZooKeeper+with+a+Self-Managed+Metadata+Quorum
KIP-500 RFC - replace Zookeeper for Kafka MDM

https://drive.google.com/open?id=10T8h05mecdU12FTmSflww4HfZNKghx1_

kafka-guide-2019-confluent-kafka-definitive-guide-complete.pdf

Kafka Guide - 2019 - Confluent

https://assets.confluent.io/m/7a91acf41502a75e/original/20180328-EB-Confluent_Designing_Event_Driven_Systems.pdf?_ga=2.165530684.2462
0135.1589381838-1712595248.1587214799

kafka-ebook-20180328-EB-Confluent_Designing_Event_Driven_Systems.pdf

Kafka - Design Event Driven Systems ebook
https://www.confluent.io/resources/kafka-summit-2020/Kafka 2020 Summit with presentations **

https://kafka-tutorials.confluent.io/?_ga=2.255305614.740418466.1611961981-2041899468.1610139243

Kafka 101 Tutorial - Event Streaming start ***  


https://www.confluent.io/resources/kafka-summit-2020/apache-kafka-and-ksqldb-in-action-lets-build-a-streaming-data-pipeline/

Kafka and KSQL Tutorial - create a data pipeline ***  


https://talks.rmoff.net/JuUJ8l#sSlsXRYApache Kafka and ksqlDB in Action : Let’s Build a Streaming Data Pipeline
https://talks.rmoff.net/yE9NeVApache Kafka - From Zero to Hero with Kafka Connect
Widget Connector
urlhttps://www.youtube.com/watch?v=Z8_O0wEIafw

Apache Kafka and KSQL in Action : Let’s Build a Streaming Data Pipeline! by Robin Moffatt



https://banzaicloud.com/blog/supertubes-focal/
Using Supertubes, Kafka and tools to automate POD recoveries

Apache Kafka Tutorial without Zookeeper url 

Apache Kafka Tutorial without Zookeeper-2024.pdf. link

Apache Kafka Tutorial without Zookeeper-2024.pdf. file

Apache Kafka Tutorial without Zookeeper-2024.pdf ** 


Compare to other open-source distributed file management systems

https://blockonomi.com/interplanetary-file-system/

ipfs-blockonomi.com-What is IPFS Interplanetary File System Complete Beginners Guide.pdf

IPFS tutorial

UDT 

...

kafka-microservices-integration-jhipster-oicd-2022-developer.okta.com-Communicate Between Microservices with Apache Kafka.pdf file

One of the traditional approaches for communicating between microservices is through their REST APIs. However, as your system evolves and the number of microservices grows, communication becomes more complex, and the architecture might start resembling our old friend the spaghetti anti-pattern, with services depending on each other or tightly coupled, slowing down development teams. This model can exhibit low latency but only works if services are made highly available.

To overcome this design disadvantage, new architectures aim to decouple senders from receivers, with asynchronous messaging. In a Kafka-centric architecture, low latency is preserved, with additional advantages like message balancing among available consumers and centralized management.

When dealing with a brownfield platform (legacy), a recommended way to decouple a monolith and ready it for a move to microservices is to implement asynchronous messaging.

In this tutorial you will learn how to:

  • Create a microservices architecture with JHipster
  • Enable Kafka integration for communicating microservices
  • Set up Okta as the authentication provider


Potential Value Opportunities

...