Project aimed at transformation of reports from Oracle to modern Big Data stack for international insurance company

The speaker will tell how he and his team made the Proof of Concept of a streaming ELT pipeline for a large international insurance company. The following main components were used.

• Oracle server
• Debezium connector
• Kafka
• Spark Structural Streaming
• Delta Lake
• AWS S3 - for cloud storage