Building a data analytics platform in an event-driven world
ClearBank largely follows a microservices-based approach where we rely on the transfer of data between various domains using events in an “Event-Carried State Transfer” model. Using these ‘events’ to build our data analytics platform was a good starting point and enabled us to quickly start ingesting data into our platform.
However, using events directly introduces some challenges related to re-processability and data accuracy that needed to be addressed. In this article, we discuss these challenges and how to overcome them.