COMPONENT DEVELOPMENT FOR THE DATA LAKE
One of our most recent collaborations was the participation in a project for a large financial institution, with the aim of developing a component that would validate the content of the tables and boards of its Data Lake. This would allow obtaining statistical values and KPIs contained in the lake, as well as making historical comparisons on the evolution of these and the generation of alerts in the event that these exceed the values defined by certain configurable thresholds. On the other hand, it allows to extract a representative data set of those KPIs that do not comply with the requirements.
The component is capable of performing generic validations through statistical and comparative calculations with historical values obtained in previous executions. It also performs specific validations that check if the business logic is met.