COMPONENT DEVELOPMENT FOR THE DATA LAKE

One of our most recent collaborations was the participation in a project for a large financial institution, with the aim of developing a component that would validate the content of the tables and boards of its Data Lake. This would allow obtaining statistical values ​​and KPIs contained in the lake, as well as making historical comparisons on the evolution of these and the generation of alerts in the event that these exceed the values ​​defined by certain configurable thresholds. On the other hand, it allows to extract a representative data set of those KPIs that do not comply with the requirements.

The component is capable of performing generic validations through statistical and comparative calculations with historical values ​​obtained in previous executions. It also performs specific validations that check if the business logic is met.