IDBx Data Engine

Inter-American Development Bank

IDBx Data Engine is a tool that extracts, analyzes and consolidates data from IDB online courses, improving decision making and educational management with clear visualizations and continuous monitoring. Developed by the IDB's INDES, this system responds to the need to effectively analyze online education in Latin America, using data to adjust and improve MOOC programs in the region.

IDBx Data Engine allows the centralization and simplification of the analysis of large volumes of educational data, ensuring more effective management and the adaptation of educational content to the real needs of students in the Latin American context.

Data Integration: IDBx Data Engine supports data integration from various sources, consolidating diverse datasets. Analysis and Visualization: Users can perform data analysis and create interactive visualizations to extract insights. Data Quality Assurance: The engine offers data quality checks and validation to ensure data accuracy.

Utilizes open standards such as AWS S3 for information storage, ensuring interoperability. Employs MongoDB as a NoSQL database for efficient data management and storage. Implements an ETL process to extract, decrypt, and transform data from AWS S3 to MongoDB. Generates CSV format reports using Python processes, optimizing data export. Deploys and executes processes in Docker containers, ensuring a controlled and reproducible environment. Incorporates scripts for system administration.