Streamlining Data Processing Using Apache Airflow, MongoDB, Spark SQL, and Google Cloud Composer


✨2026 Research Updates✨

The research has been published as a peer-reviewed conference paper:

B. Srinivas, E. Bardak, I. Avila, J. Brungard, Y. Cao, and M. B. Chaudhari, “Streamlining Social Music Analytics with Distributed Data Processing: Apache Airflow, MongoDB, and Spark SQL,” in 2025 International Conference on Computing, Intelligence, and Application (CIACON), Durgapur, India, 2025, pp. 1–6. doi: 10.1109/CIACON65473.2025.11189649 .

Dashboard implementation with MongoDB Charts