About Client

Our customer is a marketing measurement company that provides a single source of truth for media investment decisions. Central to this mission is the collection of raw data from multiple marketing data sources through various methods such as APIs, emails, FTP, and more. The Data Ingestion Framework (DIF) facilitates this process by extracting, transforming, and loading data into a data warehouse for comprehensive analytics.

Our Solution

• Data Ingestion – A data ingestion module is developed to fetch data from Satellite data feed. The data is stored as NetCDF and ESRI Shape files with segregation for date, region and products. Developed in Python as a daily cron job.
• ETL – An ETL pipeline is developed to read product files and transform it to create vector data – Shape files, GeoJSON layers and raster data – GeoTIFF layers.
• Visualization – A Powerful UI is developed, allowing users to manipulate, filter and sort the data for further analysis. MapBox GL JS is used to render geo-referenced images, contour lines and marker clusters.

Business Impact

• Revealing insights to optimize fishing operations – Near real-time data for fishing recommendations and ocean conditions helped the fishermen to locate the closest, most productive fishing grounds.
• Monitor changing conditions – Various oceanographic data values like temperature, plankton helped researchers with the understanding of climate changes as well as effects of chemical contamination and its impact on marine life.
• Feature based thin client deployment made it easy to reach a larger and wider customer base.