data-engineering-pipeline repositories
Trending repositories tagged data-engineering-pipeline, ranked by trending score. Updated daily.
-
1
edrewitz/WxData
A Python package & CLI tool that assists users create automated ETL pipelines for various types of real-time and archived weather data & supports GRIB2 -> NETCDF. WxData can access 20+ Weather Models, Observations (METAR & RAWS), Radar Data, Observed Soundings, Fuels Data and interfaces for Open-Meteo and AirNow APIs.
GitHub · Python · 29 stars · 2 forks · +2 stars in 24 hours · Trending score 0.81
-
2
Mahyar-AlamBeigi/divar-auto-data
A Python-based data engineering pipeline for collecting, storing, standardizing, and analyzing vehicle listings from Divar.
GitHub · Jupyter Notebook · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.01