All issues are fixed and pertained to the latest changes.#64
All issues are fixed and pertained to the latest changes.#64soumyadipkarforma wants to merge 7 commits intoisro:masterfrom
Conversation
- Converted 'isro_scrape/scraping.ipynb' to a robust Python script 'isro_scrape/scrape.py'. - Implemented data deduplication and key normalization. - Added a GitHub Actions workflow '.github/workflows/daily_scrape.yml' for daily midnight UTC updates. - Enhanced the scraper to clean mission names and technical details. - Updated 'api/spacecraft_missions.js' with improved comments and naming. - Added a direct link to spacecraft missions on 'index.html'. - Cleaned up redundant API endpoint files.
…r-and-automation Feature/modernize scraper and automation
|
Hey @soumyadipkarforma — the GitHub Actions workflows here look great, especially the daily scrape automation. This maps directly to a gap in the repo's data pipeline. Worth flagging: my PR #65 also touches The daily scrape automation in particular would pair well with the normalization pipeline I added in #65 ( |
2 participants
No description provided.