Download FENGYUN data in one script

Background

The download method of FENGYUN satellite is so inconvenient, especially for large datasets …

So, I decide to scrape the FTP links from the “Order” page and save them into one file.

Then, lftp could speed up the download speed a lot!

Requirements

Python installed with three packages: logging, getpass and selenium

Usage

Script and example: https://github.com/zxdawn/weather_data/tree/master/FY

  1. Order data on the FY website (all platforms) or using the FY Toolkit (Windows).

  2. Run the script from the terminal

    $ python fy.py
    

    Input the requested infos ….

  3. Check the bash script named download_fy.sh

    (You can change the name by savename in the fy,py script)

  4. Run the bash script

    $ chmod +x download_fy.sh
    $ ./download_fy.sh
    

    Example of the bash script:

    #!/bin/bash
    lftp -e "mget -c ftp://AO20200701000066936:Uo6O5__j@ftp.nsmc.org.cn/*" &
    lftp -e "mget -c ftp://AO20200701000065328:0lK_rxpW@ftp.nsmc.org.cn/AO202007010000653280001/*" &
    lftp -e "mget -c ftp://AO20200701000065328:0lK_rxpW@ftp.nsmc.org.cn/AO202007010000653280002/*" &
    lftp -e "mget -c ftp://AO20200701000065328:0lK_rxpW@ftp.nsmc.org.cn/AO202007010000653280003/*" &
    

Version control

VersionActionTime
1.0Init2020-07-03

Say something

Thank you

Your comment has been submitted and will be published once it has been approved.

OOPS!

Your comment has not been submitted. Please go back and try again. Thank You!

If this error persists, please open an issue by clicking here.