From 6d6c586dc209dcfa0ca188992829e79a2b1f16f8 Mon Sep 17 00:00:00 2001 From: you-n-g Date: Sun, 28 Nov 2021 13:44:49 +0800 Subject: [PATCH] Update data crawler --- scripts/data_collector/yahoo/README.md | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/scripts/data_collector/yahoo/README.md b/scripts/data_collector/yahoo/README.md index 0deef9c95..aa358e719 100644 --- a/scripts/data_collector/yahoo/README.md +++ b/scripts/data_collector/yahoo/README.md @@ -27,7 +27,8 @@ pip install -r requirements.txt ## Collector Data ### Get Qlib data(`bin file`) - > `qlib-data` from *YahooFinance*, is the data that has been dumped and can be used directly in `qlib` + > `qlib-data` from *YahooFinance*, is the data that has been dumped and can be used directly in `qlib`. + > This ready-made qlib-data is not updated regularly. If users want the latest data, please follow [these steps](#collector-yahoofinance-data-to-qlib) download the latest data. - get data: `python scripts/get_data.py qlib_data` - parameters: @@ -57,7 +58,8 @@ pip install -r requirements.txt ``` ### Collector *YahooFinance* data to qlib -> collector *YahooFinance* data and *dump* into `qlib` format +> collector *YahooFinance* data and *dump* into `qlib` format. +> If the above ready-made data can't meet users' requirements, users can follow this section to crawl the latest data and convert it to qlib-data. 1. download data to csv: `python scripts/data_collector/yahoo/collector.py download_data` - parameters: