From 107d716cf801f52a35302acf802af27ed837e598 Mon Sep 17 00:00:00 2001 From: you-n-g Date: Fri, 15 Jul 2022 14:19:02 +0800 Subject: [PATCH] Update Data Updating Docs (#1203) * Update README.md * Update README.md * Update README.md --- README.md | 2 ++ scripts/data_collector/yahoo/README.md | 3 +++ 2 files changed, 5 insertions(+) diff --git a/README.md b/README.md index 0f4d2f14c..09c64988a 100644 --- a/README.md +++ b/README.md @@ -197,6 +197,8 @@ We recommend users to prepare their own data if they have a high-quality dataset > > It is recommended that users update the data manually once (--trading_date 2021-05-25) and then set it to update automatically. > + > **NOTE**: Users can't incrementally update data based on the offline data provided by Qlib(some fields are removed to reduce the data size). Users should use [yahoo collector](https://github.com/microsoft/qlib/tree/main/scripts/data_collector/yahoo#automatic-update-of-daily-frequency-datafrom-yahoo-finance) to download Yahoo data from scratch and then incrementally update it. + > > For more information, please refer to: [yahoo collector](https://github.com/microsoft/qlib/tree/main/scripts/data_collector/yahoo#automatic-update-of-daily-frequency-datafrom-yahoo-finance) * Automatic update of data to the "qlib" directory each trading day(Linux) diff --git a/scripts/data_collector/yahoo/README.md b/scripts/data_collector/yahoo/README.md index d84e4d8d8..dddfb70ea 100644 --- a/scripts/data_collector/yahoo/README.md +++ b/scripts/data_collector/yahoo/README.md @@ -157,6 +157,9 @@ pip install -r requirements.txt ### Automatic update of daily frequency data(from yahoo finance) > It is recommended that users update the data manually once (--trading_date 2021-05-25) and then set it to update automatically. + > + > **NOTE**: Users can't incrementally update data based on the offline data provided by Qlib(some fields are removed to reduce the data size). Users should use [yahoo collector](https://github.com/microsoft/qlib/tree/main/scripts/data_collector/yahoo#automatic-update-of-daily-frequency-datafrom-yahoo-finance) to download Yahoo data from scratch and then incrementally update it. + > * Automatic update of data to the "qlib" directory each trading day(Linux) * use *crontab*: `crontab -e`