From e72a0f28d015d95beb96e5b06e6993a267a5b22f Mon Sep 17 00:00:00 2001 From: Marius Ciepluch <11855163+norandom@users.noreply.github.com> Date: Sun, 12 May 2024 10:44:57 +0200 Subject: [PATCH] Updated Lab notes (markdown) --- Lab-notes.md | 16 +++++++++++++--- 1 file changed, 13 insertions(+), 3 deletions(-) diff --git a/Lab-notes.md b/Lab-notes.md index c5fc1aa..60a2b75 100644 --- a/Lab-notes.md +++ b/Lab-notes.md @@ -44,9 +44,13 @@ route 192.168.20.106 255.255.255.255 ## GitHub file site limit +* 100 MB for repository files +* 2000 MB for release files -Data cannot get pushed directly into the repo. -The release function is used instead. +Files can be compressed and split, with the command line utilities. + +Due to these limitations, the data cannot get pushed directly into the repo. +The release function is used instead. When necessary, files gets split. ``` remote: error: File data/lab_logs_normal_activity_may_6_2024.json is 1811.83 MB; this exceeds GitHub's file size limit of 100.00 MB @@ -54,4 +58,10 @@ remote: error: GH001: Large files detected. You may want to try Git Large File S To https://github.com/norandom/log2ml.git ! [remote rejected] main -> main (pre-receive hook declined) error: failed to push some refs to 'https://github.com/norandom/log2ml.git -``` \ No newline at end of file +``` + + +### Download of release data with Python + +Downloads of release assets are difficult because GitHub requires authenticated links (API), and has multiple redirects. +The download functions for released data have been implemented in a separate library, which handles such tasks. \ No newline at end of file