FUSEX:
- (Jan) invited AFS phaseout coordinators (~50 people) to test /eos/scratch
- B.Jones / CONDOR - tried "git clone https://github.com/torvalds/linux.git" (6m objects), got spurious errors: "fatal: Out of memory, calloc failed" (GIT-internal?), "fatal: Could not get current working directory: No such file or directory"
(comment Andreas: I can checkout the kernel source. It is close to 16Gb. I can also checkout a given branch afterwards (with latest patch
in a finite time. To use effectively GIT one needs an optimization for
a file recreate sequence and one should pin the object files in the local cache.)
(Georgios)
- Now have a non-virtualized SSD for PPS, thanks to Luca & Massimo for the quick response.
- Latest EOS commits use new-layout for metadata by default - this will reduce by a factor the number of random IO operations when listing directories.
- New instances use the new layout exclusively, by default.
- Old instances will create new files and directories with the new layout, but can fallback to the old one for reads. Live migration is thus possible (which is what we're doing on PPS), run "eos-ns-convert-to-locality-hashes" tool to do the conversion, if you have instances you care about.
- I'll take care of the PPS migration, please don't run the tool there
- Starting from commit 9339be0ca30a093b8a467eeaf4fbe194d47aaeca
- have added docs (step-by-step) on how to backup a running QuarkDB
(Massimo)
- Restarted working on PPS
- Cycle of files (non-empty) creation and checking (counting files, dirs and checksumming). This is to re-test general behaviour due to the new disk layout
- It looks sluggish (but Georgios is trying to push deletions and changing the disk layout)
- Later this week: check the max #clients using multiple mounts per batch