Versioning Log

Rev No. Date Author Message
57
2017-12-05
jive_cc
HV: * AriM sais that on Debian 9.2 ("Stretch") readdir_r(3)
      is deprecated -> warning -> error -> no compile
      Rewritten to use readdir(3).
    * found issue with merging multithread search results:
      duplicate/failing inserts were not caught by 
      std::copy(this_thread_results.begin(), this_thread_results.end(),
                insert_iterator(totals))
      Rewritten to manual for(...) loop copying like an
      animal. But at least we can check each duplicate insert

56
2017-05-09
jive_cc
HV: * Ah. Same copy-paste error into "releaseData(...)". Sheesh.

55
2017-05-09
jive_cc
HV: * Wow. I copied code into "initiateRead(...)" which references a
      variable that is not even there in that context. So obviously,
      this code was never really compiled, I guess ... Woopsie!

54
2017-03-20
jive_cc
HV: * Just realized that munmap() also takes a size parameter which may have
      to be adjusted based on the alignment of the mapped region

53
2017-03-19
jive_cc
HV: - AlexanderN and ChristianP report the new version (with access-pattern awareness) fails
      miserable on Mk6 - no data can be read /at all/.
      Investiation reveals ::mmap(2) failing with EINVAL. Out of the four possible causes for
      EINVAL 'offset must be a multiple of the system pagesize as returned by getpagesize(2)'
      is the most likely. Indeed, reworking to ::mmap() with an offset which is a multiple
      of the system pagesize now works. Thus also the mapped size need to be adjusted and
      when munmap(2) is called the original, page-aligned, pointer needs to be reconstructed.
52
2017-03-01
jive_cc
HV: * A patch to do access-pattern based mmap() or malloc()+read() for 
      getting a chunk's data. Random access now does not suffer from
      having to read through the whole file. 

51
2017-02-28
jive_cc
HV: * By popular demand: support filtering on the command line - vbs_fs may
      be passed pattern(s) ("-I ..") to index only recordings matching those 
      pattern(s). Thanks to Jun Yang for originally suggesting this.

50
2017-02-28
jive_cc
HV: * Removed dos ^M characters (*shivers*)

49
2017-02-09
jive_cc
HV: * Onsala users complain: vbs_{ls,rm,fs} do not treat recordings with "+"
      and "." in their names as equals (don't show up at all). Now they do.

48
2017-02-03
jive_cc
HV/BE: * BE reports tsunami having probs with reading from vbs_fs. vbs_fs
         did not handle reading past end-of-file and then seeking back to
         beginning correctly. Now it does

47
2016-11-03
jive_cc
HV: * fixed small things reported by pylint. Skipped variable naming and white spacing complaints.
46
2016-10-09
jive_cc
HV: * If no patterns given with "-T" sum by experiment, based on scan name
      formatted like <experiment>_<station>_<scan>
    * Changed to documentation to reflect transparent Mark6/FlexBuff support

45
2016-07-27
jive_cc
HV: * JonQ (who else ...) found an issue: if a directory didn't have
      permission then scanning for vbs recordings would throw an exception

44
2016-07-14
jive_cc
HV: * Woops - did edit config a little too much, to the point of removing
      the only useful bit :D

43
2016-07-14
jive_cc
HV: * remove references to obsolete ROOTDIRS variable
      (a future version may re-acquire them, though)
    * changed text to reflect that it will build/install
      three utilities: vbs_ls, vbs_rm and vbs_fs

42
2016-07-14
jive_cc
HV: * Forgot to remove a few commented-out unused lines of code

41
2016-07-14
jive_cc
HV: * rewrite of vbs_fs.cc:
        - more efficient; less memory
        - supports arbitrary mount point patterns ("-R ..." option);
          "-6" and "-v" (default, FlexBuff mountpoints) are just shorthands 
          for adding predefined patterns to the path list
        - supports MIT Haystack dplane v.2 format / EVN FlexBuff
          transparently - all recognized recordings are presented
          as single files
        - retains uid, gid and permissions of individual recordings
        - support 'quick' startup - only catalog recording names.
          Recording is fully indexed when opened for the first time.
          Note: application must open recording twice/use e.g. touch(1)
                to trigger indexing the recording of interest.
                [The touch(1) will yield an error but it will trigger
                 indexing fair enough]
    

40
2016-07-14
jive_cc
HV: * remove references to unused libvbs.*

39
2016-06-23
jive_cc
HV: * Changed Makefile.in to not create vbs_common file anymore;
      vbs_ls and vbs_rm have been changed to the effect that that
      isn't used anymore

38
2016-06-22
jive_cc
HV: * output beautified in case of OSError caught

37
2016-06-22
jive_cc
HV: * fixed referral to non-existant variable name

36
2016-06-22
jive_cc
HV: * Some more simplifications and condensations

35
2016-06-22
jive_cc
HV: * set keyword expansion correctly on vbs_rm
34
2016-06-21
jive_cc
HV: * vbs_rm is now operational so using it can hurt ...

33
2016-06-21
jive_cc
HV: * printing of help simplified

32
2016-06-21
jive_cc
HV: * rewrite of vbs_rm to be actually a useful tool

31
2016-06-20
jive_cc
HV: * Oops: "Variable used before assignment". D'oh!

30
2016-06-19
jive_cc
HV: * added support for indexing Mark6 recordings
    * added '-F' flag [cf. man ls(1)]
    * output of missing chunks updated a bit
    * honour order of 'sort by time' and 'sort by size' on cmdline

29
2016-06-16
jive_cc
HV: * There was code that stil used the (deleted) userinput.by_time/by_size fields

28
2016-06-16
jive_cc
HV: * '-v' now means "append flexbuff search paths"

27
2016-06-16
jive_cc
HV: * honour order of time, size sorting keys if they are present

26
2016-06-15
jive_cc
HV: * RTFM: '-v' and '--version' can be handled by argparse

25
2016-06-15
jive_cc
HV: * print number of chunks found/expected too in case they're not equal
    * human readable size print algorithm simplified
    * if listing recording names only, do not analyze all chunks

24
2016-06-15
jive_cc
HV: * rewrite of vbs_ls to be useful like ls(1)
23
2016-06-15
jive_cc
HV: * prevent duplitcate entries in mpmonitormap
22
2016-06-15
jive_cc
HV: * Mark6 s/w expects data at /mnt/disks/[0123]/[0-7]/data
21
2016-06-15
jive_cc
HV: * add uninstall target
20
2016-06-15
jive_cc
HV: * RomanF: 'read ahead' = 0 (==compiled-in default) results in error
      about invalid value for read ahead. Woopsie
19
2016-06-15
jive_cc
HV: * Fix minor condition; should be <=0 rather than <0
18
2016-06-15
jive_cc
HV: fix stupid errors in (file)pointer manipulation and
    reading across block boundary
17
2016-06-15
jive_cc
HV: * prepped libvbs implementation for real use
16
2016-06-15
jive_cc
HV: * exception processing saner: less duplicated code
15
2016-06-15
jive_cc
HV: * vbs_init hung if an error occurred scanning a mountpoint
14
2016-06-15
jive_cc
HV: fix instabilities in vbs_fs and hugely increase performance
13
2016-06-15
jive_cc
HV: * corrected message when default root dir used
12
2016-06-15
jive_cc
HV: * Add Mark6 support, use -6 command line arg
11
2016-06-15
jive_cc
HV: * fix reported mem-leak by correct MT handling
10
2016-06-15
jive_cc
HV: * hopefully fix data race
9
2016-06-15
jive_cc
HV: - Made it configurable; sets up the Makefile as well as vbs_ls and vbs_rm
      utilities
8
2016-06-15
jive_cc
HV: * directory_helper_templates.h needs
      pathconf(3) symbolic constants
    * filechunk_type::initiateRead() needed to cast away constness
      if 'this' for it to pass the pointer to ::pthread_create(3)
7
2016-06-15
jive_cc
HV: * catch exceptions thrown from directory_helper_templates i.s.o.
      crashing
6
2016-06-15
jive_cc
HV: * changed caching to be sped up significantly [I hope]
      should now even be able to read from >1 thread
      simultaneously from the same file.
5
2016-06-15
jive_cc
HV: * drag in some more jive5ab code [because it's soooooo good :-)]
    * added libvbs.{h,cc} - a small library to open/read VBS recordings
      as a simple file
4
2016-06-15
jive_cc
HV: * Added regular expressions from jive5ab (from pcint originally)
3
2016-06-15
jive_cc
HV: * Got rid of '-h' and '-f' FUSE options; the VBS_FS
      doesn't have to parse them
2
2016-06-15
jive_cc
HV: * enabled keyword expansion on files
1
2014-07-01
jive_cc
HV: * Initial vbs_fs rewrite (now with correct author creds)