Rev No. |
Date
|
Author
|
Message
|
57 |
2017-12-05 |
jive_cc |
HV: * AriM sais that on Debian 9.2 ("Stretch") readdir_r(3)
is deprecated -> warning -> error -> no compile
Rewritten to use readdir(3).
* found issue with merging multithread search results:
duplicate/failing inserts were not caught by
std::copy(this_thread_results.begin(), this_thread_results.end(),
insert_iterator(totals))
Rewritten to manual for(...) loop copying like an
animal. But at least we can check each duplicate insert
|
56 |
2017-05-09 |
jive_cc |
HV: * Ah. Same copy-paste error into "releaseData(...)". Sheesh.
|
55 |
2017-05-09 |
jive_cc |
HV: * Wow. I copied code into "initiateRead(...)" which references a
variable that is not even there in that context. So obviously,
this code was never really compiled, I guess ... Woopsie!
|
54 |
2017-03-20 |
jive_cc |
HV: * Just realized that munmap() also takes a size parameter which may have
to be adjusted based on the alignment of the mapped region
|
53 |
2017-03-19 |
jive_cc |
HV: - AlexanderN and ChristianP report the new version (with access-pattern awareness) fails
miserable on Mk6 - no data can be read /at all/.
Investiation reveals ::mmap(2) failing with EINVAL. Out of the four possible causes for
EINVAL 'offset must be a multiple of the system pagesize as returned by getpagesize(2)'
is the most likely. Indeed, reworking to ::mmap() with an offset which is a multiple
of the system pagesize now works. Thus also the mapped size need to be adjusted and
when munmap(2) is called the original, page-aligned, pointer needs to be reconstructed.
|
52 |
2017-03-01 |
jive_cc |
HV: * A patch to do access-pattern based mmap() or malloc()+read() for
getting a chunk's data. Random access now does not suffer from
having to read through the whole file.
|
51 |
2017-02-28 |
jive_cc |
HV: * By popular demand: support filtering on the command line - vbs_fs may
be passed pattern(s) ("-I ..") to index only recordings matching those
pattern(s). Thanks to Jun Yang for originally suggesting this.
|
50 |
2017-02-28 |
jive_cc |
HV: * Removed dos ^M characters (*shivers*)
|
49 |
2017-02-09 |
jive_cc |
HV: * Onsala users complain: vbs_{ls,rm,fs} do not treat recordings with "+"
and "." in their names as equals (don't show up at all). Now they do.
|
48 |
2017-02-03 |
jive_cc |
HV/BE: * BE reports tsunami having probs with reading from vbs_fs. vbs_fs
did not handle reading past end-of-file and then seeking back to
beginning correctly. Now it does
|
47 |
2016-11-03 |
jive_cc |
HV: * fixed small things reported by pylint. Skipped variable naming and white spacing complaints.
|
46 |
2016-10-09 |
jive_cc |
HV: * If no patterns given with "-T" sum by experiment, based on scan name
formatted like <experiment>_<station>_<scan>
* Changed to documentation to reflect transparent Mark6/FlexBuff support
|
45 |
2016-07-27 |
jive_cc |
HV: * JonQ (who else ...) found an issue: if a directory didn't have
permission then scanning for vbs recordings would throw an exception
|
44 |
2016-07-14 |
jive_cc |
HV: * Woops - did edit config a little too much, to the point of removing
the only useful bit :D
|
43 |
2016-07-14 |
jive_cc |
HV: * remove references to obsolete ROOTDIRS variable
(a future version may re-acquire them, though)
* changed text to reflect that it will build/install
three utilities: vbs_ls, vbs_rm and vbs_fs
|
42 |
2016-07-14 |
jive_cc |
HV: * Forgot to remove a few commented-out unused lines of code
|
41 |
2016-07-14 |
jive_cc |
HV: * rewrite of vbs_fs.cc:
- more efficient; less memory
- supports arbitrary mount point patterns ("-R ..." option);
"-6" and "-v" (default, FlexBuff mountpoints) are just shorthands
for adding predefined patterns to the path list
- supports MIT Haystack dplane v.2 format / EVN FlexBuff
transparently - all recognized recordings are presented
as single files
- retains uid, gid and permissions of individual recordings
- support 'quick' startup - only catalog recording names.
Recording is fully indexed when opened for the first time.
Note: application must open recording twice/use e.g. touch(1)
to trigger indexing the recording of interest.
[The touch(1) will yield an error but it will trigger
indexing fair enough]
|
40 |
2016-07-14 |
jive_cc |
HV: * remove references to unused libvbs.*
|
39 |
2016-06-23 |
jive_cc |
HV: * Changed Makefile.in to not create vbs_common file anymore;
vbs_ls and vbs_rm have been changed to the effect that that
isn't used anymore
|
38 |
2016-06-22 |
jive_cc |
HV: * output beautified in case of OSError caught
|
37 |
2016-06-22 |
jive_cc |
HV: * fixed referral to non-existant variable name
|
36 |
2016-06-22 |
jive_cc |
HV: * Some more simplifications and condensations
|
35 |
2016-06-22 |
jive_cc |
HV: * set keyword expansion correctly on vbs_rm
|
34 |
2016-06-21 |
jive_cc |
HV: * vbs_rm is now operational so using it can hurt ...
|
33 |
2016-06-21 |
jive_cc |
HV: * printing of help simplified
|
32 |
2016-06-21 |
jive_cc |
HV: * rewrite of vbs_rm to be actually a useful tool
|
31 |
2016-06-20 |
jive_cc |
HV: * Oops: "Variable used before assignment". D'oh!
|
30 |
2016-06-19 |
jive_cc |
HV: * added support for indexing Mark6 recordings
* added '-F' flag [cf. man ls(1)]
* output of missing chunks updated a bit
* honour order of 'sort by time' and 'sort by size' on cmdline
|
29 |
2016-06-16 |
jive_cc |
HV: * There was code that stil used the (deleted) userinput.by_time/by_size fields
|
28 |
2016-06-16 |
jive_cc |
HV: * '-v' now means "append flexbuff search paths"
|
27 |
2016-06-16 |
jive_cc |
HV: * honour order of time, size sorting keys if they are present
|
26 |
2016-06-15 |
jive_cc |
HV: * RTFM: '-v' and '--version' can be handled by argparse
|
25 |
2016-06-15 |
jive_cc |
HV: * print number of chunks found/expected too in case they're not equal
* human readable size print algorithm simplified
* if listing recording names only, do not analyze all chunks
|
24 |
2016-06-15 |
jive_cc |
HV: * rewrite of vbs_ls to be useful like ls(1) |
23 |
2016-06-15 |
jive_cc |
HV: * prevent duplitcate entries in mpmonitormap |
22 |
2016-06-15 |
jive_cc |
HV: * Mark6 s/w expects data at /mnt/disks/[0123]/[0-7]/data |
21 |
2016-06-15 |
jive_cc |
HV: * add uninstall target |
20 |
2016-06-15 |
jive_cc |
HV: * RomanF: 'read ahead' = 0 (==compiled-in default) results in error
about invalid value for read ahead. Woopsie |
19 |
2016-06-15 |
jive_cc |
HV: * Fix minor condition; should be <=0 rather than <0 |
18 |
2016-06-15 |
jive_cc |
HV: fix stupid errors in (file)pointer manipulation and
reading across block boundary |
17 |
2016-06-15 |
jive_cc |
HV: * prepped libvbs implementation for real use |
16 |
2016-06-15 |
jive_cc |
HV: * exception processing saner: less duplicated code |
15 |
2016-06-15 |
jive_cc |
HV: * vbs_init hung if an error occurred scanning a mountpoint |
14 |
2016-06-15 |
jive_cc |
HV: fix instabilities in vbs_fs and hugely increase performance |
13 |
2016-06-15 |
jive_cc |
HV: * corrected message when default root dir used |
12 |
2016-06-15 |
jive_cc |
HV: * Add Mark6 support, use -6 command line arg |
11 |
2016-06-15 |
jive_cc |
HV: * fix reported mem-leak by correct MT handling |
10 |
2016-06-15 |
jive_cc |
HV: * hopefully fix data race |
9 |
2016-06-15 |
jive_cc |
HV: - Made it configurable; sets up the Makefile as well as vbs_ls and vbs_rm
utilities |
8 |
2016-06-15 |
jive_cc |
HV: * directory_helper_templates.h needs
pathconf(3) symbolic constants
* filechunk_type::initiateRead() needed to cast away constness
if 'this' for it to pass the pointer to ::pthread_create(3) |
7 |
2016-06-15 |
jive_cc |
HV: * catch exceptions thrown from directory_helper_templates i.s.o.
crashing |
6 |
2016-06-15 |
jive_cc |
HV: * changed caching to be sped up significantly [I hope]
should now even be able to read from >1 thread
simultaneously from the same file. |
5 |
2016-06-15 |
jive_cc |
HV: * drag in some more jive5ab code [because it's soooooo good :-)]
* added libvbs.{h,cc} - a small library to open/read VBS recordings
as a simple file |
4 |
2016-06-15 |
jive_cc |
HV: * Added regular expressions from jive5ab (from pcint originally) |
3 |
2016-06-15 |
jive_cc |
HV: * Got rid of '-h' and '-f' FUSE options; the VBS_FS
doesn't have to parse them |
2 |
2016-06-15 |
jive_cc |
HV: * enabled keyword expansion on files
|
1 |
2014-07-01 |
jive_cc |
HV: * Initial vbs_fs rewrite (now with correct author creds)
|