BitMagic C++ Library: APIs
Aug, 2018 (updated for BitMagic v.3.13.0)
BitMagic C++ is a header only library
Header  Description  Link(s) 

bm.h  Root of BitMagic APIs, implements bm::bvector<> .
Iterators, methods and functions implementing container and main set algebraic operations.
Very often, this is just enough to start working with bit sets. Main building block for
inverted indexes, matrices of relationships, bloom filters, high dimentional
binary classifications.

bm.h 
bmserial.h  Classes and methods to transform bvector<> into a compact BLOB, ready for disk I/O, network transfer or database storage. Utilities to restore/deserialize bitvector. Methods to perform logical operations between bitvector and its compact, serialized BLOB.  bmserial.h 
bmalgo.h bmalgo_impl.h  Algorithms with bit vectors to compute similarity/distance metrics and components of complex metrics efficiently, without producing intermediate temporary bit vectors. Logical operations to efficiently combine bit vectors and C arrays (or STL iterators). Template algorithms to visit bvector<> set elements.  bmalgo.h bmalgo_impl.h 
bmaggregator.h  Fast logical operations on groups of bitvectors. OR and AND aggregators.  bmaggregator.h 
bmrandom.h 
bm::random_subset<>  template utility to do random sampling of bitvectors.

bmrandom.h 
bmsparsevec.h 
bm::sparse_vector<>  container for bittransposed (integer) arrays.
Each bit plain represented as compressed bitvector, implements a form of inmemory
compression for scalar integer types. Sparse vector supports NULL (unassigned) values
semantics. Can be used for memory efficient time series vectors, events, histograms,
precalculated relationship operations, elements of matrix storage, graph connect lists,
bloom filters, bbit indexing.

bmsparsevec.h 
bmsparsevec_compr.h 
bm::rsc_sparse_vector<>  rankselect compacted container for
bittransposed (integer) arrays.
Just like bm::sparse_vector<>  each bit plain represented as compressed bitvector, implements a form of inmemory
compression for scalar integer types. Sparse vector supports NULL (unassigned) values
semantics. Ranlselect succinct vector use this (not) NULL vector to drop missing values
(bit columns in bittransposed format) to improve memory efficiency.

bmsparsevec_compr.h 
bmsparsevec_algo.h  Algorithms based on bittransposed sparse vector properties. Dynamic range clipping, setalgebra on plains, efficient searches in unsorted vectors.  bmsparsevec.h 
bmsparsevec_serial.h  Serialization and deserialization of sparse vector into compact and portable BLOB.  bmsparsevec_serial.h 
API examples and technical notes
Bitvector
Bitvector container, iterators, serialization and algorithms.
bm::bvector<>
Name  Description  Links  Examples 

bm::bvector<> container  Main container for inverted lists representation. Depending on settings it can store lists of integers or bitvectors.  More  sample1.cpp sample2.cpp sample3.cpp 
bm::bvector<>::reference  Accessor to use regular C++/STL operator conventions to assign container content  More  sample1.cpp sample9.cpp 
bm::combine_*() operations  Set Alebra algorithms for interoprability between arrays and bit vectors  More  sample7.cpp 
bm::bvector<>::enumerator  Constant iterator to traverse inverted list without explicit conversion into unpacked list of integers  More  sample5.cpp sample8.cpp 
bm::bvector<>::counted_enumerator  Constant iterator to traverse inverted list without explicit conversion into unpacked list of integers. It offers extra functinality of keeping a running sum of all ON bits it traversed from position 0 to current.  More  sample11.cpp 
bm::bvector<>::insert_iterator  insert iterator to feed inverted list into bitvector  More  sample8.cpp 
Serialization  Utilities and algorithms to compress and serialize bitvector for database storage or network transfer  More  sample4.cpp 
Allocator  API to redefine standard bvector<> alocator type to create special pool allocation strategy, thread local mamory pools, collect bitvector related memory activity statistics, etc.  More  sample6.cpp 
Bit counting  Various methods and techniques to do bit counting for the whole bitvector, ranges, via accelerated structures or iterations. Performance benchmarking for different methods.  Details  sample11.cpp 
Setting bits  Various methods and techniques to set bits in bitvectors, ranges of bits, bits flipping/swapping, load bits from a set of ints, extraction of bits. Performance benchmarking for different methods.  sample12.cpp  
Logical operations on serialized bitvectors  Example on how to perform logical operations on bitvecor BLOBs without necessarily materializing them into a randomaccess bitvector.  sample14.cpp  
Finding first and last elements of bitvectors  Example on how to determine bitvector start and end bits (dynamic range).  sample15.cpp  
bm::aggregator<>  algorithms for fast AND, OR aggregation of groups of vectors.  Example on how to initialize, setup and use bm::aggregator<>  Tech.notes  sample16.cpp 
bm::bvector<>  methods for rank and select  Example on how to build and use rankselect index  Tech.notes  sample17.cpp 
Algorithms for bm::bvector<>
Name  Description  Links  Examples 

Distances  Algorithms optimized for computing binary distances for clusterization of multidimentional binary spaces.  More  sample9.cpp 
Random subset  Algorithm binary subset randomization.  More  sample10.cpp 
Miscelleneous  Algorithms for combining(OR, XOR, SUB, AND) bvector<> with STLcompatible iterators. Count number of intervals in bitvector, etc.  More 
Bittransposed sparse vector bm::sparse_vector<>
Name  Description  Links  Examples 

bm::sparse_vector<> container  Store array of integers using compact bittransposed implementation and the arsenal of compression methods provided by bm::bvector<>  More  svsample01.cpp svsample02.cpp svsample03.cpp 
Serialization  Algorithms to compress and serialize bm::sparse_vector<> for storage or network transfer  More  svsample02.cpp 
Algorithms. Dynamic range clipping.  Algorithms on bittransposed sparse vector. Dynamic range clipping.  More  
sparse vector with NULL support  How to configure and use sparse vector with unassigned (NULL) elements  svsample04.cpp  
Algorithms. Set to set image function.  Theory of groups image function using sparse vector as an association container defining settoset translation.  Tech.notes  svsample05.cpp 
Algorithms. Search in unordered set.  Search in sparse vector, using scanner class. How to bm::sparse_vector<> iterators. Benchmarks.  Tech.notes  svsample06.cpp 
RankSelect Compacted bittransposed sparse vector. bm::rsc_sparse_vector<>
Name  Description  Links  Examples 

bm::rsc_sparse_vector<> container 
Introduction to rsc_sparse_vector<> .
Example shows how to load data, serialize and deserialize it.

rscsample01.cpp 
Advanced Examples (mixed techniques)
Name  Description  Links  Examples 

Memory consumption / sparse sets  Comparison of different methods of handling of sparse sets. Memory and performance benchmarks. Described techniques can be used for inmemory acceleration of ER JOIN operations.  Tech.notes  xsample01.cpp 
Counting Sort, construction of histograms  Example, shows a how to make fast and memory efficient integer counting sort / histogram construction using BitMagic sparse_vector<>. Speed benchmark of various techniques based on QuickSort, RB tree (stl::map<>), parallel version of counting sort.  Tech.notes  xsample02.cpp 
SNP search with succinct sparse vector  Example, shows a how to build and search memory compact vector of mutations (SNPs), using real data from NCBI. Memory and performance benchmark comparisons.  Tech.notes  xsample03.cpp 
Substring search with fingerprints and SHIFTAND  Example, shows a how to build DNA fingerprints and use different algorithms to search for a kmer subsequence. Benchmarking comparisons with more straightforward approaches.  Tech.notes  xsample04.cpp 